00010000:00010000:0.0:1746065193.909477:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1475dc9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065193.909492:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065193.909494:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065193.909496:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1475dc9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065193.909500:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1475dc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065193.911607:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1475dd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065193.911617:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1475dd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065193.911622:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1475dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065193.911626:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065193.911629:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1475dd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065193.911635:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1475dd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065193.911644:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b7e52700) 00010000:00010000:0.0:1746065193.911647:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065193.911649:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1475dd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065193.911653:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1475dd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065193.911700:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b200/0xad6b7ddc1475dc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93735c expref: 36 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.911718:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc1475dd7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93735c expref: 35 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065193.911724:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065193.911725:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065193.911727:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ac00, rc 0) 00000100:00100000:0.0:1746065193.911792:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+35:1667:x1830881264772992:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2584us (4216us total) trans 8589936692 rc 0/0 00000100:00100000:0.0:1746065193.911799:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14269 00000100:00100000:0.0:1746065193.911846:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263750144:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065193.911860:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065193.913682:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881264772608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 12176us (16003us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065193.913691:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7315 00000100:00100000:0.0:1746065193.924088:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065193.924123:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065193.926260:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b6800/0xad6b7ddc1475da6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937340 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065193.926273:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263750400:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065193.926308:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065193.932182:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065193.936861:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065193.936916:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065193.957886:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065193.957935:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065193.957965:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264774528 00000100:00100000:0.0:1746065193.957972:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264774528 00002000:00100000:0.0:1746065193.958011:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (3477504->4194303) req@ffff880099cf1180 x1830881264774528/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:109/0 lens 488/0 e 0 to 0 dl 1746065204 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065193.958020:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1180 with x1830881264774528 ext(3477504->4194303) 00002000:00010000:0.0:1746065193.958025:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf1180 00000100:00100000:0.0:1746065193.958037:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5510 00000100:00100000:0.0:1746065193.958042:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881264774528:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065193.966691:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.005728:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.011532:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.017715:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.017818:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.017852:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264775680 00000100:00100000:0.0:1746065194.017859:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264775680 00002000:00100000:0.0:1746065194.017897:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4673535) req@ffff880136a78e00 x1830881264775680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.017905:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78e00 with x1830881264775680 ext(4194304->4673535) 00002000:00010000:0.0:1746065194.017909:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a78e00 00000100:00100000:0.0:1746065194.017936:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5512 00000100:00100000:0.0:1746065194.017944:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881264775680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065194.029212:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.093471:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.129912:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.135282:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.142973:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.157122:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.166765:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.166841:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.197045:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.197087:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.197125:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.207966:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.238079:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.238130:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.240263:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.240362:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264778752 00000100:00100000:0.0:1746065194.240367:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264778752 00002000:00100000:0.0:1746065194.240398:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2367488->4194303) req@ffff88013615f480 x1830881264778752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.240406:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615f480 with x1830881264778752 ext(2367488->4194303) 00002000:00010000:0.0:1746065194.240410:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013615f480 00000100:00100000:0.0:1746065194.240428:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5517 00000100:00100000:0.0:1746065194.240433:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881264778752:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065194.249523:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.264397:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264779392 00000100:00100000:0.0:1746065194.264403:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264779392 00010000:00010000:0.0:1746065194.264476:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc1475b53 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371bf expref: 30 pid: 11461 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746065194.264509:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7323 00000100:00100000:0.0:1746065194.264524:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881264779392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.264535:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.264560:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc1475b53 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371bf expref: 30 pid: 11461 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746065194.264570:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc1475b53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371bf expref: 30 pid: 11461 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746065194.264589:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.264603:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881264779392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.264607:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7323 00010000:00010000:0.0:1746065194.264639:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc1475b53 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371bf expref: 29 pid: 11461 timeout: 890 lvb_type: 1 00000100:00100000:0.0:1746065194.264657:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263752320:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065194.265136:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263752448:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065194.265145:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7ff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263752576:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065194.265167:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475e47 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1396736->2097151] (req 1396736->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373a9 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.265178:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdae00, rc 0) 00000100:00100000:0.0:1746065194.265209:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:1672:x1830881264779264:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7584us (7790us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.265216:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16067 00000100:00100000:0.0:1746065194.267084:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.271310:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.271338:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.271366:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.278878:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.282399:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.282458:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.283097:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.288444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.292110:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.297621:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.305358:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.305404:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.307956:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.312718:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.315460:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.323527:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.327530:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.327608:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.334148:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.337054:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.359659:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.366802:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.369948:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.369980:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.371748:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.381375:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.383925:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.394219:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264784640 00000100:00100000:0.0:1746065194.394227:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264784640 00010000:00010000:0.0:1746065194.394252:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475e47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1396736->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373a9 expref: 28 pid: 12258 timeout: 890 lvb_type: 0 00000100:00100000:0.0:1746065194.394284:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7334 00000100:00100000:0.0:1746065194.394290:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881264784640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.394301:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.394316:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475e47 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373a9 expref: 28 pid: 12258 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065194.394327:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475e47 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373a9 expref: 28 pid: 12258 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065194.394344:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475e47 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1396736->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373a9 expref: 28 pid: 12258 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065194.394366:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.394368:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065194.394374:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc1475ea2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->1957887) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373f6 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.394381:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc1475ea2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->1957887) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373f6 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.394405:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc1475ea2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->1957887) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373f6 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.394428:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263755008:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065194.394494:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.396891:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.401280:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.433179:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.436053:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.437653:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.440605:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065194.441387:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc1475ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441394:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc1475ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746065194.441431:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00000004:00200000:0.0:1746065194.441434:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065194.441448:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc1475ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441456:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc1475ee1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441464:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1475ed3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441469:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1475ed3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441473:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1475ed3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441488:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1475ed3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441493:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065194.441495:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1475ed3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441500:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1475ed3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441508:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065194.441510:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065194.441513:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1475ed3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441517:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1475ed3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441529:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475eda lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441534:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475eda lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441537:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475eda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441541:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065194.441543:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475eda lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441558:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475eda lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441572:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5d800) 00010000:00010000:0.0:1746065194.441574:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065194.441576:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475eda lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441579:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdae00/0xad6b7ddc1475eda lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065194.441607:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1475ecc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937404 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.441617:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc1475ee1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937404 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065194.441623:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065194.441625:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065194.441627:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda400, rc 0) 00000100:00100000:0.0:1746065194.444044:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:1688:x1830881264785536:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 7565us (7630us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.444053:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14273 00000100:00100000:0.0:1746065194.445611:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.446590:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.446748:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.449327:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264786176 00000100:00100000:0.0:1746065194.449331:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264786176 00000100:00100000:0.0:1746065194.449353:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264786432 00000100:00100000:0.0:1746065194.449354:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264786432 00000100:00100000:0.0:1746065194.449365:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16081 00000100:00100000:0.0:1746065194.449370:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881264786176:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065194.449389:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065194.449397:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc1475efd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937412 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065194.449428:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263755392:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065194.449889:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065194.460649:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.460729:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.464696:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.467353:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.468002:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.470692:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264787840 00000100:00100000:0.0:1746065194.470699:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264787840 00000100:00100000:0.0:1746065194.498349:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.502008:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.506003:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2005:x1830881264788608:12345-192.168.202.27@tcp:4:cat.0 Request processed in 3711us (3985us total) trans 21474841479 rc 0/0 00000100:00100000:0.0:1746065194.506014:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1834 00002000:00100000:0.0:1746065194.506025:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1159167) req@ffff880134b00e00 x1830881264788608/t21474841479(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:110/0 lens 488/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.506032:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00e00 with x1830881264788608 ext(1048576->1159167) 00010000:00010000:0.0:1746065194.506041:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc1475e5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373be expref: 29 pid: 9549 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065194.506053:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc1475e5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1159167) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373be expref: 29 pid: 9549 timeout: 890 lvb_type: 0 00002000:00010000:0.0:1746065194.506074:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b00e00 00000100:00100000:0.0:1746065194.526677:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.535586:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.535627:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.537001:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.559030:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.562941:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.568317:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.574446:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.580369:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.580417:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.589811:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.593614:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.593681:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.596442:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.596474:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.596504:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.604979:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.605059:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.614369:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.627320:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881264792448:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7228us (12064us total) trans 21474841480 rc 0/0 00000100:00100000:0.0:1746065194.627334:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1838 00002000:00100000:0.0:1746065194.627346:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x94:0x0] (1708032->1957887) req@ffff88009aceea00 x1830881264792448/t21474841480(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:110/0 lens 488/448 e 0 to 0 dl 1746065205 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.627370:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceea00 with x1830881264792448 ext(1708032->1957887) 00010000:00010000:0.0:1746065194.627380:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc1475ea2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373f6 expref: 31 pid: 12258 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065194.627394:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc1475ea2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1708032->1957887) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373f6 expref: 31 pid: 12258 timeout: 890 lvb_type: 0 00002000:00010000:0.0:1746065194.627401:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aceea00 00000100:00100000:0.0:1746065194.641260:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.641314:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.663648:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.675982:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.676026:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.691448:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.708929:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.716057:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.719524:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.719576:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.722835:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.727321:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.727365:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.731220:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.735492:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.781621:0:8144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263758080 00000100:00100000:0.0:1746065194.781628:0:8144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263758080 00000100:00100000:0.0:1746065194.781687:0:8144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1746065194.781694:0:8144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f1e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3761:x1830881263758080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065194.782033:0:8144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f1e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3761:x1830881263758080:12345-0@lo:400:kworker.0 Request processed in 339us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.782039:0:8144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00080000:0.0:1746065194.782063:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746065194.782066:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065194.782073:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263758208 00000100:00100000:0.0:1746065194.782075:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263758208 00000100:00100000:0.0:1746065194.782091:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1746065194.782096:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881263758208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065194.782120:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881263758208:12345-0@lo:400:kworker.0 Request processed in 24us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.782134:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1746065194.782151:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263758464 00000100:00100000:0.0:1746065194.782154:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263758464 00000100:00080000:0.0:1746065194.782165:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065194.782185:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263759360 00000100:00100000:0.0:1746065194.782187:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263759360 00000100:00100000:0.0:1746065194.782201:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:0.0:1746065194.782204:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263758464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065194.782226:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263758464:12345-0@lo:400:kworker.0 Request processed in 22us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.782231:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00080000:0.0:1746065194.782752:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1746065194.782754:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746065194.782755:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065194.812416:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.815932:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.815962:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.843357:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.849093:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.854701:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.858711:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.861347:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263760384 00000100:00100000:0.0:1746065194.861352:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263760384 00000100:00100000:0.0:1746065194.861968:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:0.0:1746065194.861976:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+45:3762:x1830881263760384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746065194.861991:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1028412864 pending 5959680 free 3910598656 avail 3679076352 00000100:00100000:0.0:1746065194.862034:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+45:3762:x1830881263760384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 60us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.862039:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:0.0:1746065194.865905:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.876846:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.877558:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1746065194.877569:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263760768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065194.877597:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065194.879293:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.884045:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.890180:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.891149:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.930879:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.931594:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.946436:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.960767:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.964057:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.966265:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.968919:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.968953:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264799360 00000100:00100000:0.0:1746065194.968957:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264799360 00002000:00100000:0.0:1746065194.968984:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1458176->1814527) req@ffff880098dd8000 x1830881264799360/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:110/0 lens 488/0 e 0 to 0 dl 1746065205 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065194.968992:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8000 with x1830881264799360 ext(1458176->1814527) 00010000:00010000:0.0:1746065194.968998:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1476007 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374b3 expref: 14 pid: 9548 timeout: 890 lvb_type: 0 00010000:00010000:0.0:1746065194.969005:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc1476007 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1458176->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374b3 expref: 14 pid: 9548 timeout: 890 lvb_type: 0 00002000:00010000:0.0:1746065194.969010:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098dd8000 00000100:00100000:0.0:1746065194.969021:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1840 00000100:00100000:0.0:1746065194.969027:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881264799360:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065194.978785:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.979096:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.979499:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7351 00000100:00100000:0.0:1746065194.979506:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881264799488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065194.979513:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065194.979520:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1475ef6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937427 expref: 13 pid: 12260 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746065194.979527:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1475ef6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937427 expref: 13 pid: 12260 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746065194.979538:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1475ef6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937427 expref: 13 pid: 12260 timeout: 890 lvb_type: 1 00010000:00010000:0.0:1746065194.979566:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065194.980167:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881264799488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 660us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065194.980172:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7351 00000100:00100000:0.0:1746065194.980482:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.983832:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.985409:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.990880:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065194.991296:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.000624:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881264800384:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9015us (9742us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065195.000635:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5545 00002000:00100000:0.0:1746065195.000645:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880098dd9c00 x1830881264800384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:110/0 lens 488/440 e 0 to 0 dl 1746065205 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065195.000653:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9c00 with x1830881264800384 ext(1048576->2097151) 00002000:00010000:0.0:1746065195.000658:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9c00 00000100:00100000:0.0:1746065195.012113:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065195.013516:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065195.138899:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065195.140020:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065195.140097:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065195.140972:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065195.161364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.179608:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.187993:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.188715:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.188737:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264801792 00000100:00100000:0.0:1746065195.188740:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264801792 00000100:00100000:0.0:1746065195.188797:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14281 00000100:00100000:0.0:1746065195.188803:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+15:1722:x1830881264801792:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065195.188814:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065195.188826:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856000/0xad6b7ddc1476062 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937500 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.188865:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1476069 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065195.188875:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1476069 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065195.188884:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1476069 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065195.188894:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856600/0xad6b7ddc1476070 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065195.188899:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856600/0xad6b7ddc1476070 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065195.188904:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856600/0xad6b7ddc1476070 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065195.188958:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc1476077 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065195.188967:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc1475ff9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374ac expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.188982:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc1476031 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374d6 expref: 43 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.188987:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc1476077 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065195.189011:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc1476031 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374d6 expref: 43 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.189019:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc1476031 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374d6 expref: 43 pid: 9571 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746065195.189028:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263762176:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065195.189069:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc1475ff9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374ac expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.189076:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718600/0xad6b7ddc1475ff9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374ac expref: 25 pid: 9571 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746065195.189082:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263762304:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065195.189095:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee9c0 going to sleep for 11 seconds 00000100:00080000:0.0:1746065195.189108:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065195.193085:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263762176:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065195.193099:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263762304:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065195.193119:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc1476077 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:0.0:1746065195.195732:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.195743:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264802304 00000100:00100000:0.0:1746065195.195746:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264802304 00010000:00010000:0.0:1746065195.195758:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc1476031 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374d6 expref: 45 pid: 9571 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746065195.195793:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7355 00000100:00100000:0.0:1746065195.195798:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881264802304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065195.195803:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065195.195807:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc1476031 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374d6 expref: 45 pid: 9571 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065195.195813:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc1476031 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374d6 expref: 45 pid: 9571 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065195.195823:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb000/0xad6b7ddc1476031 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374d6 expref: 45 pid: 9571 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065195.195832:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065195.195835:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc1476077 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065195.195841:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc1476077 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065195.195846:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc1476077 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065195.195860:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065195.196564:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881264802304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 764us (831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065195.196570:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7355 00000100:00100000:0.0:1746065195.200182:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.200293:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.200713:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.205483:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.215267:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.230088:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065195.231908:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc14760a1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065195.231914:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc14760a1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065195.231931:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00010000:00010000:0.0:1746065195.232035:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147609a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937523 expref: 19 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.232050:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc14760a1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937523 expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.232055:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065195.232057:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065195.232059:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4a00, rc 0) 00000100:00100000:0.0:1746065195.232787:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+17:1722:x1830881264803456:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 6918us (7077us total) trans 8589936712 rc 0/0 00000100:00100000:0.0:1746065195.232794:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14282 00000100:00100000:0.0:1746065195.248459:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.253562:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.257137:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.261887:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264804736 00000100:00100000:0.0:1746065195.261893:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264804736 00000100:00100000:0.0:1746065195.261923:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16111 00000100:00100000:0.0:1746065195.261929:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881264804736:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065195.261941:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065195.261953:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d857400/0xad6b7ddc14760d9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93753f expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.261971:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065195.261978:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d857400/0xad6b7ddc14760d9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93753f expref: 25 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065195.261987:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d857400/0xad6b7ddc14760d9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93753f expref: 25 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065195.261997:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857400, rc 0) 00000100:00100000:0.0:1746065195.262028:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881264804736:12345-192.168.202.27@tcp:101:cat.0 Request processed in 98us (607us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065195.262032:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16111 00000100:00100000:0.0:1746065195.271309:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.273624:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.274220:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.278473:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.278815:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.284461:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.286410:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.288969:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.289016:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.290915:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065195.292239:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065195.296226:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.297284:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.306421:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.316646:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.316679:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.318481:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.329446:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.337725:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.339402:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264808448 00000100:00100000:0.0:1746065195.339408:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264808448 00002000:00100000:0.0:1746065195.339440:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2691071) req@ffff880099cf2a00 x1830881264808448/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:111/0 lens 488/0 e 0 to 0 dl 1746065206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065195.339448:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2a00 with x1830881264808448 ext(2097152->2691071) 00010000:00010000:0.0:1746065195.339455:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7000/0xad6b7ddc14760ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937554 expref: 16 pid: 9548 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065195.339468:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7000/0xad6b7ddc14760ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937554 expref: 16 pid: 9548 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746065195.339474:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cf2a00 00000100:00100000:0.0:1746065195.339496:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1845 00000100:00100000:0.0:1746065195.339502:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881264808448:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065195.350329:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881264808448:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 10816us (11092us total) trans 17179874055 rc 0/0 00000100:00100000:0.0:1746065195.350348:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1845 00002000:00100000:0.0:1746065195.350357:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2691071) req@ffff880099cf2a00 x1830881264808448/t17179874055(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:111/0 lens 488/448 e 0 to 0 dl 1746065206 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065195.350366:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2a00 with x1830881264808448 ext(2097152->2691071) 00010000:00010000:0.0:1746065195.350383:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7000/0xad6b7ddc14760ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937554 expref: 18 pid: 9548 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065195.350400:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f7000/0xad6b7ddc14760ee lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937554 expref: 18 pid: 9548 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746065195.350406:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cf2a00 00000100:00100000:0.0:1746065195.357587:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.363946:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.381971:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.388232:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.399277:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.410385:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.416760:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.416887:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263764992:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065195.416913:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc147610a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937570 expref: 45 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065195.416925:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc147610a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937570 expref: 45 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065195.416952:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda600, rc 0) 00000100:00100000:0.0:1746065195.416985:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+44:2006:x1830881264809472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5950us (6608us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065195.416992:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16118 00000100:00100000:0.0:1746065195.442596:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.449851:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.455316:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.465162:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.491443:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.496646:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.496690:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.518907:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.543929:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.544010:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.554174:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264811776 00000100:00100000:0.0:1746065195.554177:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264811776 00000100:00100000:0.0:1746065195.554200:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16124 00000100:00100000:0.0:1746065195.554207:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+45:1743:x1830881264811776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065195.554218:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065195.554230:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc147615e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9375a8 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.554251:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc14760e7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93754d expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.554258:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065195.554267:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065195.554271:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc147615e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375a8 expref: 46 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.554295:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc14760e7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93754d expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.554304:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc14760e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93754d expref: 17 pid: 9548 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746065195.554314:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263765760:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065195.560762:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065195.563585:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264811904 00000100:00100000:0.0:1746065195.563590:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264811904 00002000:00100000:0.0:1746065195.563617:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1728512->2097151) req@ffff880099cf1c00 x1830881264811904/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:111/0 lens 488/0 e 0 to 0 dl 1746065206 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065195.563626:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1c00 with x1830881264811904 ext(1728512->2097151) 00010000:00010000:0.0:1746065195.563632:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc14760e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93754d expref: 18 pid: 9548 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065195.563642:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc14760e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93754d expref: 18 pid: 9548 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746065195.563648:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cf1c00 00000100:00100000:0.0:1746065195.564315:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1847 00000100:00100000:0.0:1746065195.564321:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881264811904:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065195.565959:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881264811648:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 11375us (12349us total) trans 17179874056 rc 0/0 00000100:00100000:0.0:1746065195.565973:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1846 00002000:00100000:0.0:1746065195.565981:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2433024->2822143) req@ffff880099cf3100 x1830881264811648/t17179874056(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:111/0 lens 488/448 e 0 to 0 dl 1746065206 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065195.565988:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3100 with x1830881264811648 ext(2433024->2822143) 00010000:00010000:0.0:1746065195.565996:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1476126 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93757e expref: 47 pid: 9548 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065195.566004:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1476126 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2433024->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93757e expref: 47 pid: 9548 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746065195.566009:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cf3100 00000001:00080000:0.0:1746065195.567894:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874055 is committed 00000001:00080000:0.0:1746065195.567908:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874052 is committed 00000001:00080000:0.0:1746065195.567923:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874047 is committed 00000001:00080000:0.0:1746065195.567932:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874043 is committed 00000100:00100000:0.0:1746065195.571268:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881264811904:12345-192.168.202.27@tcp:4:cat.0 Request processed in 6936us (8471us total) trans 17179874057 rc 0/0 00000100:00100000:0.0:1746065195.571279:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1847 00002000:00100000:0.0:1746065195.571289:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1728512->2097151) req@ffff880099cf1c00 x1830881264811904/t17179874057(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:111/0 lens 488/448 e 0 to 0 dl 1746065206 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065195.571299:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1c00 with x1830881264811904 ext(1728512->2097151) 00010000:00010000:0.0:1746065195.571314:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc14760e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93754d expref: 10 pid: 9548 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065195.571325:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc14760e7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1728512->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93754d expref: 10 pid: 9548 timeout: 891 lvb_type: 0 00002000:00010000:0.0:1746065195.571434:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cf1c00 00000100:00100000:0.0:1746065195.572092:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.576980:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.586215:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.588361:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.595047:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.632609:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.633091:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.635895:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16127 00000100:00100000:0.0:1746065195.635904:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:1743:x1830881264813312:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065195.635912:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065195.635922:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1476173 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9375bd expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.635938:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065195.635943:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc1476165 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2531328->3112959] (req 2531328->3112959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375af expref: 9 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.635948:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065195.635952:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1476173 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375bd expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.635982:0:9549:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc1476165 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2531328->3112959] (req 2531328->3112959) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375af expref: 9 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.635993:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1476173 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375bd expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.636014:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61c00, rc 0) 00000100:00100000:0.0:1746065195.636052:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:1743:x1830881264813312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 149us (2960us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065195.636057:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16127 00000100:00100000:0.0:1746065195.639004:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.644720:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.644761:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264813568 00000100:00100000:0.0:1746065195.644768:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264813568 00000100:00100000:0.0:1746065195.644821:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16128 00000100:00100000:0.0:1746065195.644831:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:1740:x1830881264813568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065195.644847:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065195.644864:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61000/0xad6b7ddc147617a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9375c4 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.644887:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065195.644889:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065195.644894:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61000/0xad6b7ddc147617a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375c4 expref: 11 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.644904:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61000/0xad6b7ddc147617a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375c4 expref: 11 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.644913:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61000, rc 0) 00000100:00100000:0.0:1746065195.644947:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:1740:x1830881264813568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 116us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065195.644953:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16128 00000100:00100000:0.0:1746065195.646019:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.646046:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.646066:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.646090:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.646124:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264813824 00000100:00100000:0.0:1746065195.646129:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264813824 00010000:00010000:0.0:1746065195.646145:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1475f90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93746d expref: 8 pid: 9549 timeout: 891 lvb_type: 1 00000100:00100000:0.0:1746065195.646161:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264813696 00000100:00100000:0.0:1746065195.646162:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264813696 00010000:00010000:0.0:1746065195.646170:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147608c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93750e expref: 10 pid: 9549 timeout: 891 lvb_type: 1 00000100:00100000:0.0:1746065195.646180:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264813952 00000100:00100000:0.0:1746065195.646182:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264813952 00010000:00010000:0.0:1746065195.646189:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1475f58 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93744a expref: 26 pid: 11461 timeout: 891 lvb_type: 0 00000100:00100000:0.0:1746065195.646199:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7372 00000100:00100000:0.0:1746065195.646204:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2006:x1830881264813824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065195.646212:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065195.646227:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1475f90 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93746d expref: 8 pid: 9549 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746065195.646235:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1475f90 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93746d expref: 8 pid: 9549 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746065195.646263:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1475f90 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93746d expref: 8 pid: 9549 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746065195.646275:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065195.646295:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2006:x1830881264813824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 91us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065195.646300:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7372 00000100:00100000:0.0:1746065195.646311:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7373 00000100:00100000:0.0:1746065195.646315:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264813696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065195.646322:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065195.646328:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147608c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93750e expref: 10 pid: 9549 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746065195.646336:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147608c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93750e expref: 10 pid: 9549 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746065195.646345:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147608c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93750e expref: 10 pid: 9549 timeout: 891 lvb_type: 1 00010000:00010000:0.0:1746065195.646351:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065195.646362:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881264813696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065195.646367:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7373 00000100:00100000:0.0:1746065195.646400:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7374 00000100:00100000:0.0:1746065195.646405:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881264813952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065195.646416:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065195.646422:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1475f58 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93744a expref: 26 pid: 11461 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065195.646430:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1475f58 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93744a expref: 26 pid: 11461 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065195.646440:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1475f58 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93744a expref: 26 pid: 11461 timeout: 891 lvb_type: 0 00010000:00010000:0.0:1746065195.646447:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065195.646449:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065195.646454:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147616c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1650687) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375b6 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.646461:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147616c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1650687) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375b6 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.646482:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147616c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1400832->1650687) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375b6 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065195.646493:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d29180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263766912:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065195.646545:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065195.651209:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.656424:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.661931:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.678190:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.688672:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.688721:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.707611:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.707645:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.707897:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16129 00000100:00100000:0.0:1746065195.707904:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2005:x1830881264815744:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065195.707918:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065195.707929:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2e00/0xad6b7ddc1476181 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9375cb expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065195.707964:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263767296:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065195.708010:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065195.716828:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.716872:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.736892:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.743930:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.845053:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.872455:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.879624:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.894124:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.894636:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.897824:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.897865:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.912970:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.918644:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.930290:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.930332:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.936421:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.960973:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.971970:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264819072 00000100:00100000:0.0:1746065195.971978:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264819072 00000100:00100000:0.0:1746065195.972024:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264819200 00000100:00100000:0.0:1746065195.972027:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264819200 00000100:00100000:0.0:1746065195.972050:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16136 00000100:00100000:0.0:1746065195.972056:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881264819072:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065195.972073:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065195.972091:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc14761b2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9375fc expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065195.972133:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263768576:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065195.973236:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065195.973261:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16137 00000100:00100000:0.0:1746065195.973267:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881264819200:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065195.973276:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065195.973285:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc14761b9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937603 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065195.973299:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065195.973300:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065195.973307:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc14761b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937603 expref: 27 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065195.973320:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc14761b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937603 expref: 27 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065195.973338:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3600, rc 0) 00000100:00100000:0.0:1746065195.990582:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.996454:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065195.998892:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.017349:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.018275:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.087471:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.109071:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264820864 00000100:00100000:0.0:1746065196.109075:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264820864 00000100:00100000:0.0:1746065196.109108:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5281 00000100:00100000:0.0:1746065196.109115:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:30397:x1830881264820864:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065196.109308:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:30397:x1830881264820864:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 192us (2219us total) trans 8589936719 rc 0/0 00000100:00100000:0.0:1746065196.109314:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5281 00000100:00100000:0.0:1746065196.111079:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.120111:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264821376 00000100:00100000:0.0:1746065196.120119:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264821376 00000100:00100000:0.0:1746065196.120150:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264821504 00000100:00100000:0.0:1746065196.120152:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264821504 00000100:00100000:0.0:1746065196.120167:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264821632 00000100:00100000:0.0:1746065196.120169:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264821632 00000100:00100000:0.0:1746065196.120183:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16143 00000100:00100000:0.0:1746065196.120190:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881264821376:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065196.120205:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.120219:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14761ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937634 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.120252:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.120254:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.120261:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14761ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937634 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.120275:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14761ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937634 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.120285:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3a00, rc 0) 00000100:00100000:0.0:1746065196.120321:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881264821376:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 132us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.120327:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16143 00000100:00100000:0.0:1746065196.120342:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16144 00000100:00100000:0.0:1746065196.120346:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881264821504:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065196.120352:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.120359:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1476206 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93763b expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.120369:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.120376:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1476206 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93763b expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.120384:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1476206 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93763b expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.120395:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2c00, rc 0) 00000100:00100000:0.0:1746065196.122664:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264821504:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2307us (3057us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065196.122674:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16144 00000100:00100000:0.0:1746065196.122763:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.122849:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.122872:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264822016 00000100:00100000:0.0:1746065196.122878:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264822016 00010000:00010000:0.0:1746065196.122901:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc14761b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937603 expref: 28 pid: 1880 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065196.122918:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264822144 00000100:00100000:0.0:1746065196.122920:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264822144 00010000:00010000:0.0:1746065196.122929:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc14761ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375f5 expref: 8 pid: 1880 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065196.122941:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7383 00000100:00100000:0.0:1746065196.122947:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881264822016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.122958:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.122975:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc14761b9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937603 expref: 28 pid: 1880 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.122984:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc14761b9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937603 expref: 28 pid: 1880 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.123003:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3600/0xad6b7ddc14761b9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937603 expref: 28 pid: 1880 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.123018:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.123059:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881264822016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 112us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.123064:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7383 00000100:00100000:0.0:1746065196.123074:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7384 00000100:00100000:0.0:1746065196.123078:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881264822144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.123086:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.123092:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc14761ab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375f5 expref: 8 pid: 1880 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.123100:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc14761ab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375f5 expref: 8 pid: 1880 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.123112:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc14761ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375f5 expref: 8 pid: 1880 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.123119:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.123120:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.123126:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14761f8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93762d expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.123134:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14761f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93762d expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.123162:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14761f8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93762d expref: 26 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065196.123173:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263769856:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065196.123232:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.127018:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.134618:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.137036:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.137059:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264822912 00000100:00100000:0.0:1746065196.137063:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264822912 00000100:00100000:0.0:1746065196.137099:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16148 00000100:00100000:0.0:1746065196.137105:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:1756:x1830881264822912:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065196.137117:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.137131:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1476237 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93765e expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.137152:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc147615e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375a8 expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.137159:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147620d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937642 expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.137165:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1476188 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375d2 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.137170:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.137171:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.137173:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1476237 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->1474559] (req 1048576->1474559) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93765e expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.137193:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1476188 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375d2 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.137214:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1476188 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375d2 expref: 12 pid: 9548 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065196.137225:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263770112:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065196.137288:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147620d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937642 expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.137296:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147620d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937642 expref: 10 pid: 12260 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065196.137303:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263770240:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065196.137325:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc147615e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375a8 expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.137331:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc147615e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375a8 expref: 30 pid: 12260 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065196.137337:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263770368:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065196.137350:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.144390:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.146593:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264823424 00000100:00100000:0.0:1746065196.146596:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264823424 00010000:00010000:0.0:1746065196.146609:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc147615e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375a8 expref: 31 pid: 12260 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065196.146640:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7387 00000100:00100000:0.0:1746065196.146645:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881264823424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.146652:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.146665:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc147615e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375a8 expref: 31 pid: 12260 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.146673:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc147615e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375a8 expref: 31 pid: 12260 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.146689:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc147615e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375a8 expref: 31 pid: 12260 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.146701:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.146717:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881264823424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.146722:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7387 00000100:00100000:0.0:1746065196.149428:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.150547:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264823552 00000100:00100000:0.0:1746065196.150552:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264823552 00010000:00010000:0.0:1746065196.150566:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44400/0xad6b7ddc1476229 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937657 expref: 21 pid: 7204 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065196.150585:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7389 00000100:00100000:0.0:1746065196.150590:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+21:2006:x1830881264823552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.150598:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.150610:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44400/0xad6b7ddc1476229 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937657 expref: 21 pid: 7204 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.150618:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44400/0xad6b7ddc1476229 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937657 expref: 21 pid: 7204 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.150630:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44400/0xad6b7ddc1476229 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937657 expref: 21 pid: 7204 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.150640:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065196.150644:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1476245 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065196.150651:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1476245 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065196.150657:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1476245 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065196.150712:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.150745:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+20:2006:x1830881264823552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 153us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.150750:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7389 00000100:00100000:0.0:1746065196.154635:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.160980:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.161398:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.165157:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.176308:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.176375:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.179945:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.190178:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.192510:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.233990:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.234065:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.262124:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.267752:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.267818:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.268217:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264826368 00000100:00100000:0.0:1746065196.268220:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264826368 00010000:00010000:0.0:1746065196.268233:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61c00/0xad6b7ddc1476173 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9375bd expref: 29 pid: 9549 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065196.268248:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7393 00000100:00100000:0.0:1746065196.268253:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264826112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.268259:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.268266:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc147621b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937649 expref: 10 pid: 12258 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.268996:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc147621b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937649 expref: 10 pid: 12258 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.269018:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc147621b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937649 expref: 10 pid: 12258 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.269030:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.269046:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881264826112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 792us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.269051:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7393 00000100:00100000:0.0:1746065196.269153:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.269163:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264826880 00000100:00100000:0.0:1746065196.269165:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264826880 00000100:00100000:0.0:1746065196.269184:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16155 00000100:00100000:0.0:1746065196.269188:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2007:x1830881264826880:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065196.269194:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.269199:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0200/0xad6b7ddc1476299 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9376a4 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.269208:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.269212:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0200/0xad6b7ddc1476299 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9376a4 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.269219:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0200/0xad6b7ddc1476299 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9376a4 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.269226:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0200, rc 0) 00000100:00100000:0.0:1746065196.269243:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2007:x1830881264826880:12345-192.168.202.27@tcp:101:cat.0 Request processed in 54us (90us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065196.269247:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16155 00000100:00100000:0.0:1746065196.273015:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263771776:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065196.273032:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc1476292 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937696 expref: 8 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.273042:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131047400/0xad6b7ddc1476292 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937696 expref: 8 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.273063:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047400, rc 0) 00000100:00100000:0.0:1746065196.273084:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2007:x1830881264826624:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4084us (4896us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065196.273090:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16154 00000100:00100000:0.0:1746065196.278563:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.284469:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.299591:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.318696:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.318748:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.321071:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.321100:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264828288 00000100:00100000:0.0:1746065196.321104:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264828288 00002000:00100000:0.0:1746065196.321134:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1617920->2097151) req@ffff88012f3c1500 x1830881264828288/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.321142:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c1500 with x1830881264828288 ext(1617920->2097151) 00010000:00010000:0.0:1746065196.321147:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14761f8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93762d expref: 27 pid: 1880 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.321156:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc14761f8 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93762d expref: 27 pid: 1880 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746065196.321161:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3c1500 00000100:00100000:0.0:1746065196.321186:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1853 00000100:00100000:0.0:1746065196.321192:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881264828288:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065196.328251:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.328856:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.330322:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.334550:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.338333:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.344444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.345179:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.355330:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264829696 00000100:00100000:0.0:1746065196.355340:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264829696 00000100:00100000:0.0:1746065196.355385:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14294 00000100:00100000:0.0:1746065196.355392:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+21:1777:x1830881264829696:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065196.355410:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.355412:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065196.355434:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7800/0xad6b7ddc14762df lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9376ce expref: 21 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.356663:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065196.356669:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065196.356682:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14762ed lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9376d5 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.357034:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14762f4 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065196.357046:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14762f4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065196.357054:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14762f4 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065196.357064:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00010000:00010000:0.0:1746065196.357145:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14762ed lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9376d5 expref: 23 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.357157:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14762f4 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9376d5 expref: 22 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.357162:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065196.357165:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065196.357166:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44800, rc 0) 00000100:00100000:0.0:1746065196.357205:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+22:1777:x1830881264829696:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1813us (3361us total) trans 8589936726 rc 0/0 00000100:00100000:0.0:1746065196.357211:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14294 00000100:00100000:0.0:1746065196.368002:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264830080 00000100:00100000:0.0:1746065196.368006:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264830080 00000100:00100000:0.0:1746065196.368035:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16161 00000100:00100000:0.0:1746065196.368041:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881264829952:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065196.368065:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1476309 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.368076:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc1476015 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374c1 expref: 7 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.368082:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc147607e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937507 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.368089:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc147601c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374c8 expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.368107:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.368108:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.368110:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1476309 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.368126:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc147601c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374c8 expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.368134:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc147601c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374c8 expref: 27 pid: 9548 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065196.368142:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263773312:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065196.368394:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc147607e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937507 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.368403:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc147607e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937507 expref: 11 pid: 12260 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065196.368410:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263773568:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065196.368448:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc1476015 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374c1 expref: 7 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.368454:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc1476015 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374c1 expref: 7 pid: 9548 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065196.368469:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263773696:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065196.368486:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.369049:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264830208 00000100:00100000:0.0:1746065196.369052:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264830208 00000100:00100000:0.0:1746065196.369067:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264830464 00000100:00100000:0.0:1746065196.369069:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264830464 00000100:00100000:0.0:1746065196.369080:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16164 00000100:00100000:0.0:1746065196.369084:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881264830208:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065196.369099:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147631e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.369115:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1476237 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93765e expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.369120:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065196.369122:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065196.369123:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147631e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.369136:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1476237 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93765e expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.369143:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1476237 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1474559) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93765e expref: 27 pid: 9549 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065196.369151:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263773824:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065196.369176:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.385137:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.385292:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263773312:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065196.385317:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.385331:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.385344:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.385365:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264830720 00000100:00100000:0.0:1746065196.385371:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264830720 00010000:00010000:0.0:1746065196.385409:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14761ff lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937634 expref: 12 pid: 9549 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065196.385436:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264830976 00000100:00100000:0.0:1746065196.385438:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264830976 00010000:00010000:0.0:1746065196.385448:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc147601c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374c8 expref: 28 pid: 9548 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065196.385461:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264830848 00000100:00100000:0.0:1746065196.385463:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264830848 00010000:00010000:0.0:1746065196.385470:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc1476284 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93768f expref: 13 pid: 12260 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065196.385484:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7397 00000100:00100000:0.0:1746065196.385490:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881264830720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.385504:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.385523:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14761ff lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937634 expref: 12 pid: 9549 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.385563:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc14761ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937634 expref: 12 pid: 9549 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.385589:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.385625:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881264830720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 135us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.385631:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7397 00000100:00100000:0.0:1746065196.385647:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7398 00000100:00100000:0.0:1746065196.385652:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881264830976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.385661:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.385673:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc147601c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374c8 expref: 28 pid: 9548 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.385682:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc147601c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374c8 expref: 28 pid: 9548 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.385695:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc147601c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9374c8 expref: 28 pid: 9548 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.385709:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.385722:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881264830976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.385727:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7398 00000100:00100000:0.0:1746065196.385737:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7399 00000100:00100000:0.0:1746065196.385741:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881264830848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.385754:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.385761:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc1476284 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93768f expref: 13 pid: 12260 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.385769:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131046a00/0xad6b7ddc1476284 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93768f expref: 13 pid: 12260 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.385807:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.385820:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881264830848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.385825:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7399 00000100:00100000:0.0:1746065196.385854:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.385866:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264831104 00000100:00100000:0.0:1746065196.385869:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264831104 00010000:00010000:0.0:1746065196.385879:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc14761c0 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93760a expref: 28 pid: 1880 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065196.387623:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7402 00000100:00100000:0.0:1746065196.387630:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881264831104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.387638:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.387648:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc14761c0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93760a expref: 28 pid: 1880 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.387657:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc14761c0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93760a expref: 28 pid: 1880 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.387668:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131046200/0xad6b7ddc14761c0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93760a expref: 28 pid: 1880 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.387682:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.387684:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.387686:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1476302 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.387692:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1476302 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.387707:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.387727:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881264831104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (1872us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.387733:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7402 00000100:00100000:0.0:1746065196.395933:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7403 00000100:00100000:0.0:1746065196.395944:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881264831744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.395957:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.395980:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1476214 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937650 expref: 11 pid: 12258 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.396117:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1476214 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937650 expref: 11 pid: 12258 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.396140:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1476214 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937650 expref: 11 pid: 12258 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.396156:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.396201:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264831744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 259us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.396217:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7403 00000100:00100000:0.0:1746065196.403854:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.403897:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264832256 00000100:00100000:0.0:1746065196.403907:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264832256 00000100:00100000:0.0:1746065196.403947:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16167 00000100:00100000:0.0:1746065196.403954:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881264832256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065196.403974:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.403993:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1476333 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9376e3 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065196.404021:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d72c, atime: 0x6812d729, ctime: 0x6812d72c, blocks: 0x6d8 00010000:00010000:0.0:1746065196.404042:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.404045:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.404056:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1476333 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9376e3 expref: 30 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.404073:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc1476333 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9376e3 expref: 30 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.404085:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1a00, rc 0) 00000100:00100000:0.0:1746065196.404136:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881264832256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 182us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.404142:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16167 00000100:00100000:0.0:1746065196.411971:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881264831616:12345-192.168.202.27@tcp:4:cat.0 Request processed in 25534us (25618us total) trans 17179874060 rc 0/0 00000100:00100000:0.0:1746065196.411980:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1854 00002000:00100000:0.0:1746065196.411998:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2301952->2895871) req@ffff88008f7fc000 x1830881264831616/t17179874060(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:112/0 lens 488/448 e 0 to 0 dl 1746065207 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.412008:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fc000 with x1830881264831616 ext(2301952->2895871) 00010000:00010000:0.0:1746065196.412017:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131046e00/0xad6b7ddc147627d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2301952->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937688 expref: 15 pid: 12260 timeout: 892 lvb_type: 0 00010000:00010000:0.0:1746065196.412028:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131046e00/0xad6b7ddc147627d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2301952->2895871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937688 expref: 15 pid: 12260 timeout: 892 lvb_type: 0 00002000:00010000:0.0:1746065196.412034:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7fc000 00000100:00100000:0.0:1746065196.412084:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.412128:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.412174:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065196.412191:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746065196.412219:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065196.412239:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1099 00000100:00100000:0.0:1746065196.412494:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+294:2006:x1830881264833408:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065196.412650:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+294:2006:x1830881264833408:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 405us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.412657:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1099 00000100:00100000:0.0:1746065196.419739:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.420688:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.421161:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.430934:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5581 00000100:00100000:0.0:1746065196.430943:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881264834304:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065196.436979:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264835584 00000100:00100000:0.0:1746065196.436991:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264835584 00000100:00100000:0.0:1746065196.437290:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5285 00000100:00100000:0.0:1746065196.437297:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+20:1777:x1830881264835584:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:0.0:1746065196.437704:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+21:1777:x1830881264835584:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 407us (769us total) trans 8589936728 rc 0/0 00000100:00100000:0.0:1746065196.437710:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5285 00000100:00100000:0.0:1746065196.445965:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264835840 00000100:00100000:0.0:1746065196.445972:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264835840 00000100:00100000:0.0:1746065196.446020:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5286 00000100:00100000:0.0:1746065196.446026:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b40dc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+21:1777:x1830881264835840:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:0.0:1746065196.449644:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881264834560:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18457us (18928us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065196.449652:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5582 00002000:00100000:0.0:1746065196.449659:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880090dda680 x1830881264834560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.449667:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dda680 with x1830881264834560 ext(1048576->2097151) 00002000:00010000:0.0:1746065196.449673:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dda680 00000100:00100000:0.0:1746065196.470512:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.472128:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.478169:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.484687:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.495518:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.495563:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.495581:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264837248 00000100:00100000:0.0:1746065196.495588:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264837248 00002000:00100000:0.0:1746065196.495616:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009856dc00 x1830881264837248/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.495633:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856dc00 with x1830881264837248 ext(2097152->4194303) 00002000:00010000:0.0:1746065196.495638:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856dc00 00000100:00100000:0.0:1746065196.495650:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264837376 00000100:00100000:0.0:1746065196.495652:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264837376 00002000:00100000:0.0:1746065196.495663:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009856c000 x1830881264837376/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.495670:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c000 with x1830881264837376 ext(2097152->4194303) 00002000:00010000:0.0:1746065196.495672:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856c000 00000100:00100000:0.0:1746065196.495681:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5586 00000100:00100000:0.0:1746065196.495686:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881264837248:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065196.515323:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.530767:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.530847:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.534469:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.534489:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264838272 00000100:00100000:0.0:1746065196.534493:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264838272 00000100:00100000:0.0:1746065196.534541:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14297 00000100:00100000:0.0:1746065196.534547:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:1785:x1830881264838272:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065196.534565:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.534579:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ee00/0xad6b7ddc14763a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937745 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.534653:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc14763aa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065196.534664:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc14763aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065196.534672:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc14763aa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065196.534680:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00010000:00010000:0.0:1746065196.534747:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ee00/0xad6b7ddc14763a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937745 expref: 33 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.534764:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc14763aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937745 expref: 32 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.534824:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065196.534827:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065196.534830:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656ec00, rc 0) 00000100:00100000:0.0:1746065196.534866:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:1785:x1830881264838272:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 318us (401us total) trans 8589936730 rc 0/0 00000100:00100000:0.0:1746065196.534871:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14297 00000100:00100000:0.0:1746065196.535377:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.548173:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.556818:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.557610:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881264837760:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25573us (26848us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065196.557617:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5588 00002000:00100000:0.0:1746065196.557625:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009856e300 x1830881264837760/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.557633:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856e300 with x1830881264837760 ext(2097152->4194303) 00002000:00010000:0.0:1746065196.557637:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856e300 00000100:00100000:0.0:1746065196.568177:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.568274:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.573978:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.574052:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.581520:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.586267:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.591448:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.591900:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.591924:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.591937:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.592073:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.598287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.615809:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.623861:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.623900:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.626826:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.629407:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.634252:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.635326:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.641183:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.645681:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.646599:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2006:x1830881264842112:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 596us (922us total) trans 17179874062 rc 0/0 00000100:00100000:0.0:1746065196.646607:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5596 00002000:00100000:0.0:1746065196.646613:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3129344->3145727) req@ffff88008c52bb80 x1830881264842112/t17179874062(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:112/0 lens 16872/448 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.646621:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52bb80 with x1830881264842112 ext(3129344->3145727) 00002000:00010000:0.0:1746065196.646625:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c52bb80 00000100:00100000:0.0:1746065196.647815:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.656295:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881264842368:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 6432us (8471us total) trans 21474841486 rc 0/0 00000100:00100000:0.0:1746065196.656311:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5597 00002000:00100000:0.0:1746065196.656323:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2678783) req@ffff88008c52ad80 x1830881264842368/t21474841486(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:112/0 lens 488/448 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.656333:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52ad80 with x1830881264842368 ext(2097152->2678783) 00002000:00010000:0.0:1746065196.656339:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c52ad80 00000100:00100000:0.0:1746065196.715637:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.715688:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.726102:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.726151:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.743090:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.743135:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.748660:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.751129:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.757954:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.781048:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.784814:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.786020:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264844160 00000100:00100000:0.0:1746065196.786026:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264844160 00000100:00100000:0.0:1746065196.786444:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16195 00000100:00100000:0.0:1746065196.786451:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:1792:x1830881264844160:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065196.786463:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.786476:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f0bba00/0xad6b7ddc1476421 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9377b5 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.786497:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835ca00/0xad6b7ddc14763f0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2678783) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937784 expref: 10 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.786504:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065196.786505:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065196.786507:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f0bba00/0xad6b7ddc1476421 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9377b5 expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.786534:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835ca00/0xad6b7ddc14763f0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2678783) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937784 expref: 10 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.786543:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835ca00/0xad6b7ddc14763f0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2678783) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937784 expref: 10 pid: 12258 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065196.786551:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263777792:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065196.787443:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.788930:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.788985:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.793972:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.797651:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.808403:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264845312 00000100:00100000:0.0:1746065196.810104:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264845312 00002000:00100000:0.0:1746065196.810133:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009aba5500 x1830881264845312/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.810141:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba5500 with x1830881264845312 ext(3145728->4194303) 00002000:00010000:0.0:1746065196.810145:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aba5500 00000100:00100000:0.0:1746065196.810173:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5603 00000100:00100000:0.0:1746065196.810178:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881264845312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065196.823462:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.824131:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.824148:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.824169:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.824207:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264845440 00000100:00100000:0.0:1746065196.824213:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264845440 00000100:00100000:0.0:1746065196.824243:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264845696 00000100:00100000:0.0:1746065196.824244:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264845696 00000100:00100000:0.0:1746065196.824254:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264845568 00000100:00100000:0.0:1746065196.824256:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264845568 00000100:00100000:0.0:1746065196.824264:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264845824 00000100:00100000:0.0:1746065196.824266:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264845824 00000100:00100000:0.0:1746065196.824281:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16196 00000100:00100000:0.0:1746065196.824287:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881264845440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065196.824301:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.824317:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84ac00/0xad6b7ddc1476428 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9377bc expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065196.824361:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263778176:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065196.824427:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.824446:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16197 00000100:00100000:0.0:1746065196.824452:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881264845696:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065196.824459:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.824468:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc147642f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9377ca expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.824483:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.824485:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.824493:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc147642f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9377ca expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.824505:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84b600/0xad6b7ddc147642f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9377ca expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.824514:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b600, rc 0) 00000100:00100000:0.0:1746065196.824542:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881264845696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 90us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.824547:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16197 00000100:00100000:0.0:1746065196.824561:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16198 00000100:00100000:0.0:1746065196.824566:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881264845568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065196.824571:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.824576:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc1476436 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9377c3 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065196.824597:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263778304:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065196.824617:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.824677:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16199 00000100:00100000:0.0:1746065196.824683:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881264845824:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065196.824693:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.824699:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc147643d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9377d1 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.824712:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.824713:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.824718:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc147643d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9377d1 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.824727:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc147643d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9377d1 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065196.824733:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5ce600, rc 0) 00000100:00100000:0.0:1746065196.824751:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881264845824:12345-192.168.202.27@tcp:101:cat.0 Request processed in 69us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.824756:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16199 00000100:00100000:0.0:1746065196.842993:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.843039:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.848104:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.865927:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.870377:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264846976 00000100:00100000:0.0:1746065196.870385:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264846976 00000100:00100000:0.0:1746065196.870426:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16202 00000100:00100000:0.0:1746065196.870435:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:1799:x1830881264846976:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065196.870451:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065196.870467:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc1476452 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9377e6 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.870495:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc14763b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93774c expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.870508:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065196.870510:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065196.870513:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc1476452 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9377e6 expref: 10 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.870564:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc14763b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93774c expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.870578:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc14763b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1409024->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93774c expref: 29 pid: 9550 timeout: 892 lvb_type: 0 00000100:00100000:0.0:1746065196.870589:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263778688:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065196.870647:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.874807:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.879121:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.879448:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.894305:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.906032:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.929030:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.937417:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.937670:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.947370:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264848384 00000100:00100000:0.0:1746065196.947378:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264848384 00010000:00010000:0.0:1746065196.947408:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc1476372 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937714 expref: 18 pid: 12258 timeout: 892 lvb_type: 1 00000100:00100000:0.0:1746065196.947446:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7424 00000100:00100000:0.0:1746065196.947453:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881264848384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065196.947462:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065196.947477:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc1476372 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937714 expref: 18 pid: 12258 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.947487:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc1476372 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937714 expref: 18 pid: 12258 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.947505:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835d000/0xad6b7ddc1476372 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937714 expref: 18 pid: 12258 timeout: 892 lvb_type: 1 00010000:00010000:0.0:1746065196.948573:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.948576:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065196.948583:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc147646e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 692224->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937802 expref: 32 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.948591:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc147646e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 692224->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937802 expref: 32 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065196.948618:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc147646e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 692224->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937802 expref: 32 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065196.948628:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263779584:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065196.948690:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065196.954281:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263779584:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065196.954298:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065196.954333:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881264848384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6879us (7176us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065196.954341:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7424 00000100:00100000:0.0:1746065196.957920:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.958082:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.970231:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.975832:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.986587:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.986632:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065196.986654:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264849792 00000100:00100000:0.0:1746065196.986657:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264849792 00002000:00100000:0.0:1746065196.986674:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88008f3e4700 x1830881264849792/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:112/0 lens 488/0 e 0 to 0 dl 1746065207 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065196.986682:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4700 with x1830881264849792 ext(2097152->4194303) 00002000:00010000:0.0:1746065196.986685:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e4700 00000100:00100000:0.0:1746065196.986705:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5611 00000100:00100000:0.0:1746065196.986709:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881264849792:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065196.999146:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.007488:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.029587:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881264849792:12345-192.168.202.27@tcp:3:cat.0 Request processed in 42868us (42945us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065197.029597:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5611 00002000:00100000:0.0:1746065197.029607:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88008f3e4700 x1830881264849792/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:112/0 lens 488/440 e 0 to 0 dl 1746065207 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.029620:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4700 with x1830881264849792 ext(2097152->4194303) 00002000:00010000:0.0:1746065197.029624:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e4700 00000100:00100000:0.0:1746065197.046625:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.058307:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.058348:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.059732:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.066204:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.070673:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.075921:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.080143:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.081664:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.081683:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264851584 00000100:00100000:0.0:1746065197.081686:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264851584 00000100:00100000:0.0:1746065197.082866:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14298 00000100:00100000:0.0:1746065197.082874:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+22:1805:x1830881264851584:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065197.082889:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.082902:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926c00/0xad6b7ddc1476498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93782c expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.082942:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926200/0xad6b7ddc147649f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.082952:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926200/0xad6b7ddc147649f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.082961:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926200/0xad6b7ddc147649f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.082974:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc14764a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.082984:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc14764a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.082989:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc14764a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.083038:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927400/0xad6b7ddc14764ad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.083047:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f7400/0xad6b7ddc1476364 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9376ea expref: 49 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.083054:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc14763aa lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937745 expref: 31 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.083060:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927400/0xad6b7ddc14764ad lrc: 5/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.083082:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc14763aa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937745 expref: 31 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.083091:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc14763aa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937745 expref: 31 pid: 13395 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065197.083100:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263780736:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065197.083680:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f7400/0xad6b7ddc1476364 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9376ea expref: 49 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.083693:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f7400/0xad6b7ddc1476364 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9376ea expref: 49 pid: 9571 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065197.083701:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac64000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263780864:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065197.084292:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.089007:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.089036:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.089060:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.089116:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac64000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263780864:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065197.089158:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263780736:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065197.089179:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927400/0xad6b7ddc14764ad lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 14 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065197.091665:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264852352 00000100:00100000:0.0:1746065197.091669:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264852352 00000100:00100000:0.0:1746065197.091692:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5287 00000100:00100000:0.0:1746065197.091697:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+50:8521:x1830881264852352:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065197.091876:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+51:8521:x1830881264852352:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 178us (795us total) trans 8589936731 rc 0/0 00000100:00100000:0.0:1746065197.091881:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5287 00000100:00100000:0.0:1746065197.096448:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263780992:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065197.096476:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc14764b4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937833 expref: 19 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.096495:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856400/0xad6b7ddc14764b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937833 expref: 19 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.096505:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856400, rc 0) 00010000:00010000:0.0:1746065197.097143:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927400/0xad6b7ddc14764ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097149:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927400/0xad6b7ddc14764ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065197.097185:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00000004:00200000:0.0:1746065197.097189:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065197.097200:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927400/0xad6b7ddc14764ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097208:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927400/0xad6b7ddc14764ad lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097216:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926200/0xad6b7ddc147649f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097221:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926200/0xad6b7ddc147649f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097226:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926200/0xad6b7ddc147649f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097231:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d926200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065197.097234:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926200/0xad6b7ddc147649f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097239:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926200/0xad6b7ddc147649f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097247:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065197.097249:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065197.097252:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926200/0xad6b7ddc147649f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097256:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926200/0xad6b7ddc147649f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097265:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc14764a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097269:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc14764a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097273:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc14764a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097277:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d926e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065197.097279:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc14764a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097284:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc14764a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097289:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f854600) 00010000:00010000:0.0:1746065197.097291:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065197.097293:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc14764a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097297:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926e00/0xad6b7ddc14764a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065197.097322:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926c00/0xad6b7ddc1476498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93782c expref: 24 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.097331:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d927400/0xad6b7ddc14764ad lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93782c expref: 23 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.097336:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065197.097338:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065197.097339:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927400, rc 0) 00000100:00100000:0.0:1746065197.097374:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+23:1805:x1830881264851584:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 14502us (15710us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.097379:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14298 00000100:00100000:0.0:1746065197.103138:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.103173:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.103904:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.105173:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.105187:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.105201:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.105214:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.106654:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.106669:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.106683:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.123230:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.128711:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.145474:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.148817:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264855168 00000100:00100000:0.0:1746065197.148830:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264855168 00000100:00100000:0.0:1746065197.148874:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264855040 00000100:00100000:0.0:1746065197.148877:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264855040 00000100:00100000:0.0:1746065197.148893:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264855296 00000100:00100000:0.0:1746065197.148896:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264855296 00000100:00100000:0.0:1746065197.148915:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16224 00000100:00100000:0.0:1746065197.148921:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881264855168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065197.148940:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.148956:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc1476539 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9378a3 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.148982:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.148984:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.148994:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc1476539 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9378a3 expref: 33 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.149008:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc1476539 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9378a3 expref: 33 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.149018:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779c00, rc 0) 00000100:00100000:0.0:1746065197.149077:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881264855168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 155us (2957us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.149083:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16224 00000100:00100000:0.0:1746065197.149099:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16225 00000100:00100000:0.0:1746065197.149104:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881264855040:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065197.149110:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.149120:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1476540 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93789c expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.149132:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.149133:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.149137:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1476540 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93789c expref: 31 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.149148:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1476540 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93789c expref: 31 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.149155:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779200, rc 0) 00000100:00100000:0.0:1746065197.149170:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881264855040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 67us (3006us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.149175:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16225 00000100:00100000:0.0:1746065197.149184:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16226 00000100:00100000:0.0:1746065197.149189:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881264855296:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065197.149194:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.149200:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1476547 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9378aa expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.149222:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1476547 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9378aa expref: 33 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.149229:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1476547 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9378aa expref: 33 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.149244:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778e00, rc 0) 00000100:00100000:0.0:1746065197.149256:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881264855296:12345-192.168.202.27@tcp:101:cat.0 Request processed in 68us (3036us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065197.149261:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16226 00000100:00100000:0.0:1746065197.152586:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.152636:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.152652:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264855808 00000100:00100000:0.0:1746065197.152657:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264855808 00000100:00100000:0.0:1746065197.152690:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264856064 00000100:00100000:0.0:1746065197.152693:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264856064 00000100:00100000:0.0:1746065197.152709:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16229 00000100:00100000:0.0:1746065197.152714:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264855808:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065197.152744:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.152760:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc1476467 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9377fb expref: 17 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.152767:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc1476539 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9378a3 expref: 31 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.152786:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577bc00/0xad6b7ddc14764ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937872 expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.152792:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.152794:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.152796:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.152815:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577bc00/0xad6b7ddc14764ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937872 expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.152824:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577bc00/0xad6b7ddc14764ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937872 expref: 10 pid: 12260 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065197.153962:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263782144:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065197.154002:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc1476539 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9378a3 expref: 31 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.154017:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc1476539 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9378a3 expref: 31 pid: 11461 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065197.154025:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263782656:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065197.154046:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc1476467 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9377fb expref: 17 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.154053:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577b800/0xad6b7ddc1476467 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9377fb expref: 17 pid: 10219 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065197.154059:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263782784:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065197.154071:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.154126:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.154170:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.155654:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16232 00000100:00100000:0.0:1746065197.155660:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881264855936:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065197.155675:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc1476571 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.155688:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc147647c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3637248->4030463] (req 3637248->4030463) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937810 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.155694:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476491 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4030464->18446744073709551615] (req 4194304->4673535) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937825 expref: 17 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.155698:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065197.155699:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065197.155701:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc1476571 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.155712:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476491 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4030464->18446744073709551615] (req 4194304->4673535) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937825 expref: 17 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.155718:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476491 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4030464->18446744073709551615] (req 4194304->4673535) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937825 expref: 17 pid: 10219 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065197.155724:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263783040:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065197.159299:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc147647c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3637248->4030463] (req 3637248->4030463) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937810 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.159312:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc147647c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3637248->4030463] (req 3637248->4030463) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937810 expref: 17 pid: 1880 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065197.159322:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263783296:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065197.159367:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.159793:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263782144:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065197.159803:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263782656:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065197.159810:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263782784:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065197.159829:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.171016:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264856832 00000100:00100000:0.0:1746065197.171019:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264856832 00002000:00100000:0.0:1746065197.171042:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1376255) req@ffff88009856d500 x1830881264856832/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.171049:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d500 with x1830881264856832 ext(1048576->1376255) 00010000:00010000:0.0:1746065197.171054:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1476475 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937809 expref: 30 pid: 1880 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065197.171062:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1476475 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1376255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937809 expref: 30 pid: 1880 timeout: 893 lvb_type: 0 00002000:00010000:0.0:1746065197.171067:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009856d500 00000100:00100000:0.0:1746065197.171079:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1860 00000100:00100000:0.0:1746065197.171083:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881264856832:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:0.0:1746065197.185659:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.185669:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.185685:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.185692:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.185698:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.185704:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d926e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065197.185706:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.185713:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.185724:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.185730:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc147655c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.185792:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264855808:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 33075us (33206us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.185799:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16229 00010000:00010000:0.0:1746065197.185851:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476491 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4030464->18446744073709551615] (req 4194304->4673535) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937825 expref: 18 pid: 10219 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065197.185860:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263783040:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065197.185869:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263783296:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065197.185885:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc1476571 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.211261:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065197.213334:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147654e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.213341:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147654e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.213353:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147654e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.213359:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147654e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.213365:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147654e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.213370:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065197.213372:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147654e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.213383:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147654e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.213392:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147654e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.213397:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147654e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.213438:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881264855552:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 62844us (64046us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.213444:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16227 00000100:00100000:0.0:1746065197.213828:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.216224:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.216265:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.223694:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.227135:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.227177:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.235433:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.248537:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264859904 00000100:00100000:0.0:1746065197.248546:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264859904 00000100:00100000:0.0:1746065197.248594:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5290 00000100:00100000:0.0:1746065197.248602:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+25:1805:x1830881264859904:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:0.0:1746065197.248800:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+26:1805:x1830881264859904:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 195us (891us total) trans 8589936737 rc 0/0 00000100:00100000:0.0:1746065197.248810:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5290 00000100:00100000:0.0:1746065197.281454:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.290258:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.292598:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.299407:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.308293:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.324440:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.324473:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.324505:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.338313:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.349033:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.349533:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.349562:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.349574:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.349597:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.350819:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.350853:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.350865:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264862976 00000100:00100000:0.0:1746065197.350867:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264862976 00002000:00100000:0.0:1746065197.350887:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3584000->3948543) req@ffff8800900f1180 x1830881264862976/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.350895:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1180 with x1830881264862976 ext(3584000->3948543) 00010000:00010000:0.0:1746065197.350901:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3da00/0xad6b7ddc14765b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->3948543) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9378d4 expref: 21 pid: 9549 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065197.350911:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3da00/0xad6b7ddc14765b7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3584000->3948543) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9378d4 expref: 21 pid: 9549 timeout: 893 lvb_type: 0 00002000:00010000:0.0:1746065197.350917:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800900f1180 00000100:00100000:0.0:1746065197.350928:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1863 00000100:00100000:0.0:1746065197.350933:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881264862976:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065197.357882:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.359701:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.359733:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.360715:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.381405:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.381441:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.400372:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.403362:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881264864512:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 21746us (21960us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065197.403369:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5625 00002000:00100000:0.0:1746065197.403376:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880092746a00 x1830881264864512/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:113/0 lens 488/440 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.403384:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746a00 with x1830881264864512 ext(2097152->4194303) 00002000:00010000:0.0:1746065197.403388:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092746a00 00000100:00100000:0.0:1746065197.415032:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.417858:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.422595:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.423943:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.440603:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.441356:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.441383:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264865920 00000100:00100000:0.0:1746065197.441387:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264865920 00002000:00100000:0.0:1746065197.441413:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2600960->3145727) req@ffff880092745180 x1830881264865920/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.441421:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745180 with x1830881264865920 ext(2600960->3145727) 00010000:00010000:0.0:1746065197.441428:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14765fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93791a expref: 36 pid: 9548 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065197.441436:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc14765fd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2600960->3145727] (req 2600960->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93791a expref: 36 pid: 9548 timeout: 893 lvb_type: 0 00002000:00010000:0.0:1746065197.441441:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092745180 00000100:00100000:0.0:1746065197.441454:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1866 00000100:00100000:0.0:1746065197.441459:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881264865920:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065197.446060:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.457972:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.458003:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264866176 00000100:00100000:0.0:1746065197.458009:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264866176 00010000:00010000:0.0:1746065197.458037:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc14765e8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937913 expref: 12 pid: 9550 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065197.458069:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7448 00000100:00100000:0.0:1746065197.458078:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881264866176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.458091:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.458112:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc14765e8 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937913 expref: 12 pid: 9550 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065197.458129:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc14765e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937913 expref: 12 pid: 9550 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065197.458153:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.458193:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881264866176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 115us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.458200:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7448 00010000:00010000:0.0:1746065197.458248:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc14765e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937913 expref: 11 pid: 9550 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065197.458266:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263784448:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065197.458279:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263784576:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065197.458302:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc1476612 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->2363391] (req 2097152->2363391) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937936 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.458311:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c4600, rc 0) 00000100:00100000:0.0:1746065197.458335:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:1812:x1830881264866048:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 17395us (17739us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.458341:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16249 00000100:00100000:0.0:1746065197.461502:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.473755:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc1880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263784704:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065197.473807:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.473846:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881264866304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 12207us (12348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.473858:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7449 00000100:00100000:0.0:1746065197.480768:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.488025:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.507870:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.510828:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.516448:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.545470:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.545512:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.587525:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.605246:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.613512:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.613671:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.622151:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.646046:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.654365:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.658679:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.665263:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.730844:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.735070:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.735466:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:0.0:1746065197.739727:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime: 1746065193 -> 1746065197 00000100:00100000:0.0:1746065197.739749:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263785984:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065197.739791:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc147663c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937959 expref: 38 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.739803:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46600/0xad6b7ddc147663c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937959 expref: 38 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.739815:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46600, rc 0) 00000100:00100000:0.0:1746065197.739855:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092a64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881264869888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8887us (9020us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065197.739862:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16255 00000100:00100000:0.0:1746065197.739980:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16257 00000100:00100000:0.0:1746065197.739988:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881264870144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065197.739999:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.740009:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147664a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937967 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.740023:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.740025:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.740030:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147664a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937967 expref: 36 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.740041:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147664a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937967 expref: 36 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.740048:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d9200, rc 0) 00000100:00100000:0.0:1746065197.740060:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881264870144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 74us (4596us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.740064:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16257 00000100:00100000:0.0:1746065197.740981:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263786240 00000100:00100000:0.0:1746065197.740986:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263786240 00000100:00100000:0.0:1746065197.741014:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:0.0:1746065197.741019:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263786240:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1746065197.741031:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 569344 granted 1000163648 pending 5083136 free 3907088384 avail 3675566080 00000100:00100000:0.0:1746065197.741054:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263786240:12345-0@lo:13:osp-pre-1-1.0 Request processed in 35us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.741058:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00080000:0.0:1746065197.741075:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065197.765144:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.771408:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.795557:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263786752:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065197.795579:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.795638:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881264870784:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5610us (5832us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.795648:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7457 00000100:00100000:0.0:1746065197.797592:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.806372:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.806402:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264871168 00000100:00100000:0.0:1746065197.806408:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264871168 00000100:00100000:0.0:1746065197.806439:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16260 00000100:00100000:0.0:1746065197.806445:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+34:1826:x1830881264871168:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065197.806459:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065197.806472:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc147665f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93797c expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.806494:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1476627 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937944 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.806501:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147664a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937967 expref: 35 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.806507:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.806509:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.806512:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc147665f lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2801663] (req 2097152->2801663) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93797c expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.806544:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147664a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937967 expref: 35 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065197.806553:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147664a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937967 expref: 35 pid: 11461 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065197.806563:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263786880:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065197.806632:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1476627 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937944 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.806639:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1476627 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937944 expref: 11 pid: 11461 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065197.806645:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263787008:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065197.806658:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.814081:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.814110:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.814129:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264871424 00000100:00100000:0.0:1746065197.814135:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264871424 00010000:00010000:0.0:1746065197.814162:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc147662e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 241664->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93794b expref: 23 pid: 11461 timeout: 893 lvb_type: 0 00000100:00100000:0.0:1746065197.814180:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264871296 00000100:00100000:0.0:1746065197.814181:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264871296 00010000:00010000:0.0:1746065197.814190:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147664a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937967 expref: 36 pid: 11461 timeout: 893 lvb_type: 1 00000100:00100000:0.0:1746065197.814202:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7458 00000100:00100000:0.0:1746065197.814207:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881264871424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.814217:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.814231:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc147662e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 241664->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93794b expref: 23 pid: 11461 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065197.814239:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc147662e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 241664->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93794b expref: 23 pid: 11461 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065197.814255:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc147662e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 241664->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93794b expref: 23 pid: 11461 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065197.814277:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.814279:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065197.814285:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc1476651 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93796e expref: 37 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.814291:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc1476651 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93796e expref: 37 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.814321:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc1476651 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93796e expref: 37 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065197.814331:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263787136:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065197.814387:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065197.814468:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7459 00000100:00100000:0.0:1746065197.814473:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881264871296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065197.814479:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065197.814488:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147664a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937967 expref: 36 pid: 11461 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065197.814496:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9200/0xad6b7ddc147664a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937967 expref: 36 pid: 11461 timeout: 893 lvb_type: 1 00010000:00010000:0.0:1746065197.814508:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.814535:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881264871296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 62us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.814540:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7459 00000100:00100000:0.0:1746065197.821843:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.822568:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.844245:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.847176:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.849014:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.856453:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.856498:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.859215:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264872704 00000100:00100000:0.0:1746065197.859220:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264872704 00002000:00100000:0.0:1746065197.859252:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1183743) req@ffff880091bc3b80 x1830881264872704/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.859262:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc3b80 with x1830881264872704 ext(1048576->1183743) 00010000:00010000:0.0:1746065197.859267:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d46000/0xad6b7ddc1476635 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937952 expref: 13 pid: 11461 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065197.859278:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d46000/0xad6b7ddc1476635 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1183743) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937952 expref: 13 pid: 11461 timeout: 893 lvb_type: 0 00002000:00010000:0.0:1746065197.859284:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bc3b80 00000100:00100000:0.0:1746065197.859298:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1869 00000100:00100000:0.0:1746065197.859303:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881264872704:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065197.867037:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.895867:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.908176:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.918446:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.935339:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.938697:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.949641:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.961505:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263788416:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065197.961543:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdba00/0xad6b7ddc1476697 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379b4 expref: 14 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065197.961559:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdba00, rc 0) 00000100:00100000:0.0:1746065197.961597:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:1835:x1830881264874496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8527us (8573us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.961608:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16268 00000100:00100000:0.0:1746065197.963844:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881264874368:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10293us (10951us total) trans 17179874069 rc 0/0 00000100:00100000:0.0:1746065197.963853:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1870 00002000:00100000:0.0:1746065197.963861:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (3010560->3145727) req@ffff8800996f8000 x1830881264874368/t17179874069(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:113/0 lens 488/448 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.963868:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f8000 with x1830881264874368 ext(3010560->3145727) 00010000:00010000:0.0:1746065197.963876:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c1b400/0xad6b7ddc1476658 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937975 expref: 41 pid: 9548 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065197.963886:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c1b400/0xad6b7ddc1476658 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3010560->3145727] (req 3010560->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937975 expref: 41 pid: 9548 timeout: 893 lvb_type: 0 00002000:00010000:0.0:1746065197.963891:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800996f8000 00000100:00100000:0.0:1746065197.968227:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.970739:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.972547:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.972624:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264875136 00000100:00100000:0.0:1746065197.972628:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264875136 00002000:00100000:0.0:1746065197.972652:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1912832->2097151) req@ffff880092744700 x1830881264875136/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.972660:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744700 with x1830881264875136 ext(1912832->2097151) 00010000:00010000:0.0:1746065197.972667:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc1476689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379a6 expref: 14 pid: 9548 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065197.972680:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc1476689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379a6 expref: 14 pid: 9548 timeout: 893 lvb_type: 0 00002000:00010000:0.0:1746065197.972686:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092744700 00000100:00100000:0.0:1746065197.972700:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1872 00000100:00100000:0.0:1746065197.972911:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881264875136:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065197.984150:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881264875136:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 11230us (11591us total) trans 21474841492 rc 0/0 00000100:00100000:0.0:1746065197.984161:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1872 00002000:00100000:0.0:1746065197.984173:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1912832->2097151) req@ffff880092744700 x1830881264875136/t21474841492(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:113/0 lens 488/448 e 0 to 0 dl 1746065208 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.984180:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744700 with x1830881264875136 ext(1912832->2097151) 00010000:00010000:0.0:1746065197.984190:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc1476689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379a6 expref: 16 pid: 9548 timeout: 893 lvb_type: 0 00010000:00010000:0.0:1746065197.984202:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc1476689 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1912832->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379a6 expref: 16 pid: 9548 timeout: 894 lvb_type: 0 00002000:00010000:0.0:1746065197.984208:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092744700 00000100:00100000:0.0:1746065197.990026:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.990103:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065197.990138:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264876416 00000100:00100000:0.0:1746065197.990143:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264876416 00002000:00100000:0.0:1746065197.990173:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (1118208->1122303) req@ffff880092747800 x1830881264876416/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:113/0 lens 488/0 e 0 to 0 dl 1746065208 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.990182:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747800 with x1830881264876416 ext(1118208->1122303) 00002000:00010000:0.0:1746065197.990186:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092747800 00000100:00100000:0.0:1746065197.990201:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5643 00000100:00100000:0.0:1746065197.990206:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881264876416:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065197.990298:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881264876416:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 92us (195us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065197.990302:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5643 00002000:00100000:0.0:1746065197.990306:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (1118208->1122303) req@ffff880092747800 x1830881264876416/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:113/0 lens 488/4536 e 0 to 0 dl 1746065208 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065197.990312:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747800 with x1830881264876416 ext(1118208->1122303) 00002000:00010000:0.0:1746065197.990315:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092747800 00000100:00100000:0.0:1746065197.993870:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263789056:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065197.993887:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065197.994136:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881264876160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3881us (4113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065197.994146:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7467 00000100:00100000:0.0:1746065197.995278:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.005828:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.006744:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.012897:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.024727:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881264877184:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9787us (11830us total) trans 0 rc 974848/974848 00000100:00100000:0.0:1746065198.024738:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5645 00002000:00100000:0.0:1746065198.024749:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x77:0x0] (1122304->2097151) req@ffff88012f1a7480 x1830881264877184/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 974848/974848 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.024758:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7480 with x1830881264877184 ext(1122304->2097151) 00002000:00010000:0.0:1746065198.024763:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7480 00000100:00100000:0.0:1746065198.025252:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264877312 00000100:00100000:0.0:1746065198.025259:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264877312 00000100:00100000:0.0:1746065198.025299:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16272 00000100:00100000:0.0:1746065198.025305:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881264877312:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065198.025461:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.025479:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc14766b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9379d0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.025979:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263789312:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065198.026034:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.032035:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.032069:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.033807:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.042996:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.066613:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.075610:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.095369:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.101300:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.116185:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.116216:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.116720:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7470 00000100:00100000:0.0:1746065198.116727:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881264878592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065198.116736:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.116747:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1476690 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379ad expref: 40 pid: 1880 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.116755:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1476690 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379ad expref: 40 pid: 1880 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.116767:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1476690 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379ad expref: 40 pid: 1880 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.116806:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.116807:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.116811:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc14766d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379f3 expref: 39 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.116817:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc14766d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3071999) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379f3 expref: 39 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.116834:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc14766d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2895872->3145727] (req 2895872->3071999) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379f3 expref: 39 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.116841:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263790208:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065198.121481:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.127694:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.133709:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.144546:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.158817:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.159466:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.198651:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16280 00000100:00100000:0.0:1746065198.198658:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881264880384:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065198.198664:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.198671:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97400/0xad6b7ddc14766eb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937a08 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.198689:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a97400/0xad6b7ddc14766eb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a08 expref: 42 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.198698:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a97400/0xad6b7ddc14766eb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a08 expref: 42 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.198715:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97400, rc 0) 00000100:00100000:0.0:1746065198.198965:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881264880384:12345-192.168.202.27@tcp:101:cat.0 Request processed in 308us (962us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065198.198971:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16280 00000100:00100000:0.0:1746065198.208124:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.209637:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.216165:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.245371:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.256405:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.271901:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.284144:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.292963:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.302152:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.320078:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881264882176:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 17746us (17923us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065198.320089:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1875 00002000:00100000:0.0:1746065198.320099:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880099ec6a00 x1830881264882176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.320106:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6a00 with x1830881264882176 ext(1048576->2097151) 00010000:00010000:0.0:1746065198.320114:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1476707 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a24 expref: 41 pid: 10219 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.320126:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c600/0xad6b7ddc1476707 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a24 expref: 41 pid: 10219 timeout: 894 lvb_type: 0 00002000:00010000:0.0:1746065198.320132:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec6a00 00000100:00100000:0.0:1746065198.330896:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.333034:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.340509:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.344150:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264882816 00000100:00100000:0.0:1746065198.344157:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264882816 00002000:00100000:0.0:1746065198.344190:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2895872->3071999) req@ffff88012f3c0700 x1830881264882816/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.344198:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0700 with x1830881264882816 ext(2895872->3071999) 00010000:00010000:0.0:1746065198.344204:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc14766d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2895872->3145727] (req 2895872->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379f3 expref: 41 pid: 10219 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.344216:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc14766d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2895872->3145727] (req 2895872->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379f3 expref: 41 pid: 10219 timeout: 894 lvb_type: 0 00002000:00010000:0.0:1746065198.344226:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3c0700 00000100:00100000:0.0:1746065198.344247:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1876 00000100:00100000:0.0:1746065198.344255:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881264882816:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065198.352204:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881264882816:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7948us (8467us total) trans 17179874071 rc 0/0 00000100:00100000:0.0:1746065198.352213:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1876 00002000:00100000:0.0:1746065198.352222:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2895872->3071999) req@ffff88012f3c0700 x1830881264882816/t17179874071(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:114/0 lens 488/448 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.352231:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0700 with x1830881264882816 ext(2895872->3071999) 00010000:00010000:0.0:1746065198.352237:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc14766d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2895872->3145727] (req 2895872->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379f3 expref: 45 pid: 10219 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.352249:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc14766d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2895872->3145727] (req 2895872->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379f3 expref: 45 pid: 10219 timeout: 894 lvb_type: 0 00002000:00010000:0.0:1746065198.352255:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3c0700 00000100:00100000:0.0:1746065198.358272:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264883072 00000100:00100000:0.0:1746065198.358279:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264883072 00010000:00010000:0.0:1746065198.358307:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc14766d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2895872->3145727] (req 2895872->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379f3 expref: 44 pid: 10219 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.359099:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7473 00000100:00100000:0.0:1746065198.359107:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881264883072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065198.359119:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.359136:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc14766d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2895872->3145727] (req 2895872->3071999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379f3 expref: 44 pid: 10219 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.359147:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc14766d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2895872->3145727] (req 2895872->3071999) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379f3 expref: 44 pid: 10219 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.359164:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc14766d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2895872->3145727] (req 2895872->3071999) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9379f3 expref: 44 pid: 10219 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.359191:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.359193:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.359199:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc147671c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a39 expref: 43 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.359206:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc147671c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a39 expref: 43 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.359233:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc147671c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a39 expref: 43 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.359242:0:7190:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc147671c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a39 expref: 43 pid: 10219 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.359251:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263791232:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065198.361719:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.365525:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263791232:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065198.365543:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065198.365594:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881264883072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6486us (7465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.365603:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7473 00000100:00100000:0.0:1746065198.374722:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264883328 00000100:00100000:0.0:1746065198.374726:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264883328 00002000:00100000:0.0:1746065198.374746:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012f3c3480 x1830881264883328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.374755:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c3480 with x1830881264883328 ext(2097152->3145727) 00010000:00010000:0.0:1746065198.374760:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc147671c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a39 expref: 43 pid: 10219 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.374768:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc147671c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a39 expref: 43 pid: 10219 timeout: 894 lvb_type: 0 00002000:00010000:0.0:1746065198.374787:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3c3480 00000100:00100000:0.0:1746065198.374799:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264883584 00000100:00100000:0.0:1746065198.374802:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264883584 00002000:00100000:0.0:1746065198.374814:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880092744a80 x1830881264883584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.374820:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744a80 with x1830881264883584 ext(2097152->4194303) 00002000:00010000:0.0:1746065198.374823:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092744a80 00000100:00100000:0.0:1746065198.374832:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1877 00000100:00100000:0.0:1746065198.374837:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881264883328:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065198.385643:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881264883328:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10802us (11230us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065198.385652:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1877 00002000:00100000:0.0:1746065198.385663:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012f3c3480 x1830881264883328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.385671:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c3480 with x1830881264883328 ext(2097152->3145727) 00010000:00010000:0.0:1746065198.385681:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc147671c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a39 expref: 43 pid: 10219 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.385693:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c000/0xad6b7ddc147671c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a39 expref: 43 pid: 10219 timeout: 894 lvb_type: 0 00002000:00010000:0.0:1746065198.385699:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3c3480 00000100:00100000:0.0:1746065198.389815:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.400831:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.404888:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.412161:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.413954:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.413991:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.416222:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.416251:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.419006:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.419041:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.423412:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.424726:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.424767:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.424977:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16296 00000100:00100000:0.0:1746065198.424982:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881264886016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065198.424989:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.424997:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc147675b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937a78 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.425018:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263792640:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065198.425037:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00002000:00010000:0.0:1746065198.428061:0:1880:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065197 -> 1746065198 00002000:00010000:0.0:1746065198.428069:0:1880:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065197 -> 1746065198 00002000:00010000:0.0:1746065198.428071:0:1880:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065197 -> 1746065198 00000100:00100000:0.0:1746065198.428087:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d05180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263792640:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065198.428204:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc147675b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a78 expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.428217:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc147675b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a78 expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.428229:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167e00, rc 0) 00000100:00100000:0.0:1746065198.428874:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881264886016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3888us (4103us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065198.428882:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16296 00000100:00100000:0.0:1746065198.443932:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.447846:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.447885:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.450801:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065198.451566:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1475c6b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065198.451573:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1475c6b lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065198.451583:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1475c6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065198.451587:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abac800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065198.451590:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1475c6b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065198.451595:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1475c6b lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065198.451604:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065198.451606:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065198.451608:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1475c6b lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065198.451612:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1475c6b lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065198.462579:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.466960:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065198.467705:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14767b6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.467712:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14767b6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065198.467728:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00010000:00010000:0.0:1746065198.467856:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc14767af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ab7 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.467871:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14767b6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ab7 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.467881:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065198.467883:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065198.467884:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97400, rc 0) 00000100:00100000:0.0:1746065198.468290:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:1855:x1830881264888064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5006us (5723us total) trans 8589936741 rc 0/0 00000100:00100000:0.0:1746065198.468640:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14306 00000100:00100000:0.0:1746065198.470991:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.479726:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.479759:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.479804:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.479839:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.479858:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264888576 00000100:00100000:0.0:1746065198.479864:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264888576 00000100:00100000:0.0:1746065198.479895:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264888832 00000100:00100000:0.0:1746065198.479897:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264888832 00000100:00100000:0.0:1746065198.479905:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264888704 00000100:00100000:0.0:1746065198.479906:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264888704 00000100:00100000:0.0:1746065198.479915:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264888960 00000100:00100000:0.0:1746065198.479917:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264888960 00000100:00100000:0.0:1746065198.479928:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16304 00000100:00100000:0.0:1746065198.479934:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264888576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065198.479949:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.479962:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc14767d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937ac5 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.480006:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263793664:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065198.480070:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.480089:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16305 00000100:00100000:0.0:1746065198.480094:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881264888832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065198.480100:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.480106:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc14767d9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937ad3 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.480128:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263793792:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065198.480147:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.484090:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263793664:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065198.484118:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc14767d2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ac5 expref: 11 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.484130:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc14767d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ac5 expref: 11 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.484141:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7fa00, rc 0) 00000100:00100000:0.0:1746065198.484183:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264888576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4248us (4463us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065198.484190:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16304 00000100:00100000:0.0:1746065198.486723:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.491586:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.491624:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.491652:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.491678:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.491694:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.491717:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.498404:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263794304:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.498425:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc1476818 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.506903:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.506929:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.507308:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.507537:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.521554:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.521578:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264891392 00000100:00100000:0.0:1746065198.521583:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264891392 00010000:00010000:0.0:1746065198.521605:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc14766f2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a0f expref: 35 pid: 9549 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746065198.523054:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.523068:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264891520 00000100:00100000:0.0:1746065198.523071:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264891520 00010000:00010000:0.0:1746065198.523084:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a200/0xad6b7ddc147660b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937928 expref: 46 pid: 9548 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.523110:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7490 00000100:00100000:0.0:1746065198.523116:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881264891520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065198.523123:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.523132:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013683a200/0xad6b7ddc147660b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937928 expref: 45 pid: 9548 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.523140:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013683a200/0xad6b7ddc147660b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937928 expref: 45 pid: 9548 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.523153:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683a200/0xad6b7ddc147660b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937928 expref: 45 pid: 9548 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.523175:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065198.523191:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+44:2006:x1830881264891520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.523196:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7490 00000100:00100000:0.0:1746065198.529938:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881264890368:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 11700us (22628us total) trans 21474841494 rc 0/0 00000100:00100000:0.0:1746065198.529943:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1880 00002000:00100000:0.0:1746065198.529948:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1261567) req@ffff880098dda300 x1830881264890368/t21474841494(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:114/0 lens 488/448 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.529953:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dda300 with x1830881264890368 ext(1048576->1261567) 00010000:00010000:0.0:1746065198.529958:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc147673f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a5c expref: 16 pid: 10219 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.529964:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d45800/0xad6b7ddc147673f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1261567) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a5c expref: 16 pid: 10219 timeout: 894 lvb_type: 0 00002000:00010000:0.0:1746065198.529968:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098dda300 00000100:00100000:0.0:1746065198.530251:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881264890624:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11371us (22713us total) trans 17179874074 rc 0/0 00000100:00100000:0.0:1746065198.530257:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1881 00002000:00100000:0.0:1746065198.530262:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (2068480->2097151) req@ffff880098dd8e00 x1830881264890624/t17179874074(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:114/0 lens 488/448 e 0 to 0 dl 1746065209 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.530270:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8e00 with x1830881264890624 ext(2068480->2097151) 00010000:00010000:0.0:1746065198.530275:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc1476715 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a32 expref: 43 pid: 10219 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.530283:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc1476715 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2068480->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937a32 expref: 43 pid: 10219 timeout: 894 lvb_type: 0 00002000:00010000:0.0:1746065198.530288:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880098dd8e00 00000100:00100000:0.0:1746065198.533235:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.534034:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.534108:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065198.535193:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc1476818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.535201:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc1476818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.535212:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc1476818 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.535217:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc1476818 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.535221:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc1476818 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.535229:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065198.535309:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc1476818 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.535314:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc1476818 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.535322:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc1476818 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.535327:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96600/0xad6b7ddc1476818 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.536157:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881264889728:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 43591us (44475us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.536165:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16311 00000100:00100000:0.0:1746065198.539869:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264892288 00000100:00100000:0.0:1746065198.539877:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264892288 00000100:00100000:0.0:1746065198.539924:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14309 00000100:00100000:0.0:1746065198.539932:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:1855:x1830881264892288:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:0.0:1746065198.539975:0:13395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.539996:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835dc00/0xad6b7ddc14767cb lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937abe expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540010:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065198.540014:0:13395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065198.540033:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc147682d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.540044:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1475ebe lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373fd expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540050:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc1475f2e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937435 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540056:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1475af8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93718e expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540062:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc1475b37 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371aa expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540068:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1475b3e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371b1 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540073:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45a00/0xad6b7ddc1475cc6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372b4 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540079:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1475cdb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372bb expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540084:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc147682d lrc: 10/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.540109:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1475cdb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372bb expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540122:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1475cdb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372bb expref: 10 pid: 7203 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.540132:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263795584:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.540618:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45a00/0xad6b7ddc1475cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372b4 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540627:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45a00/0xad6b7ddc1475cc6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372b4 expref: 28 pid: 9571 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.540634:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263795712:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.540658:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1475b3e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371b1 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540665:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1475b3e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371b1 expref: 28 pid: 9571 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.540672:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263795840:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.540694:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc1475b37 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371aa expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540701:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc1475b37 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371aa expref: 10 pid: 7231 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.540707:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263795968:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.540731:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1475af8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93718e expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540737:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1475af8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93718e expref: 10 pid: 9571 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.540743:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263796096:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.540763:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc1475f2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937435 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540770:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc1475f2e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937435 expref: 28 pid: 9571 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.540801:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092528000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263796224:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.540835:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1475ebe lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373fd expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.540842:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1475ebe lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373fd expref: 10 pid: 7231 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.540849:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263796352:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065198.540865:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065198.546505:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263795584:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065198.546525:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263795712:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.546533:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1475b3e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371b1 expref: 28 pid: 9571 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.546552:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263795840:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.546560:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc1475b37 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9371aa expref: 10 pid: 7231 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.546567:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263795968:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.546574:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31600/0xad6b7ddc1475af8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93718e expref: 9 pid: 9571 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.546580:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263796096:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.546587:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc1475f2e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937435 expref: 27 pid: 9571 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.546594:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092528000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263796224:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.546602:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1475ebe lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9373fd expref: 9 pid: 7231 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.546609:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252a680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263796352:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065198.546634:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc147682d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065198.550545:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264893696 00000100:00100000:0.0:1746065198.550549:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264893696 00010000:00010000:0.0:1746065198.550583:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45a00/0xad6b7ddc1475cc6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372b4 expref: 28 pid: 9571 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.550899:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7500 00000100:00100000:0.0:1746065198.550905:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881264893696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065198.550918:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.550922:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45a00/0xad6b7ddc1475cc6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372b4 expref: 28 pid: 9571 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.550931:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45a00/0xad6b7ddc1475cc6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372b4 expref: 28 pid: 9571 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.550947:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45a00/0xad6b7ddc1475cc6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372b4 expref: 28 pid: 9571 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.550959:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065198.550962:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc147682d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.550969:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065198.551002:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881264893696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.551007:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7500 00000100:00100000:0.0:1746065198.551018:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7501 00000100:00100000:0.0:1746065198.551022:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881264893568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065198.551026:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.551029:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1475cdb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372bb expref: 9 pid: 7203 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.551036:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1475cdb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372bb expref: 9 pid: 7203 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.551049:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1475cdb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9372bb expref: 9 pid: 7203 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.551056:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065198.551058:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc147682d lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.551064:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc147682d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.551069:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc147682d lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.551084:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065198.551093:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881264893568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (1708us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.551097:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7501 00010000:00010000:0.0:1746065198.551759:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc147682d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.551766:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc147682d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000040:00080000:0.0:1746065198.551986:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].919, 88 off88696 00000004:00080000:0.0:1746065198.551993:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794570218614ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065198.552025:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].951, 88 off91520 00000004:00080000:0.0:1746065198.552029:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794570255904ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065198.552046:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].952, 88 off91608 00000004:00080000:0.0:1746065198.552049:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794570275133ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065198.552055:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].920, 88 off88784 00000004:00080000:0.0:1746065198.552058:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794570284533ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065198.552064:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].921, 88 off88872 00000004:00080000:0.0:1746065198.552066:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794570292303ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065198.552072:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].953, 88 off91696 00000004:00080000:0.0:1746065198.552074:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794570300196ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065198.552079:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].954, 88 off91784 00000004:00080000:0.0:1746065198.552081:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794570307411ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065198.552086:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].955, 88 off91872 00000004:00080000:0.0:1746065198.552088:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794570314798ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065198.552094:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].922, 88 off88960 00000004:00080000:0.0:1746065198.552095:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794570322046ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065198.552101:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].956, 88 off91960 00000004:00080000:0.0:1746065198.552103:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794570329208ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065198.552108:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].923, 88 off89048 00000004:00080000:0.0:1746065198.552110:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794570336511ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065198.552115:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].957, 88 off92048 00000004:00080000:0.0:1746065198.552117:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794570343531ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065198.552122:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].924, 88 off89136 00000004:00080000:0.0:1746065198.552124:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794570350503ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065198.552129:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].925, 88 off89224 00000004:00080000:0.0:1746065198.552131:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794570357576ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065198.552137:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].926, 88 off89312 00000004:00080000:0.0:1746065198.552139:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794570365196ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065198.552144:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].927, 88 off89400 00000004:00080000:0.0:1746065198.552146:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 794570372826ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065198.552152:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].958, 88 off92136 00000004:00080000:0.0:1746065198.552153:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 794570379956ns, next at 761143559853ns, rc = 0 00000100:00100000:0.0:1746065198.557946:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263796864 00000100:00100000:0.0:1746065198.557952:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263796864 00000100:00100000:0.0:1746065198.557981:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263797376 00000100:00100000:0.0:1746065198.557983:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263797376 00000100:00100000:0.0:1746065198.557993:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263797888 00000100:00100000:0.0:1746065198.557994:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263797888 00000100:00100000:0.0:1746065198.558005:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16314 00000100:00100000:0.0:1746065198.558011:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3761:x1830881263796864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065198.558130:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3761:x1830881263796864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (233us total) trans 17179874075 rc 0/0 00000100:00100000:0.0:1746065198.558136:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16314 00000100:00100000:0.0:1746065198.558149:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263798400 00000100:00100000:0.0:1746065198.558151:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263798400 00000100:00100000:0.0:1746065198.558161:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263796480 00000100:00100000:0.0:1746065198.558163:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263796480 00000100:00100000:0.0:1746065198.558171:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263796992 00000100:00100000:0.0:1746065198.558173:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263796992 00000100:00100000:0.0:1746065198.558178:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263797504 00000100:00100000:0.0:1746065198.558180:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263797504 00000100:00100000:0.0:1746065198.558187:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16315 00000100:00100000:0.0:1746065198.558190:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3761:x1830881263797376:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065198.558230:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:0.0:1746065198.558233:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.558234:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065198.558236:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.558238:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:0.0:1746065198.558255:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3761:x1830881263797376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (290us total) trans 17179874076 rc 0/0 00000100:00100000:0.0:1746065198.558260:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16315 00000100:00100000:0.0:1746065198.558271:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263798016 00000100:00100000:0.0:1746065198.558273:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263798016 00000100:00100000:0.0:1746065198.558281:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16316 00000100:00100000:0.0:1746065198.558284:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3761:x1830881263797888:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065198.558331:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065198.558333:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.558335:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065198.558336:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.558338:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:0.0:1746065198.558353:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3761:x1830881263797888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 68us (364us total) trans 21474841495 rc 0/0 00000100:00100000:0.0:1746065198.558357:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16316 00000100:00100000:0.0:1746065198.558366:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16317 00000100:00100000:0.0:1746065198.558369:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3761:x1830881263798400:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.558414:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3761:x1830881263798400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (402us total) trans 21474841496 rc 0/0 00000100:00100000:0.0:1746065198.558418:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16317 00000100:00100000:0.0:1746065198.558425:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16318 00000100:00100000:0.0:1746065198.558428:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3761:x1830881263796480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065198.558470:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3761:x1830881263796480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (340us total) trans 17179874077 rc 0/0 00000100:00100000:0.0:1746065198.558474:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16318 00000100:00100000:0.0:1746065198.558481:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16319 00000100:00100000:0.0:1746065198.558484:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3761:x1830881263796992:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065198.558522:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065198.558524:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065198.558526:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065198.558527:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065198.558528:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065198.558542:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3761:x1830881263796992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (390us total) trans 17179874078 rc 0/0 00000100:00100000:0.0:1746065198.558546:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16319 00000100:00100000:0.0:1746065198.558554:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16320 00000100:00100000:0.0:1746065198.558558:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3761:x1830881263797504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.558595:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3761:x1830881263797504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 36us (422us total) trans 21474841497 rc 0/0 00000100:00100000:0.0:1746065198.558604:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16320 00000100:00100000:0.0:1746065198.558611:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16321 00000100:00100000:0.0:1746065198.558615:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3761:x1830881263798016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065198.558645:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065198.558647:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.558649:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065198.558650:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.558652:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:0.0:1746065198.560844:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263798016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2227us (2653us total) trans 21474841498 rc 0/0 00000100:00100000:0.0:1746065198.560850:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16321 00000004:00080000:0.0:1746065198.561048:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 1 in flight, 40 done 00000004:00010000:0.0:1746065198.561815:0:13395:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009577ea00 reply state ffff880099dec400 transno 8589936745 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc147682d lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.561833:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc147682d lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.561844:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065198.561847:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065198.561850:0:13395:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746065198.561911:0:13395:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065198.561922:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:1855:x1830881264892288:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 21989us (22150us total) trans 8589936745 rc 0/0 00000100:00100000:0.0:1746065198.561928:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14309 00000100:00100000:0.0:1746065198.566307:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.569870:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.574163:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.574191:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264894080 00000100:00100000:0.0:1746065198.574199:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264894080 00000100:00100000:0.0:1746065198.574229:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16331 00000100:00100000:0.0:1746065198.574235:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881264894080:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065198.574248:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.574261:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1476849 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937af6 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.574279:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d72e, atime: 0x6812d72d, ctime: 0x6812d72e, blocks: 0x6d8 00010000:00010000:0.0:1746065198.574293:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574295:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574301:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1476849 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937af6 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574312:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1476849 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937af6 expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574324:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3e00, rc 0) 00000100:00100000:0.0:1746065198.574355:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881264894080:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 121us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.574360:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16331 00000100:00100000:0.0:1746065198.574389:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.574398:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264894208 00000100:00100000:0.0:1746065198.574400:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264894208 00000100:00100000:0.0:1746065198.574411:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16332 00000100:00100000:0.0:1746065198.574414:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881264894208:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065198.574420:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.574428:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1476850 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937afd expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.574438:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d72e, atime: 0x6812d72d, ctime: 0x6812d72e, blocks: 0x800 00010000:00010000:0.0:1746065198.574443:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574445:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574448:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1476850 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937afd expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574455:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1476850 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937afd expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574461:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2800, rc 0) 00000100:00100000:0.0:1746065198.574472:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881264894208:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 56us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.574478:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16332 00000100:00100000:0.0:1746065198.574524:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.574533:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264894336 00000100:00100000:0.0:1746065198.574535:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264894336 00000100:00100000:0.0:1746065198.574546:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16333 00000100:00100000:0.0:1746065198.574549:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881264894336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065198.574554:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.574559:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a656ee00/0xad6b7ddc1476857 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937b04 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.574567:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d72e, atime: 0x6812d72c, ctime: 0x6812d72e, blocks: 0x808 00010000:00010000:0.0:1746065198.574572:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574573:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574576:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a656ee00/0xad6b7ddc1476857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b04 expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574583:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a656ee00/0xad6b7ddc1476857 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b04 expref: 10 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574588:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656ee00, rc 0) 00000100:00100000:0.0:1746065198.574599:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264894336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 49us (75us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.574602:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16333 00000100:00100000:0.0:1746065198.574624:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.574632:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264894464 00000100:00100000:0.0:1746065198.574634:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264894464 00000100:00100000:0.0:1746065198.574646:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16334 00000100:00100000:0.0:1746065198.574650:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881264894464:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065198.574656:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.574663:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a54ae00/0xad6b7ddc147685e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937b0b expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.574672:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d72e, atime: 0x6812d72e, ctime: 0x6812d72e, blocks: 0x808 00010000:00010000:0.0:1746065198.574678:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574679:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574683:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a54ae00/0xad6b7ddc147685e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b0b expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574690:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a54ae00/0xad6b7ddc147685e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b0b expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574696:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a54ae00, rc 0) 00000100:00100000:0.0:1746065198.574709:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264894464:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 58us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.574713:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16334 00000100:00100000:0.0:1746065198.574737:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.574746:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264894592 00000100:00100000:0.0:1746065198.574749:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264894592 00000100:00100000:0.0:1746065198.574761:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16335 00000100:00100000:0.0:1746065198.574765:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264894592:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065198.574769:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.574794:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009d358800/0xad6b7ddc1476865 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937b12 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.574807:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 4670560, mtime: 0x6812d72e, atime: 0x6812d72e, ctime: 0x6812d72e, blocks: 0x13b0 00010000:00010000:0.0:1746065198.574814:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574815:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574819:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009d358800/0xad6b7ddc1476865 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b12 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574827:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009d358800/0xad6b7ddc1476865 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b12 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574833:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d358800, rc 0) 00000100:00100000:0.0:1746065198.574846:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881264894592:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 81us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.574850:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16335 00000100:00100000:0.0:1746065198.574889:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.574899:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264894720 00000100:00100000:0.0:1746065198.574901:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264894720 00000100:00100000:0.0:1746065198.574914:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16336 00000100:00100000:0.0:1746065198.574918:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264894720:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065198.574923:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.574930:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd000/0xad6b7ddc147686c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937b19 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065198.574938:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d72e, atime: 0x6812d72e, ctime: 0x6812d72e, blocks: 0x1008 00010000:00010000:0.0:1746065198.574945:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574946:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.574949:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd000/0xad6b7ddc147686c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b19 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574957:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a6cd000/0xad6b7ddc147686c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b19 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065198.574963:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a6cd000, rc 0) 00000100:00100000:0.0:1746065198.574976:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881264894720:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 58us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.574981:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16336 00000100:00100000:0.0:1746065198.578543:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.578570:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.578713:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.579518:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16337 00000100:00100000:0.0:1746065198.579526:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881264894848:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065198.579609:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881264894848:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 86us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.579615:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16337 00000100:00100000:0.0:1746065198.579628:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16338 00000100:00100000:0.0:1746065198.579632:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881264894976:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065198.579657:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881264894976:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 24us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.579661:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16338 00000100:00100000:0.0:1746065198.579669:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16339 00000100:00100000:0.0:1746065198.579673:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881264895104:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065198.579690:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881264895104:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 17us (979us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.579695:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16339 00000100:00100000:0.0:1746065198.585879:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.585907:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.586085:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.587048:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.587069:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.587093:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.590879:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.594757:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.599864:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.603116:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264897280 00000100:00100000:0.0:1746065198.603120:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264897280 00000100:00100000:0.0:1746065198.603153:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5660 00000100:00100000:0.0:1746065198.603161:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881264897280:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065198.603187:0:20324:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147687a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.603197:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.603199:0:20324:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.603203:0:20324:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147687a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.603212:0:20324:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6dc00/0xad6b7ddc147687a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.611100:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.611137:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.611167:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.611191:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264897536 00000100:00100000:0.0:1746065198.611198:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264897536 00000100:00100000:0.0:1746065198.611250:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264898048 00000100:00100000:0.0:1746065198.611253:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264898048 00000100:00100000:0.0:1746065198.611270:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5663 00000100:00100000:0.0:1746065198.611275:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+15:2007:x1830881264897792:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065198.611293:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc1476888 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.611304:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.611306:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065198.611310:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc1476888 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.611321:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6c800/0xad6b7ddc1476888 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065198.614752:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.681997:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.684067:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.684097:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.684115:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.684337:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.684352:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.684387:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.684404:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16352 00000100:00100000:0.0:1746065198.684409:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881264899072:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:0.0:1746065198.684482:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065198.684485:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065198 -> 1746065198 00002000:00010000:0.0:1746065198.684487:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065197 -> 1746065198 00002000:00010000:0.0:1746065198.684489:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065198 -> 1746065198 00002000:00010000:0.0:1746065198.684491:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065198.684530:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+16:2005:x1830881264899072:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 121us (467us total) trans 21474841504 rc 0/0 00000100:00100000:0.0:1746065198.684535:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16352 00000100:00100000:0.0:1746065198.690494:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.694877:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263799168:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.699262:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065198.699306:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263799680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065198.699334:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065198.699345:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263800192:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065198.699356:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065198.699365:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263800704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.699376:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065198.699399:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263799168 00000100:00100000:0.0:1746065198.699403:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263799168 00000100:00100000:0.0:1746065198.699422:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263799680 00000100:00100000:0.0:1746065198.699424:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263799680 00000100:00100000:0.0:1746065198.699431:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263800192 00000100:00100000:0.0:1746065198.699432:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263800192 00000100:00100000:0.0:1746065198.699437:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263800704 00000100:00100000:0.0:1746065198.699438:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263800704 00000100:00100000:0.0:1746065198.699445:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16370 00000100:00100000:0.0:1746065198.699449:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263799168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065198.699531:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065198.699533:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065198 -> 1746065198 00002000:00010000:0.0:1746065198.699535:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065198 -> 1746065198 00002000:00010000:0.0:1746065198.699536:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065198 -> 1746065198 00002000:00010000:0.0:1746065198.699537:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746065198.699557:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263799168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 108us (299us total) trans 21474841513 rc 0/0 00000100:00100000:0.0:1746065198.699562:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16370 00000100:00100000:0.0:1746065198.699572:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16371 00000100:00100000:0.0:1746065198.699576:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3762:x1830881263799680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065198.699627:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3762:x1830881263799680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (292us total) trans 17179874095 rc 0/0 00000100:00100000:0.0:1746065198.699632:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16371 00000100:00100000:0.0:1746065198.699639:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16372 00000100:00100000:0.0:1746065198.699643:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3762:x1830881263800192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065198.699674:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:0.0:1746065198.699676:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.699678:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065198.699679:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.699681:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:0.0:1746065198.699696:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3762:x1830881263800192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 53us (339us total) trans 17179874096 rc 0/0 00000100:00100000:0.0:1746065198.699701:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16372 00000100:00100000:0.0:1746065198.699709:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16373 00000100:00100000:0.0:1746065198.699713:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263800704:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.699754:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263800704:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (377us total) trans 21474841514 rc 0/0 00000100:00100000:0.0:1746065198.699758:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16373 00000004:00080000:0.0:1746065198.699803:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3800/2, rc 0, transno 21474841513 00000100:00100000:0.0:1746065198.699807:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263799168:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065198.699815:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f1c00/2, rc 0, transno 17179874095 00000100:00100000:0.0:1746065198.699817:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263799680:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065198.699823:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edad500/2, rc 0, transno 17179874096 00000100:00100000:0.0:1746065198.699825:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263800192:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065198.699830:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f2300/2, rc 0, transno 21474841514 00000100:00100000:0.0:1746065198.699832:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263800704:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.703199:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.738208:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.744733:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.749225:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.760570:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.769263:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.783110:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.784599:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.793007:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.811580:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.811605:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.811635:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.811657:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264902784 00000100:00100000:0.0:1746065198.811663:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264902784 00010000:00010000:0.0:1746065198.811691:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc14768b9 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b20 expref: 8 pid: 7231 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.817397:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.817583:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881264902144:12345-192.168.202.27@tcp:3:cat.0 Request processed in 29912us (34478us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065198.817594:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5668 00002000:00100000:0.0:1746065198.817604:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009834c700 x1830881264902144/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.817614:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834c700 with x1830881264902144 ext(0->1048575) 00002000:00010000:0.0:1746065198.817620:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834c700 00000100:00100000:0.0:1746065198.817741:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264903040 00000100:00100000:0.0:1746065198.817748:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264903040 00000100:00100000:0.0:1746065198.817794:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14319 00000100:00100000:0.0:1746065198.817800:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+31:1865:x1830881264903040:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065198.817816:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065198.817832:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1476953 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937b5f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.817877:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1476945 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.817884:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1476953 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b5f expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.817899:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1476945 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065198.817908:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1476953 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b5f expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.817921:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065198.817924:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065198.817926:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1476953 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b5f expref: 32 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065198.817933:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25400, rc 0) 00000100:00100000:0.0:1746065198.817950:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+32:1865:x1830881264903040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 150us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.817954:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14319 00000100:00100000:0.0:1746065198.820852:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263802880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.822407:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263803008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.822475:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065198.822488:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263803392:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.822505:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263801984 00000100:00100000:0.0:1746065198.822517:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263801984 00000100:00100000:0.0:1746065198.822530:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263802880 00000100:00100000:0.0:1746065198.822532:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263802880 00000100:00100000:0.0:1746065198.822540:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263802624 00000100:00100000:0.0:1746065198.822542:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263802624 00000100:00100000:0.0:1746065198.822547:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263803136 00000100:00100000:0.0:1746065198.822549:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263803136 00000100:00100000:0.0:1746065198.822557:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16386 00000100:00100000:0.0:1746065198.822561:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263802880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065198.822606:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065198.822609:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065198 -> 1746065198 00002000:00010000:0.0:1746065198.822611:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065198 -> 1746065198 00002000:00010000:0.0:1746065198.822612:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065198 -> 1746065198 00002000:00010000:0.0:1746065198.822614:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746065198.822629:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+24:3759:x1830881263802880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (155us total) trans 21474841515 rc 0/0 00000100:00100000:0.0:1746065198.822634:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16386 00000100:00100000:0.0:1746065198.822641:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16388 00000100:00100000:0.0:1746065198.822644:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3761:x1830881263803136:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065198.822671:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065198.822673:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.822674:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065198.822676:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.822677:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:0.0:1746065198.822688:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3761:x1830881263803136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (157us total) trans 21474841517 rc 0/0 00000100:00100000:0.0:1746065198.822693:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16388 00000100:00100000:0.0:1746065198.822702:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065198.822715:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dca80/2, rc 0, transno 17179874103 00000100:00100000:0.0:1746065198.822718:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263802496:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065198.822726:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834f100/2, rc 0, transno 21474841515 00000100:00100000:0.0:1746065198.822728:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263802880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.822738:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065198.822748:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263803520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.822761:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065198.822790:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263803520 00000100:00100000:0.0:1746065198.822793:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263803520 00000100:00100000:0.0:1746065198.822804:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16390 00000100:00100000:0.0:1746065198.822807:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3760:x1830881263803008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065198.822840:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065198.822843:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.822845:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065198.822846:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065198.822848:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:0.0:1746065198.822865:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+27:3760:x1830881263803008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (126us total) trans 21474841519 rc 0/0 00000100:00100000:0.0:1746065198.822870:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16390 00000004:00080000:0.0:1746065198.822889:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834d180/2, rc 0, transno 21474841519 00000100:00100000:0.0:1746065198.822892:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263803008:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065198.822897:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09dc00/2, rc 0, transno 21474841520 00000100:00100000:0.0:1746065198.822900:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263803520:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065198.824748:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.827925:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.831371:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.837286:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.837332:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.848412:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264904064 00000100:00100000:0.0:1746065198.848421:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264904064 00002000:00100000:0.0:1746065198.848457:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009a6dce00 x1830881264904064/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:114/0 lens 488/0 e 0 to 0 dl 1746065209 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.848465:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dce00 with x1830881264904064 ext(1048576->2097151) 00002000:00010000:0.0:1746065198.848470:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dce00 00000100:00100000:0.0:1746065198.849844:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5670 00000100:00100000:0.0:1746065198.849856:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881264904064:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065198.864866:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.866225:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881264904064:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16370us (18141us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065198.866234:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5670 00002000:00100000:0.0:1746065198.866242:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009a6dce00 x1830881264904064/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:114/0 lens 488/440 e 0 to 0 dl 1746065209 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065198.866250:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dce00 with x1830881264904064 ext(1048576->2097151) 00002000:00010000:0.0:1746065198.866254:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dce00 00000100:00100000:0.0:1746065198.868945:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.897042:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.897074:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.897109:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.904925:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.910862:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.924852:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.924910:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.932032:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.936080:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.939539:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.955423:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264906880 00000100:00100000:0.0:1746065198.955435:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264906880 00010000:00010000:0.0:1746065198.956643:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc1476976 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b82 expref: 18 pid: 3067 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.956661:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264907008 00000100:00100000:0.0:1746065198.956664:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264907008 00010000:00010000:0.0:1746065198.956673:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a656ee00/0xad6b7ddc1476857 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b04 expref: 14 pid: 9548 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746065198.956684:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7508 00000100:00100000:0.0:1746065198.956688:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881264906752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065198.956694:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065198.957589:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091bafe00/0xad6b7ddc147696f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b7b expref: 37 pid: 3067 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.957598:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091bafe00/0xad6b7ddc147696f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b7b expref: 37 pid: 3067 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.957610:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091bafe00/0xad6b7ddc147696f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b7b expref: 37 pid: 3067 timeout: 894 lvb_type: 0 00010000:00010000:0.0:1746065198.957631:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065198.963391:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881264906752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6696us (8887us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065198.963401:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7508 00000100:00100000:0.0:1746065198.967415:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.967443:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.979858:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.979893:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.979933:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.982911:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065198.985610:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264908544 00000100:00100000:0.0:1746065198.985616:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264908544 00010000:00010000:0.0:1746065198.985640:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a54ae00/0xad6b7ddc147685e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b0b expref: 15 pid: 12260 timeout: 894 lvb_type: 1 00000100:00100000:0.0:1746065198.985658:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264908672 00000100:00100000:0.0:1746065198.985661:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264908672 00010000:00010000:0.0:1746065198.985670:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66a00/0xad6b7ddc1476984 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b90 expref: 29 pid: 3067 timeout: 894 lvb_type: 0 00000100:00100000:0.0:1746065198.992055:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.010322:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.026959:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.029834:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065199.034092:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065199.036180:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.054388:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.054429:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264909952 00000100:00100000:0.0:1746065199.054436:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264909952 00000100:00100000:0.0:1746065199.054501:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14321 00000100:00100000:0.0:1746065199.054520:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+6:1871:x1830881264909952:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065199.054540:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.054554:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc14769bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937bc8 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.054602:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc14769c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.054613:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc14769c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.054622:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc14769c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.054632:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc14769ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.054637:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc14769ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.054642:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc14769ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.054698:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc14769d1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.054705:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc14769d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.054710:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc14769d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065199.055613:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00000004:00200000:0.0:1746065199.055618:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065199.055635:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc14769d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.055644:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc14769d1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.055651:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc14769c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.055656:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc14769c3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.055661:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc14769c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.055670:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc14769c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.055675:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2da00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065199.055678:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc14769c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.055683:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc14769c3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.055691:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065199.055694:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065199.055697:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc14769c3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.055701:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2da00/0xad6b7ddc14769c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.056136:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc14769ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.056143:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc14769ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.056148:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc14769ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.056152:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065199.056155:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc14769ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.056160:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc14769ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.056171:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5d00) 00010000:00010000:0.0:1746065199.056173:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065199.056175:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc14769ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.056180:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc14769ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.056225:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc14769bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bc8 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.056235:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc14769d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bc8 expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.056241:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065199.056243:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065199.056245:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2ca00, rc 0) 00000100:00100000:0.0:1746065199.058376:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+7:1871:x1830881264909952:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3866us (3995us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.058384:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14321 00000100:00100000:0.0:1746065199.067725:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.067757:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.067808:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.067839:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.067871:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264910464 00000100:00100000:0.0:1746065199.067878:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264910464 00010000:00010000:0.0:1746065199.067904:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc1476968 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3444736->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b74 expref: 39 pid: 3067 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065199.067927:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7513 00000100:00100000:0.0:1746065199.067932:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881264910464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.067943:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.067958:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc1476968 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3444736->3801087) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b74 expref: 39 pid: 3067 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.067967:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc1476968 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3444736->3801087) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b74 expref: 39 pid: 3067 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.067984:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc1476968 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3444736->3801087) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b74 expref: 39 pid: 3067 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.067998:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.068000:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.068005:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc14769ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bba expref: 17 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.068012:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc14769ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bba expref: 17 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.068018:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.068018:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.068021:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc14769b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bc1 expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.068026:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc14769b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bc1 expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.068047:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc14769b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bc1 expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065199.068057:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263805184:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065199.068125:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc14769ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bba expref: 17 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065199.068131:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa3b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263805312:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065199.068144:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800999ac300 going to sleep for 11 seconds 00000100:00080000:0.0:1746065199.068808:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1746065199.068811:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1746065199.072471:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime: 1746065198 -> 1746065199 00002000:00010000:0.0:1746065199.072475:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065198 -> 1746065199 00002000:00010000:0.0:1746065199.072477:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime: 1746065198 -> 1746065199 00000100:00100000:0.0:1746065199.072493:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996faa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263805568:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065199.072524:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14769e6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bd6 expref: 15 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.072537:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc14769e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bd6 expref: 15 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.072549:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc400, rc 0) 00000100:00100000:0.0:1746065199.072581:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881264910208:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4021us (4771us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065199.072593:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16409 00000100:00100000:0.0:1746065199.074488:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.082192:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264910976 00000100:00100000:0.0:1746065199.082203:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264910976 00000100:00100000:0.0:1746065199.082242:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14322 00000100:00100000:0.0:1746065199.082248:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+7:1871:x1830881264910976:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065199.082263:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.082278:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc14769ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937be4 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.082358:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc14769f4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.082369:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc14769d1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bc8 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.082376:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc14769f4 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.082399:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc14769d1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bc8 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.082407:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc14769d1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bc8 expref: 8 pid: 9571 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065199.082418:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263805696:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065199.082495:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800999ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.086842:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.086863:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.086930:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263805696:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065199.086948:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc14769f4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065199.107119:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.107331:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.124286:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.130691:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.131936:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.136361:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.146534:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.158996:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264913792 00000100:00100000:0.0:1746065199.159005:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264913792 00000100:00100000:0.0:1746065199.159067:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5300 00000100:00100000:0.0:1746065199.159074:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:1868:x1830881264913792:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:0.0:1746065199.159271:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:1868:x1830881264913792:12345-192.168.202.27@tcp:35:cat.0 Request processed in 196us (2386us total) trans 8589936758 rc 0/0 00000100:00100000:0.0:1746065199.159278:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5300 00000100:00100000:0.0:1746065199.159754:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.159807:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.159835:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.159848:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264914048 00000100:00100000:0.0:1746065199.159852:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264914048 00010000:00010000:0.0:1746065199.159864:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc1476937 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b4a expref: 28 pid: 9550 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065199.159879:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7516 00000100:00100000:0.0:1746065199.159885:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881264914176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.159892:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.159901:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1476849 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937af6 expref: 17 pid: 9548 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.159911:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1476849 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937af6 expref: 17 pid: 9548 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.160889:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc1476849 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937af6 expref: 17 pid: 9548 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.160900:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.160919:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881264914176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1033us (1112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.160925:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7516 00000100:00100000:0.0:1746065199.163348:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.164982:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.165014:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.166003:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.166018:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264915584 00000100:00100000:0.0:1746065199.166021:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264915584 00010000:00010000:0.0:1746065199.166035:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc14769a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bac expref: 29 pid: 9550 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.166063:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7522 00000100:00100000:0.0:1746065199.166069:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2005:x1830881264915584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.166076:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.166086:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc14769a0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bac expref: 29 pid: 9550 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.166697:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc14769a0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bac expref: 29 pid: 9550 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.166709:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c285800/0xad6b7ddc14769a0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bac expref: 29 pid: 9550 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.166718:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.166732:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881264915584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 664us (730us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.166737:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7522 00000100:00100000:0.0:1746065199.166762:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.166888:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.166900:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.178592:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264916096 00000100:00100000:0.0:1746065199.178600:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264916096 00010000:00010000:0.0:1746065199.178632:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc14769ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bba expref: 19 pid: 9549 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065199.178664:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264916224 00000100:00100000:0.0:1746065199.178667:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264916224 00010000:00010000:0.0:1746065199.178677:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f66e00/0xad6b7ddc147698b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2023424->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b97 expref: 20 pid: 3067 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065199.178690:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7526 00000100:00100000:0.0:1746065199.178696:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881264916096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.178707:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.178723:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc14769ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bba expref: 20 pid: 9549 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.178733:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc14769ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bba expref: 20 pid: 9549 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.178751:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc14769ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bba expref: 20 pid: 9549 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.178792:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.178794:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.178798:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552fa00/0xad6b7ddc1476a4f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.178805:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552fa00/0xad6b7ddc1476a4f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.178823:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.180072:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881264916096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1375us (1842us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.180079:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7526 00000100:00100000:0.0:1746065199.191188:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.191211:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264917376 00000100:00100000:0.0:1746065199.191218:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264917376 00010000:00010000:0.0:1746065199.191246:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1476a17 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bf9 expref: 10 pid: 9571 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065199.191287:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7528 00000100:00100000:0.0:1746065199.191293:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881264917376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.191305:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.191309:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1476a17 lrc: 5/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bf9 expref: 10 pid: 9571 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.191318:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f6e00/0xad6b7ddc1476a17 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937bf9 expref: 10 pid: 9571 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.191336:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065199.191339:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1476a9c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065199.191347:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1476a9c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065199.191352:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1476a9c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065199.191364:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.191396:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881264917376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.191401:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7528 00000100:00100000:0.0:1746065199.191480:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.191493:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264917504 00000100:00100000:0.0:1746065199.191496:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264917504 00010000:00010000:0.0:1746065199.191520:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1476999 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ba5 expref: 28 pid: 3067 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065199.191539:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7529 00000100:00100000:0.0:1746065199.191543:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2004:x1830881264917504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.191549:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.191563:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1476999 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ba5 expref: 28 pid: 3067 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.191570:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1476999 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1925119) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ba5 expref: 28 pid: 3067 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.191584:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.191585:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.191589:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f46200/0xad6b7ddc1476a41 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.191596:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46200/0xad6b7ddc1476a41 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.192178:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.192198:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2004:x1830881264917504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 653us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.192204:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7529 00000100:00100000:0.0:1746065199.199614:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264917760 00000100:00100000:0.0:1746065199.199618:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264917760 00000100:00100000:0.0:1746065199.199642:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14326 00000100:00100000:0.0:1746065199.199647:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:1871:x1830881264917760:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:0.0:1746065199.199679:0:13395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.199704:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1476a25 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c00 expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.199731:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065199.199735:0:13395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.199763:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:1871:x1830881264917760:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 116us (531us total) trans 0 rc -116/-116 00000100:00100000:0.0:1746065199.199768:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14326 00000100:00100000:0.0:1746065199.202448:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.205156:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264918528 00000100:00100000:0.0:1746065199.205161:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264918528 00000100:00100000:0.0:1746065199.205199:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5302 00000100:00100000:0.0:1746065199.205205:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+30:1865:x1830881264918528:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:0.0:1746065199.205339:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+31:1865:x1830881264918528:12345-192.168.202.27@tcp:35:cat.0 Request processed in 133us (248us total) trans 8589936761 rc 0/0 00000100:00100000:0.0:1746065199.205345:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5302 00000100:00100000:0.0:1746065199.205985:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.278586:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.306813:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.325745:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.333899:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.333965:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.333997:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264919808 00000100:00100000:0.0:1746065199.334004:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264919808 00002000:00100000:0.0:1746065199.334038:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (3411968->3416063) req@ffff880097faa300 x1830881264919808/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.334053:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faa300 with x1830881264919808 ext(3411968->3416063) 00002000:00010000:0.0:1746065199.334058:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097faa300 00000100:00100000:0.0:1746065199.334089:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5688 00000100:00100000:0.0:1746065199.334095:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881264919808:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065199.344027:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.353186:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.353523:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.353549:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.353570:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264920448 00000100:00100000:0.0:1746065199.353576:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264920448 00000100:00100000:0.0:1746065199.353605:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264920576 00000100:00100000:0.0:1746065199.353607:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264920576 00000100:00100000:0.0:1746065199.353630:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16429 00000100:00100000:0.0:1746065199.353636:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2006:x1830881264920448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065199.353651:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.353665:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc1476b21 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937c70 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.353686:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.353688:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.353695:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc1476b21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c70 expref: 28 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.353707:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc1476b21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c70 expref: 28 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.353721:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2d600, rc 0) 00000100:00100000:0.0:1746065199.353759:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881264920448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 123us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.353765:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16429 00000100:00100000:0.0:1746065199.353804:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16430 00000100:00100000:0.0:1746065199.353809:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2006:x1830881264920576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065199.353816:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.353824:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1476b28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937c77 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.353834:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.353835:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.353839:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1476b28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c77 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.353847:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1476b28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c77 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.353853:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c400, rc 0) 00000100:00100000:0.0:1746065199.353868:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881264920576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 59us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.353872:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16430 00000100:00100000:0.0:1746065199.353904:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.353917:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264920704 00000100:00100000:0.0:1746065199.353920:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264920704 00000100:00100000:0.0:1746065199.353933:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16431 00000100:00100000:0.0:1746065199.353937:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881264920704:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065199.353943:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.353949:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1476b2f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937c7e expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.353959:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.353960:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.353964:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1476b2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c7e expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.353972:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1476b2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c7e expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.353979:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2d200, rc 0) 00000100:00100000:0.0:1746065199.353993:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881264920704:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (88us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.353997:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16431 00000100:00100000:0.0:1746065199.354039:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.354049:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264920832 00000100:00100000:0.0:1746065199.354052:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264920832 00000100:00100000:0.0:1746065199.354063:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16432 00000100:00100000:0.0:1746065199.354067:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881264920832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065199.354074:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.354082:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc1476b36 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937c85 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065199.354097:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d72f, atime: 0x6812d72e, ctime: 0x6812d72f, blocks: 0x808 00010000:00010000:0.0:1746065199.354106:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.354108:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.354112:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc1476b36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c85 expref: 29 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.354120:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc1476b36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c85 expref: 29 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.354126:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2cc00, rc 0) 00000100:00100000:0.0:1746065199.354141:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2006:x1830881264920832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 73us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.354146:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16432 00000100:00100000:0.0:1746065199.354175:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.354185:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264920960 00000100:00100000:0.0:1746065199.354187:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264920960 00000100:00100000:0.0:1746065199.354199:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16433 00000100:00100000:0.0:1746065199.354203:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2006:x1830881264920960:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065199.354210:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.354215:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2ca00/0xad6b7ddc1476b3d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937c8c expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065199.354243:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263808640:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065199.354290:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.370057:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.374158:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.374195:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.390399:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.390428:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.390446:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.390457:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.390476:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264921728 00000100:00100000:0.0:1746065199.390482:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264921728 00002000:00100000:0.0:1746065199.390522:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (3411968->3993599) req@ffff880134b00380 x1830881264921728/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.390531:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00380 with x1830881264921728 ext(3411968->3993599) 00010000:00010000:0.0:1746065199.390538:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1476ae2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c5b expref: 45 pid: 9548 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.390550:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1476ae2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c5b expref: 45 pid: 9548 timeout: 895 lvb_type: 0 00002000:00010000:0.0:1746065199.390556:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134b00380 00000100:00100000:0.0:1746065199.390568:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264922240 00000100:00100000:0.0:1746065199.390570:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264922240 00002000:00100000:0.0:1746065199.390578:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009856d180 x1830881264922240/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.390584:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d180 with x1830881264922240 ext(1048576->2097151) 00002000:00010000:0.0:1746065199.390586:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856d180 00000100:00100000:0.0:1746065199.390592:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264922112 00000100:00100000:0.0:1746065199.390593:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264922112 00002000:00100000:0.0:1746065199.390599:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009856c700 x1830881264922112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.390604:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c700 with x1830881264922112 ext(1048576->2097151) 00002000:00010000:0.0:1746065199.390606:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856c700 00000100:00100000:0.0:1746065199.390612:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264922496 00000100:00100000:0.0:1746065199.390613:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264922496 00002000:00100000:0.0:1746065199.390619:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009856f800 x1830881264922496/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.390624:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f800 with x1830881264922496 ext(0->1048575) 00002000:00010000:0.0:1746065199.390626:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856f800 00000100:00100000:0.0:1746065199.390633:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1885 00000100:00100000:0.0:1746065199.390637:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+46:2006:x1830881264921728:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065199.390796:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.390811:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264922624 00000100:00100000:0.0:1746065199.390814:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264922624 00002000:00100000:0.0:1746065199.390825:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009856f480 x1830881264922624/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.390830:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f480 with x1830881264922624 ext(1048576->2097151) 00002000:00010000:0.0:1746065199.390833:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856f480 00000100:00100000:0.0:1746065199.390841:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5690 00000100:00100000:0.0:1746065199.390845:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881264922240:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065199.391388:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5692 00000100:00100000:0.0:1746065199.391393:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881264922496:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065199.407242:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.409149:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.410843:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.415343:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.429544:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881264922240:12345-192.168.202.27@tcp:3:cat.0 Request processed in 38689us (39106us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065199.429558:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5690 00002000:00100000:0.0:1746065199.429568:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009856d180 x1830881264922240/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.429577:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d180 with x1830881264922240 ext(1048576->2097151) 00002000:00010000:0.0:1746065199.429582:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856d180 00000100:00100000:0.0:1746065199.437034:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+51:2006:x1830881264921728:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 46386us (46634us total) trans 17179874107 rc 0/0 00000100:00100000:0.0:1746065199.437045:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1885 00002000:00100000:0.0:1746065199.437070:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (3411968->3993599) req@ffff880134b00380 x1830881264921728/t17179874107(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/448 e 0 to 0 dl 1746065210 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.437079:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00380 with x1830881264921728 ext(3411968->3993599) 00010000:00010000:0.0:1746065199.437090:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1476ae2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c5b expref: 51 pid: 9548 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.437107:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1476ae2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3411968->3993599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c5b expref: 51 pid: 9548 timeout: 895 lvb_type: 0 00002000:00010000:0.0:1746065199.437113:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880134b00380 00000100:00100000:0.0:1746065199.442063:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.489245:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.501878:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.504681:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.508096:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.508141:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.513879:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2006:x1830881264925184:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5558us (5729us total) trans 17179874108 rc 0/0 00000100:00100000:0.0:1746065199.513968:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1887 00002000:00100000:0.0:1746065199.513979:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2433024->2891775) req@ffff88009ac67b80 x1830881264925184/t17179874108(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:115/0 lens 488/448 e 0 to 0 dl 1746065210 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.513988:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac67b80 with x1830881264925184 ext(2433024->2891775) 00010000:00010000:0.0:1746065199.513997:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc1476b4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c9a expref: 33 pid: 3068 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.514013:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc1476b4b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2433024->2891775) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c9a expref: 33 pid: 3068 timeout: 895 lvb_type: 0 00002000:00010000:0.0:1746065199.514019:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ac67b80 00000100:00100000:0.0:1746065199.516863:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.524845:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.531594:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264925824 00000100:00100000:0.0:1746065199.531601:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264925824 00002000:00100000:0.0:1746065199.531636:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88012dc3dc00 x1830881264925824/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.531696:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3dc00 with x1830881264925824 ext(2097152->4194303) 00002000:00010000:0.0:1746065199.531700:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3dc00 00000100:00100000:0.0:1746065199.531947:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5699 00000100:00100000:0.0:1746065199.531956:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2005:x1830881264925824:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065199.537695:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.537714:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.537735:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264926080 00000100:00100000:0.0:1746065199.537744:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264926080 00000100:00100000:0.0:1746065199.537804:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264926336 00000100:00100000:0.0:1746065199.537807:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264926336 00000100:00100000:0.0:1746065199.537841:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16440 00000100:00100000:0.0:1746065199.537846:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881264926336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065199.537853:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.537862:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1476b8a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937ccb expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.537875:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.537877:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.537884:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1476b8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ccb expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.537896:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1476b8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ccb expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.537904:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c200, rc 0) 00000100:00100000:0.0:1746065199.537940:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881264926336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 94us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.537946:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16440 00000100:00100000:0.0:1746065199.537976:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.538648:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.538673:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.558421:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.577570:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881264925952:12345-192.168.202.27@tcp:3:cat.0 Request processed in 44929us (45004us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065199.577583:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5700 00002000:00100000:0.0:1746065199.577592:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009577d500 x1830881264925952/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:115/0 lens 488/440 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.577600:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d500 with x1830881264925952 ext(2097152->4194303) 00002000:00010000:0.0:1746065199.577605:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577d500 00000100:00100000:0.0:1746065199.594580:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.606236:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.616344:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.623583:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.626352:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264928896 00000100:00100000:0.0:1746065199.626359:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264928896 00000100:00100000:0.0:1746065199.626398:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14333 00000100:00100000:0.0:1746065199.626405:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:1887:x1830881264928896:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065199.626417:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.626431:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3200/0xad6b7ddc1476bd0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937cf5 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.626517:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc1476bd7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.626528:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc1476bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.626536:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc1476bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065199.626547:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00000100:00100000:0.0:1746065199.632952:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.632978:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.632999:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.633023:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.633036:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264929536 00000100:00100000:0.0:1746065199.633039:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264929536 00000100:00100000:0.0:1746065199.634379:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264929408 00000100:00100000:0.0:1746065199.634385:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264929408 00000100:00100000:0.0:1746065199.634407:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16446 00000100:00100000:0.0:1746065199.634412:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+16:2007:x1830881264929536:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065199.634430:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abb2400/0xad6b7ddc1476c08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.634444:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc1476aaa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c38 expref: 38 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634451:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1476b8a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ccb expref: 16 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634458:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1476b2f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c7e expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634463:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.634464:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.634467:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb2400/0xad6b7ddc1476c08 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.634490:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1476b2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c7e expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634515:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1476b2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c7e expref: 19 pid: 10219 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.634525:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263810176:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065199.634587:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1476b8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ccb expref: 16 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634594:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1476b8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ccb expref: 16 pid: 3067 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.634603:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263810304:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065199.634626:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc1476aaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c38 expref: 38 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634633:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc1476aaa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c38 expref: 38 pid: 12258 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.634640:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263810432:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065199.634653:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfec00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.634672:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16448 00000100:00100000:0.0:1746065199.634677:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+16:2007:x1830881264929408:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065199.634691:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc1476c16 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.634704:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc1476a80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c31 expref: 38 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634709:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1476b98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cc4 expref: 16 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634714:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1476b28 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c77 expref: 19 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634718:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.634719:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.634721:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc1476c16 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.634733:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1476b28 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c77 expref: 19 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634739:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1476b28 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c77 expref: 19 pid: 1880 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.634746:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263810816:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065199.634769:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1476b98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cc4 expref: 16 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634792:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1476b98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cc4 expref: 16 pid: 10219 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.634803:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263811072:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065199.634822:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc1476a80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c31 expref: 38 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.634828:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc1476a80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c31 expref: 38 pid: 9548 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.634835:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263811328:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065199.634847:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.634878:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.634941:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.640412:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264930048 00000100:00100000:0.0:1746065199.640419:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264930048 00010000:00010000:0.0:1746065199.640449:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc1476bd7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cf5 expref: 14 pid: 9571 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065199.640484:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7537 00000100:00100000:0.0:1746065199.640491:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881264930048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.640510:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.640515:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc1476bd7 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cf5 expref: 14 pid: 9571 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.640525:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc1476bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cf5 expref: 14 pid: 9571 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.640548:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc1476bd7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cf5 expref: 14 pid: 9571 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.640577:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065199.640582:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1476bfa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.640590:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1476bfa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.640596:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1476bfa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.640679:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.640712:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881264930048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 221us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.640718:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7537 00000100:00100000:0.0:1746065199.640752:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.640802:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264930304 00000100:00100000:0.0:1746065199.640805:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264930304 00000100:00100000:0.0:1746065199.640822:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5306 00000100:00100000:0.0:1746065199.640826:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+35:1884:x1830881264930304:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:0.0:1746065199.640940:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+36:1884:x1830881264930304:12345-192.168.202.27@tcp:35:cat.0 Request processed in 113us (187us total) trans 8589936770 rc 0/0 00000100:00100000:0.0:1746065199.640945:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5306 00000100:00100000:0.0:1746065199.644937:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.652312:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.652339:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.652358:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264930688 00000100:00100000:0.0:1746065199.652364:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264930688 00010000:00010000:0.0:1746065199.652389:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1476b2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c7e expref: 20 pid: 10219 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.652410:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264930944 00000100:00100000:0.0:1746065199.652412:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264930944 00010000:00010000:0.0:1746065199.652419:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1476b8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ccb expref: 18 pid: 3067 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.652431:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7538 00000100:00100000:0.0:1746065199.652436:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881264930688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.652445:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.652462:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1476b2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c7e expref: 20 pid: 10219 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.652470:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1476b2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c7e expref: 20 pid: 10219 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.652486:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1476b2f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c7e expref: 20 pid: 10219 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.652511:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.652538:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2007:x1830881264930688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 102us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.652543:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7538 00000100:00100000:0.0:1746065199.652555:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7539 00000100:00100000:0.0:1746065199.652558:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+18:2007:x1830881264930944:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.652564:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.652568:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1476b8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ccb expref: 18 pid: 3067 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.652575:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1476b8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ccb expref: 18 pid: 3067 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.652584:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2c200/0xad6b7ddc1476b8a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ccb expref: 18 pid: 3067 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.652590:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.652599:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+17:2007:x1830881264930944:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.652603:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7539 00000100:00100000:0.0:1746065199.652627:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.652637:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264930816 00000100:00100000:0.0:1746065199.652639:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264930816 00010000:00010000:0.0:1746065199.652650:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc1476b21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c70 expref: 32 pid: 1880 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.652663:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7540 00000100:00100000:0.0:1746065199.652666:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2007:x1830881264930816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.652672:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.652681:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc1476b21 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c70 expref: 32 pid: 1880 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.652688:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc1476b21 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c70 expref: 32 pid: 1880 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.652699:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d600/0xad6b7ddc1476b21 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c70 expref: 32 pid: 1880 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.652706:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.652718:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2007:x1830881264930816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (90us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.652722:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7540 00000100:00100000:0.0:1746065199.675498:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.675603:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.680806:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.680837:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.680972:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.680988:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.681001:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264931072 00000100:00100000:0.0:1746065199.681003:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264931072 00010000:00010000:0.0:1746065199.681021:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1476b98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cc4 expref: 17 pid: 10219 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.681038:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264931328 00000100:00100000:0.0:1746065199.681040:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264931328 00010000:00010000:0.0:1746065199.681046:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc1476a80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c31 expref: 40 pid: 9548 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.681056:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264931584 00000100:00100000:0.0:1746065199.681057:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264931584 00010000:00010000:0.0:1746065199.681064:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc1476b52 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ca1 expref: 47 pid: 1880 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.681079:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7543 00000100:00100000:0.0:1746065199.681084:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881264931072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.681093:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.681106:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1476b98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cc4 expref: 17 pid: 10219 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.681114:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1476b98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cc4 expref: 17 pid: 10219 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.681131:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1476b98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cc4 expref: 17 pid: 10219 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.681145:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.681174:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881264931072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.681180:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7543 00000100:00100000:0.0:1746065199.681191:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7544 00000100:00100000:0.0:1746065199.681195:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881264931328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.681200:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.681205:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc1476a80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c31 expref: 40 pid: 9548 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.681211:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc1476a80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c31 expref: 40 pid: 9548 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.681227:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd81200/0xad6b7ddc1476a80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c31 expref: 40 pid: 9548 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.681234:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.681236:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.681239:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc1476c16 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.681246:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc1476c16 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.681263:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.681277:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881264931328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.681281:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7544 00000100:00100000:0.0:1746065199.681290:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7545 00000100:00100000:0.0:1746065199.681294:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881264931584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.681300:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.681309:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc1476b52 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ca1 expref: 47 pid: 1880 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.681317:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc1476b52 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ca1 expref: 47 pid: 1880 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.681326:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dc400/0xad6b7ddc1476b52 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ca1 expref: 47 pid: 1880 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.681339:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.681352:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881264931584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.681357:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7545 00000100:00100000:0.0:1746065199.681387:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.681400:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264931840 00000100:00100000:0.0:1746065199.681403:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264931840 00010000:00010000:0.0:1746065199.681414:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1476b60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937caf expref: 32 pid: 3068 timeout: 895 lvb_type: 0 00000100:00100000:0.0:1746065199.681427:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7546 00000100:00100000:0.0:1746065199.681431:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2004:x1830881264931840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.681437:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.681444:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1476b60 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937caf expref: 32 pid: 3068 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.681451:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1476b60 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937caf expref: 32 pid: 3068 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.681467:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1476b60 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937caf expref: 32 pid: 3068 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.681475:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.681488:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2004:x1830881264931840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.681496:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7546 00000100:00100000:0.0:1746065199.684815:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.684830:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264931456 00000100:00100000:0.0:1746065199.684834:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264931456 00010000:00010000:0.0:1746065199.684850:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc1476aa3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c2a expref: 47 pid: 12260 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.684868:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7548 00000100:00100000:0.0:1746065199.684873:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881264931456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.684879:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.684887:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc1476aa3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c2a expref: 47 pid: 12260 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.684894:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc1476aa3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c2a expref: 47 pid: 12260 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.684913:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc1476aa3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c2a expref: 47 pid: 12260 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.684926:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.684952:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881264931456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.684958:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7548 00000100:00100000:0.0:1746065199.684983:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.684992:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264931712 00000100:00100000:0.0:1746065199.684994:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264931712 00010000:00010000:0.0:1746065199.685005:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc1476aaa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c38 expref: 39 pid: 12258 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.685017:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7549 00000100:00100000:0.0:1746065199.685021:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881264931712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.685027:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.685036:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc1476aaa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c38 expref: 39 pid: 12258 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.685044:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc1476aaa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c38 expref: 39 pid: 12258 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.685055:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46800/0xad6b7ddc1476aaa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c38 expref: 39 pid: 12258 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.685063:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.685064:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065199.685068:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb2400/0xad6b7ddc1476c08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.685075:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb2400/0xad6b7ddc1476c08 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.685094:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.685107:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881264931712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.685112:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7549 00000100:00100000:0.0:1746065199.685136:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.685145:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264931968 00000100:00100000:0.0:1746065199.685148:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264931968 00010000:00010000:0.0:1746065199.685157:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1476b91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cd9 expref: 20 pid: 10219 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.685168:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7550 00000100:00100000:0.0:1746065199.685172:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+20:2004:x1830881264931968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.685177:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.685184:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1476b91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cd9 expref: 20 pid: 10219 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.685192:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1476b91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cd9 expref: 20 pid: 10219 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.685202:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1476b91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937cd9 expref: 20 pid: 10219 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.685209:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.685222:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+19:2004:x1830881264931968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.685227:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7550 00000100:00100000:0.0:1746065199.685250:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.685258:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264932352 00000100:00100000:0.0:1746065199.685261:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264932352 00010000:00010000:0.0:1746065199.685269:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc1476b36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c85 expref: 31 pid: 1880 timeout: 895 lvb_type: 1 00000100:00100000:0.0:1746065199.685279:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7551 00000100:00100000:0.0:1746065199.685284:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2004:x1830881264932352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.685290:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.690121:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc1476b36 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c85 expref: 31 pid: 1880 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.690136:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc1476b36 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c85 expref: 31 pid: 1880 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.690154:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2cc00/0xad6b7ddc1476b36 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c85 expref: 31 pid: 1880 timeout: 895 lvb_type: 1 00010000:00010000:0.0:1746065199.690166:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.690203:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881264932352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4917us (4951us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.690211:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7551 00000100:00100000:0.0:1746065199.697313:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264933376 00000100:00100000:0.0:1746065199.697323:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264933376 00002000:00100000:0.0:1746065199.697388:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x75:0x0] (737280->741375) req@ffff88009a6dc380 x1830881264933376/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.697397:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc380 with x1830881264933376 ext(737280->741375) 00002000:00010000:0.0:1746065199.697402:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dc380 00000100:00100000:0.0:1746065199.697419:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5705 00000100:00100000:0.0:1746065199.697426:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881264933376:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065199.697543:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881264933376:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 117us (2858us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065199.697552:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5705 00002000:00100000:0.0:1746065199.697557:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x75:0x0] (737280->741375) req@ffff88009a6dc380 x1830881264933376/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.697563:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc380 with x1830881264933376 ext(737280->741375) 00002000:00010000:0.0:1746065199.697565:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dc380 00000100:00100000:0.0:1746065199.701470:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264933632 00000100:00100000:0.0:1746065199.701476:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264933632 00002000:00100000:0.0:1746065199.701517:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2908160->2912255) req@ffff88009a6dc000 x1830881264933632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.701525:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881264933632 ext(2908160->2912255) 00002000:00010000:0.0:1746065199.701529:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dc000 00000100:00100000:0.0:1746065199.701548:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5706 00000100:00100000:0.0:1746065199.701554:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881264933632:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065199.701665:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881264933632:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 111us (3971us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065199.701671:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5706 00002000:00100000:0.0:1746065199.701676:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2908160->2912255) req@ffff88009a6dc000 x1830881264933632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.701682:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881264933632 ext(2908160->2912255) 00002000:00010000:0.0:1746065199.701685:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dc000 00000100:00100000:0.0:1746065199.704474:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264934016 00000100:00100000:0.0:1746065199.704478:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264934016 00002000:00100000:0.0:1746065199.704512:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1064960->1069055) req@ffff8800996f9f80 x1830881264934016/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.704525:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f9f80 with x1830881264934016 ext(1064960->1069055) 00002000:00010000:0.0:1746065199.704529:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f9f80 00000100:00100000:0.0:1746065199.704542:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5707 00000100:00100000:0.0:1746065199.704548:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881264934016:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065199.704633:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881264934016:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 85us (353us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065199.704639:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5707 00002000:00100000:0.0:1746065199.704643:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1064960->1069055) req@ffff8800996f9f80 x1830881264934016/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.704650:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f9f80 with x1830881264934016 ext(1064960->1069055) 00002000:00010000:0.0:1746065199.704652:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f9f80 00000100:00100000:0.0:1746065199.705971:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.706669:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.723869:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.727453:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.732093:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.757173:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263812608 00000100:00100000:0.0:1746065199.757179:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263812608 00000100:00100000:0.0:1746065199.757211:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1746065199.757215:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263812608:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065199.757239:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:0.0:1746065199.757267:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263812608:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.757271:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1189 00000100:00100000:0.0:1746065199.788968:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3760:1830881263812992:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789024:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065199.789075:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3760:1830881263813504:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789092:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065199.789105:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263814016:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789121:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065199.789151:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263814016 00000100:00100000:0.0:1746065199.789157:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263814016 00000100:00100000:0.0:1746065199.789184:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263813888 00000100:00100000:0.0:1746065199.789185:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263813888 00000100:00100000:0.0:1746065199.789197:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1746065199.789202:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3760:x1830881263814016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789240:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+32:3760:x1830881263814016:12345-0@lo:400:kworker.0 Request processed in 38us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.789245:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:0.0:1746065199.789258:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1746065199.789261:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881263813888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789287:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881263813888:12345-0@lo:400:kworker.0 Request processed in 25us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.789291:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1746065199.789313:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3760:1830881263813504:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789321:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263814016:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789326:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3760:1830881263812992:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789346:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263813120:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789363:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065199.789406:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3761:1830881263813632:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789419:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065199.789428:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3761:1830881263814144:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789439:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065199.789454:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c459c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263813120:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789460:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1746065199.789464:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ceddf226-8ddf-479f-9953-8a74c62285a9:3761:1830881263812736:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789479:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065199.789496:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263813248:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789516:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065199.789525:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3761:1830881263813760:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789535:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065199.789549:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263813632 00000100:00100000:0.0:1746065199.789551:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263813632 00000100:00100000:0.0:1746065199.789563:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263814144 00000100:00100000:0.0:1746065199.789564:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263814144 00000100:00100000:0.0:1746065199.789572:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1746065199.789576:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3761:x1830881263813632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789594:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3761:x1830881263813632:12345-0@lo:400:kworker.0 Request processed in 18us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.789598:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1746065199.789605:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1746065199.789609:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3761:x1830881263813760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789622:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3761:x1830881263813760:12345-0@lo:400:kworker.0 Request processed in 13us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.789626:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:0.0:1746065199.789643:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ceddf226-8ddf-479f-9953-8a74c62285a9:3761:1830881263812736:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789651:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3761:1830881263813760:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789657:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3761:1830881263813632:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789663:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3761:1830881263814144:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.789675:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263813248:0@lo:400:kworker.0 00000100:00100000:0.0:1746065199.826601:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.831879:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.831918:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.831946:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.831964:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.832032:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.832053:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264936064 00000100:00100000:0.0:1746065199.832060:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264936064 00000100:00100000:0.0:1746065199.833516:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264936192 00000100:00100000:0.0:1746065199.833522:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264936192 00002000:00010000:0.0:1746065199.838239:0:13375:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065198 -> 1746065199 00002000:00010000:0.0:1746065199.838242:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065198 -> 1746065199 00002000:00010000:0.0:1746065199.838243:0:13375:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065198 -> 1746065199 00000100:00100000:0.0:1746065199.838251:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263814272:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065199.838264:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d857c00/0xad6b7ddc1476c8d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d34 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.838272:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d857c00/0xad6b7ddc1476c8d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d34 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.838282:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857c00, rc 0) 00000100:00100000:0.0:1746065199.838300:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881264936064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4624us (6430us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065199.838304:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16455 00000100:00100000:0.0:1746065199.839638:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263814784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065199.839675:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065199.839706:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263814784 00000100:00100000:0.0:1746065199.839710:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263814784 00000100:00100000:0.0:1746065199.839736:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1746065199.839741:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881263814784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746065199.839762:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445584896 avail 1316122624 00000100:00100000:0.0:1746065199.839806:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881263814784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 65us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.839811:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:0.0:1746065199.840304:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263814784:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065199.849937:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.856876:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.860357:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.871194:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14340 00000100:00100000:0.0:1746065199.871200:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+36:1901:x1830881264937472:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065199.871214:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.871229:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be200/0xad6b7ddc1476cef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937d65 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.871294:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc1476cf6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871306:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc1476cf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871315:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc1476cf6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871324:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc1476cfd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871330:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc1476cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871334:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc1476cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871412:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc1476d04 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871421:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc1476d04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871427:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc1476d04 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065199.871433:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00010000:00010000:0.0:1746065199.871495:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc1476cf6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871509:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc1476cf6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871518:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc1476cf6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871523:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc1476cf6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871528:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bfa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065199.871531:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc1476cf6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871537:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc1476cf6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871547:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065199.871549:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065199.871552:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc1476cf6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871557:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc1476cf6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871577:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc1476cfd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871581:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc1476cfd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871585:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc1476cfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871589:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065199.871591:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc1476cfd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871599:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc1476cfd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871603:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5700) 00010000:00010000:0.0:1746065199.871605:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065199.871607:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc1476cfd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871610:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc1476cfd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065199.871635:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be200/0xad6b7ddc1476cef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d65 expref: 39 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.871643:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc1476d04 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d65 expref: 38 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.871648:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065199.871650:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065199.871651:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf200, rc 0) 00000100:00100000:0.0:1746065199.871685:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+38:1901:x1830881264937472:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 485us (631us total) trans 8589936779 rc 0/0 00000100:00100000:0.0:1746065199.871689:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14340 00000100:00100000:0.0:1746065199.885035:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065199.885057:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263815168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065199.885111:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065199.886315:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263815168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065199.890402:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.898756:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.921652:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.921702:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065199.922348:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc1476c94 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d3b expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.922360:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.922361:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.922364:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1476d43 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1114112->1568767] (req 1114112->1568767) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d7a expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.922380:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc1476c94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d3b expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.922388:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d857600/0xad6b7ddc1476c94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d3b expref: 12 pid: 3067 timeout: 895 lvb_type: 1 00000100:00100000:1.0:1746065199.922396:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263815424:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065199.922420:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.924033:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.924947:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.924963:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264938752 00000100:00100000:0.0:1746065199.924966:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264938752 00002000:00100000:0.0:1746065199.924987:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1269760->1273855) req@ffff880097a6ca80 x1830881264938752/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.924995:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ca80 with x1830881264938752 ext(1269760->1273855) 00002000:00010000:0.0:1746065199.924999:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6ca80 00000100:00100000:0.0:1746065199.925019:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5710 00000100:00100000:0.0:1746065199.925024:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881264938752:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065199.926466:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881264938752:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 1441us (1519us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065199.926473:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5710 00002000:00100000:0.0:1746065199.926480:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1269760->1273855) req@ffff880097a6ca80 x1830881264938752/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.926487:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ca80 with x1830881264938752 ext(1269760->1273855) 00002000:00010000:0.0:1746065199.926490:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6ca80 00000100:00100000:0.0:1746065199.926536:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.931864:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264939264 00000100:00100000:0.0:1746065199.931872:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264939264 00000100:00100000:0.0:1746065199.931913:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 809 00000100:00100000:0.0:1746065199.931920:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881264939264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065199.931934:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065199.931954:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc1476d27 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d6c expref: 21 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065199.932563:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065199.932566:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065199.932585:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881264939264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 665us (2820us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065199.932591:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 809 00000100:00100000:0.0:1746065199.932632:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.934302:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.934326:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.934338:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.934350:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.934896:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.934911:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264939776 00000100:00100000:0.0:1746065199.934914:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264939776 00000100:00100000:0.0:1746065199.934934:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264940032 00000100:00100000:0.0:1746065199.934936:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264940032 00000100:00100000:0.0:1746065199.934945:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264940288 00000100:00100000:0.0:1746065199.934947:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264940288 00000100:00100000:0.0:1746065199.935095:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264940160 00000100:00100000:0.0:1746065199.935098:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264940160 00000100:00100000:1.0:1746065199.935122:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16462 00000100:00100000:1.0:1746065199.935129:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881264939776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065199.935138:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.935151:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc1476d6d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937d88 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065199.935190:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263815680:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065199.935229:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065199.935248:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16463 00000100:00100000:1.0:1746065199.935253:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881264940032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065199.935259:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.935269:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1476d74 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937d8f expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065199.935293:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263815808:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065199.935312:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.935427:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16464 00000100:00100000:0.0:1746065199.935433:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881264940288:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065199.935439:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.935446:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1476d7b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937d9d expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065199.935473:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263815936:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065199.935494:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.936666:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.936689:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065199.936914:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264940416 00000100:00100000:1.0:1746065199.936919:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264940416 00000100:00100000:1.0:1746065199.936940:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16466 00000100:00100000:1.0:1746065199.936945:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881264940416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065199.936952:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.936961:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009580e600/0xad6b7ddc1476d89 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937dab expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065199.936973:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.936975:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065199.936981:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009580e600/0xad6b7ddc1476d89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dab expref: 48 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.936992:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009580e600/0xad6b7ddc1476d89 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dab expref: 48 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.936999:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e600, rc 0) 00000100:00100000:1.0:1746065199.937737:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881264940416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 791us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065199.937743:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16466 00000100:00100000:0.0:1746065199.939667:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.939693:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.939706:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:0.0:1746065199.939815:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065199 -> 1746065200 00002000:00010000:0.0:1746065199.939819:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065198 -> 1746065199 00002000:00010000:0.0:1746065199.939821:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065199 -> 1746065200 00000100:00100000:0.0:1746065199.939834:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263815936:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065199.939855:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1476d7b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d9d expref: 19 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.939867:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1476d7b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d9d expref: 19 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.939880:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66a00, rc 0) 00000100:00100000:0.0:1746065199.939906:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881264940288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4473us (5555us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065199.939912:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16464 00000100:00100000:0.0:1746065199.939929:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264940928 00000100:00100000:0.0:1746065199.939933:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264940928 00000100:00100000:0.0:1746065199.939995:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264941056 00000100:00100000:0.0:1746065199.939998:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264941056 00000100:00100000:0.0:1746065199.940011:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16468 00000100:00100000:0.0:1746065199.940016:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2005:x1830881264940928:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065199.940027:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.940035:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc1476d97 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937db2 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065199.940067:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263816192:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065199.940104:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092854a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.940121:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16469 00000100:00100000:0.0:1746065199.940126:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881264941056:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065199.940132:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.940138:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f66400/0xad6b7ddc1476d9e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937db9 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065199.940155:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263816320:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065199.940173:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.940191:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065199.943095:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264940800 00000100:00100000:1.0:1746065199.943107:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264940800 00002000:00100000:1.0:1746065199.943147:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1114112->1118207) req@ffff88013615d180 x1830881264940800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.943156:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615d180 with x1830881264940800 ext(1114112->1118207) 00002000:00010000:1.0:1746065199.943160:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615d180 00000100:00100000:0.0:1746065199.943521:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065199.943548:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5711 00000100:00100000:1.0:1746065199.943556:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881264940800:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065199.943662:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881264940800:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 107us (4001us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065199.943668:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5711 00002000:00100000:1.0:1746065199.943673:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1114112->1118207) req@ffff88013615d180 x1830881264940800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065199.943680:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615d180 with x1830881264940800 ext(1114112->1118207) 00002000:00010000:1.0:1746065199.943683:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615d180 00000100:00100000:0.0:1746065199.944647:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264941440 00000100:00100000:0.0:1746065199.944652:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264941440 00000100:00100000:0.0:1746065199.944671:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16471 00000100:00100000:0.0:1746065199.944676:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881264941440:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065199.944683:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.944692:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc1476dac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937dce expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065199.944718:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263816576:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065199.944744:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065199.944789:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065199.945095:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264941696 00000100:00100000:1.0:1746065199.945099:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264941696 00000100:00100000:1.0:1746065199.945115:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16472 00000100:00100000:1.0:1746065199.945119:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881264941696:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065199.945125:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065199.945130:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1476db3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937ddc expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065199.945149:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263816704:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065199.945172:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00002000:00010000:1.0:1746065199.945200:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065199 -> 1746065200 00002000:00010000:1.0:1746065199.945203:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065199 -> 1746065200 00000100:00100000:1.0:1746065199.945214:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263815808:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065199.945230:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1476d74 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d8f expref: 41 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.945239:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3800/0xad6b7ddc1476d74 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d8f expref: 41 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.945250:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3800, rc 0) 00000100:00100000:1.0:1746065199.945266:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881264940032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10013us (10926us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065199.945271:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16463 00002000:00010000:1.0:1746065199.945299:0:13375:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime: 1746065199 -> 1746065200 00002000:00010000:1.0:1746065199.945301:0:13375:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime: 1746065199 -> 1746065200 00000100:00100000:1.0:1746065199.945309:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263815680:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065199.945322:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc1476d6d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d88 expref: 47 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.945329:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2000/0xad6b7ddc1476d6d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d88 expref: 47 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.945336:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2000, rc 0) 00000100:00100000:1.0:1746065199.945350:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881264939776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10222us (11023us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065199.945354:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16462 00000100:00100000:0.0:1746065199.945410:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.945439:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.945485:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263816064:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065199.945507:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1476d82 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d96 expref: 39 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.945515:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1476d82 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d96 expref: 39 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.945521:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488400, rc 0) 00000100:00100000:0.0:1746065199.945534:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881264940160:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9870us (10639us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065199.945539:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16465 00000100:00100000:0.0:1746065199.945547:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264941312 00000100:00100000:0.0:1746065199.945549:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264941312 00000100:00100000:0.0:1746065199.945557:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264941568 00000100:00100000:0.0:1746065199.945558:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264941568 00000100:00100000:0.0:1746065199.945566:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16473 00000100:00100000:0.0:1746065199.945569:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+16:2005:x1830881264941312:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065199.945574:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065199.945579:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1476dba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937dc7 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065199.945599:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263816832:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065199.945613:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435240 going to sleep for 11 seconds 00002000:00010000:1.0:1746065199.947419:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746065199 -> 1746065200 00002000:00010000:1.0:1746065199.947421:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746065199 -> 1746065200 00000100:00100000:1.0:1746065199.947430:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263816704:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065199.947441:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1476db3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ddc expref: 17 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.947448:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc1476db3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ddc expref: 17 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065199.947454:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fa00, rc 0) 00000100:00100000:1.0:1746065199.947467:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+16:2005:x1830881264941696:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2348us (2678us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065199.947471:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16472 00002000:00010000:0.0:1746065199.948905:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746065199 -> 1746065200 00002000:00010000:0.0:1746065199.948908:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746065199 -> 1746065200 00000100:00100000:0.0:1746065199.948916:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263816192:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065199.948933:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc1476d97 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937db2 expref: 32 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.948941:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f67e00/0xad6b7ddc1476d97 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937db2 expref: 32 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.948947:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67e00, rc 0) 00000100:00100000:0.0:1746065199.948976:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2005:x1830881264940928:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8960us (9282us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065199.948981:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16468 00000100:00100000:0.0:1746065199.949011:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263816320:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065199.949023:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f66400/0xad6b7ddc1476d9e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937db9 expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.949031:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f66400/0xad6b7ddc1476d9e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937db9 expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.949036:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66400, rc 0) 00000100:00100000:0.0:1746065199.949049:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881264941056:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8924us (9343us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065199.949055:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16469 00000100:00100000:0.0:1746065199.949077:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263816576:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065199.949088:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc1476dac lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dce expref: 15 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.949095:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc1476dac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dce expref: 15 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.949100:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44c00, rc 0) 00000100:00100000:0.0:1746065199.949110:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881264941440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4434us (5591us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065199.949113:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16471 00000100:00100000:0.0:1746065199.949573:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263816832:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065199.949586:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1476dba lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dc7 expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.949594:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1476dba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dc7 expref: 13 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065199.949600:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c800, rc 0) 00000100:00100000:0.0:1746065199.949617:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881264941312:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4048us (4208us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065199.949623:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16473 00000100:00100000:0.0:1746065199.951027:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.960150:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264942080 00000100:00100000:0.0:1746065199.960155:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264942080 00002000:00100000:0.0:1746065199.960182:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1564672->1568767) req@ffff8800996faa00 x1830881264942080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.960190:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996faa00 with x1830881264942080 ext(1564672->1568767) 00002000:00010000:0.0:1746065199.960193:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996faa00 00000100:00100000:0.0:1746065199.960213:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264942208 00000100:00100000:0.0:1746065199.960215:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264942208 00002000:00100000:0.0:1746065199.960224:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x75:0x0] (737280->1048575) req@ffff8800996f8a80 x1830881264942208/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:115/0 lens 488/0 e 0 to 0 dl 1746065210 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.960229:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f8a80 with x1830881264942208 ext(737280->1048575) 00010000:00010000:0.0:1746065199.960234:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc1476c55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d0a expref: 31 pid: 3068 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.960245:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc1476c55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d0a expref: 31 pid: 3068 timeout: 895 lvb_type: 0 00002000:00010000:0.0:1746065199.960249:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800996f8a80 00000100:00100000:0.0:1746065199.960263:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1888 00000100:00100000:0.0:1746065199.960268:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2007:x1830881264942208:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065199.960356:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5712 00000100:00100000:0.0:1746065199.960360:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881264942080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065199.960440:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881264942080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 79us (1112us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065199.960445:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5712 00002000:00100000:0.0:1746065199.960449:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1564672->1568767) req@ffff8800996faa00 x1830881264942080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:115/0 lens 488/4536 e 0 to 0 dl 1746065210 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.960456:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996faa00 with x1830881264942080 ext(1564672->1568767) 00002000:00010000:0.0:1746065199.960459:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996faa00 00000100:00100000:0.0:1746065199.962318:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.969381:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2007:x1830881264942208:12345-192.168.202.27@tcp:4:cat.0 Request processed in 9110us (9489us total) trans 17179874109 rc 0/0 00000100:00100000:0.0:1746065199.969389:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1888 00002000:00100000:0.0:1746065199.969398:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (737280->1048575) req@ffff8800996f8a80 x1830881264942208/t17179874109(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:115/0 lens 488/448 e 0 to 0 dl 1746065210 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065199.969406:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f8a80 with x1830881264942208 ext(737280->1048575) 00010000:00010000:0.0:1746065199.969414:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc1476c55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d0a expref: 33 pid: 3068 timeout: 895 lvb_type: 0 00010000:00010000:0.0:1746065199.969425:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc1476c55 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 737280->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d0a expref: 33 pid: 3068 timeout: 895 lvb_type: 0 00002000:00010000:0.0:1746065199.969431:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800996f8a80 00000100:00100000:0.0:1746065199.976581:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.977280:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065199.996564:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.000263:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264943744 00000100:00100000:0.0:1746065200.000267:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264943744 00000100:00100000:1.0:1746065200.001284:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16476 00000100:00100000:1.0:1746065200.001296:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:1904:x1830881264943744:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065200.001311:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065200.001325:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb2200/0xad6b7ddc1476ddd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937df1 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.001350:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1476d43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1568767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d7a expref: 37 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.001357:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065200.001359:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065200.001362:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb2200/0xad6b7ddc1476ddd lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937df1 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.001383:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1476d43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1568767) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d7a expref: 37 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.001397:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1476d43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1114112->1568767) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d7a expref: 37 pid: 12260 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065200.001407:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263817344:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065200.001469:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065200.003857:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263817344:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065200.003878:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb2200/0xad6b7ddc1476ddd lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937df1 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.003891:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2200, rc 0) 00000100:00100000:1.0:1746065200.004044:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:1904:x1830881264943744:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2750us (4304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.004051:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16476 00000100:00100000:0.0:1746065200.006314:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.006359:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.025879:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.034915:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264944384 00000100:00100000:1.0:1746065200.034922:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264944384 00000100:00100000:1.0:1746065200.035457:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16477 00000100:00100000:1.0:1746065200.035464:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+39:1908:x1830881264944384:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065200.035480:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065200.035494:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1476de4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937df8 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.035529:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc1476c63 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d18 expref: 18 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.035540:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065200.035541:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065200.035544:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1476de4 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937df8 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.035566:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc1476c63 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d18 expref: 18 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.035576:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc1476c63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d18 expref: 18 pid: 12260 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065200.035585:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263817600:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065200.035645:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065200.038830:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263817600:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065200.038858:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1476de4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937df8 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.038875:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3600, rc 0) 00000100:00100000:1.0:1746065200.038920:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:1908:x1830881264944384:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3456us (4197us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.038929:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16477 00000100:00100000:0.0:1746065200.039088:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.039128:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.039162:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.039848:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1891 00000100:00100000:1.0:1746065200.039857:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881264945024:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065200.039991:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5716 00000100:00100000:0.0:1746065200.040001:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2004:x1830881264944896:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065200.057737:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881264945024:12345-192.168.202.27@tcp:4:cat.0 Request processed in 17872us (18566us total) trans 21474841526 rc 0/0 00000100:00100000:1.0:1746065200.057753:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1891 00002000:00100000:1.0:1746065200.057764:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1273855) req@ffff88009077d880 x1830881264945024/t21474841526(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:116/0 lens 504/448 e 0 to 0 dl 1746065211 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.057799:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d880 with x1830881264945024 ext(1048576->1273855) 00010000:00010000:1.0:1746065200.057809:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc1476c63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d18 expref: 23 pid: 12260 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.058144:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880091bae600/0xad6b7ddc1476c63 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1069055) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d18 expref: 23 pid: 12260 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746065200.058151:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009077d880 00000100:00100000:0.0:1746065200.066055:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.067040:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2004:x1830881264944896:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27039us (27912us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065200.067048:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5716 00002000:00100000:0.0:1746065200.067055:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009077c700 x1830881264944896/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:116/0 lens 488/440 e 0 to 0 dl 1746065211 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065200.067063:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c700 with x1830881264944896 ext(1048576->2097151) 00002000:00010000:0.0:1746065200.067066:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077c700 00000100:00100000:0.0:1746065200.073080:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264945664 00000100:00100000:0.0:1746065200.073084:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264945664 00000100:00100000:0.0:1746065200.073113:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16478 00000100:00100000:0.0:1746065200.073121:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2006:x1830881264945280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065200.073136:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065200.073149:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1476deb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937dff expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.073168:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065200.073170:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065200.073177:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1476deb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dff expref: 34 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.073189:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1476deb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dff expref: 34 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.073198:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7acc00, rc 0) 00000100:00100000:0.0:1746065200.073228:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:2006:x1830881264945280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 108us (1759us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065200.073232:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16478 00000100:00100000:0.0:1746065200.073243:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16479 00000100:00100000:0.0:1746065200.073248:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881264945408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065200.073255:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065200.073263:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1476df2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937e06 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.073272:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065200.073273:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065200.073278:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1476df2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e06 expref: 22 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.073286:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1476df2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e06 expref: 22 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.073292:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad200, rc 0) 00000100:00100000:0.0:1746065200.073308:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881264945408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 60us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065200.073313:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16479 00000100:00100000:0.0:1746065200.073323:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16480 00000100:00100000:0.0:1746065200.073328:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2007:x1830881264945536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065200.073336:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065200.073342:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad600/0xad6b7ddc1476df9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937e0d expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065200.073373:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263817856:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065200.073410:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065200.073511:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16481 00000100:00100000:0.0:1746065200.073517:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881264945664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065200.073523:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065200.073530:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1476e00 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937e14 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065200.073550:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263817984:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065200.073573:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065200.075494:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264945920 00000100:00100000:0.0:1746065200.075509:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264945920 00002000:00100000:0.0:1746065200.075545:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88012f09d880 x1830881264945920/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:116/0 lens 488/0 e 0 to 0 dl 1746065211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065200.075553:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d880 with x1830881264945920 ext(1048576->2097151) 00002000:00010000:0.0:1746065200.075558:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09d880 00000100:00100000:0.0:1746065200.076262:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5717 00000100:00100000:0.0:1746065200.076270:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881264945920:12345-192.168.202.27@tcp:3:cat.0 00002000:00010000:1.0:1746065200.081699:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065199 -> 1746065200 00000100:00100000:1.0:1746065200.081714:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263817984:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065200.081730:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1476e00 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e14 expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.081740:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc1476e00 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e14 expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.082146:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac200, rc 0) 00000100:00100000:1.0:1746065200.082170:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881264945664:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8653us (10116us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065200.082176:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16481 00000100:00100000:0.0:1746065200.087045:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.087142:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264946048 00000100:00100000:1.0:1746065200.087151:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264946048 00000100:00100000:1.0:1746065200.087197:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16482 00000100:00100000:1.0:1746065200.087204:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:1904:x1830881264946048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065200.087218:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065200.087233:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1476e07 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937e1b expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.087257:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f0a0800/0xad6b7ddc1476c6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3207167) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d1f expref: 46 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.087264:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065200.087266:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065200.087269:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1476e07 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e1b expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.087293:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f0a0800/0xad6b7ddc1476c6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3207167) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d1f expref: 46 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.087302:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f0a0800/0xad6b7ddc1476c6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3207167) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d1f expref: 46 pid: 1880 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065200.087312:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263818112:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065200.087669:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065200.094520:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263818112:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065200.094547:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1476e07 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e1b expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.094563:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c200, rc 0) 00000100:00100000:1.0:1746065200.094997:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:1904:x1830881264946048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7791us (7957us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.095005:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16482 00000100:00100000:0.0:1746065200.097100:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.102739:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.102893:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264946304 00000100:00100000:0.0:1746065200.102901:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264946304 00000100:00100000:0.0:1746065200.102938:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16483 00000100:00100000:0.0:1746065200.102944:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+40:1908:x1830881264946304:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065200.102959:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065200.102973:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc1476e0e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937e22 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.102993:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065200.102995:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065200.103002:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc1476e0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e22 expref: 41 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.103014:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc1476e0e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e22 expref: 41 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.103023:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856200, rc 0) 00000100:00100000:0.0:1746065200.103057:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+41:1908:x1830881264946304:12345-192.168.202.27@tcp:101:cat.0 Request processed in 113us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065200.103063:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16483 00000100:00100000:0.0:1746065200.104982:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.107324:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.109797:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.113021:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.113426:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.113956:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264947072 00000100:00100000:1.0:1746065200.113961:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264947072 00002000:00100000:1.0:1746065200.113988:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88008f7ff800 x1830881264947072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:116/0 lens 488/0 e 0 to 0 dl 1746065211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.113996:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff800 with x1830881264947072 ext(1048576->2097151) 00002000:00010000:1.0:1746065200.113999:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7ff800 00000100:00100000:1.0:1746065200.114013:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264947328 00000100:00100000:1.0:1746065200.114015:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264947328 00002000:00100000:1.0:1746065200.114023:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f7fdf80 x1830881264947328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:116/0 lens 488/0 e 0 to 0 dl 1746065211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.114029:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fdf80 with x1830881264947328 ext(1048576->2097151) 00010000:00010000:1.0:1746065200.114033:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009580e600/0xad6b7ddc1476d89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dab expref: 49 pid: 10219 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.114042:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009580e600/0xad6b7ddc1476d89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dab expref: 49 pid: 10219 timeout: 896 lvb_type: 1 00002000:00010000:1.0:1746065200.114046:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7fdf80 00000100:00100000:1.0:1746065200.114054:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1893 00000100:00100000:1.0:1746065200.114058:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881264947328:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065200.114527:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.118699:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.120132:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.120467:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7564 00000100:00100000:0.0:1746065200.120473:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+36:2004:x1830881264947840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065200.120480:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065200.120488:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc1476d90 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937da4 expref: 36 pid: 12260 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065200.120505:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc1476d90 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937da4 expref: 36 pid: 12260 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065200.120517:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc1476d90 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937da4 expref: 36 pid: 12260 timeout: 896 lvb_type: 1 00010000:00010000:0.0:1746065200.120538:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065200.120572:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+35:2004:x1830881264947840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065200.120578:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7564 00000100:00100000:0.0:1746065200.134814:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.136513:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881264947328:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 22453us (23086us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065200.136521:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1893 00002000:00100000:1.0:1746065200.136528:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f7fdf80 x1830881264947328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:116/0 lens 488/440 e 0 to 0 dl 1746065211 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.136537:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fdf80 with x1830881264947328 ext(1048576->2097151) 00010000:00010000:1.0:1746065200.136543:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009580e600/0xad6b7ddc1476d89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dab expref: 50 pid: 10219 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.136554:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009580e600/0xad6b7ddc1476d89 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dab expref: 50 pid: 10219 timeout: 896 lvb_type: 1 00002000:00010000:1.0:1746065200.136560:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7fdf80 00000100:00100000:0.0:1746065200.141745:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.150643:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.151932:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.161866:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.162528:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.162866:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1895 00000100:00100000:1.0:1746065200.162873:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2007:x1830881264948736:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065200.162968:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2007:x1830881264948736:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 96us (440us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065200.162973:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1895 00002000:00100000:1.0:1746065200.162977:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1105920->1110015) req@ffff880091bc0a80 x1830881264948736/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:116/0 lens 488/4536 e 0 to 0 dl 1746065211 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.162984:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc0a80 with x1830881264948736 ext(1105920->1110015) 00010000:00010000:1.0:1746065200.162989:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476e38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1110015) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e30 expref: 49 pid: 3067 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.163001:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476e38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1110015) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e30 expref: 49 pid: 3067 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746065200.163006:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bc0a80 00000100:00100000:0.0:1746065200.166150:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.166179:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.166218:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.166240:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264949632 00000100:00100000:0.0:1746065200.166243:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264949632 00000100:00100000:1.0:1746065200.166246:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264949120 00000100:00100000:1.0:1746065200.166250:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264949120 00002000:00100000:1.0:1746065200.166270:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2908160->3145727) req@ffff880099cf1500 x1830881264949120/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:116/0 lens 488/0 e 0 to 0 dl 1746065211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746065200.166273:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5315 00002000:00100000:1.0:1746065200.166277:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1500 with x1830881264949120 ext(2908160->3145727) 00000100:00100000:0.0:1746065200.166279:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b20ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+42:1913:x1830881264949632:12345-192.168.202.27@tcp:35:multiop.0 00010000:00010000:1.0:1746065200.166283:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1476c5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d11 expref: 41 pid: 11461 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.166292:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1476c5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d11 expref: 41 pid: 11461 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746065200.166297:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cf1500 00000100:00100000:1.0:1746065200.166307:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264949376 00000100:00100000:1.0:1746065200.166308:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264949376 00002000:00100000:1.0:1746065200.166316:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1085440->1110015) req@ffff880099cf3800 x1830881264949376/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:116/0 lens 488/0 e 0 to 0 dl 1746065211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.166321:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3800 with x1830881264949376 ext(1085440->1110015) 00010000:00010000:1.0:1746065200.166325:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476e38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1110015) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e30 expref: 49 pid: 3067 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.166332:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476e38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1110015) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e30 expref: 49 pid: 3067 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746065200.166337:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cf3800 00000100:00100000:1.0:1746065200.166345:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1896 00000100:00100000:1.0:1746065200.166349:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881264949120:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065200.166386:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b20ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+43:1913:x1830881264949632:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 106us (167us total) trans 8589936788 rc 0/0 00000100:00100000:0.0:1746065200.166393:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5315 00000100:00100000:0.0:1746065200.175956:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881264949120:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 9596us (9797us total) trans 21474841527 rc 0/0 00000100:00100000:0.0:1746065200.175967:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1896 00002000:00100000:0.0:1746065200.175978:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2908160->3145727) req@ffff880099cf1500 x1830881264949120/t21474841527(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:116/0 lens 488/448 e 0 to 0 dl 1746065211 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065200.175986:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1500 with x1830881264949120 ext(2908160->3145727) 00010000:00010000:0.0:1746065200.175995:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1476c5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d11 expref: 43 pid: 11461 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065200.176005:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1476c5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2908160->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d11 expref: 43 pid: 11461 timeout: 896 lvb_type: 0 00002000:00010000:0.0:1746065200.176010:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cf1500 00000100:00100000:0.0:1746065200.178060:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.178997:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881264949376:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 12586us (12815us total) trans 17179874111 rc 0/0 00000100:00100000:1.0:1746065200.179007:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1897 00002000:00100000:1.0:1746065200.179015:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1085440->1110015) req@ffff880099cf3800 x1830881264949376/t17179874111(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:116/0 lens 488/448 e 0 to 0 dl 1746065211 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.179023:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3800 with x1830881264949376 ext(1085440->1110015) 00010000:00010000:1.0:1746065200.179032:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476e38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1110015) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e30 expref: 51 pid: 3067 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.179043:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476e38 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1085440->1110015) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e30 expref: 51 pid: 3067 timeout: 896 lvb_type: 0 00002000:00010000:1.0:1746065200.179048:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cf3800 00000100:00100000:0.0:1746065200.185846:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.191645:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.191693:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.191886:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264950272 00000100:00100000:1.0:1746065200.191893:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264950272 00002000:00100000:1.0:1746065200.191929:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880099cf0a80 x1830881264950272/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:116/0 lens 488/0 e 0 to 0 dl 1746065211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.191939:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0a80 with x1830881264950272 ext(2097152->4194303) 00002000:00010000:1.0:1746065200.191943:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0a80 00000100:00100000:1.0:1746065200.191977:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264950656 00000100:00100000:1.0:1746065200.191980:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264950656 00002000:00100000:1.0:1746065200.191991:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880099cf3b80 x1830881264950656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:116/0 lens 488/0 e 0 to 0 dl 1746065211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.191997:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3b80 with x1830881264950656 ext(1048576->2097151) 00002000:00010000:1.0:1746065200.191999:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf3b80 00000100:00100000:1.0:1746065200.192010:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5720 00000100:00100000:1.0:1746065200.192015:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881264950272:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065200.195306:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.201121:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264950400 00000100:00100000:1.0:1746065200.201132:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264950400 00002000:00100000:1.0:1746065200.201172:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009aba4e00 x1830881264950400/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:116/0 lens 488/0 e 0 to 0 dl 1746065211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.201181:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba4e00 with x1830881264950400 ext(3145728->4194303) 00002000:00010000:1.0:1746065200.201185:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aba4e00 00000100:00100000:1.0:1746065200.201208:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5722 00000100:00100000:1.0:1746065200.201213:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2004:x1830881264950400:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065200.210201:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.216461:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881264950272:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24437us (24816us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065200.216473:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5720 00002000:00100000:1.0:1746065200.216483:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880099cf0a80 x1830881264950272/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:116/0 lens 488/440 e 0 to 0 dl 1746065211 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.216492:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0a80 with x1830881264950272 ext(2097152->4194303) 00002000:00010000:1.0:1746065200.216508:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0a80 00000100:00100000:0.0:1746065200.219484:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.224908:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.230387:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.230553:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2004:x1830881264950400:12345-192.168.202.27@tcp:3:cat.0 Request processed in 29338us (35261us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065200.230565:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5722 00002000:00100000:1.0:1746065200.230573:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009aba4e00 x1830881264950400/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:116/0 lens 488/440 e 0 to 0 dl 1746065211 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.230582:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba4e00 with x1830881264950400 ext(3145728->4194303) 00002000:00010000:1.0:1746065200.230586:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aba4e00 00000100:00100000:1.0:1746065200.230601:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264951296 00000100:00100000:1.0:1746065200.230605:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264951296 00002000:00100000:1.0:1746065200.230627:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1224704->1228799) req@ffff880099e11180 x1830881264951296/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:116/0 lens 488/0 e 0 to 0 dl 1746065211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.230633:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11180 with x1830881264951296 ext(1224704->1228799) 00002000:00010000:1.0:1746065200.230635:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e11180 00000100:00100000:1.0:1746065200.230646:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5723 00000100:00100000:1.0:1746065200.230651:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881264951296:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065200.230729:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881264951296:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 78us (346us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065200.230734:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5723 00002000:00100000:1.0:1746065200.230738:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1224704->1228799) req@ffff880099e11180 x1830881264951296/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:116/0 lens 488/4536 e 0 to 0 dl 1746065211 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065200.230745:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11180 with x1830881264951296 ext(1224704->1228799) 00002000:00010000:1.0:1746065200.230747:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e11180 00000100:00100000:0.0:1746065200.239505:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.239537:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.239561:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.239586:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.239614:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.242953:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.250332:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.256029:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.256074:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.308238:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.308486:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.313096:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.313115:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.314636:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7571 00000100:00100000:1.0:1746065200.314643:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881264953600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.314652:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.314656:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1476e62 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e45 expref: 24 pid: 9571 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.314663:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1476e62 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e45 expref: 24 pid: 9571 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.314673:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1476e62 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e45 expref: 24 pid: 9571 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.314687:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065200.314689:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc1476e9a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.314695:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc1476e9a lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.314699:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065200.314956:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.315421:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881264953600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 777us (2304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.315426:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7571 00000100:00100000:0.0:1746065200.320986:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.356155:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.372505:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.373237:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.373329:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264954496 00000100:00100000:0.0:1746065200.373332:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264954496 00000100:00100000:0.0:1746065200.373361:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16495 00000100:00100000:0.0:1746065200.373366:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881264954496:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065200.373372:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065200.373378:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc1476ebd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937e8b expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065200.373402:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263820800:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065200.373437:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065200.375210:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.375243:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.375309:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263820800:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065200.375326:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc1476ebd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e8b expref: 44 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.375336:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc1476ebd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e8b expref: 44 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.375360:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00000, rc 0) 00000100:00100000:0.0:1746065200.375383:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881264954496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2016us (2146us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065200.375390:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16495 00000100:00100000:1.0:1746065200.375564:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264954624 00000100:00100000:1.0:1746065200.375568:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264954624 00010000:00010000:1.0:1746065200.375588:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1476df2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e06 expref: 22 pid: 3067 timeout: 896 lvb_type: 1 00000100:00100000:1.0:1746065200.375604:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264954752 00000100:00100000:1.0:1746065200.375605:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264954752 00010000:00010000:1.0:1746065200.375612:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1476de4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937df8 expref: 43 pid: 1880 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065200.375622:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7573 00000100:00100000:1.0:1746065200.375627:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881264954624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.375641:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.375649:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1476df2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e06 expref: 22 pid: 3067 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.375657:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1476df2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e06 expref: 22 pid: 3067 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.375673:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1476df2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e06 expref: 22 pid: 3067 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.375683:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.375703:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881264954624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 76us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.375707:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7573 00000100:00100000:1.0:1746065200.375716:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7574 00000100:00100000:1.0:1746065200.375719:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881264954752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.375724:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.375729:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1476de4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937df8 expref: 43 pid: 1880 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.375736:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1476de4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937df8 expref: 43 pid: 1880 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.375745:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1476de4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937df8 expref: 43 pid: 1880 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.375751:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065200.375753:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065200.375758:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc1476eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1888255) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e84 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.375765:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc1476eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1888255) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e84 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.375801:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc1476eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1888255) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e84 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065200.375810:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263820928:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065200.375844:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065200.376955:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263820928:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065200.376966:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.376985:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881264954752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1264us (1742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.376992:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7574 00000100:00100000:0.0:1746065200.377454:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.381674:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.383708:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.423355:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.436405:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264955904 00000100:00100000:0.0:1746065200.436414:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264955904 00002000:00100000:0.0:1746065200.436450:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012f09f480 x1830881264955904/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:116/0 lens 488/0 e 0 to 0 dl 1746065211 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065200.436460:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f480 with x1830881264955904 ext(0->1048575) 00002000:00010000:0.0:1746065200.436466:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09f480 00000100:00100000:0.0:1746065200.436504:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5731 00000100:00100000:0.0:1746065200.436511:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:2005:x1830881264955904:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065200.455728:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.462354:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.473318:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264956416 00000100:00100000:0.0:1746065200.473327:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264956416 00000100:00100000:0.0:1746065200.473376:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14348 00000100:00100000:0.0:1746065200.473383:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:1927:x1830881264956416:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065200.473401:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065200.473416:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476ed2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937ea0 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.473503:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476ed9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.473516:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.473525:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476ed9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065200.473534:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00010000:00010000:0.0:1746065200.473603:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476ed2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea0 expref: 26 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.473628:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea0 expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.473634:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065200.473636:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065200.473639:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30a00, rc 0) 00000100:00100000:0.0:1746065200.473682:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:1927:x1830881264956416:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 299us (401us total) trans 8589936792 rc 0/0 00000100:00100000:0.0:1746065200.473688:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14348 00000100:00100000:0.0:1746065200.474383:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881264956160:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11071us (12033us total) trans 21474841528 rc 0/0 00000100:00100000:0.0:1746065200.474391:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1898 00002000:00100000:0.0:1746065200.474399:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1413120->1888255) req@ffff8800907bc700 x1830881264956160/t21474841528(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:116/0 lens 488/448 e 0 to 0 dl 1746065211 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065200.474407:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bc700 with x1830881264956160 ext(1413120->1888255) 00010000:00010000:0.0:1746065200.474413:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc1476eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e84 expref: 44 pid: 12260 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065200.474423:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc1476eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e84 expref: 44 pid: 12260 timeout: 896 lvb_type: 0 00002000:00010000:0.0:1746065200.474429:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800907bc700 00000100:00100000:0.0:1746065200.490763:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.490841:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264956544 00000100:00100000:1.0:1746065200.490850:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264956544 00010000:00010000:1.0:1746065200.490881:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc1476eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1413120->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e84 expref: 20 pid: 12260 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065200.490926:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7575 00000100:00100000:1.0:1746065200.490933:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881264956544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.490944:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.490958:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc1476eb6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->1888255) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e84 expref: 20 pid: 12260 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.490968:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc1476eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->1888255) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e84 expref: 20 pid: 12260 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.490986:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131047800/0xad6b7ddc1476eb6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1413120->1888255) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e84 expref: 20 pid: 12260 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.491015:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065200.491017:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065200.491130:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.491148:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264956672 00000100:00100000:0.0:1746065200.491152:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264956672 00000100:00100000:0.0:1746065200.491177:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14349 00000100:00100000:0.0:1746065200.491183:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+16:1928:x1830881264956672:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065200.491200:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065200.491212:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31200/0xad6b7ddc1476ee7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937ea7 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.491254:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc1476eee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.491264:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc1476eee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.491275:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc1476eee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.491286:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc1476ef5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.491291:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc1476ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.491296:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc1476ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.491344:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.491352:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc1476e9a lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e6f expref: 44 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.491359:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476ed9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea0 expref: 24 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.491364:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 5/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.491388:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea0 expref: 24 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.491397:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea0 expref: 24 pid: 9571 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065200.491408:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263821312:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065200.491488:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc1476e9a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e6f expref: 44 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.491504:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc1476e9a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e6f expref: 44 pid: 9571 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065200.491512:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c529180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263821440:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065200.491527:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435000 going to sleep for 11 seconds 00010000:00010000:1.0:1746065200.492445:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1476ecb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e99 expref: 7 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.492453:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1476ecb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e99 expref: 7 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.492474:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1476ecb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e99 expref: 7 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065200.492481:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263821568:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065200.493440:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065200.493544:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263821312:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065200.493569:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c529180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263821440:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065200.493576:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065200.493583:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:1.0:1746065200.493593:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264957056 00000100:00100000:1.0:1746065200.493597:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264957056 00000100:00100000:1.0:1746065200.493622:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5318 00000100:00100000:1.0:1746065200.493627:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+45:31231:x1830881264957056:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065200.493763:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+46:31231:x1830881264957056:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 134us (185us total) trans 8589936793 rc 0/0 00000100:00100000:1.0:1746065200.493768:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5318 00000100:00100000:0.0:1746065200.493769:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.493796:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264956800 00000100:00100000:0.0:1746065200.493800:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264956800 00010000:00010000:0.0:1746065200.493815:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea0 expref: 25 pid: 9571 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065200.493839:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7576 00000100:00100000:0.0:1746065200.493845:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881264956800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065200.494072:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065200.494079:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476ed9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea0 expref: 25 pid: 9571 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065200.494087:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476ed9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea0 expref: 25 pid: 9571 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065200.494105:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476ed9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea0 expref: 25 pid: 9571 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065200.494126:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065200.494130:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.494137:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.494141:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.494145:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065200.494160:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881264956800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 316us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065200.494165:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7576 00000100:00100000:1.0:1746065200.499959:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263821568:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065200.499976:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.500470:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+19:2004:x1830881264956544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9535us (9713us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.500479:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7575 00000100:00100000:0.0:1746065200.506162:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.506203:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.506310:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.506479:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264957184 00000100:00100000:1.0:1746065200.506487:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264957184 00010000:00010000:1.0:1746065200.506529:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc1476e9a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e6f expref: 46 pid: 9571 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065200.506560:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7577 00000100:00100000:1.0:1746065200.506567:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881264957184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.506581:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.506585:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc1476e9a lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e6f expref: 46 pid: 9571 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.506596:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc1476e9a lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e6f expref: 46 pid: 9571 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.506629:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc1476e9a lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e6f expref: 46 pid: 9571 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.506657:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065200.506661:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506670:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506676:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506692:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.506726:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881264957184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 159us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.506732:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7577 00010000:00010000:1.0:1746065200.506753:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506759:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065200.506809:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00000004:00200000:1.0:1746065200.506813:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065200.506828:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506836:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506845:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc1476eee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506851:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc1476eee lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506856:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc1476eee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506861:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc1476eee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506866:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065200.506869:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc1476eee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506874:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc1476eee lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506881:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065200.506883:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065200.506886:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc1476eee lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506890:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31a00/0xad6b7ddc1476eee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506899:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc1476ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506903:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc1476ef5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506907:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc1476ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506910:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065200.506913:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc1476ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506917:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc1476ef5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506923:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5c00) 00010000:00010000:1.0:1746065200.506924:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065200.506926:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc1476ef5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506930:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30200/0xad6b7ddc1476ef5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065200.506959:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31200/0xad6b7ddc1476ee7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea7 expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.506970:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea7 expref: 17 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.506975:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065200.506977:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065200.506978:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30800, rc 0) 00000100:00100000:1.0:1746065200.507003:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+17:1928:x1830881264956672:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 15821us (15874us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.507009:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14349 00000100:00100000:0.0:1746065200.515912:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.515984:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.516029:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.516061:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.516090:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264958208 00000100:00100000:0.0:1746065200.516092:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264958208 00000100:00100000:0.0:1746065200.516111:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264958592 00000100:00100000:0.0:1746065200.516113:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264958592 00000100:00100000:0.0:1746065200.516123:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16498 00000100:00100000:0.0:1746065200.516128:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881264958208:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065200.516139:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065200.516153:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc1476f03 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937eb5 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.516169:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065200.516171:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065200.516178:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc1476f03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eb5 expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.516190:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc1476f03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eb5 expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.516199:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30400, rc 0) 00000100:00100000:0.0:1746065200.516232:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881264958208:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 103us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065200.516237:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16498 00000100:00100000:0.0:1746065200.516249:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16499 00000100:00100000:0.0:1746065200.516252:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2007:x1830881264958592:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065200.516258:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065200.516266:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc1476f0a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937ec3 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065200.516297:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263821696:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065200.516347:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065200.523250:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.524962:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.526014:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.526715:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264958720 00000100:00100000:1.0:1746065200.526718:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264958720 00000100:00100000:1.0:1746065200.526739:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16502 00000100:00100000:1.0:1746065200.526743:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881264958720:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065200.526751:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065200.526757:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1476f42 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937eca expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.526767:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065200.526768:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065200.526787:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1476f42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eca expref: 15 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.526795:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1476f42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eca expref: 15 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.526800:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31600, rc 0) 00000100:00100000:1.0:1746065200.526819:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+15:2007:x1830881264958720:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 76us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.526824:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16502 00000100:00100000:1.0:1746065200.527310:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264958976 00000100:00100000:1.0:1746065200.527313:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264958976 00000100:00100000:1.0:1746065200.527328:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16503 00000100:00100000:1.0:1746065200.527332:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881264958976:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065200.527337:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065200.527344:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131019c00/0xad6b7ddc1476f49 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937ed8 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.527353:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065200.527354:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065200.527358:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131019c00/0xad6b7ddc1476f49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ed8 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.527371:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131019c00/0xad6b7ddc1476f49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ed8 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.527378:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131019c00, rc 0) 00000100:00100000:1.0:1746065200.527636:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881264958976:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 62us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.527643:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16503 00000100:00100000:0.0:1746065200.527737:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263821696:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065200.527761:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc1476f0a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ec3 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.527770:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc1476f0a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ec3 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.527812:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31800, rc 0) 00000100:00100000:0.0:1746065200.527830:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881264958592:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11577us (11768us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065200.527835:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16499 00000100:00100000:0.0:1746065200.540670:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881264957568:12345-192.168.202.27@tcp:3:cat.0 Request processed in 32639us (34348us total) trans 0 rc 606208/606208 00000100:00100000:0.0:1746065200.540683:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5733 00002000:00100000:0.0:1746065200.540694:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88008c528e00 x1830881264957568/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:116/0 lens 504/440 e 0 to 0 dl 1746065211 ref 1 fl Complete:/200/0 rc 606208/606208 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065200.540702:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528e00 with x1830881264957568 ext(1048576->2097151) 00002000:00010000:0.0:1746065200.540707:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c528e00 00000100:00100000:0.0:1746065200.541360:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.547442:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.547483:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.547508:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264959872 00000100:00100000:0.0:1746065200.547514:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264959872 00000100:00100000:0.0:1746065200.547545:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14352 00000100:00100000:0.0:1746065200.547551:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+47:1933:x1830881264959872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065200.547571:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065200.547587:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476f5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937eed expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.547646:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc1476f65 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547658:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc1476f65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547667:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc1476f65 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547677:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476f6c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547681:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476f6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547686:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476f6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547761:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30c00/0xad6b7ddc1476f7a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547769:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30c00/0xad6b7ddc1476f7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547789:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30c00/0xad6b7ddc1476f7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065200.547796:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00010000:00010000:0.0:1746065200.547851:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc1476f65 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547860:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc1476f65 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547864:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc1476f65 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547870:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc1476f65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547874:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065200.547877:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc1476f65 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547882:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc1476f65 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547891:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065200.547894:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065200.547897:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc1476f65 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547901:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc1476f65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547914:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476f6c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547918:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476f6c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547922:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476f6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547926:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065200.547928:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476f6c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547933:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476f6c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547938:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5100) 00010000:00010000:0.0:1746065200.547939:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065200.547941:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476f6c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547945:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31c00/0xad6b7ddc1476f6c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065200.547971:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30a00/0xad6b7ddc1476f5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eed expref: 50 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.547980:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30c00/0xad6b7ddc1476f7a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eed expref: 49 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.547985:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065200.547987:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065200.547989:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30c00, rc 0) 00000100:00100000:0.0:1746065200.548005:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+49:1933:x1830881264959872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 455us (521us total) trans 8589936795 rc 0/0 00000100:00100000:0.0:1746065200.548010:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14352 00000100:00100000:0.0:1746065200.556050:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.557985:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.558379:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264959616 00000100:00100000:1.0:1746065200.558384:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264959616 00010000:00010000:1.0:1746065200.558401:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea7 expref: 19 pid: 9571 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065200.558427:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7579 00000100:00100000:1.0:1746065200.558432:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881264959616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.558441:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.558445:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea7 expref: 19 pid: 9571 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.558453:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea7 expref: 19 pid: 9571 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.558467:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc1476efc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ea7 expref: 19 pid: 9571 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065200.558811:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065200.559836:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065200.559843:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc1476f57 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065200.559858:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc1476f57 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065200.559863:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc1476f57 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065200.559892:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.559925:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881264959616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1491us (1945us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.559933:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7579 00000100:00100000:0.0:1746065200.560823:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.560839:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.560861:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.560883:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.560944:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264960384 00000100:00100000:1.0:1746065200.560947:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264960384 00010000:00010000:1.0:1746065200.560959:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc1476e46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e3e expref: 8 pid: 13375 timeout: 896 lvb_type: 0 00000100:00100000:1.0:1746065200.560972:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264960256 00000100:00100000:1.0:1746065200.560974:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264960256 00010000:00010000:1.0:1746065200.560980:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131019c00/0xad6b7ddc1476f49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ed8 expref: 10 pid: 10219 timeout: 896 lvb_type: 1 00000100:00100000:1.0:1746065200.560990:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264960512 00000100:00100000:1.0:1746065200.560991:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264960512 00000100:00100000:1.0:1746065200.561002:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7580 00000100:00100000:1.0:1746065200.561006:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2006:x1830881264960384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.561013:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.561026:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc1476e46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e3e expref: 8 pid: 13375 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.561037:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc1476e46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e3e expref: 8 pid: 13375 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.561048:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc1476e46 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e3e expref: 8 pid: 13375 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.561056:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.561068:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2006:x1830881264960384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 62us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.561073:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7580 00000100:00100000:1.0:1746065200.561080:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7581 00000100:00100000:1.0:1746065200.561084:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881264960256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.561089:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.561095:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131019c00/0xad6b7ddc1476f49 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ed8 expref: 10 pid: 10219 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.561102:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131019c00/0xad6b7ddc1476f49 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ed8 expref: 10 pid: 10219 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.561111:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131019c00/0xad6b7ddc1476f49 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ed8 expref: 10 pid: 10219 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.561121:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.561132:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881264960256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 48us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.561139:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7581 00000100:00100000:1.0:1746065200.561159:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 811 00000100:00100000:1.0:1746065200.561164:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+48:2006:x1830881264960512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.561169:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.561178:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30c00/0xad6b7ddc1476f7a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eed expref: 48 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.561187:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065200.561189:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.561200:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881264960512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 37us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.561205:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 811 00000100:00100000:0.0:1746065200.571862:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.571903:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.571944:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.572994:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264960768 00000100:00100000:1.0:1746065200.572998:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264960768 00010000:00010000:1.0:1746065200.573014:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009577b800/0xad6b7ddc1476e85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e61 expref: 22 pid: 9549 timeout: 896 lvb_type: 1 00000100:00100000:1.0:1746065200.573030:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7582 00000100:00100000:1.0:1746065200.573034:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881264960768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.573041:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.573048:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009577b800/0xad6b7ddc1476e85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e61 expref: 21 pid: 9549 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.573742:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009577b800/0xad6b7ddc1476e85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e61 expref: 21 pid: 9549 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.573759:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577b800/0xad6b7ddc1476e85 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e61 expref: 21 pid: 9549 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.573767:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065200.573768:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065200.573790:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c718600/0xad6b7ddc1476f73 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4096000->18446744073709551615] (req 4096000->4153343) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ee6 expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.573798:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718600/0xad6b7ddc1476f73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4096000->18446744073709551615] (req 4096000->4153343) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ee6 expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.573819:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c718600/0xad6b7ddc1476f73 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4096000->18446744073709551615] (req 4096000->4153343) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ee6 expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065200.573828:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263822720:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065200.574585:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065200.576314:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.576407:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.576557:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7583 00000100:00100000:1.0:1746065200.576565:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+20:2005:x1830881264961024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.576574:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.576580:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc1476f57 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937edf expref: 20 pid: 7204 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.576589:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc1476f57 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937edf expref: 20 pid: 7204 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.576605:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc1476f57 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937edf expref: 20 pid: 7204 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.576617:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065200.576620:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e400/0xad6b7ddc1476fa4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065200.576628:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e400/0xad6b7ddc1476fa4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065200.576634:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e400/0xad6b7ddc1476fa4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065200.576657:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.576679:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ff100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881264961024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 116us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.576685:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7583 00000100:00100000:1.0:1746065200.576711:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263822720:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065200.576720:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.576732:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881264960768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3698us (4829us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.576737:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7582 00000100:00100000:0.0:1746065200.581288:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.581332:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.581380:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.581452:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.582225:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.582435:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16509 00000100:00100000:1.0:1746065200.582442:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881264961920:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065200.582448:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065200.582455:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc1476fb9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937f10 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065200.582477:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263822976:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065200.582527:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065200.590437:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264962560 00000100:00100000:1.0:1746065200.590446:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264962560 00000100:00100000:1.0:1746065200.590513:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5319 00000100:00100000:1.0:1746065200.590523:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+47:1930:x1830881264962560:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065200.590707:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+48:1930:x1830881264962560:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 184us (2774us total) trans 8589936797 rc 0/0 00000100:00100000:1.0:1746065200.590713:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5319 00000100:00100000:0.0:1746065200.591758:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263822976:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065200.591968:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc1476fb9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f10 expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.591982:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc1476fb9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f10 expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065200.607293:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30400, rc 0) 00000100:00100000:0.0:1746065200.607722:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881264961920:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 25274us (26263us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065200.607731:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16509 00000100:00100000:0.0:1746065200.615049:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.623712:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.625024:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.631934:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263823104:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065200.631973:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1476fce lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f25 expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.631991:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e600, rc 0) 00000100:00100000:0.0:1746065200.632064:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+21:1933:x1830881264962944:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8008us (8357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065200.632074:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16510 00000100:00100000:0.0:1746065200.634311:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1899 00000100:00100000:0.0:1746065200.634323:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881264963328:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065200.635318:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.642986:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.646002:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.652171:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.675647:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.696046:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065200.704970:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874111 is committed 00000001:00080000:0.0:1746065200.704989:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874109 is committed 00000001:00080000:0.0:1746065200.705002:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874105 is committed 00000001:00080000:0.0:1746065200.705027:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874087 is committed 00000100:00100000:0.0:1746065200.717438:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.721270:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.721366:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264964864 00000100:00100000:1.0:1746065200.721373:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264964864 00000100:00100000:1.0:1746065200.721427:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16513 00000100:00100000:1.0:1746065200.721435:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881264964864:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065200.721449:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065200.721465:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993e600/0xad6b7ddc1476fe3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937f3a expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.721484:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065200.721486:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065200.721504:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993e600/0xad6b7ddc1476fe3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f3a expref: 11 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.721519:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993e600/0xad6b7ddc1476fe3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f3a expref: 11 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.721528:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993e600, rc 0) 00000100:00100000:1.0:1746065200.721571:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881264964864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 136us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.721580:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16513 00000100:00100000:0.0:1746065200.735929:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.744447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.745867:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.745953:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264965248 00000100:00100000:1.0:1746065200.745957:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264965248 00010000:00010000:1.0:1746065200.745970:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476e77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e5a expref: 27 pid: 9549 timeout: 896 lvb_type: 1 00000100:00100000:1.0:1746065200.745997:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7587 00000100:00100000:1.0:1746065200.746003:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881264965248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.746011:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.746018:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476e77 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e5a expref: 27 pid: 9549 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.746028:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476e77 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e5a expref: 27 pid: 9549 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.746039:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc1476e77 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e5a expref: 27 pid: 9549 timeout: 896 lvb_type: 1 00010000:00010000:1.0:1746065200.746051:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.746069:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881264965248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.746074:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7587 00000100:00100000:0.0:1746065200.747147:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.753746:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264965504 00000100:00100000:0.0:1746065200.753750:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264965504 00010000:00010000:0.0:1746065200.753765:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1476e07 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e1b expref: 9 pid: 13375 timeout: 896 lvb_type: 0 00000100:00100000:0.0:1746065200.753798:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7588 00000100:00100000:0.0:1746065200.753803:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881264965504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065200.753811:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065200.753821:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1476e07 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e1b expref: 9 pid: 13375 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065200.753829:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1476e07 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e1b expref: 9 pid: 13375 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065200.753846:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c200/0xad6b7ddc1476e07 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e1b expref: 9 pid: 13375 timeout: 896 lvb_type: 0 00010000:00010000:0.0:1746065200.753869:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065200.753871:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065200.753876:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1476fea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2179072->3145727] (req 2179072->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f41 expref: 8 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.753883:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1476fea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2179072->3145727] (req 2179072->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f41 expref: 8 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065200.753905:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1476fea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2179072->3145727] (req 2179072->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f41 expref: 8 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065200.753915:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263824000:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065200.753973:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065200.758199:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.764593:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.764697:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264966144 00000100:00100000:1.0:1746065200.764705:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264966144 00000100:00100000:1.0:1746065200.764753:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16516 00000100:00100000:1.0:1746065200.764760:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881264966144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065200.764808:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065200.764823:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1476ff8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937f4f expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.764849:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1476ff8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f4f expref: 28 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.764858:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1476ff8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f4f expref: 28 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.764871:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993e200, rc 0) 00000100:00100000:1.0:1746065200.764905:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881264966144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 146us (318us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065200.764911:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16516 00000100:00100000:0.0:1746065200.770677:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.771317:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.788213:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.788253:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.789131:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.789561:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.789747:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7590 00000100:00100000:1.0:1746065200.789754:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881264966912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065200.789760:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065200.789766:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc1476fab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f02 expref: 12 pid: 9550 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.789786:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc1476fab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f02 expref: 12 pid: 9550 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.789796:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046200/0xad6b7ddc1476fab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f02 expref: 11 pid: 9550 timeout: 896 lvb_type: 0 00010000:00010000:1.0:1746065200.789810:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065200.789985:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881264966912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 232us (1731us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.789991:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7590 00000100:00100000:0.0:1746065200.797717:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.805003:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.805032:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.805063:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.845959:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.953023:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.962363:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065200.962392:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.962437:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264969088 00000100:00100000:1.0:1746065200.962440:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264969088 00000100:00100000:1.0:1746065200.962466:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16523 00000100:00100000:1.0:1746065200.962471:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881264969088:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065200.962478:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065200.962487:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc1477061 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937f95 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065200.962527:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263824896:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065200.962575:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065200.967507:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263824896:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065200.967536:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc1477061 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f95 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.967548:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993fe00/0xad6b7ddc1477061 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f95 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065200.967568:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fe00, rc 0) 00000100:00100000:1.0:1746065200.967611:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881264969088:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5139us (5247us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065200.967622:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16523 00000100:00100000:0.0:1746065200.985671:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.985757:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264969216 00000100:00100000:1.0:1746065200.985765:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264969216 00000100:00100000:1.0:1746065200.985836:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16525 00000100:00100000:1.0:1746065200.985842:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+27:1947:x1830881264969216:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065200.985858:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065200.985872:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147706f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937f9c expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.985896:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1476fea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2179072->3145727] (req 2179072->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f41 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.985902:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065200.985904:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065200.985906:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147706f lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f9c expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.985930:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1476fea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2179072->3145727] (req 2179072->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f41 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.985940:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1476fea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2179072->3145727] (req 2179072->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f41 expref: 7 pid: 12260 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065200.985949:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263825024:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065200.986019:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065200.987087:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065200.997576:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263825024:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065200.997607:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147706f lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f9c expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065200.997621:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:1.0:1746065200.997659:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+28:1947:x1830881264969216:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11816us (11996us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065200.997667:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16525 00000100:00100000:0.0:1746065201.001724:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065201.004374:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065201.017588:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.019908:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264969728 00000100:00100000:1.0:1746065201.019918:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264969728 00000100:00100000:1.0:1746065201.020081:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16526 00000100:00100000:1.0:1746065201.020089:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:1946:x1830881264969728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065201.020106:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.020123:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1477076 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937fa3 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.020146:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065201.020151:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1477076 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fa3 expref: 11 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.020162:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1477076 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fa3 expref: 11 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.020171:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a200, rc 0) 00000100:00100000:1.0:1746065201.020214:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:1946:x1830881264969728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 126us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.020220:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16526 00000100:00100000:0.0:1746065201.038988:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065201.041121:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065201.044270:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.059721:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.059761:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.059868:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.059905:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264970496 00000100:00100000:0.0:1746065201.059912:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264970496 00000100:00100000:0.0:1746065201.059959:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16527 00000100:00100000:0.0:1746065201.059965:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+22:1941:x1830881264970496:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065201.059980:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065201.059992:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147708b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937fb1 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.060015:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1476fff lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f56 expref: 9 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.060020:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065201.060022:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065201.060024:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147708b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2445312->3145727] (req 2445312->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fb1 expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.060047:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1476fff lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f56 expref: 9 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.060056:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1476fff lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2105343) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f56 expref: 9 pid: 12260 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065201.060066:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263825664:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065201.060197:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065201.060315:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263825408:192.168.202.27@tcp:105: 00000100:00080000:1.0:1746065201.060379:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065201.061154:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065201.065728:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263825536:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065201.065749:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.065805:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881264970112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 21389us (21541us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.065818:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7592 00000100:00100000:1.0:1746065201.066000:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263825664:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.066019:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147708b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2445312->3145727] (req 2445312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fb1 expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.066032:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7200, rc 0) 00000100:00100000:1.0:1746065201.066054:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+23:1941:x1830881264970496:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6089us (6185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.066060:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16527 00000100:00080000:1.0:1746065201.066964:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065201.074656:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065201.075374:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065201.078380:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.085598:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.097748:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.097915:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264971520 00000100:00100000:1.0:1746065201.097923:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264971520 00000100:00100000:1.0:1746065201.097960:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16528 00000100:00100000:1.0:1746065201.097967:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+23:1947:x1830881264971520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065201.097983:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.097998:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc1477099 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937fb8 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.098019:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065201.098026:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147708b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2445312->3145727] (req 2445312->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fb1 expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.098031:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065201.098035:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc1477099 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fb8 expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.098068:0:9550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147708b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2445312->3145727] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fb1 expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.098079:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d47000/0xad6b7ddc1477099 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fb8 expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.098088:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47000, rc 0) 00000100:00100000:1.0:1746065201.098138:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+24:1947:x1830881264971520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 171us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.098144:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16528 00000100:00100000:0.0:1746065201.117917:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.123249:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.123291:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264971904 00000100:00100000:0.0:1746065201.123297:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264971904 00002000:00100000:0.0:1746065201.123332:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2445312->2449407) req@ffff880135138e00 x1830881264971904/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:117/0 lens 488/0 e 0 to 0 dl 1746065212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065201.123341:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138e00 with x1830881264971904 ext(2445312->2449407) 00010000:00010000:0.0:1746065201.123349:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147708b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fb1 expref: 24 pid: 9550 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065201.123360:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147708b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fb1 expref: 24 pid: 9550 timeout: 897 lvb_type: 0 00002000:00010000:0.0:1746065201.123366:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135138e00 00000100:00100000:0.0:1746065201.133199:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.134041:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.134451:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264972160 00000100:00100000:1.0:1746065201.134456:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264972160 00000100:00100000:0.0:1746065201.137286:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.137936:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264972416 00000100:00100000:1.0:1746065201.137943:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264972416 00000100:00100000:1.0:1746065201.137980:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16530 00000100:00100000:1.0:1746065201.137988:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:1949:x1830881264972160:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065201.138002:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.138016:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc14770a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937fc6 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.138037:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147706f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f9c expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.138043:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1477076 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fa3 expref: 11 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.138053:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1476ff1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f48 expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.138058:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065201.138060:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065201.138062:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc14770a7 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3637248->3928063] (req 3637248->3928063) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fc6 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.138085:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1476ff1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f48 expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.138094:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1476ff1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f48 expref: 28 pid: 12260 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.138104:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263826048:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.138171:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1477076 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fa3 expref: 11 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.138179:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1477076 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fa3 expref: 11 pid: 1880 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.138187:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263826176:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.138208:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147706f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f9c expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.138220:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147706f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f9c expref: 28 pid: 1880 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.138228:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263826304:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065201.138240:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065201.138280:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.138933:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264972544 00000100:00100000:0.0:1746065201.138936:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264972544 00002000:00100000:0.0:1746065201.138960:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2445312->3145727) req@ffff88009aba4380 x1830881264972544/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:117/0 lens 488/0 e 0 to 0 dl 1746065212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065201.138968:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba4380 with x1830881264972544 ext(2445312->3145727) 00010000:00010000:0.0:1746065201.138974:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147708b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fb1 expref: 24 pid: 9550 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065201.138983:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147708b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2445312->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fb1 expref: 24 pid: 9550 timeout: 897 lvb_type: 0 00002000:00010000:0.0:1746065201.138989:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aba4380 00000100:00100000:0.0:1746065201.139008:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1905 00000100:00100000:0.0:1746065201.139013:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881264972544:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065201.148025:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263826048:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065201.148036:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263826176:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065201.148042:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263826304:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.148065:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc14770a7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3637248->3928063] (req 3637248->3928063) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fc6 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.148079:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:1.0:1746065201.148114:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:1949:x1830881264972160:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10126us (14072us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.148121:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16530 00000100:00100000:0.0:1746065201.153016:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.153075:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.153167:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264972800 00000100:00100000:1.0:1746065201.153174:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264972800 00010000:00010000:1.0:1746065201.153204:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1477076 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fa3 expref: 11 pid: 1880 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.153226:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264972672 00000100:00100000:1.0:1746065201.153228:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264972672 00010000:00010000:1.0:1746065201.153237:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1476ff1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f48 expref: 29 pid: 12260 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.153251:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7596 00000100:00100000:1.0:1746065201.153257:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881264972800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.153268:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.153285:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1477076 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fa3 expref: 11 pid: 1880 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.153294:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1477076 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fa3 expref: 11 pid: 1880 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.153312:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc1477076 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fa3 expref: 11 pid: 1880 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.153327:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.153356:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881264972800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.153362:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7596 00000100:00100000:1.0:1746065201.153374:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7597 00000100:00100000:1.0:1746065201.153378:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881264972672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.153385:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.153390:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1476ff1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f48 expref: 29 pid: 12260 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.153398:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1476ff1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f48 expref: 29 pid: 12260 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.153412:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1476ff1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f48 expref: 29 pid: 12260 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.153419:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.153431:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881264972672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.153436:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7597 00000100:00100000:0.0:1746065201.166624:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.173993:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.174330:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.176751:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.180463:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.188687:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.188755:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.196725:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264974592 00000100:00100000:0.0:1746065201.196735:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264974592 00002000:00100000:0.0:1746065201.196771:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009a6df800 x1830881264974592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:117/0 lens 488/0 e 0 to 0 dl 1746065212 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065201.197091:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df800 with x1830881264974592 ext(2097152->3145727) 00002000:00010000:0.0:1746065201.197097:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6df800 00000100:00100000:0.0:1746065201.197684:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5753 00000100:00100000:0.0:1746065201.197694:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881264974592:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065201.208508:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.208947:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264974720 00000100:00100000:1.0:1746065201.208955:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264974720 00000100:00100000:1.0:1746065201.209006:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16532 00000100:00100000:1.0:1746065201.209013:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:1946:x1830881264974720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065201.209028:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.209042:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc14770b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937fd4 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.209066:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a54ae00/0xad6b7ddc14770ae lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->3387391] (req 3145728->3387391) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fcd expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.209074:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc14770a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3387392->18446744073709551615] (req 3637248->3928063) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fc6 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.209080:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065201.209082:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065201.209085:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc14770b5 lrc: 5/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fd4 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.209239:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc14770a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3387392->18446744073709551615] (req 3637248->3928063) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fc6 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.209250:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc14770a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3387392->18446744073709551615] (req 3637248->3928063) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fc6 expref: 11 pid: 9550 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.209261:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263826944:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.209356:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a54ae00/0xad6b7ddc14770ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->3387391] (req 3145728->3387391) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fcd expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.209364:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a54ae00/0xad6b7ddc14770ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->3387391] (req 3145728->3387391) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fcd expref: 26 pid: 11461 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.209371:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263827072:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065201.209389:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065201.209630:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.211167:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263826944:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065201.211177:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263827072:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.211193:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc14770b5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fd4 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.211204:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44e00, rc 0) 00000100:00100000:1.0:1746065201.211245:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:1946:x1830881264974720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2232us (2744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.211255:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16532 00000100:00100000:0.0:1746065201.211268:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.211323:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.219077:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.219159:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.219508:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7601 00000100:00100000:1.0:1746065201.219519:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881264975360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.219527:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.219538:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a54ae00/0xad6b7ddc14770ae lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [3145728->3387391] (req 3145728->3387391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fcd expref: 30 pid: 11461 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.219547:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a54ae00/0xad6b7ddc14770ae lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->3387391] (req 3145728->3387391) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fcd expref: 30 pid: 11461 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.219567:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a54ae00/0xad6b7ddc14770ae lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->3387391] (req 3145728->3387391) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fcd expref: 30 pid: 11461 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.219579:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.219580:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.219586:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc14770b5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fd4 expref: 12 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.219592:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc14770b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fd4 expref: 12 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.219598:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.219599:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.219601:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc14770bc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fdb expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.219607:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc14770bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fdb expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.219633:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa4600/0xad6b7ddc14770bc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fdb expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065201.219643:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263827200:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065201.219708:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc14770b5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fd4 expref: 12 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065201.219716:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263827328:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065201.219732:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065201.224572:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263827200:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065201.224667:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.224836:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263827328:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065201.224850:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.224897:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881264975360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5378us (5737us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.224907:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7601 00000100:00100000:0.0:1746065201.228718:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.233541:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.235299:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.252089:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.252632:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.277914:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.292582:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.293830:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263827456:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065201.293848:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:0.0:1746065201.298864:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.298925:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264977408 00000100:00100000:1.0:1746065201.298933:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264977408 00010000:00010000:1.0:1746065201.298963:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc1477084 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937faa expref: 28 pid: 7204 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.298998:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7602 00000100:00100000:1.0:1746065201.299005:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881264977408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.299017:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.299023:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc1477084 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937faa expref: 28 pid: 7204 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.299033:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc1477084 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937faa expref: 28 pid: 7204 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.299050:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047600/0xad6b7ddc1477084 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937faa expref: 28 pid: 7204 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.299077:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.299081:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299089:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299095:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299117:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.299154:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881264977408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 146us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.299160:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7602 00010000:00010000:1.0:1746065201.299238:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299244:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065201.299281:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00000004:00200000:1.0:1746065201.299285:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065201.299297:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299305:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299314:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc14770ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299319:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc14770ca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299323:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc14770ca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299328:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc14770ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299332:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de4600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065201.299335:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc14770ca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299339:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc14770ca lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299345:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065201.299347:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065201.299349:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc14770ca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299353:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc14770ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299360:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc14770d1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299363:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc14770d1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299368:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc14770d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299371:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065201.299373:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc14770d1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299376:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc14770d1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299381:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009867e200) 00010000:00010000:1.0:1746065201.299382:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065201.299384:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc14770d1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299387:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc14770d1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.299411:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e400/0xad6b7ddc14770c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe2 expref: 20 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.299421:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe2 expref: 19 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.299425:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.299427:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065201.299428:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5c00, rc 0) 00000100:00100000:1.0:1746065201.299447:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+19:1955:x1830881264977024:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 18820us (21543us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.299452:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14358 00000100:00100000:0.0:1746065201.303019:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.303698:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.303736:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065201.305865:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065201.306067:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065201.306126:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16535 00000100:00100000:0.0:1746065201.306132:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881264977664:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065201.306139:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065201.306147:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc14770e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937ff0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.306159:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.306161:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.306164:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc14770e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ff0 expref: 11 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.306173:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc14770e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ff0 expref: 11 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.306183:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44000, rc 0) 00000100:00100000:0.0:1746065201.306221:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881264977664:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 90us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.306227:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16535 00000100:00100000:0.0:1746065201.316122:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.316269:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264978048 00000100:00100000:1.0:1746065201.316276:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264978048 00000100:00100000:1.0:1746065201.316309:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14359 00000100:00100000:1.0:1746065201.316315:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+19:1955:x1830881264978048:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065201.316330:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.316344:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc14770f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd937ffe expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.316422:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc14770fb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.316434:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe2 expref: 20 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.316440:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc14770fb lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.316461:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe2 expref: 20 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.316470:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc14770d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe2 expref: 20 pid: 7204 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.316479:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263827584:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065201.318537:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065201.318892:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.319146:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881263827584:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.319161:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc14770fb lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065201.319684:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc14770fb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065201.319689:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc14770fb lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:0.0:1746065201.319703:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00010000:00010000:0.0:1746065201.319806:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc14770f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ffe expref: 21 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.319819:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc14770fb lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ffe expref: 20 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.319824:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065201.319827:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065201.319829:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67200, rc 0) 00000100:00100000:0.0:1746065201.319855:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+20:1955:x1830881264978048:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3541us (3740us total) trans 8589936806 rc 0/0 00000100:00100000:0.0:1746065201.319861:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14359 00000100:00100000:0.0:1746065201.323011:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.323132:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264978432 00000100:00100000:1.0:1746065201.323140:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264978432 00000100:00100000:1.0:1746065201.323180:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14360 00000100:00100000:1.0:1746065201.323187:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+20:1955:x1830881264978432:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065201.323207:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.323210:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065201.323232:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc14770fb lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ffe expref: 20 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.323247:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.323250:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065201.323259:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc1477109 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938005 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.323332:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67e00/0xad6b7ddc1477110 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.323342:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67e00/0xad6b7ddc1477110 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.323350:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67e00/0xad6b7ddc1477110 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065201.323359:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00010000:00010000:1.0:1746065201.323432:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67600/0xad6b7ddc1477109 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938005 expref: 22 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.323443:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67e00/0xad6b7ddc1477110 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938005 expref: 21 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.323449:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.323451:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065201.323453:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67e00, rc 0) 00000100:00100000:1.0:1746065201.324428:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+21:1955:x1830881264978432:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1238us (1422us total) trans 8589936807 rc 0/0 00000100:00100000:1.0:1746065201.324434:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14360 00000100:00100000:0.0:1746065201.329030:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.329051:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264978560 00000100:00100000:1.0:1746065201.329059:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264978560 00000100:00100000:1.0:1746065201.329100:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14361 00000100:00100000:1.0:1746065201.329108:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+21:1955:x1830881264978560:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065201.329128:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.329143:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc147711e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93800c expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.329191:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc147711e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93800c expref: 22 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.329203:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66600/0xad6b7ddc147711e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93800c expref: 22 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.329218:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.329221:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065201.329223:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66600, rc 0) 00000100:00100000:1.0:1746065201.329257:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+22:1955:x1830881264978560:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 151us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.329263:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14361 00000100:00100000:0.0:1746065201.334913:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.334933:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.334960:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.334986:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.335015:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264978688 00000100:00100000:0.0:1746065201.335022:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264978688 00000100:00100000:0.0:1746065201.335065:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264978816 00000100:00100000:0.0:1746065201.335068:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264978816 00000100:00100000:0.0:1746065201.335079:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264978944 00000100:00100000:0.0:1746065201.335080:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264978944 00000100:00100000:0.0:1746065201.335088:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264979072 00000100:00100000:0.0:1746065201.335090:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264979072 00000100:00100000:0.0:1746065201.335100:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16537 00000100:00100000:0.0:1746065201.335107:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881264978688:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065201.335142:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d44c00/0xad6b7ddc1477125 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.335157:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d856a00/0xad6b7ddc1476dc8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937de3 expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.335165:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc1476f03 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eb5 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.335177:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1476deb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dff expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.335183:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.335184:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.335187:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44c00/0xad6b7ddc1477125 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.335213:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1476deb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dff expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.335223:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1476deb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dff expref: 11 pid: 3067 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.335234:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263827712:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065201.335305:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc1476f03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eb5 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.335313:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc1476f03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eb5 expref: 12 pid: 11461 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.335321:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263827840:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065201.335344:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d856a00/0xad6b7ddc1476dc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937de3 expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.335354:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d856a00/0xad6b7ddc1476dc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937de3 expref: 28 pid: 1880 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065201.335362:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263827968:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065201.335377:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065201.335442:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16538 00000100:00100000:0.0:1746065201.335448:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881264978816:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065201.335464:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc147712c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.335474:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1476ecb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e99 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.335481:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f47400/0xad6b7ddc1476f8f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ef4 expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.335499:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1476f3b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ebc expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.335504:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.335505:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.335508:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc147712c lrc: 6/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.335521:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1476f3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ebc expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.335529:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1476f3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ebc expref: 12 pid: 12260 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.335537:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263828096:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065201.335557:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16539 00000100:00100000:1.0:1746065201.335563:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881264978944:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065201.335563:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f47400/0xad6b7ddc1476f8f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ef4 expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.335570:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f47400/0xad6b7ddc1476f8f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ef4 expref: 24 pid: 1880 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.335577:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263828224:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.335580:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.335589:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1476fce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f25 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.335595:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14770df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe9 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.335595:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1476ecb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e99 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.335602:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993e600/0xad6b7ddc1476fe3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f3a expref: 11 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.335602:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1476ecb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e99 expref: 11 pid: 11461 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.335606:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.335608:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.335609:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.335609:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4ea680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263828352:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065201.335620:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435240 going to sleep for 11 seconds 00010000:00010000:1.0:1746065201.335621:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009993e600/0xad6b7ddc1476fe3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f3a expref: 11 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.335628:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009993e600/0xad6b7ddc1476fe3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f3a expref: 11 pid: 1880 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065201.335634:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263828480:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.335658:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14770df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe9 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.335669:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14770df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe9 expref: 12 pid: 11461 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065201.335675:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263828608:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065201.335678:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16540 00000100:00100000:0.0:1746065201.335683:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881264979072:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065201.335697:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1476fce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f25 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.335698:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.335705:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1476fce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f25 expref: 24 pid: 12260 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.335711:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263828736:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065201.335711:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577b400/0xad6b7ddc1476e3f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e37 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.335717:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1476f42 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eca expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065201.335722:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00010000:00010000:0.0:1746065201.335722:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577ac00/0xad6b7ddc1476e8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e68 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.335727:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.335728:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.335730:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.335742:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577ac00/0xad6b7ddc1476e8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e68 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065201.341522:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577ac00/0xad6b7ddc1476e8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e68 expref: 11 pid: 9549 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.341542:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263828864:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.343968:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1476f42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eca expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065201.343979:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1476f42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eca expref: 13 pid: 10219 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065201.343988:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263829760:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.344022:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577b400/0xad6b7ddc1476e3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e37 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.344030:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577b400/0xad6b7ddc1476e3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e37 expref: 28 pid: 3067 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.344042:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263829888:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065201.344059:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065201.345593:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.345621:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.345646:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.345663:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264980096 00000100:00100000:0.0:1746065201.345669:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264980096 00010000:00010000:0.0:1746065201.345692:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993e600/0xad6b7ddc1476fe3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f3a expref: 12 pid: 1880 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.345710:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264980480 00000100:00100000:0.0:1746065201.345712:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264980480 00010000:00010000:0.0:1746065201.345719:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1476fce lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f25 expref: 25 pid: 12260 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065201.345728:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264980352 00000100:00100000:0.0:1746065201.345730:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264980352 00010000:00010000:0.0:1746065201.345736:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14770df lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe9 expref: 14 pid: 11461 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.345748:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7604 00000100:00100000:0.0:1746065201.345753:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881264980096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065201.345762:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065201.345797:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993e600/0xad6b7ddc1476fe3 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f3a expref: 12 pid: 1880 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.345807:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993e600/0xad6b7ddc1476fe3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f3a expref: 12 pid: 1880 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.345826:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.345850:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881264980096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.345856:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7604 00000100:00100000:0.0:1746065201.345870:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7605 00000100:00100000:0.0:1746065201.345875:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881264980480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065201.345881:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065201.345888:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1476fce lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f25 expref: 25 pid: 12260 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065201.345895:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1476fce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f25 expref: 25 pid: 12260 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065201.345905:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.345917:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881264980480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 42us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.345921:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7605 00000100:00100000:0.0:1746065201.345930:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7606 00000100:00100000:0.0:1746065201.345934:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881264980352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065201.345939:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065201.345944:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14770df lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe9 expref: 14 pid: 11461 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.345950:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14770df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe9 expref: 14 pid: 11461 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.345960:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.345961:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.345965:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.345972:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.345990:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.346003:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881264980352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 69us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.346009:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7606 00000100:00100000:0.0:1746065201.346032:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.346042:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264979456 00000100:00100000:0.0:1746065201.346045:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264979456 00010000:00010000:0.0:1746065201.346054:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc1476f03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eb5 expref: 14 pid: 11461 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.346065:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7607 00000100:00100000:0.0:1746065201.346069:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881264979456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065201.346074:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065201.346082:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc1476f03 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eb5 expref: 14 pid: 11461 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.346090:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc1476f03 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eb5 expref: 14 pid: 11461 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.346100:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30400/0xad6b7ddc1476f03 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eb5 expref: 14 pid: 11461 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.346112:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.346126:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881264979456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.346131:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7607 00000100:00100000:0.0:1746065201.346178:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.346188:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264979712 00000100:00100000:0.0:1746065201.346190:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264979712 00010000:00010000:0.0:1746065201.346199:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856a00/0xad6b7ddc1476dc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937de3 expref: 29 pid: 1880 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065201.346210:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7608 00000100:00100000:0.0:1746065201.346214:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881264979712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065201.346219:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065201.346224:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d856a00/0xad6b7ddc1476dc8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937de3 expref: 29 pid: 1880 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065201.346231:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d856a00/0xad6b7ddc1476dc8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937de3 expref: 29 pid: 1880 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065201.346241:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856a00/0xad6b7ddc1476dc8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937de3 expref: 29 pid: 1880 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065201.346248:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.346261:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881264979712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.346266:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7608 00000100:00100000:0.0:1746065201.346320:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.346330:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264980224 00000100:00100000:0.0:1746065201.346333:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264980224 00010000:00010000:0.0:1746065201.346342:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1476ecb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e99 expref: 12 pid: 11461 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065201.346356:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7609 00000100:00100000:0.0:1746065201.346361:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881264980224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065201.346366:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065201.346373:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1476ecb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e99 expref: 12 pid: 11461 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065201.346379:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1476ecb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e99 expref: 12 pid: 11461 timeout: 897 lvb_type: 0 00010000:00010000:0.0:1746065201.346389:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.346403:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881264980224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 42us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.346408:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7609 00000100:00100000:0.0:1746065201.346438:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.346447:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264979584 00000100:00100000:0.0:1746065201.346449:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264979584 00010000:00010000:0.0:1746065201.346459:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1476deb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dff expref: 12 pid: 3067 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.346468:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7610 00000100:00100000:0.0:1746065201.346472:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881264979584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065201.346477:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065201.346483:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1476deb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dff expref: 12 pid: 3067 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.346507:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1476deb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dff expref: 12 pid: 3067 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.346516:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc1476deb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937dff expref: 12 pid: 3067 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.346523:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.346524:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.346527:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44c00/0xad6b7ddc1477125 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.346532:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44c00/0xad6b7ddc1477125 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.346545:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.346558:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881264979584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.346563:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7610 00000100:00100000:0.0:1746065201.346593:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.346603:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264979840 00000100:00100000:0.0:1746065201.346605:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264979840 00010000:00010000:0.0:1746065201.346614:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1476f3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ebc expref: 14 pid: 12260 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.346624:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7611 00000100:00100000:0.0:1746065201.346628:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881264979840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065201.346635:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065201.346641:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1476f3b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ebc expref: 14 pid: 12260 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.346647:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1476f3b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ebc expref: 14 pid: 12260 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.346656:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1476f3b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ebc expref: 14 pid: 12260 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.346664:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.346676:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881264979840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 48us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.346681:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7611 00000100:00100000:0.0:1746065201.346723:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.346734:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264979968 00000100:00100000:0.0:1746065201.346737:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264979968 00010000:00010000:0.0:1746065201.346746:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f47400/0xad6b7ddc1476f8f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ef4 expref: 25 pid: 1880 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.346756:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7612 00000100:00100000:0.0:1746065201.346760:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881264979968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065201.346765:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065201.346771:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f47400/0xad6b7ddc1476f8f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ef4 expref: 25 pid: 1880 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.346808:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f47400/0xad6b7ddc1476f8f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ef4 expref: 25 pid: 1880 timeout: 897 lvb_type: 1 00010000:00010000:0.0:1746065201.346818:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.346819:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065201.346822:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc147712c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.346827:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc147712c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.346837:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065201.346850:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881264979968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.346855:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7612 00010000:00010000:1.0:1746065201.347441:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993e600/0xad6b7ddc1476fe3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f3a expref: 10 pid: 1880 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065201.347454:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263828480:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.347463:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc14770df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937fe9 expref: 11 pid: 11461 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065201.347469:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263828608:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.347477:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1476fce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937f25 expref: 23 pid: 12260 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.347494:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263828736:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.347506:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.347512:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.347517:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.347527:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.347533:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.347539:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.347543:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065201.347546:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.347551:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.347559:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.347564:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f66a00/0xad6b7ddc1477133 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065201.347590:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881264978944:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 12028us (12630us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.347595:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16539 00000100:00100000:1.0:1746065201.359832:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.359846:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.359861:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.359874:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.359886:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264980992 00000100:00100000:1.0:1746065201.359888:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264980992 00010000:00010000:1.0:1746065201.359898:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1476f42 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eca expref: 12 pid: 10219 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065201.359909:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264980608 00000100:00100000:1.0:1746065201.359910:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264980608 00010000:00010000:1.0:1746065201.359915:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc14770e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937ff0 expref: 13 pid: 1880 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065201.359925:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7613 00000100:00100000:1.0:1746065201.360114:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881264980736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.360122:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.360130:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577ac00/0xad6b7ddc1476e8c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e68 expref: 11 pid: 9549 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065201.360138:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577ac00/0xad6b7ddc1476e8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e68 expref: 11 pid: 9549 timeout: 897 lvb_type: 1 00010000:00010000:1.0:1746065201.360149:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.360163:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881264980736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 233us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.360839:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7613 00010000:00010000:0.0:1746065201.360877:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577ac00/0xad6b7ddc1476e8c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e68 expref: 10 pid: 9549 timeout: 897 lvb_type: 1 00000100:00100000:1.0:1746065201.360883:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.360886:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263828864:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065201.360892:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264981504 00000100:00100000:1.0:1746065201.360894:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264981504 00010000:00010000:0.0:1746065201.360894:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c31600/0xad6b7ddc1476f42 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937eca expref: 10 pid: 10219 timeout: 897 lvb_type: 1 00000100:00100000:0.0:1746065201.360901:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263829760:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065201.360904:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b400/0xad6b7ddc1476e3f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e37 expref: 28 pid: 3067 timeout: 897 lvb_type: 0 00000100:00100000:0.0:1746065201.360907:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263829888:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065201.360920:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7619 00010000:00010000:0.0:1746065201.360921:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065201.360924:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881264981504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.360929:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.360935:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577b400/0xad6b7ddc1476e3f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e37 expref: 28 pid: 3067 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.360941:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577b400/0xad6b7ddc1476e3f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e37 expref: 28 pid: 3067 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.361517:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577b400/0xad6b7ddc1476e3f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937e37 expref: 27 pid: 3067 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.361526:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.361527:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065201.361528:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.361534:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.361545:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.361560:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881264981504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 635us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.361565:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7619 00010000:00010000:0.0:1746065201.361596:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.361603:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.361613:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.361618:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.361623:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.361627:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065201.361629:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.361634:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.361643:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065201.361653:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d47200/0xad6b7ddc147713a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065201.361681:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881264979072:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 25998us (26694us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.361687:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16540 00000100:00100000:0.0:1746065201.364261:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.368872:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.368897:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.370655:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.370688:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.370715:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.370738:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.370757:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.370818:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264982656 00000100:00100000:1.0:1746065201.370822:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264982656 00010000:00010000:1.0:1746065201.370842:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1476953 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b5f expref: 54 pid: 7231 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.370860:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264982528 00000100:00100000:1.0:1746065201.370862:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264982528 00010000:00010000:1.0:1746065201.370875:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1476961 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b6d expref: 28 pid: 13395 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.370882:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264983040 00000100:00100000:1.0:1746065201.370884:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264983040 00010000:00010000:1.0:1746065201.370889:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1476945 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b51 expref: 55 pid: 13395 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.370895:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264982784 00000100:00100000:1.0:1746065201.370896:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264982784 00010000:00010000:1.0:1746065201.370902:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc1476d04 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d65 expref: 56 pid: 9571 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.370907:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264982912 00000100:00100000:1.0:1746065201.370908:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264982912 00010000:00010000:1.0:1746065201.370913:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc1476cda lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d5e expref: 29 pid: 9571 timeout: 897 lvb_type: 0 00000100:00100000:1.0:1746065201.370920:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7622 00000100:00100000:1.0:1746065201.370924:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+56:2005:x1830881264982656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.370932:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.370936:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1476953 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b5f expref: 56 pid: 7231 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.370948:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1476953 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b5f expref: 56 pid: 7231 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.370964:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1476953 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b5f expref: 56 pid: 7231 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.370977:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.370980:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147714f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065201.370987:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.371005:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881264982656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.371010:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7622 00000100:00100000:1.0:1746065201.371040:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7623 00000100:00100000:1.0:1746065201.371044:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2005:x1830881264982528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.371049:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.371053:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1476961 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b6d expref: 29 pid: 13395 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371059:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1476961 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b6d expref: 29 pid: 13395 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371070:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1476961 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b6d expref: 29 pid: 13395 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371077:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.371081:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147714f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065201.371086:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.371099:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881264982528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.371104:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7623 00000100:00100000:1.0:1746065201.371114:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7624 00000100:00100000:1.0:1746065201.371119:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881264983040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.371124:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.371127:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1476945 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b51 expref: 54 pid: 13395 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371134:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1476945 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b51 expref: 54 pid: 13395 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371143:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1476945 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937b51 expref: 54 pid: 13395 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371149:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.371152:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147714f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065201.371156:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.371166:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881264983040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.371170:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7624 00000100:00100000:1.0:1746065201.371178:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7625 00000100:00100000:1.0:1746065201.371181:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+52:2007:x1830881264982784:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.371186:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.371189:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc1476d04 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d65 expref: 52 pid: 9571 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371194:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc1476d04 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d65 expref: 52 pid: 9571 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371202:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc1476d04 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d65 expref: 52 pid: 9571 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371208:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.371210:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147714f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065201.371214:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.371222:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+51:2007:x1830881264982784:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.371226:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7625 00000100:00100000:1.0:1746065201.371232:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7626 00000100:00100000:1.0:1746065201.371235:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2007:x1830881264982912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.371239:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.371241:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc1476cda lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d5e expref: 27 pid: 9571 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371247:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc1476cda lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d5e expref: 27 pid: 9571 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371254:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc1476cda lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937d5e expref: 27 pid: 9571 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.371259:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.371262:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147714f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065201.371265:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.371273:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881264982912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 37us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.371277:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7626 00000100:00100000:0.0:1746065201.372036:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.372076:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.372875:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7627 00000100:00100000:1.0:1746065201.372882:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881264983296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065201.372891:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065201.372895:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc1476af0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c62 expref: 26 pid: 9571 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.372903:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc1476af0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c62 expref: 26 pid: 9571 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.372917:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc1476af0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd937c62 expref: 26 pid: 9571 timeout: 897 lvb_type: 0 00010000:00010000:1.0:1746065201.372926:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.372930:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147714f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065201.372936:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065201.373412:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881264983296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 530us (1377us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.373420:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7627 00000001:00080000:0.0:1746065201.377832:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936810 is committed 00000004:00080000:0.0:1746065201.377841:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 962 committed 00000004:00080000:0.0:1746065201.377852:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 937 committed 00000004:00080000:0.0:1746065201.377861:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 936 committed 00000004:00080000:0.0:1746065201.377862:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 935 committed 00000004:00080000:0.0:1746065201.377863:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 934 committed 00000004:00080000:0.0:1746065201.377865:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 961 committed 00000004:00080000:0.0:1746065201.377866:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 933 committed 00000004:00080000:0.0:1746065201.377867:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 960 committed 00000004:00080000:0.0:1746065201.377869:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 932 committed 00000004:00080000:0.0:1746065201.377870:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 959 committed 00000004:00080000:0.0:1746065201.377871:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 958 committed 00000004:00080000:0.0:1746065201.377872:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 957 committed 00000004:00080000:0.0:1746065201.377873:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 931 committed 00000004:00080000:0.0:1746065201.377874:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 930 committed 00000004:00080000:0.0:1746065201.377875:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 956 committed 00000004:00080000:0.0:1746065201.377877:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 955 committed 00000004:00080000:0.0:1746065201.377878:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 929 committed 00000001:00080000:0.0:1746065201.377881:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936809 is committed 00000001:00080000:0.0:1746065201.377885:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936808 is committed 00000100:00100000:1.0:1746065201.378104:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263831168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.378152:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.378187:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263831680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.378204:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.378220:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065201.378224:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263831296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.378236:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.378246:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263831808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.378258:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.378278:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263831168 00000100:00100000:1.0:1746065201.378283:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263831168 00000100:00100000:1.0:1746065201.378316:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263831680 00000100:00100000:1.0:1746065201.378318:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263831680 00000100:00100000:1.0:1746065201.378326:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263831296 00000100:00100000:1.0:1746065201.378328:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263831296 00000100:00100000:1.0:1746065201.378335:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263831808 00000100:00100000:1.0:1746065201.378336:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263831808 00000100:00100000:1.0:1746065201.378346:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16543 00000100:00100000:1.0:1746065201.378351:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263831168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.378469:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263831168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (316us total) trans 21474841533 rc 0/0 00000100:00100000:1.0:1746065201.378475:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16543 00000100:00100000:1.0:1746065201.378498:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16544 00000100:00100000:1.0:1746065201.378503:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263831680:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.379061:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263831680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 558us (856us total) trans 21474841536 rc 0/0 00000100:00100000:1.0:1746065201.379067:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16544 00000100:00100000:1.0:1746065201.379081:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263832192:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.379098:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.379111:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263832704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.379126:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.379160:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841522 gen 2 00000004:00080000:1.0:1746065201.379164:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009252ad80, transno 21474841495 00000004:00080000:1.0:1746065201.379169:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092529880, transno 21474841496 00000004:00080000:1.0:1746065201.379171:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009252a680, transno 21474841497 00000004:00080000:1.0:1746065201.379173:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092529180, transno 21474841498 00000004:00080000:1.0:1746065201.379175:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092528000, transno 21474841499 00000004:00080000:1.0:1746065201.379177:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092528380, transno 21474841500 00000004:00080000:1.0:1746065201.379179:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092528e00, transno 21474841501 00000004:00080000:1.0:1746065201.379180:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009252a300, transno 21474841502 00000004:00080000:1.0:1746065201.379182:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1180, transno 21474841507 00000004:00080000:1.0:1746065201.379184:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3b80, transno 21474841508 00000004:00080000:1.0:1746065201.379186:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f2d80, transno 21474841509 00000004:00080000:1.0:1746065201.379189:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0a80, transno 21474841510 00000004:00080000:1.0:1746065201.379190:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0e00, transno 21474841511 00000004:00080000:1.0:1746065201.379192:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0000, transno 21474841512 00000004:00080000:1.0:1746065201.379194:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3800, transno 21474841513 00000004:00080000:1.0:1746065201.379197:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f2300, transno 21474841514 00000004:00080000:1.0:1746065201.379199:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834f100, transno 21474841515 00000004:00080000:1.0:1746065201.379201:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834d880, transno 21474841516 00000004:00080000:1.0:1746065201.379203:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834e300, transno 21474841517 00000004:00080000:1.0:1746065201.379205:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834ea00, transno 21474841518 00000004:00080000:1.0:1746065201.379207:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834d180, transno 21474841519 00000004:00080000:1.0:1746065201.379209:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09dc00, transno 21474841520 00000004:00080000:1.0:1746065201.379211:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834df80, transno 21474841521 00000004:00080000:1.0:1746065201.379213:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834c380, transno 21474841522 00000100:00100000:1.0:1746065201.379218:0:3759:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009aba6300 x1830881263831296/t21474841534(21474841534) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065217 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:1.0:1746065201.379226:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aba6300/2, rc 0, transno 21474841534 00000100:00100000:1.0:1746065201.379230:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263831296:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065201.379238:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996fdf80/2, rc 0, transno 21474841535 00000100:00100000:1.0:1746065201.379241:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263831808:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065201.379246:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aba5c00/2, rc 0, transno 21474841533 00000100:00100000:1.0:1746065201.379248:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263831168:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065201.379254:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957da680/2, rc 0, transno 21474841536 00000100:00100000:1.0:1746065201.379256:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263831680:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065201.379263:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065201.379267:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263832320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.379282:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.379294:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263832832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.379306:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.379322:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263832192 00000100:00100000:1.0:1746065201.379324:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263832192 00000100:00100000:1.0:1746065201.379341:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263832704 00000100:00100000:1.0:1746065201.379343:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263832704 00000100:00100000:1.0:1746065201.379348:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263832320 00000100:00100000:1.0:1746065201.379349:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263832320 00000100:00100000:1.0:1746065201.379354:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263832832 00000100:00100000:1.0:1746065201.379355:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263832832 00000100:00100000:1.0:1746065201.379362:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16547 00000100:00100000:1.0:1746065201.379367:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263832192:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.379434:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263832192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (334us total) trans 17179874115 rc 0/0 00000100:00100000:1.0:1746065201.379439:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16547 00000100:00100000:1.0:1746065201.379448:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16548 00000100:00100000:1.0:1746065201.379452:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009d2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263832704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065201.379502:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065201.379504:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065201.379506:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065201.379508:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065201.379510:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:1.0:1746065201.379526:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009d2f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263832704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (399us total) trans 17179874116 rc 0/0 00000100:00100000:1.0:1746065201.379531:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16548 00000100:00100000:1.0:1746065201.379631:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16549 00000100:00100000:1.0:1746065201.379636:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263832320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.379679:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263832320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (395us total) trans 17179874117 rc 0/0 00000100:00100000:1.0:1746065201.379683:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16549 00000100:00100000:1.0:1746065201.379691:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16550 00000100:00100000:1.0:1746065201.379695:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263832832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065201.379725:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:1.0:1746065201.379727:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065201.379729:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065201.379730:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065201.379732:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:1.0:1746065201.379747:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263832832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (440us total) trans 17179874118 rc 0/0 00000100:00100000:1.0:1746065201.379752:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16550 00000100:00100000:1.0:1746065201.379792:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874105 gen 2 00000004:00080000:1.0:1746065201.379795:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f1f80, transno 17179874075 00000004:00080000:1.0:1746065201.379799:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0700, transno 17179874076 00000004:00080000:1.0:1746065201.379801:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f3800, transno 17179874077 00000004:00080000:1.0:1746065201.379803:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0380, transno 17179874078 00000004:00080000:1.0:1746065201.379805:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0a80, transno 17179874079 00000004:00080000:1.0:1746065201.379806:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0e00, transno 17179874080 00000004:00080000:1.0:1746065201.379808:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f1500, transno 17179874081 00000004:00080000:1.0:1746065201.379810:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0000, transno 17179874082 00000004:00080000:1.0:1746065201.379812:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f3480, transno 17179874083 00000004:00080000:1.0:1746065201.379814:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577ce00, transno 17179874088 00000004:00080000:1.0:1746065201.379816:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f100, transno 17179874089 00000004:00080000:1.0:1746065201.379818:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd8380, transno 17179874090 00000004:00080000:1.0:1746065201.379820:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd8700, transno 17179874091 00000004:00080000:1.0:1746065201.379821:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaca80, transno 17179874092 00000004:00080000:1.0:1746065201.379823:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577ed80, transno 17179874093 00000004:00080000:1.0:1746065201.379825:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edac380, transno 17179874094 00000004:00080000:1.0:1746065201.379827:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f1c00, transno 17179874095 00000004:00080000:1.0:1746065201.379829:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edad500, transno 17179874096 00000004:00080000:1.0:1746065201.379830:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edad880, transno 17179874097 00000004:00080000:1.0:1746065201.379832:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaf800, transno 17179874098 00000004:00080000:1.0:1746065201.379834:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edae300, transno 17179874099 00000004:00080000:1.0:1746065201.379835:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaf480, transno 17179874100 00000004:00080000:1.0:1746065201.379837:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edace00, transno 17179874101 00000004:00080000:1.0:1746065201.379839:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaf100, transno 17179874102 00000004:00080000:1.0:1746065201.379841:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dca80, transno 17179874103 00000004:00080000:1.0:1746065201.379843:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edac700, transno 17179874104 00000004:00080000:1.0:1746065201.379845:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaea00, transno 17179874105 00000100:00100000:1.0:1746065201.379848:0:3759:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff8800996fbb80 x1830881263832320/t17179874117(17179874117) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065217 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:1.0:1746065201.379855:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996fbb80/2, rc 0, transno 17179874117 00000100:00100000:1.0:1746065201.379857:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263832320:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065201.379866:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996f8380/2, rc 0, transno 17179874118 00000100:00100000:1.0:1746065201.379868:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263832832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065201.379874:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996f8700/2, rc 0, transno 17179874115 00000100:00100000:1.0:1746065201.379876:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263832192:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065201.379881:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996f9c00/2, rc 0, transno 17179874116 00000100:00100000:1.0:1746065201.379883:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263832704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065201.379994:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 24 done 00000100:00080000:1.0:1746065201.380049:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065201.380052:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065201.383188:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263830912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.383238:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.383328:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263831040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.383345:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065201.391706:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513a300/2, rc 0, transno 21474841537 00000100:00100000:0.0:1746065201.391710:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263830912:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.391715:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263831424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065201.391735:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.391755:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263831936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.391766:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.391795:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263832448:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.391806:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065201.391814:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263832960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.391825:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065201.391877:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263831424 00000100:00100000:1.0:1746065201.391881:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263831424 00000100:00100000:1.0:1746065201.391899:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263831936 00000100:00100000:1.0:1746065201.391900:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263831936 00000100:00100000:1.0:1746065201.391907:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263832448 00000100:00100000:1.0:1746065201.391909:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263832448 00000100:00100000:1.0:1746065201.391915:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263832960 00000100:00100000:1.0:1746065201.391916:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263832960 00000100:00100000:1.0:1746065201.391924:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16556 00000100:00100000:1.0:1746065201.391927:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881263831424:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065201.391975:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746065201.391978:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065201.391979:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065201.391981:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065201.391983:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:1.0:1746065201.392004:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263831424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (269us total) trans 21474841540 rc 0/0 00000100:00100000:1.0:1746065201.392008:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16556 00000100:00100000:1.0:1746065201.392019:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16557 00000100:00100000:1.0:1746065201.392023:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263831936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.392068:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881263831936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (300us total) trans 17179874121 rc 0/0 00000100:00100000:1.0:1746065201.392073:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16557 00000100:00100000:1.0:1746065201.392081:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16558 00000100:00100000:1.0:1746065201.392085:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263832448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065201.392116:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065201.392118:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065201.392120:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065201.392122:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065201.392123:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065201.392139:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881263832448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (332us total) trans 17179874122 rc 0/0 00000100:00100000:1.0:1746065201.392143:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16558 00000100:00100000:1.0:1746065201.392152:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16559 00000100:00100000:1.0:1746065201.392156:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263832960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065201.392198:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881263832960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (372us total) trans 17179874123 rc 0/0 00000100:00100000:1.0:1746065201.392205:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16559 00000004:00080000:0.0:1746065201.399606:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aba7800/2, rc 0, transno 21474841540 00000100:00100000:0.0:1746065201.399617:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263831424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065201.399632:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996fb100/2, rc 0, transno 17179874121 00000100:00100000:0.0:1746065201.399635:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263831936:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065201.399643:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996f9180/2, rc 0, transno 17179874122 00000100:00100000:0.0:1746065201.399645:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263832448:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065201.399655:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996fa300/2, rc 0, transno 17179874123 00000100:00100000:0.0:1746065201.399657:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263832960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065201.406749:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065201.406838:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264983552 00000100:00100000:1.0:1746065201.406845:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264983552 00000100:00100000:1.0:1746065201.406892:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14364 00000100:00100000:1.0:1746065201.406899:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:1955:x1830881264983552:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065201.406915:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065201.406930:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fac00/0xad6b7ddc147715d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93801a expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.406999:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xad6b7ddc1477164 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.407010:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xad6b7ddc1477164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.407019:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xad6b7ddc1477164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065201.407039:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00000004:00200000:1.0:1746065201.407042:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065201.407054:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xad6b7ddc1477164 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065201.407072:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800929fac00/0xad6b7ddc147715d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93801a expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.407085:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xad6b7ddc1477164 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93801a expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065201.407092:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065201.407095:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065201.407098:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5e00, rc 0) 00000100:00100000:1.0:1746065201.407135:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:1955:x1830881264983552:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 237us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065201.407140:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14364 00000100:00100000:0.0:1746065201.414678:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.414714:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.414744:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.414770:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.414825:0:8144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264983680 00000100:00100000:0.0:1746065201.414833:0:8144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264983680 00000100:00100000:0.0:1746065201.414871:0:8144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 233 00000100:00100000:0.0:1746065201.414877:0:8144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124d38bc-0f92-4827-84b7-a543154654fd+15:2006:x1830881264983680:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065201.414934:0:8144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124d38bc-0f92-4827-84b7-a543154654fd+15:2006:x1830881264983680:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 56us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065201.414940:0:8144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 233 00000100:00080000:0.0:1746065201.415747:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065201.417452:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.417492:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.417514:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.417525:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.417537:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065201.417554:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065202.063680:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065202.428062:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.428098:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.428135:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.428149:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.428178:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.428248:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.428274:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264984960 00000100:00100000:0.0:1746065202.428284:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264984960 00000100:00100000:0.0:1746065202.429980:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264985216 00000100:00100000:0.0:1746065202.429988:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264985216 00000100:00100000:1.0:1746065202.430133:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264985472 00000100:00100000:1.0:1746065202.430138:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264985472 00000100:00100000:1.0:1746065202.430162:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264985088 00000100:00100000:1.0:1746065202.430165:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264985088 00000100:00100000:1.0:1746065202.430178:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264985344 00000100:00100000:1.0:1746065202.430180:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264985344 00000100:00100000:1.0:1746065202.430190:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264985600 00000100:00100000:1.0:1746065202.430192:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264985600 00000100:00100000:1.0:1746065202.430209:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16566 00000100:00100000:1.0:1746065202.430217:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881264984960:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:1.0:1746065202.431422:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881264984960:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 1204us (3645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065202.431428:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16566 00000100:00100000:0.0:1746065202.438362:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.441829:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.441867:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.441901:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.441927:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.441954:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.442582:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264985856 00000100:00100000:0.0:1746065202.442586:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264985856 00000100:00100000:0.0:1746065202.443379:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16577 00000100:00100000:0.0:1746065202.443386:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881264985856:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065202.443425:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881264985856:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 40us (1605us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.443431:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16577 00000100:00100000:0.0:1746065202.448566:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.453359:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.461074:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.465554:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.465594:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.465641:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.465689:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264987136 00000100:00100000:0.0:1746065202.465696:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264987136 00000100:00100000:0.0:1746065202.465748:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264987392 00000100:00100000:0.0:1746065202.465750:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264987392 00000100:00100000:1.0:1746065202.465759:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264987648 00000100:00100000:0.0:1746065202.465767:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5761 00000100:00100000:1.0:1746065202.465769:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264987648 00000100:00100000:0.0:1746065202.465804:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881264987136:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065202.465836:0:9555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc147719c lrc: 3/1,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065202.465837:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5762 00010000:00010000:0.0:1746065202.465848:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.465850:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.465854:0:9555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc147719c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.465864:0:9555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc147719c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065202.465961:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881264987392:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065202.465979:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc14771aa lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.465988:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065202.465989:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065202.465993:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc14771aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.466002:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc14771aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065202.470045:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5764 00000100:00100000:0.0:1746065202.470083:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881264987904:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065202.470113:0:9553:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f04a000/0xad6b7ddc14771b1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.470124:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.470126:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.470130:0:9553:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f04a000/0xad6b7ddc14771b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.470140:0:9553:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f04a000/0xad6b7ddc14771b1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.504143:0:9555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc147719c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.504157:0:9555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc147719c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.504163:0:9555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc147719c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.504169:0:9555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065202.504172:0:9555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc147719c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.504178:0:9555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc147719c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.504193:0:9555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc147719c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.504197:0:9555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d47600/0xad6b7ddc147719c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065202.504286:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881264987136:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 38509us (38734us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065202.504295:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5761 00010000:00010000:1.0:1746065202.519765:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc14771aa lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.519791:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc14771aa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.519798:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc14771aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.519803:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065202.519807:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc14771aa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.519814:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc14771aa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.519829:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc14771aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.519834:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc14771aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065202.519902:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881264987392:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 54053us (54301us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065202.519910:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5762 00000100:00100000:0.0:1746065202.549105:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.549263:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264988800 00000100:00100000:1.0:1746065202.549271:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264988800 00000100:00100000:1.0:1746065202.549446:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 812 00000100:00100000:1.0:1746065202.549453:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:1955:x1830881264988800:12345-192.168.202.27@tcp:103:mirror_io.0 00010000:00010000:1.0:1746065202.549465:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065202.549493:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67e00/0xad6b7ddc1477110 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938005 expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.549729:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065202.549733:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065202.549909:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:1955:x1830881264988800:12345-192.168.202.27@tcp:103:mirror_io.0 Request processed in 456us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065202.549915:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 812 00000100:00100000:0.0:1746065202.551960:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.554498:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.575271:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.584365:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.594355:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.603241:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.603278:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.603296:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.603309:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.603336:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.603355:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264990208 00000100:00100000:0.0:1746065202.603362:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264990208 00000100:00100000:0.0:1746065202.603392:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264990592 00000100:00100000:0.0:1746065202.603394:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264990592 00000100:00100000:0.0:1746065202.603402:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264990720 00000100:00100000:0.0:1746065202.603404:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264990720 00000100:00100000:0.0:1746065202.603411:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264990848 00000100:00100000:0.0:1746065202.603412:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264990848 00000100:00100000:0.0:1746065202.603423:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16580 00000100:00100000:0.0:1746065202.603430:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881264990208:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.603444:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.603458:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090684a00/0xad6b7ddc1477228 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938060 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.603485:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.603488:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.603495:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090684a00/0xad6b7ddc1477228 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938060 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.603509:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090684a00/0xad6b7ddc1477228 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938060 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.603522:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090684a00, rc 0) 00000100:00100000:0.0:1746065202.603557:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881264990208:12345-192.168.202.27@tcp:101:cat.0 Request processed in 128us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.603563:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16580 00000100:00100000:0.0:1746065202.603576:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16581 00000100:00100000:0.0:1746065202.603581:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881264990592:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.603587:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.603595:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090684000/0xad6b7ddc147722f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93806e expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.603604:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.603605:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.603608:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090684000/0xad6b7ddc147722f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93806e expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.603617:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090684000/0xad6b7ddc147722f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93806e expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.603622:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090684000, rc 0) 00000100:00100000:0.0:1746065202.603635:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881264990592:12345-192.168.202.27@tcp:101:cat.0 Request processed in 54us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.603639:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16581 00000100:00100000:0.0:1746065202.603649:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16582 00000100:00100000:0.0:1746065202.603653:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881264990720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.603660:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.603666:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc1477236 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938075 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.603674:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.603675:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.603678:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc1477236 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938075 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.603686:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc1477236 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938075 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.603692:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090685400, rc 0) 00000100:00100000:0.0:1746065202.603704:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881264990720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.603709:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16582 00000100:00100000:0.0:1746065202.603717:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16583 00000100:00100000:0.0:1746065202.603721:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881264990848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.603726:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.603732:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090684200/0xad6b7ddc147723d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93807c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.603739:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.603741:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.603744:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090684200/0xad6b7ddc147723d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93807c expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.603751:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090684200/0xad6b7ddc147723d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93807c expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.603757:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090684200, rc 0) 00000100:00100000:0.0:1746065202.603770:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881264990848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 49us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.603802:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16583 00000100:00100000:0.0:1746065202.603831:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.603844:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264990976 00000100:00100000:0.0:1746065202.603847:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264990976 00000100:00100000:0.0:1746065202.603861:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16584 00000100:00100000:0.0:1746065202.603865:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881264990976:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.603871:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.603876:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090684400/0xad6b7ddc1477244 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938083 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.603886:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.603887:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.603891:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090684400/0xad6b7ddc1477244 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938083 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.603898:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090684400/0xad6b7ddc1477244 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938083 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.603904:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090684400, rc 0) 00000100:00100000:0.0:1746065202.603918:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881264990976:12345-192.168.202.27@tcp:101:cat.0 Request processed in 53us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.603922:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16584 00000100:00100000:0.0:1746065202.603964:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.603975:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264991104 00000100:00100000:0.0:1746065202.603977:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264991104 00000100:00100000:0.0:1746065202.603990:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16585 00000100:00100000:0.0:1746065202.603994:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881264991104:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.603999:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.604005:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090685e00/0xad6b7ddc147724b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93808a expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.604014:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604015:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604018:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090685e00/0xad6b7ddc147724b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93808a expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604025:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090685e00/0xad6b7ddc147724b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93808a expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604032:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090685e00, rc 0) 00000100:00100000:0.0:1746065202.604047:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881264991104:12345-192.168.202.27@tcp:101:cat.0 Request processed in 52us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.604051:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16585 00000100:00100000:0.0:1746065202.604080:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.604088:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264991232 00000100:00100000:0.0:1746065202.604091:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264991232 00000100:00100000:0.0:1746065202.604103:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16586 00000100:00100000:0.0:1746065202.604107:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881264991232:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.604112:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.604119:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1477252 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938091 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.604128:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604129:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604133:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1477252 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938091 expref: 27 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604141:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1477252 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938091 expref: 27 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604146:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779600, rc 0) 00000100:00100000:0.0:1746065202.604159:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881264991232:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (78us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.604163:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16586 00000100:00100000:0.0:1746065202.604194:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.604204:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264991360 00000100:00100000:0.0:1746065202.604206:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264991360 00000100:00100000:0.0:1746065202.604219:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16587 00000100:00100000:0.0:1746065202.604223:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881264991360:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.604229:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.604234:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1477259 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938098 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.604243:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604244:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604248:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1477259 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938098 expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604259:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1477259 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938098 expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604265:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779200, rc 0) 00000100:00100000:0.0:1746065202.604278:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090173c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881264991360:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.604282:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16587 00000100:00100000:0.0:1746065202.604395:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.604405:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264991488 00000100:00100000:0.0:1746065202.604407:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264991488 00000100:00100000:0.0:1746065202.604419:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16588 00000100:00100000:0.0:1746065202.604423:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881264991488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.604428:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.604433:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095778200/0xad6b7ddc1477260 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93809f expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.604441:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604442:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604445:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095778200/0xad6b7ddc1477260 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93809f expref: 24 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604452:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095778200/0xad6b7ddc1477260 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93809f expref: 24 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604457:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778200, rc 0) 00000100:00100000:0.0:1746065202.604470:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881264991488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 47us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.604487:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16588 00000100:00100000:0.0:1746065202.604517:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.604527:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264991616 00000100:00100000:0.0:1746065202.604529:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264991616 00000100:00100000:0.0:1746065202.604540:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16589 00000100:00100000:0.0:1746065202.604544:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881264991616:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.604549:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.604554:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477267 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9380a6 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.604562:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604563:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604566:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477267 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380a6 expref: 28 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604574:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477267 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380a6 expref: 28 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604580:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778e00, rc 0) 00000100:00100000:0.0:1746065202.604592:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881264991616:12345-192.168.202.27@tcp:101:cat.0 Request processed in 47us (74us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.604596:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16589 00000100:00100000:0.0:1746065202.604625:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.604634:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264991744 00000100:00100000:0.0:1746065202.604637:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264991744 00000100:00100000:0.0:1746065202.604648:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16590 00000100:00100000:0.0:1746065202.604652:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881264991744:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.604657:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.604662:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc147726e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9380ad expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.604671:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604672:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604675:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc147726e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380ad expref: 29 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604683:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc147726e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380ad expref: 29 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604689:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779c00, rc 0) 00000100:00100000:0.0:1746065202.604701:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881264991744:12345-192.168.202.27@tcp:101:cat.0 Request processed in 48us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.604706:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16590 00000100:00100000:0.0:1746065202.604743:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.604754:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264991872 00000100:00100000:0.0:1746065202.604757:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264991872 00000100:00100000:0.0:1746065202.604769:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16591 00000100:00100000:0.0:1746065202.604795:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881264991872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065202.604801:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065202.604806:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc1477275 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9380b4 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065202.604815:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604816:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065202.604819:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc1477275 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380b4 expref: 25 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604827:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc1477275 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380b4 expref: 25 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065202.604834:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090684e00, rc 0) 00000100:00100000:0.0:1746065202.604848:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881264991872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 74us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065202.604852:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16591 00000100:00100000:0.0:1746065202.615463:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.615659:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264992000 00000100:00100000:1.0:1746065202.615664:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264992000 00010000:00010000:1.0:1746065202.615687:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc1477205 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938052 expref: 11 pid: 13395 timeout: 898 lvb_type: 0 00000100:00100000:0.0:1746065202.615687:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.616232:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264992128 00000100:00100000:1.0:1746065202.616236:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264992128 00010000:00010000:1.0:1746065202.616249:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6c000/0xad6b7ddc14771e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93804b expref: 30 pid: 7231 timeout: 898 lvb_type: 0 00000100:00100000:0.0:1746065202.618538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.620586:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264992256 00000100:00100000:1.0:1746065202.620596:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264992256 00010000:00010000:1.0:1746065202.620627:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xad6b7ddc1477164 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93801a expref: 10 pid: 7204 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065202.620866:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7631 00000100:00100000:1.0:1746065202.620873:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881264992256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065202.620887:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065202.620892:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xad6b7ddc1477164 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93801a expref: 10 pid: 7204 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065202.620902:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xad6b7ddc1477164 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93801a expref: 10 pid: 7204 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065202.620919:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5e00/0xad6b7ddc1477164 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93801a expref: 10 pid: 7204 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065202.620939:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065202.620944:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc1477283 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065202.620952:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc1477283 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065202.620957:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc1477283 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065202.621099:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065202.623538:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881264992256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2658us (4998us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065202.623547:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7631 00000100:00100000:0.0:1746065202.624092:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.624106:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.624116:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.624126:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.624146:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.624174:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264993024 00000100:00100000:0.0:1746065202.624177:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264993024 00002000:00100000:0.0:1746065202.624196:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880097d29880 x1830881264993024/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:118/0 lens 488/0 e 0 to 0 dl 1746065213 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065202.624203:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d29880 with x1830881264993024 ext(0->1048575) 00002000:00010000:0.0:1746065202.624206:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d29880 00000100:00100000:0.0:1746065202.624216:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5768 00000100:00100000:0.0:1746065202.624220:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881264992768:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065202.625341:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5770 00000100:00100000:0.0:1746065202.625349:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881264993024:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065202.628513:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264993408 00000100:00100000:1.0:1746065202.628522:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264993408 00000100:00100000:1.0:1746065202.628570:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14369 00000100:00100000:1.0:1746065202.628577:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:1966:x1830881264993408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065202.628592:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065202.628609:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1477291 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9380bb expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.628654:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1477291 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380bb expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.628665:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1477291 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380bb expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.628679:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065202.628682:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065202.628686:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad600, rc 0) 00000100:00100000:1.0:1746065202.628713:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:1966:x1830881264993408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 136us (4565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065202.628719:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14369 00000100:00100000:0.0:1746065202.633957:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.660350:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.660884:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264993792 00000100:00100000:1.0:1746065202.660890:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264993792 00010000:00010000:1.0:1746065202.660912:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1477156 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938013 expref: 9 pid: 9571 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065202.660941:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7632 00000100:00100000:1.0:1746065202.660947:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881264993792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065202.660957:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065202.660962:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1477156 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938013 expref: 9 pid: 9571 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065202.660970:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1477156 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938013 expref: 9 pid: 9571 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065202.660991:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1477156 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938013 expref: 9 pid: 9571 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065202.663512:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065202.663519:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.663528:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.663533:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065202.663579:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881264993792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2630us (3228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065202.663587:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7632 00000100:00100000:0.0:1746065202.671546:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.671598:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.671658:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264994048 00000100:00100000:1.0:1746065202.671666:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264994048 00010000:00010000:1.0:1746065202.671691:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1477291 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380bb expref: 11 pid: 13395 timeout: 898 lvb_type: 0 00000100:00100000:1.0:1746065202.671712:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7633 00000100:00100000:1.0:1746065202.671717:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881264994048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065202.671731:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065202.671735:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1477291 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380bb expref: 12 pid: 13395 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065202.671745:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1477291 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380bb expref: 12 pid: 13395 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065202.671766:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1477291 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380bb expref: 12 pid: 13395 timeout: 898 lvb_type: 0 00010000:00010000:1.0:1746065202.671802:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065202.671807:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.671815:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.671821:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.672628:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065202.672651:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881264994048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 932us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065202.672657:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7633 00010000:00010000:1.0:1746065202.672681:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000020 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.672686:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000020 pid: 7231 initiator: MDT0 00000040:00080000:1.0:1746065202.672910:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].956, 88 off91960 00000004:00080000:1.0:1746065202.672917:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798691143112ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065202.672945:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].983, 88 off94336 00000004:00080000:1.0:1746065202.672950:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798691176493ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065202.672964:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].984, 88 off94424 00000004:00080000:1.0:1746065202.672967:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798691193299ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065202.672974:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].957, 88 off92048 00000004:00080000:1.0:1746065202.672976:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798691202530ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065202.672982:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].958, 88 off92136 00000004:00080000:1.0:1746065202.672984:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798691210562ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065202.672990:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].985, 88 off94512 00000004:00080000:1.0:1746065202.672995:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798691221804ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065202.673003:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].986, 88 off94600 00000004:00080000:1.0:1746065202.673005:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798691231469ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065202.673012:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].987, 88 off94688 00000004:00080000:1.0:1746065202.673014:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798691240948ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065202.673043:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].959, 88 off92224 00000004:00080000:1.0:1746065202.673046:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798691272548ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065202.673056:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].988, 88 off94776 00000004:00080000:1.0:1746065202.673058:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798691284912ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065202.673065:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].960, 88 off92312 00000004:00080000:1.0:1746065202.673068:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798691294143ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065202.673093:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].989, 88 off94864 00000004:00080000:1.0:1746065202.673095:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798691321755ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065202.673102:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].961, 88 off92400 00000004:00080000:1.0:1746065202.673104:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798691331013ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065202.673111:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].962, 88 off92488 00000004:00080000:1.0:1746065202.673113:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798691339842ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065202.673119:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].963, 88 off92576 00000004:00080000:1.0:1746065202.673121:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798691348058ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065202.673129:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].964, 88 off92664 00000004:00080000:1.0:1746065202.673132:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 798691358404ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065202.673139:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].990, 88 off94952 00000004:00080000:1.0:1746065202.673142:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 798691368178ns, next at 761143559853ns, rc = 0 00010000:00010000:1.0:1746065202.675582:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c2 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.675592:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065202.675594:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065202.675597:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc14772a6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c9 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.675604:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc14772a6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c9 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.675610:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc14772a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c9 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065202.675626:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263833728 00000100:00100000:1.0:1746065202.675631:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263833728 00000100:00100000:1.0:1746065202.675660:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16592 00000100:00100000:1.0:1746065202.675666:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263833728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065202.675761:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065202.675764:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:1.0:1746065202.675767:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065198 -> 1746065198 00002000:00010000:1.0:1746065202.675768:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065199 -> 1746065199 00002000:00010000:1.0:1746065202.675770:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 1752 -> 1752 00000100:00100000:1.0:1746065202.675815:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+15:3762:x1830881263833728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (358us total) trans 17179874125 rc 0/0 00000100:00100000:1.0:1746065202.675821:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16592 00010000:00010000:1.0:1746065202.675852:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc14772a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c9 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065202.675864:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263833984:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065202.675906:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065202.676067:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263834240:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065202.676097:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065202.676119:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263834752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065202.676135:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065202.676172:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263833856:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065202.676282:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263835264:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065202.676336:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263834752 00000100:00100000:0.0:1746065202.676339:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263834752 00000100:00100000:0.0:1746065202.676367:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16594 00000100:00100000:0.0:1746065202.676373:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3760:x1830881263834496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065202.676431:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 4670560 -> 4670560 00002000:00010000:0.0:1746065202.676434:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065201 -> 1746065201 00002000:00010000:0.0:1746065202.676436:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00002000:00010000:0.0:1746065202.676437:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065201 -> 1746065201 00002000:00010000:0.0:1746065202.676439:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5040 -> 5040 00000100:00100000:0.0:1746065202.676466:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3760:x1830881263834496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 93us (391us total) trans 17179874126 rc 0/0 00000100:00100000:1.0:1746065202.676494:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16596 00000100:00100000:0.0:1746065202.676499:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16594 00000100:00100000:1.0:1746065202.676501:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+16:3760:x1830881263835136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065202.676512:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16597 00000100:00100000:0.0:1746065202.676518:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3761:x1830881263834752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065202.676548:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16598 00000100:00100000:1.0:1746065202.676552:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+16:3760:x1830881263835648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065202.676566:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065202.676569:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065202.676571:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065202.676572:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065202.676574:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00002000:00010000:1.0:1746065202.676592:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:0.0:1746065202.676592:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881263834752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (456us total) trans 21474841544 rc 0/0 00002000:00010000:1.0:1746065202.676594:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065202.676596:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746065202.676596:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16597 00002000:00010000:1.0:1746065202.676597:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065202.676599:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:1.0:1746065202.676619:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3760:x1830881263835648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (332us total) trans 17179874127 rc 0/0 00000100:00100000:1.0:1746065202.676624:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16598 00000100:00100000:1.0:1746065202.676634:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263834368 00000100:00100000:1.0:1746065202.676637:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263834368 00000100:00100000:1.0:1746065202.676650:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16599 00000100:00100000:1.0:1746065202.676654:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+18:3762:x1830881263834368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065202.676666:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263834880 00000100:00100000:0.0:1746065202.676669:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263834880 00000100:00100000:0.0:1746065202.676681:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263835392 00000100:00100000:0.0:1746065202.676682:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263835392 00002000:00010000:1.0:1746065202.676691:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065202.676693:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065201 -> 1746065201 00002000:00010000:1.0:1746065202.676695:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00000100:00100000:0.0:1746065202.676695:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16600 00002000:00010000:1.0:1746065202.676696:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065201 -> 1746065201 00002000:00010000:1.0:1746065202.676698:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746065202.676699:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263834880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065202.676718:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263834368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (88us total) trans 21474841545 rc 0/0 00000100:00100000:1.0:1746065202.676723:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16599 00000100:00100000:1.0:1746065202.676732:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16601 00000100:00100000:1.0:1746065202.676736:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+17:3762:x1830881263835392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065202.676747:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:0.0:1746065202.676749:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065202.676751:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065202.676752:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065202.676754:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00002000:00010000:1.0:1746065202.676768:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065202.676770:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065202.676788:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065202.676789:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065202.676791:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065202.676800:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263834880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 100us (145us total) trans 21474841546 rc 0/0 00000100:00100000:0.0:1746065202.676806:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16600 00000100:00100000:1.0:1746065202.676809:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+19:3762:x1830881263835392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (132us total) trans 17179874128 rc 0/0 00000100:00100000:1.0:1746065202.676813:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16601 00000100:00100000:1.0:1746065202.676827:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065202.676839:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263834624:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065202.676842:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263833856 00000100:00100000:0.0:1746065202.676844:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263833856 00000100:00100000:1.0:1746065202.676852:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065202.677228:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263834624 00000100:00100000:0.0:1746065202.677231:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263834624 00000100:00100000:1.0:1746065202.677238:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263835008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065202.677243:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16603 00000100:00100000:0.0:1746065202.677246:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881263833856:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065202.677254:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065202.677263:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263835520:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065202.677273:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:0.0:1746065202.677280:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065202.677283:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:0.0:1746065202.677285:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065198 -> 1746065198 00002000:00010000:0.0:1746065202.677286:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065200 -> 1746065200 00002000:00010000:0.0:1746065202.677288:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065202.677289:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263835008 00000100:00100000:1.0:1746065202.677292:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263835008 00000100:00100000:1.0:1746065202.677304:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263835520 00000100:00100000:1.0:1746065202.677306:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263835520 00000100:00100000:1.0:1746065202.677313:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16604 00000100:00100000:0.0:1746065202.677313:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881263833856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (485us total) trans 17179874130 rc 0/0 00000100:00100000:1.0:1746065202.677317:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881263834624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065202.677318:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16603 00000100:00100000:0.0:1746065202.677330:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16605 00000100:00100000:0.0:1746065202.677335:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881263835008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065202.677359:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065202.677361:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065202.677363:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065202.677364:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065202.677366:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:1.0:1746065202.677383:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263834624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (529us total) trans 21474841548 rc 0/0 00000100:00100000:1.0:1746065202.677387:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16604 00000100:00100000:0.0:1746065202.677393:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263835008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (137us total) trans 21474841549 rc 0/0 00000100:00100000:1.0:1746065202.677397:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16606 00000100:00100000:0.0:1746065202.677400:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16605 00000100:00100000:1.0:1746065202.677401:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881263835520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065202.677447:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881263835520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (172us total) trans 17179874131 rc 0/0 00000100:00100000:1.0:1746065202.677451:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16606 00000100:00100000:1.0:1746065202.677500:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263835136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1000us (1380us total) trans 21474841543 rc 0/0 00000100:00100000:1.0:1746065202.677504:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16596 00000004:00080000:1.0:1746065202.677524:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd8700/2, rc 0, transno 17179874130 00000100:00100000:1.0:1746065202.677528:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263833856:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065202.677535:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615ea00/2, rc 0, transno 21474841548 00000100:00100000:1.0:1746065202.677538:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263834624:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065202.677543:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615f100/2, rc 0, transno 21474841549 00000100:00100000:1.0:1746065202.677546:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263835008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065202.677551:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800996f9500/2, rc 0, transno 17179874131 00000100:00100000:1.0:1746065202.677553:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263835520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065202.695579:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.695687:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.697019:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263833984:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065202.697043:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc1477298 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c2 expref: 29 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065202.697057:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c2 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.697067:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d800, rc 0) 00000100:00100000:1.0:1746065202.697097:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:1963:x1830881264993664:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 58179us (63146us total) trans 8589936817 rc 0/0 00000100:00100000:1.0:1746065202.697102:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14370 00000100:00100000:0.0:1746065202.709574:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.709619:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.709715:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264994432 00000100:00100000:1.0:1746065202.709720:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264994432 00000100:00100000:1.0:1746065202.709753:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 813 00000100:00100000:1.0:1746065202.709759:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881264994432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065202.709790:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065202.709808:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14772ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380d0 expref: 28 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.709821:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065202.709824:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065202.709858:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881264994432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065202.709863:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 813 00000100:00100000:0.0:1746065202.713896:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.713935:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.715457:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.715481:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264995328 00000100:00100000:0.0:1746065202.715484:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264995328 00002000:00100000:0.0:1746065202.715499:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012edac380 x1830881264995328/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:118/0 lens 488/0 e 0 to 0 dl 1746065213 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065202.715505:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac380 with x1830881264995328 ext(1048576->2097151) 00002000:00010000:0.0:1746065202.715509:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edac380 00000100:00100000:0.0:1746065202.715519:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5774 00000100:00100000:0.0:1746065202.715524:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881264995328:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065202.721344:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.722021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.728146:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.732823:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.732842:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.732906:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264996224 00000100:00100000:1.0:1746065202.732913:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264996224 00010000:00010000:1.0:1746065202.732938:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147718e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93803d expref: 12 pid: 10219 timeout: 898 lvb_type: 1 00000100:00100000:1.0:1746065202.732961:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7635 00000100:00100000:1.0:1746065202.732966:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881264996224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065202.732976:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065202.732991:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147718e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93803d expref: 12 pid: 10219 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065202.733000:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147718e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93803d expref: 12 pid: 10219 timeout: 898 lvb_type: 1 00010000:00010000:1.0:1746065202.733019:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065202.733048:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881264996224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065202.733053:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7635 00000100:00100000:0.0:1746065202.742750:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.742768:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.742801:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264996608 00000100:00100000:0.0:1746065202.742804:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264996608 00002000:00100000:0.0:1746065202.742821:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012edaf480 x1830881264996608/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:118/0 lens 488/0 e 0 to 0 dl 1746065213 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065202.742828:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf480 with x1830881264996608 ext(1048576->2097151) 00002000:00010000:0.0:1746065202.742831:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edaf480 00000100:00100000:0.0:1746065202.742840:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264996864 00000100:00100000:0.0:1746065202.742841:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264996864 00002000:00100000:0.0:1746065202.742849:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012edace00 x1830881264996864/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:118/0 lens 488/0 e 0 to 0 dl 1746065213 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065202.742854:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edace00 with x1830881264996864 ext(1048576->2097151) 00002000:00010000:0.0:1746065202.742856:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edace00 00000100:00100000:0.0:1746065202.742864:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5777 00000100:00100000:0.0:1746065202.742868:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881264996608:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065202.749315:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263837056:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746065202.749347:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746065202.749684:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065202.749704:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263837056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065202.754406:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.755150:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.770345:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.773904:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881264996608:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 31026us (31148us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065202.773914:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5777 00002000:00100000:0.0:1746065202.773923:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012edaf480 x1830881264996608/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:118/0 lens 488/440 e 0 to 0 dl 1746065213 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065202.773932:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf480 with x1830881264996608 ext(1048576->2097151) 00002000:00010000:0.0:1746065202.773938:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edaf480 00000100:00100000:0.0:1746065202.778632:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.783896:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.784994:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.804309:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.812836:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.816148:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.817142:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264999040 00000100:00100000:1.0:1746065202.817151:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264999040 00002000:00100000:1.0:1746065202.817185:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4571136->4575231) req@ffff88012f1a7b80 x1830881264999040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:118/0 lens 488/0 e 0 to 0 dl 1746065213 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065202.817195:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7b80 with x1830881264999040 ext(4571136->4575231) 00002000:00010000:1.0:1746065202.817200:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7b80 00000100:00100000:1.0:1746065202.822034:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5781 00000100:00100000:1.0:1746065202.822050:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881264999040:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065202.822189:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881264999040:12345-192.168.202.27@tcp:3:cat.0 Request processed in 144us (6047us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065202.822195:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5781 00002000:00100000:1.0:1746065202.822202:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4571136->4575231) req@ffff88012f1a7b80 x1830881264999040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:118/0 lens 488/4536 e 0 to 0 dl 1746065213 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065202.822211:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7b80 with x1830881264999040 ext(4571136->4575231) 00002000:00010000:1.0:1746065202.822216:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7b80 00000100:00100000:0.0:1746065202.822673:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.822736:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.837149:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.844869:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.850327:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.854262:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.855035:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265000064:12345-192.168.202.27@tcp:4:cat.0 Request processed in 4520us (4710us total) trans 21474841550 rc 0/0 00000100:00100000:0.0:1746065202.855042:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1910 00002000:00100000:0.0:1746065202.855047:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (4173824->4194303) req@ffff88012f1a5880 x1830881265000064/t21474841550(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:118/0 lens 488/448 e 0 to 0 dl 1746065213 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065202.855054:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5880 with x1830881265000064 ext(4173824->4194303) 00010000:00010000:0.0:1746065202.855058:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800999c0600/0xad6b7ddc14772bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380de expref: 28 pid: 9549 timeout: 898 lvb_type: 0 00010000:00010000:0.0:1746065202.855072:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800999c0600/0xad6b7ddc14772bb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4173824->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380de expref: 28 pid: 9549 timeout: 898 lvb_type: 0 00002000:00010000:0.0:1746065202.855077:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f1a5880 00000100:00100000:0.0:1746065202.860196:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.866596:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.868810:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.889935:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.893014:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.893386:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.897995:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.898227:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265001088:12345-192.168.202.27@tcp:4:cat.0 Request processed in 4772us (5219us total) trans 17179874135 rc 0/0 00000100:00100000:0.0:1746065202.898235:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1911 00002000:00100000:0.0:1746065202.898243:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4575231) req@ffff88009ac64e00 x1830881265001088/t17179874135(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:118/0 lens 488/448 e 0 to 0 dl 1746065213 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065202.898251:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac64e00 with x1830881265001088 ext(4194304->4575231) 00010000:00010000:0.0:1746065202.898259:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc14772c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4194304->4575231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380e5 expref: 32 pid: 9549 timeout: 898 lvb_type: 0 00010000:00010000:0.0:1746065202.898272:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009af08600/0xad6b7ddc14772c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 4194304->4575231) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380e5 expref: 32 pid: 9549 timeout: 898 lvb_type: 0 00002000:00010000:0.0:1746065202.898278:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ac64e00 00000100:00100000:0.0:1746065202.900905:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.905531:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.905952:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265001728 00000100:00100000:1.0:1746065202.905957:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265001728 00002000:00100000:1.0:1746065202.905986:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4575232->4673535) req@ffff88009ac64700 x1830881265001728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:118/0 lens 488/0 e 0 to 0 dl 1746065213 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065202.905994:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac64700 with x1830881265001728 ext(4575232->4673535) 00002000:00010000:1.0:1746065202.905998:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac64700 00000100:00100000:1.0:1746065202.906016:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5786 00000100:00100000:1.0:1746065202.906022:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265001728:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065202.909178:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065202.909197:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263838592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065202.909244:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1746065202.909523:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065202.909574:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263838592:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065202.912206:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.912770:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.913002:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265002112 00000100:00100000:1.0:1746065202.913009:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265002112 00002000:00100000:1.0:1746065202.913044:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880097fa8e00 x1830881265002112/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:118/0 lens 488/0 e 0 to 0 dl 1746065213 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065202.913053:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8e00 with x1830881265002112 ext(3145728->4194303) 00002000:00010000:1.0:1746065202.913058:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa8e00 00000100:00100000:1.0:1746065202.913072:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265002240 00000100:00100000:1.0:1746065202.913074:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265002240 00002000:00100000:1.0:1746065202.913083:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097fab800 x1830881265002240/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:118/0 lens 488/0 e 0 to 0 dl 1746065213 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065202.913089:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab800 with x1830881265002240 ext(3145728->4194303) 00002000:00010000:1.0:1746065202.913091:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fab800 00000100:00100000:1.0:1746065202.913101:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5787 00000100:00100000:1.0:1746065202.913107:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265002112:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065202.914640:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5788 00000100:00100000:1.0:1746065202.914650:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265002240:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065202.930004:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265002112:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16887us (17794us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065202.930015:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5787 00002000:00100000:1.0:1746065202.930026:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880097fa8e00 x1830881265002112/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:118/0 lens 488/440 e 0 to 0 dl 1746065213 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065202.930035:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8e00 with x1830881265002112 ext(3145728->4194303) 00002000:00010000:1.0:1746065202.930040:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa8e00 00000100:00100000:0.0:1746065202.930813:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.939148:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265002240:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24492us (26369us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065202.939158:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5788 00002000:00100000:1.0:1746065202.939167:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097fab800 x1830881265002240/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:118/0 lens 488/440 e 0 to 0 dl 1746065213 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065202.939181:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab800 with x1830881265002240 ext(3145728->4194303) 00002000:00010000:1.0:1746065202.939186:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fab800 00000100:00100000:0.0:1746065202.950258:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.950377:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265002752 00000100:00100000:1.0:1746065202.950385:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265002752 00002000:00100000:1.0:1746065202.950426:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4673535) req@ffff880097faaa00 x1830881265002752/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:118/0 lens 488/0 e 0 to 0 dl 1746065213 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065202.950436:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faaa00 with x1830881265002752 ext(4194304->4673535) 00002000:00010000:1.0:1746065202.950441:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097faaa00 00000100:00100000:1.0:1746065202.951137:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5789 00000100:00100000:1.0:1746065202.951150:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265002752:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065202.955337:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265002752:12345-192.168.202.27@tcp:3:cat.0 Request processed in 4181us (5080us total) trans 0 rc 479232/479232 00000100:00100000:1.0:1746065202.955346:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5789 00002000:00100000:1.0:1746065202.955355:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4673535) req@ffff880097faaa00 x1830881265002752/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:118/0 lens 488/440 e 0 to 0 dl 1746065213 ref 1 fl Complete:/200/0 rc 479232/479232 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065202.955363:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faaa00 with x1830881265002752 ext(4194304->4673535) 00002000:00010000:1.0:1746065202.955368:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097faaa00 00000100:00100000:0.0:1746065202.965826:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.979197:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065202.979331:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265003264 00000100:00100000:1.0:1746065202.979339:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265003264 00000100:00100000:1.0:1746065202.979393:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14373 00000100:00100000:1.0:1746065202.979401:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+29:1973:x1830881265003264:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065202.979424:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065202.979439:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc14772fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93811d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065202.979634:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc1477301 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.979645:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc1477301 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.979654:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc1477301 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.979665:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc1477308 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.979670:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc1477308 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.979674:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fe00/0xad6b7ddc1477308 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.979752:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc147730f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.979760:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc147730f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065202.979765:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fc00/0xad6b7ddc147730f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065202.979864:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 8864864 00000100:00100000:0.0:1746065202.990731:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065202.995968:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.005031:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065203.013755:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065203.019038:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.019085:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065203.019638:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065203.019642:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065203.021179:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065203.021647:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065203.029436:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.032578:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.047554:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265004928 00000100:00100000:0.0:1746065203.047563:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265004928 00000100:00100000:0.0:1746065203.047605:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14377 00000100:00100000:0.0:1746065203.047612:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:1975:x1830881265004928:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065203.047632:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.047635:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065203.047658:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f0bba00/0xad6b7ddc147734e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938139 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.047687:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065203.047691:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065203.047700:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147737f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938147 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.047805:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477386 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065203.047816:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477386 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065203.047824:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477386 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065203.047833:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477386 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065203.047838:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477386 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065203.047842:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477386 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065203.047846:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065203.047849:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477386 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065203.047854:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477386 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065203.047859:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065203.047862:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065203.047865:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477386 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065203.047868:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477386 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065203.047888:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147737f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938147 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.047894:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147737f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938147 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.047899:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b200, rc 0) 00000100:00100000:0.0:1746065203.047940:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+7:1975:x1830881265004928:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 328us (617us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065203.047945:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14377 00000100:00100000:0.0:1746065203.051348:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.075061:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065203.075797:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065203.095169:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.095570:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265005696 00000100:00100000:1.0:1746065203.095580:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265005696 00002000:00100000:1.0:1746065203.095648:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880091b65c00 x1830881265005696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:119/0 lens 488/0 e 0 to 0 dl 1746065214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.095657:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65c00 with x1830881265005696 ext(0->1048575) 00002000:00010000:1.0:1746065203.095662:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65c00 00000100:00100000:1.0:1746065203.095681:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5790 00000100:00100000:1.0:1746065203.095688:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265005696:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065203.115098:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265005696:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19403us (19933us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065203.115108:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5790 00002000:00100000:1.0:1746065203.115116:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880091b65c00 x1830881265005696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:119/0 lens 488/440 e 0 to 0 dl 1746065214 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.115124:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65c00 with x1830881265005696 ext(0->1048575) 00002000:00010000:1.0:1746065203.115128:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65c00 00000100:00100000:0.0:1746065203.117904:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.157993:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.158059:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.159314:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265006208 00000100:00100000:1.0:1746065203.159324:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265006208 00002000:00100000:1.0:1746065203.159367:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091b64000 x1830881265006208/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:119/0 lens 488/0 e 0 to 0 dl 1746065214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.159377:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64000 with x1830881265006208 ext(3145728->4194303) 00002000:00010000:1.0:1746065203.159383:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b64000 00000100:00100000:1.0:1746065203.159798:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5791 00000100:00100000:1.0:1746065203.159805:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265006208:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065203.169353:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.182287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.182315:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.182357:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.182378:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265006848 00000100:00100000:1.0:1746065203.182383:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265006848 00010000:00010000:1.0:1746065203.182406:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc14772d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380fa expref: 13 pid: 9549 timeout: 899 lvb_type: 0 00000100:00100000:1.0:1746065203.182421:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265006976 00000100:00100000:1.0:1746065203.182423:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265006976 00010000:00010000:1.0:1746065203.182435:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538800/0xad6b7ddc14772de lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938101 expref: 27 pid: 9549 timeout: 899 lvb_type: 0 00000100:00100000:1.0:1746065203.182446:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7646 00000100:00100000:1.0:1746065203.182449:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265006720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065203.182454:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065203.182465:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1477340 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938132 expref: 12 pid: 9549 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746065203.182484:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1477340 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938132 expref: 12 pid: 9549 timeout: 899 lvb_type: 1 00000100:00100000:0.0:1746065203.182565:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265006208:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22761us (24582us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065203.182572:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5791 00002000:00100000:0.0:1746065203.182580:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091b64000 x1830881265006208/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:119/0 lens 488/440 e 0 to 0 dl 1746065214 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065203.182587:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64000 with x1830881265006208 ext(3145728->4194303) 00002000:00010000:0.0:1746065203.182591:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b64000 00010000:00010000:1.0:1746065203.182756:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc1477340 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938132 expref: 12 pid: 9549 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746065203.182771:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065203.182799:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265006720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 348us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065203.182804:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7646 00000100:00100000:1.0:1746065203.190691:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265007360 00000100:00100000:1.0:1746065203.190698:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265007360 00002000:00100000:1.0:1746065203.190735:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3104768->3108863) req@ffff88012edaf800 x1830881265007360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:119/0 lens 488/0 e 0 to 0 dl 1746065214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.190744:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf800 with x1830881265007360 ext(3104768->3108863) 00002000:00010000:1.0:1746065203.190749:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edaf800 00000100:00100000:1.0:1746065203.190766:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5792 00000100:00100000:1.0:1746065203.190792:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265007360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065203.190903:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265007360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 131us (269us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065203.190909:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5792 00002000:00100000:1.0:1746065203.190915:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3104768->3108863) req@ffff88012edaf800 x1830881265007360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:119/0 lens 488/4536 e 0 to 0 dl 1746065214 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.190921:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf800 with x1830881265007360 ext(3104768->3108863) 00002000:00010000:1.0:1746065203.190924:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edaf800 00000100:00100000:0.0:1746065203.191156:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263839360:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065203.191170:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065203.191187:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265006976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8643us (8829us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065203.191195:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7647 00000100:00100000:0.0:1746065203.195398:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.200486:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.206117:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.206150:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.206174:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265007872 00000100:00100000:1.0:1746065203.206181:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265007872 00000100:00100000:0.0:1746065203.206184:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065203.206208:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488600/0xad6b7ddc1477339 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93812b expref: 12 pid: 9549 timeout: 899 lvb_type: 1 00000100:00100000:0.0:1746065203.206209:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265007744 00000100:00100000:0.0:1746065203.206212:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265007744 00010000:00010000:0.0:1746065203.206223:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539800/0xad6b7ddc14772f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 4575232->4673535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938116 expref: 32 pid: 10219 timeout: 899 lvb_type: 0 00000100:00100000:1.0:1746065203.206231:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265008000 00000100:00100000:1.0:1746065203.206233:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265008000 00000100:00100000:0.0:1746065203.206238:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7648 00010000:00010000:1.0:1746065203.206240:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44a00/0xad6b7ddc14772e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938108 expref: 17 pid: 10219 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746065203.206243:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265007872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065203.206253:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7649 00010000:00010000:0.0:1746065203.206253:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065203.206257:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265007744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065203.206262:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065203.206268:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c539800/0xad6b7ddc14772f3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 4575232->4673535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938116 expref: 32 pid: 10219 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.206268:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c488600/0xad6b7ddc1477339 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93812b expref: 12 pid: 9549 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746065203.206277:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c539800/0xad6b7ddc14772f3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4575232->4673535) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938116 expref: 32 pid: 10219 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.206443:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c488600/0xad6b7ddc1477339 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93812b expref: 12 pid: 9549 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746065203.206464:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539800/0xad6b7ddc14772f3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 4575232->4673535) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938116 expref: 32 pid: 10219 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746065203.206489:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065203.206521:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265007744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 263us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065203.206527:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7649 00010000:00010000:0.0:1746065203.206812:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.206815:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.206821:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc14773e1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93816a expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.206829:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc14773e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93816a expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.206855:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc14773e1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->3678207) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93816a expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065203.206866:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263840000:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065203.206916:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c381840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065203.213065:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263840000:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065203.213085:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065203.213118:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265007872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6873us (7005us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065203.213126:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7648 00000100:00100000:1.0:1746065203.213234:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.213248:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265008256 00000100:00100000:1.0:1746065203.213253:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265008256 00002000:00100000:1.0:1746065203.213283:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3674112->3678207) req@ffff88012b4eaa00 x1830881265008256/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:119/0 lens 488/0 e 0 to 0 dl 1746065214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.213292:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4eaa00 with x1830881265008256 ext(3674112->3678207) 00002000:00010000:1.0:1746065203.213296:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4eaa00 00000100:00100000:1.0:1746065203.213309:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5793 00000100:00100000:1.0:1746065203.213315:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265008256:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065203.213408:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265008256:12345-192.168.202.27@tcp:3:cat.0 Request processed in 92us (175us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065203.213417:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5793 00002000:00100000:1.0:1746065203.213422:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3674112->3678207) req@ffff88012b4eaa00 x1830881265008256/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:119/0 lens 488/4536 e 0 to 0 dl 1746065214 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.213428:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4eaa00 with x1830881265008256 ext(3674112->3678207) 00002000:00010000:1.0:1746065203.213430:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4eaa00 00000100:00100000:0.0:1746065203.214346:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.221221:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.231546:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.251585:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.252316:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.252694:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.253080:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16626 00000100:00100000:0.0:1746065203.253087:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265009408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065203.253094:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.253102:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a000/0xad6b7ddc14773f6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93817f expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065203.253124:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263840640:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065203.253850:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009c3819c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065203.254620:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.259563:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.262438:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.265079:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.275738:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.280747:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.291524:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.292551:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.300285:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dfb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263841152:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065203.300305:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065203.300383:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265010688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7638us (7831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065203.300393:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7654 00000100:00100000:0.0:1746065203.300706:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.300815:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265010816 00000100:00100000:1.0:1746065203.300822:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265010816 00000100:00100000:1.0:1746065203.300864:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16630 00000100:00100000:1.0:1746065203.300870:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265010816:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065203.300883:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065203.300898:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72600/0xad6b7ddc1477412 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93819b expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065203.300935:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263841280:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065203.303233:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065203.304952:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263841280:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065203.304980:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72600/0xad6b7ddc1477412 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93819b expref: 33 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.304992:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72600/0xad6b7ddc1477412 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93819b expref: 33 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.305018:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72600, rc 0) 00000100:00100000:1.0:1746065203.305064:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265010816:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4192us (4357us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065203.305072:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16630 00000100:00100000:0.0:1746065203.306874:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.379091:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.385014:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.385577:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265011712 00000100:00100000:0.0:1746065203.385582:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265011712 00010000:00010000:0.0:1746065203.385606:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc14773c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938155 expref: 18 pid: 7231 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746065203.385638:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7655 00000100:00100000:0.0:1746065203.385645:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265011712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065203.385660:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065203.385665:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc14773c5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938155 expref: 18 pid: 7231 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.385673:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc14773c5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938155 expref: 18 pid: 7231 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.385690:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc14773c5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938155 expref: 18 pid: 7231 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.385705:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065203.385709:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc1477420 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065203.385716:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdba00/0xad6b7ddc1477420 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065203.385721:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065203.385768:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2006:x1830881265011712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 124us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065203.385787:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7655 00000100:00100000:0.0:1746065203.387932:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.427090:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.430355:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.430505:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.430989:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265012224 00000100:00100000:1.0:1746065203.430998:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265012224 00000100:00100000:1.0:1746065203.431057:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265012352 00000100:00100000:1.0:1746065203.431061:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265012352 00000100:00100000:1.0:1746065203.431087:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16631 00000100:00100000:1.0:1746065203.431095:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265012224:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065203.431112:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065203.431128:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72600/0xad6b7ddc1477451 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9381b0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065203.431179:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263841664:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065203.431268:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065203.431307:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16632 00000100:00100000:1.0:1746065203.431312:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265012352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065203.431319:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065203.431326:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc1477458 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9381b7 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065203.431348:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263841792:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065203.431365:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065203.435804:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:1.0:1746065203.439632:0:9549:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size: 4670560 -> 4897248 00000100:00100000:1.0:1746065203.439653:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263841664:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065203.439678:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72600/0xad6b7ddc1477451 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381b0 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.439690:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72600/0xad6b7ddc1477451 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381b0 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.439703:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72600, rc 0) 00000100:00100000:1.0:1746065203.439736:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265012224:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8642us (9387us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065203.439744:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16631 00000100:00100000:0.0:1746065203.460020:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.460099:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.471612:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.479057:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.504851:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.518796:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.549042:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.557103:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.557156:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.557231:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.557261:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265013760 00000100:00100000:0.0:1746065203.557269:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265013760 00000100:00100000:0.0:1746065203.557305:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265014144 00000100:00100000:0.0:1746065203.557307:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265014144 00000100:00100000:0.0:1746065203.557322:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16636 00000100:00100000:0.0:1746065203.557328:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265013760:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065203.557343:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.557357:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1477497 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9381da expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065203.557399:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263842432:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065203.557461:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065203.557521:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16637 00000100:00100000:0.0:1746065203.557526:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265014144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065203.557532:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.557540:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45a00/0xad6b7ddc147749e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9381e8 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.557550:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.557551:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.557558:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45a00/0xad6b7ddc147749e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381e8 expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.557574:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f45a00/0xad6b7ddc147749e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381e8 expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.557582:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45a00, rc 0) 00000100:00100000:0.0:1746065203.557600:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265014144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 75us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065203.557605:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16637 00000100:00100000:0.0:1746065203.559501:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.563047:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263842432:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065203.563074:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1477497 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381da expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.563086:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1477497 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381da expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.563098:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44600, rc 0) 00000100:00100000:0.0:1746065203.563133:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265013760:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5804us (6037us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065203.563140:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16636 00000100:00100000:0.0:1746065203.563230:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.563244:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265014400 00000100:00100000:0.0:1746065203.563248:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265014400 00000100:00100000:0.0:1746065203.563270:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16638 00000100:00100000:0.0:1746065203.563274:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2012:x1830881265014400:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065203.563287:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.563296:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc14774c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9381ef expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.563311:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.563312:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.563317:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc14774c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381ef expref: 17 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.563327:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44800/0xad6b7ddc14774c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381ef expref: 17 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.563334:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44800, rc 0) 00000100:00100000:0.0:1746065203.563346:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2012:x1830881265014400:12345-192.168.202.27@tcp:101:cat.0 Request processed in 71us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065203.563350:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16638 00000100:00100000:1.0:1746065203.576797:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.576901:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.577190:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265014528 00000100:00100000:0.0:1746065203.577194:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265014528 00000100:00100000:0.0:1746065203.577228:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 816 00000100:00100000:0.0:1746065203.577233:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265014528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065203.577241:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065203.577263:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489800/0xad6b7ddc14774ba lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381e1 expref: 37 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.577279:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065203.577282:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065203.577317:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265014528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065203.577323:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 816 00000100:00100000:0.0:1746065203.579952:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.580064:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265015040 00000100:00100000:1.0:1746065203.580071:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265015040 00002000:00100000:1.0:1746065203.580106:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009aeca300 x1830881265015040/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:119/0 lens 488/0 e 0 to 0 dl 1746065214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.580114:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeca300 with x1830881265015040 ext(3145728->4194303) 00002000:00010000:1.0:1746065203.580119:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeca300 00000100:00100000:1.0:1746065203.580140:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5797 00000100:00100000:1.0:1746065203.580147:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265015040:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065203.587394:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.590691:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.602880:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265015040:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22722us (22923us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065203.602890:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5797 00002000:00100000:1.0:1746065203.602901:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009aeca300 x1830881265015040/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:119/0 lens 488/440 e 0 to 0 dl 1746065214 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.602916:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeca300 with x1830881265015040 ext(3145728->4194303) 00002000:00010000:1.0:1746065203.602921:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aeca300 00000100:00100000:0.0:1746065203.604362:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.604392:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.604423:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.604442:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265015680 00000100:00100000:0.0:1746065203.604446:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265015552 00000100:00100000:1.0:1746065203.604448:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265015680 00000100:00100000:0.0:1746065203.604448:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265015552 00010000:00010000:1.0:1746065203.604482:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095778200/0xad6b7ddc1477260 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93809f expref: 29 pid: 3068 timeout: 899 lvb_type: 1 00010000:00010000:0.0:1746065203.604482:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc1477236 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938075 expref: 17 pid: 9549 timeout: 899 lvb_type: 1 00000100:00100000:1.0:1746065203.604502:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265015808 00000100:00100000:1.0:1746065203.604503:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265015808 00010000:00010000:1.0:1746065203.604512:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61e00/0xad6b7ddc1477187 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93802f expref: 11 pid: 10219 timeout: 899 lvb_type: 1 00000100:00100000:0.0:1746065203.604559:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7658 00000100:00100000:0.0:1746065203.604566:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265015680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065203.604576:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065203.604591:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095778200/0xad6b7ddc1477260 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93809f expref: 29 pid: 3068 timeout: 899 lvb_type: 1 00000100:00100000:1.0:1746065203.604598:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7659 00010000:00010000:0.0:1746065203.604600:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095778200/0xad6b7ddc1477260 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93809f expref: 29 pid: 3068 timeout: 899 lvb_type: 1 00000100:00100000:1.0:1746065203.604603:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265015552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065203.604609:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065203.604618:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095778200/0xad6b7ddc1477260 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93809f expref: 29 pid: 3068 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746065203.604622:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc1477236 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938075 expref: 17 pid: 9549 timeout: 899 lvb_type: 1 00010000:00010000:1.0:1746065203.604629:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc1477236 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938075 expref: 17 pid: 9549 timeout: 899 lvb_type: 1 00010000:00010000:0.0:1746065203.604683:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065203.604705:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc1477236 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938075 expref: 17 pid: 9549 timeout: 899 lvb_type: 1 00000100:00100000:0.0:1746065203.604708:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265015680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 143us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065203.604714:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7658 00010000:00010000:1.0:1746065203.604726:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065203.604741:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265015552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 138us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065203.604747:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7659 00000100:00100000:0.0:1746065203.621215:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.631023:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.631682:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.635950:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.636027:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265016576 00000100:00100000:1.0:1746065203.636033:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265016576 00000100:00100000:1.0:1746065203.636070:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16641 00000100:00100000:1.0:1746065203.636076:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265016576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065203.636089:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065203.636101:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc14774dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938204 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065203.636142:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263843072:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065203.636203:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065203.637611:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263843072:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065203.637633:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc14774dd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938204 expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.637644:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc14774dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938204 expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.637668:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046400, rc 0) 00000100:00100000:1.0:1746065203.637695:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265016576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1619us (1751us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065203.637702:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16641 00000100:00100000:0.0:1746065203.646053:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.646084:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.646743:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.646798:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265017216 00000100:00100000:0.0:1746065203.646806:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265017216 00000100:00100000:0.0:1746065203.646844:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16642 00000100:00100000:0.0:1746065203.646851:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2012:x1830881265017216:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065203.646864:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.646880:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc14774e4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93820b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.646902:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc1477404 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93818d expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.646908:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065203.646910:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065203.646913:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc14774e4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93820b expref: 18 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.646936:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc1477404 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93818d expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.646950:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc1477404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93818d expref: 32 pid: 3068 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746065203.646960:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263843200:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065203.647019:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065203.647364:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265016832 00000100:00100000:1.0:1746065203.647370:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265016832 00002000:00100000:1.0:1746065203.647394:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097d07800 x1830881265016832/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:119/0 lens 488/0 e 0 to 0 dl 1746065214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.647407:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07800 with x1830881265016832 ext(3145728->4194303) 00002000:00010000:1.0:1746065203.647411:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d07800 00000100:00100000:1.0:1746065203.647434:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265017088 00000100:00100000:1.0:1746065203.647437:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265017088 00002000:00100000:1.0:1746065203.647449:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880097d04a80 x1830881265017088/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:119/0 lens 488/0 e 0 to 0 dl 1746065214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.647455:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04a80 with x1830881265017088 ext(3145728->4194303) 00002000:00010000:1.0:1746065203.647457:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d04a80 00000100:00100000:1.0:1746065203.647478:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5801 00000100:00100000:1.0:1746065203.647483:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265016832:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065203.662680:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.664417:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265017344 00000100:00100000:1.0:1746065203.664425:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265017344 00002000:00100000:1.0:1746065203.664456:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4897247) req@ffff880097d07480 x1830881265017344/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:119/0 lens 488/0 e 0 to 0 dl 1746065214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.664475:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07480 with x1830881265017344 ext(4194304->4897247) 00010000:00010000:1.0:1746065203.664482:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc1477404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93818d expref: 35 pid: 3068 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746065203.664494:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc1477404 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93818d expref: 35 pid: 3068 timeout: 899 lvb_type: 0 00002000:00010000:1.0:1746065203.664500:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d07480 00000100:00100000:1.0:1746065203.664527:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1917 00000100:00100000:1.0:1746065203.664532:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265017344:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065203.668550:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265016832:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21057us (22495us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065203.668560:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5801 00002000:00100000:1.0:1746065203.668569:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097d07800 x1830881265016832/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:119/0 lens 488/440 e 0 to 0 dl 1746065214 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.668577:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07800 with x1830881265016832 ext(3145728->4194303) 00002000:00010000:1.0:1746065203.668582:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d07800 00000100:00100000:0.0:1746065203.697417:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.697447:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.697477:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265017472 00000100:00100000:0.0:1746065203.697484:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265017472 00000100:00100000:0.0:1746065203.697517:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265017600 00000100:00100000:0.0:1746065203.697519:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265017600 00000100:00100000:0.0:1746065203.697533:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16643 00000100:00100000:0.0:1746065203.697538:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265017472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065203.697552:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.697566:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc14774eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938212 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065203.697606:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263843328:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065203.697671:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065203.697689:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16644 00000100:00100000:0.0:1746065203.697693:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265017600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065203.697699:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.697707:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5aa00/0xad6b7ddc14774f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938219 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065203.697727:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263843456:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065203.697745:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065203.699383:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881265017344:12345-192.168.202.27@tcp:4:cat.0 Request processed in 34847us (36707us total) trans 17179874137 rc 0/0 00000100:00100000:1.0:1746065203.699391:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1917 00002000:00100000:1.0:1746065203.699400:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4897247) req@ffff880097d07480 x1830881265017344/t17179874137(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:119/0 lens 488/448 e 0 to 0 dl 1746065214 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.699409:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07480 with x1830881265017344 ext(4194304->4897247) 00010000:00010000:1.0:1746065203.699415:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc1477404 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93818d expref: 37 pid: 3068 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746065203.699426:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc1477404 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [4194304->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93818d expref: 37 pid: 3068 timeout: 899 lvb_type: 0 00002000:00010000:1.0:1746065203.699432:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d07480 00000100:00100000:0.0:1746065203.701672:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:1.0:1746065203.701838:0:9548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065200 -> 1746065203 00002000:00010000:1.0:1746065203.701842:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065200 -> 1746065203 00002000:00010000:1.0:1746065203.701843:0:9548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065200 -> 1746065203 00000100:00100000:1.0:1746065203.701859:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263843328:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065203.701885:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc14774eb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938212 expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.701897:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc14774eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938212 expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.701920:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a800, rc 0) 00000100:00100000:1.0:1746065203.701952:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265017472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4413us (4542us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065203.701959:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16643 00000100:00100000:0.0:1746065203.711026:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.711109:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265017984 00000100:00100000:1.0:1746065203.711116:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265017984 00002000:00100000:1.0:1746065203.711149:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88009ac66a00 x1830881265017984/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:119/0 lens 488/0 e 0 to 0 dl 1746065214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.711158:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac66a00 with x1830881265017984 ext(4194304->4898815) 00002000:00010000:1.0:1746065203.711162:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac66a00 00000100:00100000:1.0:1746065203.711191:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5803 00000100:00100000:1.0:1746065203.711198:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265017984:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065203.716835:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265017984:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5628us (5806us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746065203.716845:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5803 00002000:00100000:1.0:1746065203.716855:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88009ac66a00 x1830881265017984/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:119/0 lens 488/440 e 0 to 0 dl 1746065214 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.716864:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac66a00 with x1830881265017984 ext(4194304->4898815) 00002000:00010000:1.0:1746065203.716868:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac66a00 00000100:00100000:0.0:1746065203.719143:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.724039:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.739815:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.739891:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265018624 00000100:00100000:1.0:1746065203.739899:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265018624 00002000:00100000:1.0:1746065203.739934:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88009ac66d80 x1830881265018624/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:119/0 lens 488/0 e 0 to 0 dl 1746065214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.739942:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac66d80 with x1830881265018624 ext(4194304->4898815) 00002000:00010000:1.0:1746065203.739947:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac66d80 00000100:00100000:1.0:1746065203.739972:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5804 00000100:00100000:1.0:1746065203.739977:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265018624:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065203.748067:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265018624:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8081us (8250us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746065203.748078:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5804 00002000:00100000:1.0:1746065203.748087:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88009ac66d80 x1830881265018624/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:119/0 lens 488/440 e 0 to 0 dl 1746065214 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065203.748096:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac66d80 with x1830881265018624 ext(4194304->4898815) 00002000:00010000:1.0:1746065203.748102:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac66d80 00000100:00100000:0.0:1746065203.754769:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.755131:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265018752 00000100:00100000:1.0:1746065203.755141:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265018752 00000100:00100000:1.0:1746065203.755191:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16646 00000100:00100000:1.0:1746065203.755199:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265018752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065203.755215:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065203.755231:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1477500 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938227 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065203.755277:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263843712:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065203.755362:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065203.762249:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263843712:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065203.762278:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1477500 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938227 expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.762291:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1477500 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938227 expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.762319:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046c00, rc 0) 00000100:00100000:1.0:1746065203.762370:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265018752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7170us (7608us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065203.762377:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16646 00000100:00100000:0.0:1746065203.777000:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.777185:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265018880 00000100:00100000:1.0:1746065203.777193:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265018880 00000100:00100000:1.0:1746065203.777237:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16647 00000100:00100000:1.0:1746065203.777244:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265018880:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065203.777259:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065203.777274:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1477507 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93822e expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065203.777320:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263843840:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065203.777392:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065203.779481:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.788270:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.788579:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263843840:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065203.788604:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1477507 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93822e expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.788616:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1477507 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93822e expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.788640:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047600, rc 0) 00000100:00100000:1.0:1746065203.788679:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265018880:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11435us (11685us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065203.788687:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16647 00000100:00100000:0.0:1746065203.790451:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.800252:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.802286:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.802456:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265019904 00000100:00100000:0.0:1746065203.802471:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265019904 00000100:00100000:0.0:1746065203.802509:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16648 00000100:00100000:0.0:1746065203.802514:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2023:x1830881265019904:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065203.802529:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.802543:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc1477531 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93823c expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.802567:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1477180 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938021 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.802575:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1477252 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938091 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.802581:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090684a00/0xad6b7ddc1477228 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938060 expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.802587:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.802589:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.802593:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc1477531 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [737280->991231] (req 737280->991231) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93823c expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.802622:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090684a00/0xad6b7ddc1477228 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938060 expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.802633:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090684a00/0xad6b7ddc1477228 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938060 expref: 19 pid: 9549 timeout: 899 lvb_type: 1 00000100:00100000:0.0:1746065203.802644:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263843968:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065203.802739:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1477252 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938091 expref: 34 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.802746:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1477252 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938091 expref: 34 pid: 3068 timeout: 899 lvb_type: 1 00000100:00100000:0.0:1746065203.802753:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263844096:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065203.802790:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1477180 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938021 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.803767:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f60e00/0xad6b7ddc1477180 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938021 expref: 10 pid: 10219 timeout: 899 lvb_type: 1 00000100:00100000:0.0:1746065203.803805:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263844224:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065203.804872:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065203.818703:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.819487:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.821593:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.835099:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.836113:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.836752:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265020672 00000100:00100000:0.0:1746065203.836756:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265020672 00002000:00100000:0.0:1746065203.836798:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x75:0x0] (737280->741375) req@ffff88012b4e8380 x1830881265020672/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:119/0 lens 488/0 e 0 to 0 dl 1746065214 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065203.836806:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e8380 with x1830881265020672 ext(737280->741375) 00002000:00010000:0.0:1746065203.836810:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4e8380 00000100:00100000:0.0:1746065203.836832:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5805 00000100:00100000:0.0:1746065203.836837:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265020672:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065203.836925:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265020672:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 87us (811us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065203.836930:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5805 00002000:00100000:0.0:1746065203.836935:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x75:0x0] (737280->741375) req@ffff88012b4e8380 x1830881265020672/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:119/0 lens 488/4536 e 0 to 0 dl 1746065214 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065203.836941:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e8380 with x1830881265020672 ext(737280->741375) 00002000:00010000:0.0:1746065203.836943:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4e8380 00000100:00100000:0.0:1746065203.843281:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.843307:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.843332:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.843356:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.843370:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265021184 00000100:00100000:0.0:1746065203.843376:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265021184 00010000:00010000:0.0:1746065203.843396:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc14772c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380ec expref: 18 pid: 9549 timeout: 899 lvb_type: 0 00000100:00100000:1.0:1746065203.843410:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265021056 00000100:00100000:0.0:1746065203.843412:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265021312 00000100:00100000:0.0:1746065203.843414:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265021312 00000100:00100000:1.0:1746065203.843415:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265021056 00010000:00010000:0.0:1746065203.843421:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc14774f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938220 expref: 35 pid: 10219 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746065203.843432:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7665 00000100:00100000:0.0:1746065203.843436:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265021184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065203.843446:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065203.843460:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc14772c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380ec expref: 18 pid: 9549 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.843480:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc14772c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380ec expref: 18 pid: 9549 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.843497:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc14772c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380ec expref: 18 pid: 9549 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.843509:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065203.843530:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265021184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065203.843538:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7665 00010000:00010000:1.0:1746065203.843552:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3400/0xad6b7ddc14772d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380f3 expref: 36 pid: 10219 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746065203.843571:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7666 00000100:00100000:1.0:1746065203.843575:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7667 00000100:00100000:0.0:1746065203.843575:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265021312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065203.843580:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265021056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065203.843580:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065203.843586:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc14774f9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938220 expref: 36 pid: 10219 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746065203.843587:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065203.843592:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc14774f9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938220 expref: 36 pid: 10219 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746065203.844258:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cd3400/0xad6b7ddc14772d0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 9 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380f3 expref: 36 pid: 10219 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.844262:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc14774f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938220 expref: 36 pid: 10219 timeout: 899 lvb_type: 0 00010000:00010000:1.0:1746065203.844267:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cd3400/0xad6b7ddc14772d0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 10 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380f3 expref: 36 pid: 10219 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.844274:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065203.844279:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3400/0xad6b7ddc14772d0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380f3 expref: 35 pid: 10219 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746065203.844302:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265021312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 726us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065203.844307:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7666 00010000:00010000:1.0:1746065203.844418:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065203.845242:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265021056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1659us (1931us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065203.845248:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7667 00000100:00100000:0.0:1746065203.854972:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.855007:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265021440 00000100:00100000:0.0:1746065203.855015:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265021440 00010000:00010000:0.0:1746065203.855043:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc14774e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93820b expref: 17 pid: 3068 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746065203.855073:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7668 00000100:00100000:0.0:1746065203.855079:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265021440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065203.855093:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065203.855110:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc14774e4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93820b expref: 17 pid: 3068 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.855121:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc14774e4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93820b expref: 17 pid: 3068 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.855140:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a200/0xad6b7ddc14774e4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93820b expref: 17 pid: 3068 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.855152:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.855154:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.855159:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477538 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2846720->3145727] (req 2846720->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938243 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.855166:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2846720->3145727] (req 2846720->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938243 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.855193:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2846720->3145727] (req 2846720->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938243 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065203.855204:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263844992:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065203.858098:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065203.860656:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.866398:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.873216:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.873249:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.873274:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.873287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.873310:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.873330:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265022336 00000100:00100000:0.0:1746065203.873335:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265022336 00000100:00100000:0.0:1746065203.873368:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265022208 00000100:00100000:0.0:1746065203.873369:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265022208 00010000:00010000:0.0:1746065203.873377:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc147746d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381cc expref: 14 pid: 9548 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746065203.873389:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265022720 00000100:00100000:0.0:1746065203.873391:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265022720 00010000:00010000:0.0:1746065203.873397:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45a00/0xad6b7ddc147749e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381e8 expref: 30 pid: 9549 timeout: 899 lvb_type: 1 00000100:00100000:0.0:1746065203.873409:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7669 00000100:00100000:0.0:1746065203.873414:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265022208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065203.873425:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065203.873441:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc147746d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381cc expref: 14 pid: 9548 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.873447:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc147746d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381cc expref: 14 pid: 9548 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.873478:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc147746d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381cc expref: 14 pid: 9548 timeout: 899 lvb_type: 0 00010000:00010000:0.0:1746065203.873492:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065203.873521:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265022208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065203.873527:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7669 00000100:00100000:0.0:1746065203.873539:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7670 00000100:00100000:0.0:1746065203.873543:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265022720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065203.873548:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065203.873553:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f45a00/0xad6b7ddc147749e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381e8 expref: 30 pid: 9549 timeout: 899 lvb_type: 1 00010000:00010000:0.0:1746065203.873561:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f45a00/0xad6b7ddc147749e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381e8 expref: 30 pid: 9549 timeout: 899 lvb_type: 1 00010000:00010000:0.0:1746065203.873572:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45a00/0xad6b7ddc147749e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381e8 expref: 30 pid: 9549 timeout: 899 lvb_type: 1 00010000:00010000:0.0:1746065203.873579:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.873581:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065203.873585:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc147753f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2707455) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938251 expref: 29 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.873591:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc147753f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2707455) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938251 expref: 29 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.873613:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091ae7600/0xad6b7ddc147753f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2707455) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938251 expref: 29 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065203.873623:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263845376:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065203.873669:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065203.873707:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16651 00000100:00100000:0.0:1746065203.873712:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265022592:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065203.873721:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.873729:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc1477569 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93825f expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065203.874039:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263845504:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065203.874074:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00002000:00010000:1.0:1746065203.876565:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746065203 -> 1746065204 00002000:00010000:1.0:1746065203.876571:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065203 -> 1746065204 00002000:00010000:1.0:1746065203.876573:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746065203 -> 1746065204 00000100:00100000:1.0:1746065203.876589:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263845504:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065203.876613:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc1477569 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93825f expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.876625:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97000/0xad6b7ddc1477569 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93825f expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.876698:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97000, rc 0) 00000100:00100000:1.0:1746065203.877241:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265022592:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3526us (3988us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065203.877248:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16651 00000100:00100000:0.0:1746065203.880514:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.889205:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.889247:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.893685:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.915435:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.915495:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.915675:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265024000 00000100:00100000:1.0:1746065203.915684:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265024000 00000100:00100000:1.0:1746065203.915718:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265023872 00000100:00100000:1.0:1746065203.915720:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265023872 00000100:00100000:1.0:1746065203.915751:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16653 00000100:00100000:1.0:1746065203.915759:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2006:x1830881265024000:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065203.915798:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065203.915815:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131055800/0xad6b7ddc1477577 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93826d expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065203.915860:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263845632:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065203.915925:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065203.915985:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16654 00000100:00100000:0.0:1746065203.915991:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265023872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065203.915999:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.916007:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96400/0xad6b7ddc147757e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938266 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.916023:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a96400/0xad6b7ddc147757e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938266 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.916031:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96400/0xad6b7ddc147757e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938266 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.916041:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96400, rc 0) 00000100:00100000:0.0:1746065203.916062:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265023872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (567us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065203.916067:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16654 00000100:00100000:1.0:1746065203.917954:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263845632:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065203.917976:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131055800/0xad6b7ddc1477577 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93826d expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.917985:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131055800/0xad6b7ddc1477577 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93826d expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.918008:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055800, rc 0) 00000100:00100000:1.0:1746065203.918036:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2006:x1830881265024000:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2277us (2606us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065203.918043:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16653 00000100:00100000:0.0:1746065203.919694:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.919906:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265024128 00000100:00100000:1.0:1746065203.919913:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265024128 00000100:00100000:0.0:1746065203.920171:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16655 00000100:00100000:0.0:1746065203.920179:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2028:x1830881265024128:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065203.920193:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065203.920205:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1477585 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938274 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.920228:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477538 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2846720->3145727] (req 2846720->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938243 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.920234:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065203.920235:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065203.920238:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96200/0xad6b7ddc1477585 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938274 expref: 17 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.920260:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477538 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2846720->3145727] (req 2846720->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938243 expref: 32 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065203.920270:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477538 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2846720->3145727] (req 2846720->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938243 expref: 32 pid: 9548 timeout: 899 lvb_type: 0 00000100:00100000:0.0:1746065203.920280:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263845760:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065203.920623:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065203.923983:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.934927:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.941911:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.965438:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.966261:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.968179:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.971153:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.971491:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.972123:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.972619:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.972641:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065203.973516:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265025536 00000100:00100000:1.0:1746065203.973520:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265025536 00000100:00100000:1.0:1746065203.973547:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265025792 00000100:00100000:1.0:1746065203.973549:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265025792 00000100:00100000:1.0:1746065203.973558:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265025664 00000100:00100000:1.0:1746065203.973559:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265025664 00000100:00100000:1.0:1746065203.973570:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16658 00000100:00100000:1.0:1746065203.973575:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265025536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065203.973583:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065203.973595:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de5400/0xad6b7ddc14775bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938290 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065203.973626:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263846272:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065203.973665:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065203.973678:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16659 00000100:00100000:1.0:1746065203.973683:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265025792:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065203.973689:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065203.973695:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc14775c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93829e expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065203.973714:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263846400:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065203.973731:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065203.973744:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16660 00000100:00100000:1.0:1746065203.973749:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265025664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065203.973754:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065203.973762:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14775cb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938297 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065203.973786:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065203.973788:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065203.973795:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14775cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938297 expref: 37 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.973806:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc14775cb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938297 expref: 37 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.973814:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5cea00, rc 0) 00000100:00100000:1.0:1746065203.973830:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265025664:12345-192.168.202.27@tcp:101:cat.0 Request processed in 81us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065203.973835:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16660 00000100:00100000:1.0:1746065203.979888:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263846400:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065203.979914:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc14775c4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93829e expref: 35 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.979926:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc14775c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93829e expref: 35 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065203.979937:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2c000, rc 0) 00002000:00010000:0.0:1746065203.980157:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065203 -> 1746065204 00002000:00010000:0.0:1746065203.980161:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065203 -> 1746065204 00002000:00010000:0.0:1746065203.980163:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065203 -> 1746065204 00000100:00100000:0.0:1746065203.980171:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263846272:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065203.980185:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de5400/0xad6b7ddc14775bd lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938290 expref: 34 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.980193:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de5400/0xad6b7ddc14775bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938290 expref: 34 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065203.980204:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5400, rc 0) 00000100:00100000:1.0:1746065203.980362:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265025792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6675us (7740us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065203.980368:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16659 00000100:00100000:0.0:1746065203.980685:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265025536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7108us (8562us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065203.980691:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16658 00000100:00100000:0.0:1746065203.983709:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.983743:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.985961:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065203.999151:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.012311:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.026348:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.041241:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.054019:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.054068:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265027584 00000100:00100000:1.0:1746065204.054075:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265027584 00000100:00100000:1.0:1746065204.054115:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16663 00000100:00100000:1.0:1746065204.054121:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2032:x1830881265027584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065204.054134:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065204.054148:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1477603 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9382ba expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.054169:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489200/0xad6b7ddc14774cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1892351) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381f6 expref: 13 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.054177:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065204.054179:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065204.054181:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1477603 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382ba expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.054207:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489200/0xad6b7ddc14774cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1892351) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381f6 expref: 13 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.054217:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489200/0xad6b7ddc14774cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1892351) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381f6 expref: 13 pid: 9548 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746065204.054227:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263846912:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065204.054305:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065204.061542:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263846912:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065204.061568:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1477603 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382ba expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.061581:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c5400, rc 0) 00000100:00100000:1.0:1746065204.061637:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2032:x1830881265027584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7515us (7625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065204.061645:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16663 00000100:00100000:0.0:1746065204.062269:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.062510:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265027712 00000100:00100000:1.0:1746065204.062517:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265027712 00002000:00100000:1.0:1746065204.062688:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1069056->1892351) req@ffff880134b03480 x1830881265027712/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:120/0 lens 488/0 e 0 to 0 dl 1746065215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065204.062703:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b03480 with x1830881265027712 ext(1069056->1892351) 00010000:00010000:1.0:1746065204.062710:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489200/0xad6b7ddc14774cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381f6 expref: 14 pid: 9548 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065204.062723:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489200/0xad6b7ddc14774cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381f6 expref: 14 pid: 9548 timeout: 900 lvb_type: 0 00002000:00010000:1.0:1746065204.062728:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b03480 00000100:00100000:1.0:1746065204.062770:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1921 00000100:00100000:1.0:1746065204.062815:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265027712:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065204.083277:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265027968 00000100:00100000:1.0:1746065204.083284:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265027968 00000100:00100000:1.0:1746065204.083325:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16664 00000100:00100000:1.0:1746065204.083332:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265027968:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065204.083347:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065204.083360:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc147760a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9382c1 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065204.083400:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263847040:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065204.083457:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065204.085805:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263847040:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065204.085828:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc147760a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382c1 expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.085844:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc147760a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382c1 expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.085865:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60a00, rc 0) 00000100:00100000:1.0:1746065204.085892:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265027968:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2561us (2680us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065204.085898:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16664 00000100:00100000:0.0:1746065204.088388:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.092609:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265027712:12345-192.168.202.27@tcp:4:cat.0 Request processed in 29794us (30339us total) trans 21474841554 rc 0/0 00000100:00100000:1.0:1746065204.092619:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1921 00002000:00100000:1.0:1746065204.092628:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1069056->1892351) req@ffff880134b03480 x1830881265027712/t21474841554(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:120/0 lens 488/448 e 0 to 0 dl 1746065215 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065204.092637:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b03480 with x1830881265027712 ext(1069056->1892351) 00010000:00010000:1.0:1746065204.092645:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489200/0xad6b7ddc14774cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381f6 expref: 16 pid: 9548 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065204.092657:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489200/0xad6b7ddc14774cf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1069056->1892351) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381f6 expref: 16 pid: 9548 timeout: 900 lvb_type: 0 00002000:00010000:1.0:1746065204.092663:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b03480 00000100:00100000:0.0:1746065204.108107:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.108130:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.108208:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265028352 00000100:00100000:1.0:1746065204.108217:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265028352 00000100:00100000:1.0:1746065204.108265:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16665 00000100:00100000:1.0:1746065204.108271:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265028352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065204.108289:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065204.108303:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1477634 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9382cf expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065204.108346:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263847168:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065204.108424:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065204.108617:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.113046:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065204.113671:0:12260:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff880091b65f80 x1830881263847168) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88012c489200/0xad6b7ddc14774cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1069056->1892351) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381f6 expref: 18 pid: 9548 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065204.113695:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489200/0xad6b7ddc14774cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1069056->1892351) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9381f6 expref: 18 pid: 9548 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746065204.113716:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263847168:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065204.113737:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1477634 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382cf expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.113745:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1477634 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382cf expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.113753:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61000, rc 0) 00000100:00100000:1.0:1746065204.113807:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265028352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5503us (5674us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065204.113813:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16665 00000100:00100000:0.0:1746065204.119761:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.120524:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.120636:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265029120 00000100:00100000:1.0:1746065204.120643:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265029120 00002000:00100000:1.0:1746065204.120678:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88008c459c00 x1830881265029120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:120/0 lens 488/0 e 0 to 0 dl 1746065215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065204.120688:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459c00 with x1830881265029120 ext(1048576->2097151) 00002000:00010000:1.0:1746065204.120692:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459c00 00000100:00100000:1.0:1746065204.120716:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5815 00000100:00100000:1.0:1746065204.120722:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265029120:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065204.121276:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265029248 00000100:00100000:1.0:1746065204.121279:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265029248 00000100:00100000:1.0:1746065204.121295:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16666 00000100:00100000:1.0:1746065204.121299:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+32:2034:x1830881265029248:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065204.121307:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065204.121320:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9382d6 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.121340:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14775af lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938282 expref: 14 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.121346:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065204.121348:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065204.121350:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382d6 expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.121371:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14775af lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938282 expref: 14 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.121380:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc14775af lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938282 expref: 14 pid: 9549 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746065204.121395:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263847424:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065204.125411:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065204.131669:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263847424:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065204.131696:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2842624->3145727] (req 2842624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382d6 expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.131712:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61c00, rc 0) 00000100:00100000:1.0:1746065204.131766:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2034:x1830881265029248:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10464us (11240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065204.131796:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16666 00000100:00100000:0.0:1746065204.136342:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.136968:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265029120:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16241us (17209us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065204.136979:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5815 00002000:00100000:1.0:1746065204.136990:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88008c459c00 x1830881265029120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:120/0 lens 488/440 e 0 to 0 dl 1746065215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065204.136998:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459c00 with x1830881265029120 ext(1048576->2097151) 00002000:00010000:1.0:1746065204.137004:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459c00 00000100:00100000:0.0:1746065204.140902:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.157104:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.157126:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.157167:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.157556:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265029760 00000100:00100000:1.0:1746065204.157563:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265029760 00000100:00100000:1.0:1746065204.157596:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16667 00000100:00100000:1.0:1746065204.157603:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2036:x1830881265029760:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065204.157619:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065204.157633:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc1477642 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9382dd expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.157656:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382d6 expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.157663:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065204.157664:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065204.157667:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc1477642 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3223552->3637247] (req 3223552->3637247) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382dd expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.157691:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382d6 expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.157701:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382d6 expref: 30 pid: 12260 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746065204.157710:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263847680:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065204.157788:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065204.160367:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265030272 00000100:00100000:1.0:1746065204.160376:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265030272 00002000:00100000:1.0:1746065204.160411:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012f09d180 x1830881265030272/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:120/0 lens 504/0 e 0 to 0 dl 1746065215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065204.160421:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881265030272 ext(2097152->4194303) 00010000:00010000:1.0:1746065204.160428:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382d6 expref: 31 pid: 12260 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065204.160442:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382d6 expref: 31 pid: 12260 timeout: 900 lvb_type: 0 00002000:00010000:1.0:1746065204.160449:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09d180 00000100:00100000:1.0:1746065204.160476:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1922 00000100:00100000:1.0:1746065204.160482:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265030272:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065204.163359:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263847680:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065204.163383:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc1477642 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3223552->3637247] (req 3223552->3637247) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382dd expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.163399:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60a00, rc 0) 00000100:00100000:1.0:1746065204.163527:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2036:x1830881265029760:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5923us (6428us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065204.163535:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16667 00000100:00100000:0.0:1746065204.168022:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.178243:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.178268:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265030528 00000100:00100000:1.0:1746065204.178275:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265030528 00000100:00100000:1.0:1746065204.178317:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16668 00000100:00100000:1.0:1746065204.178324:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2032:x1830881265030528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065204.178339:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065204.178352:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1477649 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9382e4 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.178375:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065204.178376:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065204.178380:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1477649 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382e4 expref: 36 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.178395:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1477649 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382e4 expref: 36 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.178403:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61600, rc 0) 00000100:00100000:1.0:1746065204.178435:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2032:x1830881265030528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 112us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065204.178440:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16668 00000100:00100000:0.0:1746065204.181140:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265030400:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11031us (13115us total) trans 21474841555 rc 0/0 00000100:00100000:0.0:1746065204.181150:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1923 00002000:00100000:0.0:1746065204.181161:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2842624->3145727) req@ffff88012f09f100 x1830881265030400/t21474841555(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:120/0 lens 488/448 e 0 to 0 dl 1746065215 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065204.181169:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f100 with x1830881265030400 ext(2842624->3145727) 00010000:00010000:0.0:1746065204.181177:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382d6 expref: 36 pid: 12260 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.181194:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382d6 expref: 36 pid: 12260 timeout: 900 lvb_type: 0 00002000:00010000:0.0:1746065204.181199:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09f100 00000100:00100000:0.0:1746065204.182849:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881265030272:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22362us (25676us total) trans 0 rc 1794048/1794048 00000100:00100000:0.0:1746065204.182858:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1922 00002000:00100000:0.0:1746065204.182865:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012f09d180 x1830881265030272/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:120/0 lens 504/440 e 0 to 0 dl 1746065215 ref 1 fl Complete:H/200/0 rc 1794048/1794048 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065204.182873:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881265030272 ext(2097152->4194303) 00010000:00010000:0.0:1746065204.182879:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382d6 expref: 34 pid: 12260 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.182889:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc147763b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2842624->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382d6 expref: 34 pid: 12260 timeout: 900 lvb_type: 0 00002000:00010000:0.0:1746065204.182895:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f09d180 00000100:00100000:0.0:1746065204.183414:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.190724:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.190759:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.190810:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.195697:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.204746:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.204816:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.204835:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265031424 00000100:00100000:0.0:1746065204.204844:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265031424 00002000:00100000:0.0:1746065204.204879:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3223552->3227647) req@ffff88009077ea00 x1830881265031424/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:120/0 lens 488/0 e 0 to 0 dl 1746065215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065204.204889:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ea00 with x1830881265031424 ext(3223552->3227647) 00002000:00010000:0.0:1746065204.204893:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077ea00 00000100:00100000:0.0:1746065204.204907:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265031680 00000100:00100000:0.0:1746065204.204909:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265031680 00002000:00100000:0.0:1746065204.204918:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009077c000 x1830881265031680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:120/0 lens 488/0 e 0 to 0 dl 1746065215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065204.204924:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c000 with x1830881265031680 ext(2097152->3145727) 00002000:00010000:0.0:1746065204.204926:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077c000 00000100:00100000:0.0:1746065204.204935:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5817 00000100:00100000:0.0:1746065204.204941:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265031424:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065204.205134:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265031424:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 190us (394us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065204.205141:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5817 00002000:00100000:0.0:1746065204.205146:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3223552->3227647) req@ffff88009077ea00 x1830881265031424/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:120/0 lens 488/4536 e 0 to 0 dl 1746065215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065204.205153:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ea00 with x1830881265031424 ext(3223552->3227647) 00002000:00010000:0.0:1746065204.205156:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077ea00 00000100:00100000:0.0:1746065204.205169:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5818 00000100:00100000:0.0:1746065204.205174:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265031680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065204.211300:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.221820:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265031680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16642us (17001us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065204.221828:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5818 00002000:00100000:1.0:1746065204.221837:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009077c000 x1830881265031680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:120/0 lens 488/440 e 0 to 0 dl 1746065215 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065204.221846:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c000 with x1830881265031680 ext(2097152->3145727) 00002000:00010000:1.0:1746065204.221851:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077c000 00000100:00100000:0.0:1746065204.221983:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.222034:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.222061:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265032192 00000100:00100000:0.0:1746065204.222066:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265032192 00002000:00100000:0.0:1746065204.222096:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3633152->3637247) req@ffff88008f7fe300 x1830881265032192/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:120/0 lens 488/0 e 0 to 0 dl 1746065215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065204.222097:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265032320 00000100:00100000:1.0:1746065204.222100:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265032320 00002000:00100000:0.0:1746065204.222103:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe300 with x1830881265032192 ext(3633152->3637247) 00002000:00010000:0.0:1746065204.222106:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fe300 00002000:00100000:1.0:1746065204.222113:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3289088->3293183) req@ffff88008f7fd500 x1830881265032320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:120/0 lens 488/0 e 0 to 0 dl 1746065215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065204.222119:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd500 with x1830881265032320 ext(3289088->3293183) 00000100:00100000:0.0:1746065204.222119:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5819 00002000:00010000:1.0:1746065204.222122:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd500 00000100:00100000:0.0:1746065204.222124:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265032192:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065204.222135:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5820 00000100:00100000:1.0:1746065204.222139:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265032320:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065204.222654:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265032320:12345-192.168.202.27@tcp:3:cat.0 Request processed in 512us (618us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065204.222654:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265032192:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 528us (670us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065204.222660:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5820 00002000:00100000:1.0:1746065204.222665:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3289088->3293183) req@ffff88008f7fd500 x1830881265032320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:120/0 lens 488/4536 e 0 to 0 dl 1746065215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065204.222670:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd500 with x1830881265032320 ext(3289088->3293183) 00002000:00010000:1.0:1746065204.222673:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd500 00000100:00100000:0.0:1746065204.223030:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5819 00002000:00100000:0.0:1746065204.223037:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3633152->3637247) req@ffff88008f7fe300 x1830881265032192/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:120/0 lens 488/4536 e 0 to 0 dl 1746065215 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065204.223043:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe300 with x1830881265032192 ext(3633152->3637247) 00002000:00010000:0.0:1746065204.223045:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fe300 00000100:00100000:0.0:1746065204.227574:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.231707:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.244547:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.248272:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.259037:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265033088:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 10569us (10757us total) trans 21474841556 rc 0/0 00000100:00100000:0.0:1746065204.259049:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1924 00002000:00100000:0.0:1746065204.259059:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3223552->3637247) req@ffff88008f7ffb80 x1830881265033088/t21474841556(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:120/0 lens 488/448 e 0 to 0 dl 1746065215 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065204.259072:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ffb80 with x1830881265033088 ext(3223552->3637247) 00010000:00010000:0.0:1746065204.259081:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc1477642 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3223552->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382dd expref: 17 pid: 12260 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.259094:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc1477642 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3223552->3637247) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382dd expref: 17 pid: 12260 timeout: 900 lvb_type: 0 00002000:00010000:0.0:1746065204.259100:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f7ffb80 00000100:00100000:0.0:1746065204.262934:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.274124:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.297593:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.310392:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.320998:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.327365:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.332963:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.337391:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.337438:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.337489:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265034624 00000100:00100000:1.0:1746065204.337496:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265034624 00000100:00100000:1.0:1746065204.337530:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265034752 00000100:00100000:1.0:1746065204.337532:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265034752 00000100:00100000:1.0:1746065204.337561:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16671 00000100:00100000:1.0:1746065204.337568:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265034624:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065204.337581:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065204.337594:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147767a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938300 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.337611:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065204.337613:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065204.337619:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147767a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938300 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.337630:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147767a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938300 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.337637:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fa00, rc 0) 00000100:00100000:0.0:1746065204.338184:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265034880 00000100:00100000:0.0:1746065204.338187:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265034880 00000100:00100000:0.0:1746065204.338209:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265035008 00000100:00100000:0.0:1746065204.338211:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265035008 00000100:00100000:0.0:1746065204.338223:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16673 00000100:00100000:0.0:1746065204.338228:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265034880:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065204.338234:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065204.338237:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265034624:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 669us (852us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065204.338240:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc1477688 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93830e expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065204.338245:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16671 00000100:00100000:1.0:1746065204.338254:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16674 00000100:00100000:1.0:1746065204.338258:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265035008:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065204.338262:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065204.338268:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580f400/0xad6b7ddc147768f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938315 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065204.338274:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263849088:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065204.338275:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065204.338276:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065204.338280:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580f400/0xad6b7ddc147768f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938315 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.338287:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580f400/0xad6b7ddc147768f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938315 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.338293:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f400, rc 0) 00000100:00100000:1.0:1746065204.338306:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265035008:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 47us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065204.338310:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16674 00000100:00100000:0.0:1746065204.338322:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435b40 going to sleep for 11 seconds 00002000:00010000:1.0:1746065204.344589:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065203 -> 1746065204 00000100:00100000:1.0:1746065204.344614:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263849088:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065204.344644:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc1477688 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93830e expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.344656:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc1477688 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93830e expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.345313:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac800, rc 0) 00000100:00100000:1.0:1746065204.345379:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265034880:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 7148us (7257us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065204.345386:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16673 00000100:00100000:0.0:1746065204.353448:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.357607:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.367940:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265035648 00000100:00100000:0.0:1746065204.367947:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265035648 00000100:00100000:0.0:1746065204.367993:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14391 00000100:00100000:0.0:1746065204.367999:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2041:x1830881265035648:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065204.368017:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065204.368019:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065204.368040:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2600/0xad6b7ddc147769d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93831c expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.368300:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065204.368305:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065204.368315:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad000/0xad6b7ddc14776ab lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938323 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.368390:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc14776b2 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065204.368400:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc14776b2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065204.368408:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc14776b2 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746065204.368416:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065204.368499:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad000/0xad6b7ddc14776ab lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938323 expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.368513:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc14776b2 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938323 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.368517:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065204.368519:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065204.368521:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac800, rc 0) 00000100:00100000:0.0:1746065204.369048:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2041:x1830881265035648:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1047us (1183us total) trans 8589936851 rc 0/0 00000100:00100000:0.0:1746065204.369054:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14391 00000100:00100000:0.0:1746065204.372253:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.374592:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.374675:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.374701:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.374723:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.374736:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.375043:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.389473:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.389489:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.389501:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.389513:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.389524:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.389540:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.389554:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.389577:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.389599:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.389628:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265036800 00000100:00100000:0.0:1746065204.389636:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265036800 00010000:00010000:0.0:1746065204.389666:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60c00/0xad6b7ddc147716b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938028 expref: 15 pid: 10219 timeout: 900 lvb_type: 1 00000100:00100000:0.0:1746065204.389683:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265036928 00000100:00100000:0.0:1746065204.389685:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265036928 00010000:00010000:0.0:1746065204.389693:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1477259 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938098 expref: 34 pid: 9549 timeout: 900 lvb_type: 1 00000100:00100000:0.0:1746065204.389701:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265037568 00000100:00100000:0.0:1746065204.389702:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265037568 00010000:00010000:0.0:1746065204.389710:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147767a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938300 expref: 14 pid: 12260 timeout: 900 lvb_type: 1 00000100:00100000:0.0:1746065204.389718:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265037952 00000100:00100000:0.0:1746065204.389719:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265037952 00010000:00010000:0.0:1746065204.389726:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc14775d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382a5 expref: 35 pid: 3067 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746065204.389733:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265037184 00000100:00100000:0.0:1746065204.389734:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265037184 00010000:00010000:0.0:1746065204.389741:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1477649 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382e4 expref: 35 pid: 12260 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746065204.389748:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265037696 00000100:00100000:0.0:1746065204.389749:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265037696 00010000:00010000:0.0:1746065204.389755:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835d000/0xad6b7ddc1477657 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382f2 expref: 36 pid: 3067 timeout: 900 lvb_type: 0 00000100:00100000:0.0:1746065204.389766:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265036672 00000100:00100000:0.0:1746065204.389768:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265036672 00010000:00010000:0.0:1746065204.389792:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090684000/0xad6b7ddc147722f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93806e expref: 16 pid: 9549 timeout: 900 lvb_type: 1 00000100:00100000:0.0:1746065204.389799:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265037056 00000100:00100000:0.0:1746065204.389801:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265037056 00010000:00010000:0.0:1746065204.389808:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f60400/0xad6b7ddc1477172 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938036 expref: 15 pid: 10219 timeout: 900 lvb_type: 1 00000100:00100000:0.0:1746065204.389815:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265037312 00000100:00100000:0.0:1746065204.389817:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265037312 00010000:00010000:0.0:1746065204.389822:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009580f400/0xad6b7ddc147768f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938315 expref: 16 pid: 12260 timeout: 900 lvb_type: 1 00000100:00100000:0.0:1746065204.389830:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7684 00000100:00100000:0.0:1746065204.389836:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+16:2007:x1830881265036800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065204.389848:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065204.389863:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f60c00/0xad6b7ddc147716b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938028 expref: 16 pid: 10219 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.389872:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f60c00/0xad6b7ddc147716b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938028 expref: 16 pid: 10219 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.389896:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065204.389928:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+16:2007:x1830881265036800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 91us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.389934:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7684 00000100:00100000:0.0:1746065204.389947:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7685 00000100:00100000:0.0:1746065204.389951:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265036928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065204.389956:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065204.389962:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1477259 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938098 expref: 36 pid: 9549 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.389968:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1477259 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938098 expref: 36 pid: 9549 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.389977:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065204.389988:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265036928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 36us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.389992:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7685 00000100:00100000:0.0:1746065204.390001:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7686 00000100:00100000:0.0:1746065204.390004:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265037568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065204.390011:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065204.390020:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147767a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938300 expref: 15 pid: 12260 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.390027:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147767a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938300 expref: 15 pid: 12260 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.390036:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065204.390047:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265037568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 42us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.390052:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7686 00000100:00100000:0.0:1746065204.390059:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7687 00000100:00100000:0.0:1746065204.390063:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265037952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065204.390069:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065204.390074:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc14775d2 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382a5 expref: 35 pid: 3067 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.390080:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc14775d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382a5 expref: 35 pid: 3067 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.390088:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065204.390098:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265037952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 34us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.390101:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7687 00000100:00100000:0.0:1746065204.390109:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7688 00000100:00100000:0.0:1746065204.390113:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265037184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065204.390118:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065204.390124:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1477649 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382e4 expref: 35 pid: 12260 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.390130:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1477649 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382e4 expref: 35 pid: 12260 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.390139:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065204.390150:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265037184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 36us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.390154:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7688 00000100:00100000:0.0:1746065204.390162:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7689 00000100:00100000:0.0:1746065204.390166:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265037696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065204.390170:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065204.392638:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835d000/0xad6b7ddc1477657 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382f2 expref: 32 pid: 3067 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.392857:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835d000/0xad6b7ddc1477657 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382f2 expref: 32 pid: 3067 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.392874:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835d000/0xad6b7ddc1477657 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382f2 expref: 32 pid: 3067 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.392897:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065204.393125:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265037696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2956us (3581us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.393133:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7689 00000100:00100000:1.0:1746065204.393204:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.393212:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265037440 00000100:00100000:0.0:1746065204.393217:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265037440 00010000:00010000:0.0:1746065204.393233:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc14775d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382ac expref: 17 pid: 3067 timeout: 900 lvb_type: 1 00000100:00100000:0.0:1746065204.393246:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7693 00000100:00100000:0.0:1746065204.393251:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265037440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065204.393260:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065204.393271:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065204.393274:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc14775d9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382ac expref: 17 pid: 3067 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.393280:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc14775d9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382ac expref: 17 pid: 3067 timeout: 900 lvb_type: 1 00000100:00100000:1.0:1746065204.393281:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065204.393291:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc14775d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382ac expref: 17 pid: 3067 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.393299:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065204.393300:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065204.393303:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14776dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.393310:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14776dc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065204.393313:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065204.393326:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065204.393342:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265037440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.393347:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7693 00000100:00100000:0.0:1746065204.393356:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265038080 00000100:00100000:0.0:1746065204.393359:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265038080 00000100:00100000:1.0:1746065204.393363:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265038208 00000100:00100000:1.0:1746065204.393366:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265038208 00010000:00010000:0.0:1746065204.393366:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090684200/0xad6b7ddc147723d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93807c expref: 16 pid: 9549 timeout: 900 lvb_type: 1 00000100:00100000:0.0:1746065204.393374:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265037824 00000100:00100000:0.0:1746065204.393376:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265037824 00010000:00010000:0.0:1746065204.393382:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477267 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380a6 expref: 35 pid: 9549 timeout: 900 lvb_type: 1 00002000:00100000:1.0:1746065204.393389:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3293183) req@ffff880099ec7b80 x1830881265038208/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:120/0 lens 488/0 e 0 to 0 dl 1746065215 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065204.393391:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7694 00000100:00100000:0.0:1746065204.393395:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265038080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00002000:00100000:1.0:1746065204.393397:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7b80 with x1830881265038208 ext(3145728->3293183) 00010000:00010000:0.0:1746065204.393400:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065204.393403:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1477650 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382eb expref: 35 pid: 3067 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.393406:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090684200/0xad6b7ddc147723d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93807c expref: 16 pid: 9549 timeout: 900 lvb_type: 1 00010000:00010000:1.0:1746065204.393412:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1477650 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382eb expref: 35 pid: 3067 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.393413:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090684200/0xad6b7ddc147723d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93807c expref: 16 pid: 9549 timeout: 900 lvb_type: 1 00002000:00010000:1.0:1746065204.393417:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec7b80 00010000:00010000:0.0:1746065204.393422:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090684200/0xad6b7ddc147723d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93807c expref: 16 pid: 9549 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.393429:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065204.393437:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1925 00000100:00100000:1.0:1746065204.393442:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265038208:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065204.393445:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265038080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.393450:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7694 00000100:00100000:0.0:1746065204.393472:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7695 00000100:00100000:0.0:1746065204.393477:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265037824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065204.393483:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065204.393488:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477267 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380a6 expref: 35 pid: 9549 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.393496:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477267 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380a6 expref: 36 pid: 9549 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.393720:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477267 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380a6 expref: 36 pid: 9549 timeout: 900 lvb_type: 1 00010000:00010000:0.0:1746065204.393728:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065204.393729:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065204.393732:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc14776ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.393738:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc14776ce lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.393752:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065204.393769:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265037824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 292us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.393791:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7695 00010000:00010000:0.0:1746065204.393829:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc14776ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.393835:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc14776ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.393848:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc14776ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.393854:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc14776ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.393864:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc14776ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.393870:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065204.393873:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc14776ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.393879:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc14776ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.393887:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc14776ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.393893:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf400/0xad6b7ddc14776ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065204.393926:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265036288:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 17901us (19251us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.393933:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16676 00000100:00100000:0.0:1746065204.394051:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263851136:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065204.394061:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc14776ea lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.394078:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14776dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.394247:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14776dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.394258:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14776dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.394263:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14776dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.394269:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14776dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.394273:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71bc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065204.394275:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14776dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.394280:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14776dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.394289:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14776dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.394293:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14776dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065204.394335:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265035904:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 17931us (19611us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.394341:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16678 00000100:00100000:0.0:1746065204.396656:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.397130:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.399114:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265038208:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5670us (5799us total) trans 17179874140 rc 0/0 00000100:00100000:1.0:1746065204.399125:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1925 00002000:00100000:1.0:1746065204.399132:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3293183) req@ffff880099ec7b80 x1830881265038208/t17179874140(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:120/0 lens 488/448 e 0 to 0 dl 1746065215 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065204.399140:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7b80 with x1830881265038208 ext(3145728->3293183) 00010000:00010000:1.0:1746065204.399146:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1477650 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382eb expref: 35 pid: 3067 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065204.399158:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1477650 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3293183) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9382eb expref: 35 pid: 3067 timeout: 900 lvb_type: 0 00002000:00010000:1.0:1746065204.399164:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec7b80 00000100:00100000:0.0:1746065204.404579:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065204.405037:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc14776ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.405045:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc14776ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.405059:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc14776ea lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.405065:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc14776ea lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.405070:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc14776ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.405079:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065204.405081:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc14776ea lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.405087:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc14776ea lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.405095:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc14776ea lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065204.405100:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc14776ea lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065204.405817:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265036416:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 28217us (30112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065204.405825:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16680 00000100:00100000:0.0:1746065204.407490:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.410439:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.410510:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.410867:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265038976 00000100:00100000:1.0:1746065204.410872:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265038976 00010000:00010000:1.0:1746065204.410891:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc14772a6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c9 expref: 25 pid: 13395 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746065204.410907:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265039104 00000100:00100000:1.0:1746065204.410908:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265039104 00010000:00010000:1.0:1746065204.410915:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c2 expref: 42 pid: 7231 timeout: 900 lvb_type: 0 00000100:00100000:1.0:1746065204.411071:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7699 00000100:00100000:1.0:1746065204.411079:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265038976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065204.411141:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7700 00000100:00100000:0.0:1746065204.411147:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881265039104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065204.411156:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065204.411161:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c2 expref: 42 pid: 7231 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.411169:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c2 expref: 42 pid: 7231 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.411187:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d800/0xad6b7ddc147729f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c2 expref: 42 pid: 7231 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065204.411197:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065204.411199:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065204.411201:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc14772a6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c9 expref: 25 pid: 13395 timeout: 900 lvb_type: 0 00010000:00010000:0.0:1746065204.411203:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0xad6b7ddc14776f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065204.411210:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065204.411214:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc14772a6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c9 expref: 25 pid: 13395 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065204.411223:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc14772a6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9380c9 expref: 25 pid: 13395 timeout: 900 lvb_type: 0 00010000:00010000:1.0:1746065204.411231:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065204.411233:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0xad6b7ddc14776f1 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065204.411238:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065204.411242:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265039104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.411248:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7700 00000100:00100000:1.0:1746065204.411250:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881265038976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 173us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065204.411254:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7699 00000100:00100000:0.0:1746065204.411992:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.412045:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.414705:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263852032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065204.414740:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065204.414759:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263852544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065204.414789:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065204.414808:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065204.414812:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263852160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065204.414826:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065204.414835:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263852672:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065204.414846:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065204.415904:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263852672 00000100:00100000:1.0:1746065204.415907:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263852672 00000100:00100000:1.0:1746065204.415927:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263851776 00000100:00100000:1.0:1746065204.415929:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263851776 00000100:00100000:1.0:1746065204.415937:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263852288 00000100:00100000:1.0:1746065204.415939:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263852288 00000100:00100000:1.0:1746065204.415947:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16681 00000100:00100000:1.0:1746065204.415952:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3759:x1830881263852032:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065204.416083:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16683 00000100:00100000:0.0:1746065204.416089:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881263852160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065204.416483:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3759:x1830881263852032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 530us (1741us total) trans 17179874141 rc 0/0 00000100:00100000:0.0:1746065204.416490:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3759:x1830881263852160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 403us (1664us total) trans 17179874143 rc 0/0 00000100:00100000:1.0:1746065204.416492:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16681 00000100:00100000:0.0:1746065204.416495:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16683 00000100:00100000:0.0:1746065204.416504:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16684 00000100:00100000:0.0:1746065204.416508:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881263852672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065204.416544:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00000100:00100000:1.0:1746065204.416638:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16685 00000100:00100000:1.0:1746065204.416644:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3761:x1830881263851776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065204.416700:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263851776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (1796us total) trans 17179874145 rc 0/0 00000100:00100000:1.0:1746065204.416705:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16685 00000100:00100000:1.0:1746065204.416714:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263852800 00000100:00100000:1.0:1746065204.416716:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263852800 00000100:00100000:1.0:1746065204.416728:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263853312 00000100:00100000:1.0:1746065204.416730:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263853312 00000100:00100000:1.0:1746065204.416735:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263851904 00000100:00100000:1.0:1746065204.416737:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263851904 00000100:00100000:1.0:1746065204.416742:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263852416 00000100:00100000:1.0:1746065204.416743:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263852416 00000100:00100000:1.0:1746065204.416749:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263852928 00000100:00100000:1.0:1746065204.416750:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263852928 00000100:00100000:1.0:1746065204.416755:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263853440 00000100:00100000:1.0:1746065204.416756:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263853440 00000100:00100000:1.0:1746065204.416762:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263853184 00000100:00100000:1.0:1746065204.416764:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263853184 00000100:00100000:1.0:1746065204.416769:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263853696 00000100:00100000:1.0:1746065204.416770:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263853696 00000100:00100000:1.0:1746065204.416792:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263853568 00000100:00100000:1.0:1746065204.416794:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263853568 00000100:00100000:1.0:1746065204.416800:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16686 00000100:00100000:1.0:1746065204.416804:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3761:x1830881263852288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065204.416839:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065204.416841:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065204.416842:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065204.416845:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065204.416846:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065204.416863:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3761:x1830881263852288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (972us total) trans 17179874146 rc 0/0 00000100:00100000:1.0:1746065204.416867:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16686 00000100:00100000:1.0:1746065204.416876:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16687 00000100:00100000:1.0:1746065204.416880:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3761:x1830881263852800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065204.416914:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065204.416916:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065204.416917:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065204.416919:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:0.0:1746065204.416938:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263852672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 430us (2091us total) trans 17179874144 rc 0/0 00000100:00100000:1.0:1746065204.416939:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881263852800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (376us total) trans 21474841557 rc 0/0 00000100:00100000:1.0:1746065204.416944:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16687 00000100:00100000:0.0:1746065204.416946:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16684 00000100:00100000:1.0:1746065204.416953:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16688 00000100:00100000:0.0:1746065204.416955:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16689 00000100:00100000:1.0:1746065204.416956:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3761:x1830881263853312:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065204.416958:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263851904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065204.416987:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746065204.416989:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065204.416991:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065204.416993:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065204.416995:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:0.0:1746065204.416998:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3761:x1830881263851904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (380us total) trans 17179874147 rc 0/0 00000100:00100000:0.0:1746065204.417003:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16689 00000100:00100000:1.0:1746065204.417006:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881263853312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (415us total) trans 21474841558 rc 0/0 00000100:00100000:1.0:1746065204.417010:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16688 00000100:00100000:0.0:1746065204.417012:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16690 00000100:00100000:1.0:1746065204.417016:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16691 00000100:00100000:0.0:1746065204.417016:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263852416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065204.417019:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3761:x1830881263852928:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065204.417055:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+32:3761:x1830881263852416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (417us total) trans 17179874148 rc 0/0 00000100:00100000:1.0:1746065204.417056:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881263852928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 35us (399us total) trans 21474841559 rc 0/0 00000100:00100000:0.0:1746065204.417060:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16690 00000100:00100000:1.0:1746065204.417068:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16691 00000100:00100000:1.0:1746065204.417075:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16692 00000100:00100000:1.0:1746065204.417079:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3761:x1830881263853440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065204.417112:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:1.0:1746065204.417114:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065204.417115:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065204.417117:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065204.417118:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:1.0:1746065204.417133:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3761:x1830881263853440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (458us total) trans 21474841560 rc 0/0 00000100:00100000:1.0:1746065204.417138:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16692 00000100:00100000:1.0:1746065204.417147:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16694 00000100:00100000:1.0:1746065204.417150:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3760:x1830881263853696:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065204.417194:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa6300/2, rc 0, transno 17179874147 00000100:00100000:1.0:1746065204.417202:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263851904:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065204.417209:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa7100/2, rc 0, transno 17179874148 00000100:00100000:1.0:1746065204.417211:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263852416:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065204.417218:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec4e00/2, rc 0, transno 21474841559 00000100:00100000:1.0:1746065204.417221:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263852928:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065204.417226:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec5f80/2, rc 0, transno 21474841560 00000100:00100000:1.0:1746065204.417229:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263853440:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065204.417235:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec6680/2, rc 0, transno 21474841557 00000100:00100000:1.0:1746065204.417237:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263852800:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065204.417243:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec4a80/2, rc 0, transno 21474841558 00000100:00100000:1.0:1746065204.417245:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263853312:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065204.417251:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa5f80/2, rc 0, transno 17179874145 00000100:00100000:1.0:1746065204.417253:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263851776:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065204.417258:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa6d80/2, rc 0, transno 17179874146 00000100:00100000:1.0:1746065204.417261:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263852288:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065204.417316:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3760:x1830881263853696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (594us total) trans 21474841562 rc 0/0 00000100:00100000:1.0:1746065204.417321:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16694 00000100:00100000:1.0:1746065204.417328:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263853824 00000100:00100000:1.0:1746065204.417330:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263853824 00000100:00100000:1.0:1746065204.417338:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16697 00000100:00100000:1.0:1746065204.417342:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3762:x1830881263853824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065204.417385:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+33:3762:x1830881263853824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (71us total) trans 17179874149 rc 0/0 00000100:00100000:1.0:1746065204.417390:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16697 00000004:00080000:0.0:1746065204.417468:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa6a00/2, rc 0, transno 17179874143 00000100:00100000:0.0:1746065204.417471:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263852160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065204.417478:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa7800/2, rc 0, transno 17179874144 00000100:00100000:0.0:1746065204.417480:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263852672:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065204.417486:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa6680/2, rc 0, transno 17179874141 00000100:00100000:0.0:1746065204.417489:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263852032:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065204.417494:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa7480/2, rc 0, transno 17179874142 00000100:00100000:0.0:1746065204.417496:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263852544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065204.417688:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265039488 00000100:00100000:0.0:1746065204.417692:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265039488 00000100:00100000:0.0:1746065204.417722:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14394 00000100:00100000:0.0:1746065204.417727:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+7:2041:x1830881265039488:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065204.417742:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065204.417753:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc14776f8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938331 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.417804:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc14776f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938331 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.417814:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc14776f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938331 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.417826:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065204.417829:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065204.417831:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f400, rc 0) 00000100:00100000:0.0:1746065204.417866:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2041:x1830881265039488:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 139us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.417871:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14394 00000100:00100000:0.0:1746065204.422181:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265039616 00000100:00100000:0.0:1746065204.422189:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265039616 00000100:00100000:0.0:1746065204.422220:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14395 00000100:00100000:0.0:1746065204.422227:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2041:x1830881265039616:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065204.422241:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065204.422253:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc14776ff lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938338 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.422320:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f800/0xad6b7ddc1477706 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065204.422332:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f800/0xad6b7ddc1477706 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065204.422341:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f800/0xad6b7ddc1477706 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065204.422364:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:0.0:1746065204.422367:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065204.422379:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f800/0xad6b7ddc1477706 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065204.422399:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc14776ff lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938338 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.422422:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f800/0xad6b7ddc1477706 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938338 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065204.422428:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065204.422431:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065204.422433:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f800, rc 0) 00000100:00100000:0.0:1746065204.422483:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2041:x1830881265039616:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 256us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.422489:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14395 00000100:00100000:0.0:1746065204.425073:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.425109:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.425124:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.425190:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.425206:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265040128 00000100:00100000:0.0:1746065204.425209:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265040128 00000100:00100000:0.0:1746065204.425228:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16699 00000100:00100000:0.0:1746065204.425233:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265039872:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065204.425243:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065204.425253:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1477714 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938346 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065204.425266:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d730, atime: 0x6812d730, ctime: 0x6812d730, blocks: 0x800 00010000:00010000:0.0:1746065204.425274:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065204.425275:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065204.425280:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1477714 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938346 expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065204.425290:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1477714 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938346 expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065204.425297:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e200, rc 0) 00000100:00100000:0.0:1746065204.425331:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265039872:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 97us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.425338:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16699 00000100:00100000:0.0:1746065204.425351:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16700 00000100:00100000:0.0:1746065204.425361:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265040000:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065204.425367:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065204.425374:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580e600/0xad6b7ddc1477722 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93834d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065204.425384:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d734, atime: 0x6812d734, ctime: 0x6812d733, blocks: 0x808 00010000:00010000:0.0:1746065204.425390:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065204.425391:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065204.425396:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580e600/0xad6b7ddc1477722 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93834d expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065204.425404:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580e600/0xad6b7ddc1477722 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93834d expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065204.425410:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e600, rc 0) 00000100:00100000:0.0:1746065204.425423:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265040000:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 67us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.425428:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16700 00000100:00100000:0.0:1746065204.426425:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065204.426454:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065204.426575:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265040256 00000100:00100000:1.0:1746065204.426579:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265040256 00000100:00100000:1.0:1746065204.426690:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265040384 00000100:00100000:1.0:1746065204.426694:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265040384 00000100:00100000:1.0:1746065204.426710:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16702 00000100:00100000:1.0:1746065204.426716:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265040256:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065204.426723:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065204.426733:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc1477729 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93835b expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065204.426746:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 4897248, mtime: 0x6812d734, atime: 0x6812d734, ctime: 0x6812d734, blocks: 0x1568 00010000:00010000:1.0:1746065204.426755:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065204.426757:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065204.426762:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc1477729 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93835b expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.426771:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc1477729 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93835b expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065204.426799:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af08c00, rc 0) 00000100:00100000:1.0:1746065204.427257:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265040256:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 540us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065204.427263:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16702 00000100:00100000:0.0:1746065204.765406:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263853952 00000100:00100000:0.0:1746065204.765500:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263853952 00000100:00100000:0.0:1746065204.765976:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:0.0:1746065204.765983:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3762:x1830881263853952:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065204.766019:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:0.0:1746065204.766057:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3762:x1830881263853952:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.766062:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00100000:0.0:1746065204.798649:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ceddf226-8ddf-479f-9953-8a74c62285a9:3759:1830881263854080:0@lo:400:kworker.0 00000100:00100000:0.0:1746065204.798707:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065204.802287:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263854080 00000100:00100000:1.0:1746065204.802290:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263854080 00000100:00100000:1.0:1746065204.802503:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1746065204.802510:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3759:x1830881263854080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065204.802540:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3759:x1830881263854080:12345-0@lo:400:kworker.0 Request processed in 31us (3832us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.802792:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ceddf226-8ddf-479f-9953-8a74c62285a9:3759:1830881263854080:0@lo:400:kworker.0 00000100:00100000:1.0:1746065204.802838:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1746065204.846732:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263855360 00000100:00100000:0.0:1746065204.846740:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263855360 00000100:00100000:0.0:1746065204.846972:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1746065204.846979:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881263855360:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746065204.847007:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445580800 avail 1316118528 00000100:00100000:0.0:1746065204.847052:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881263855360:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (1551us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.847058:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:0.0:1746065204.877151:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263855488 00000100:00100000:0.0:1746065204.877159:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263855488 00000100:00100000:0.0:1746065204.877192:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1746065204.877197:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881263855488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746065204.877214:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1069729216 pending 3883008 free 3910598656 avail 3679076352 00000100:00100000:0.0:1746065204.877246:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881263855488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 49us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.877251:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1746065204.894883:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263855616 00000100:00100000:0.0:1746065204.894889:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263855616 00000100:00100000:0.0:1746065204.894917:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00000100:00100000:0.0:1746065204.894924:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263855616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746065204.894940:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1072974144 pending 4603904 free 3906863104 avail 3675340800 00000100:00100000:0.0:1746065204.894975:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881263855616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 52us (1635us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065204.894980:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00010000:00010000:1.0:1746065205.075500:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065205.433107:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.433148:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.433178:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.433206:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.433221:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.433248:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.433272:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265040512 00000100:00100000:0.0:1746065205.433278:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265040512 00000100:00100000:0.0:1746065205.433309:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265040640 00000100:00100000:0.0:1746065205.433311:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265040640 00000100:00100000:0.0:1746065205.433319:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265040768 00000100:00100000:0.0:1746065205.433321:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265040768 00000100:00100000:0.0:1746065205.433328:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265040896 00000100:00100000:0.0:1746065205.433329:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265040896 00000100:00100000:0.0:1746065205.433337:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265041024 00000100:00100000:0.0:1746065205.433338:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265041024 00000100:00100000:0.0:1746065205.433344:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265041152 00000100:00100000:0.0:1746065205.433346:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265041152 00000100:00100000:0.0:1746065205.433353:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16704 00000100:00100000:0.0:1746065205.433358:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265040512:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.433476:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265040512:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 90us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.433482:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16704 00000100:00100000:0.0:1746065205.433495:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16705 00000100:00100000:0.0:1746065205.433500:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265040640:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.433531:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265040640:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 31us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.433535:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16705 00000100:00100000:0.0:1746065205.433544:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16706 00000100:00100000:0.0:1746065205.433547:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265040768:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.433570:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265040768:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 22us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.433574:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16706 00000100:00100000:0.0:1746065205.433583:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16707 00000100:00100000:0.0:1746065205.433586:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265040896:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.433608:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265040896:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 21us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.433612:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16707 00000100:00100000:0.0:1746065205.433621:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16708 00000100:00100000:0.0:1746065205.433625:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265041024:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.433648:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265041024:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.433652:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16708 00000100:00100000:0.0:1746065205.433660:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16709 00000100:00100000:0.0:1746065205.433664:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265041152:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.433687:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265041152:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 23us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.433691:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16709 00000100:00080000:0.0:1746065205.433853:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065205.433857:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065205.440737:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.440813:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.440843:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.440866:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.440880:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.440898:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265041280 00000100:00100000:0.0:1746065205.440905:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265041280 00000100:00100000:0.0:1746065205.440932:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265041536 00000100:00100000:0.0:1746065205.440935:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265041536 00000100:00100000:0.0:1746065205.440944:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265041792 00000100:00100000:0.0:1746065205.440946:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265041792 00000100:00100000:0.0:1746065205.440954:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265041408 00000100:00100000:0.0:1746065205.440956:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265041408 00000100:00100000:0.0:1746065205.440963:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265041664 00000100:00100000:0.0:1746065205.440965:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265041664 00000100:00100000:0.0:1746065205.440974:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16710 00000100:00100000:0.0:1746065205.440981:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881265041280:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.441063:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881265041280:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 82us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.441070:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16710 00000100:00100000:0.0:1746065205.441098:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16711 00000100:00100000:0.0:1746065205.441102:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265041536:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.441133:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265041536:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 31us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.441138:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16711 00000100:00100000:0.0:1746065205.441146:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16712 00000100:00100000:0.0:1746065205.441150:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265041792:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.441178:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265041792:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.441182:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16712 00000100:00100000:0.0:1746065205.441274:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16713 00000100:00100000:0.0:1746065205.441279:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265041408:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.441302:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265041408:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 23us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.441307:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16713 00000100:00100000:0.0:1746065205.441314:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16714 00000100:00100000:0.0:1746065205.441318:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265041664:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.441341:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265041664:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 23us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.441346:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16714 00000100:00100000:0.0:1746065205.441434:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.441462:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265041920 00000100:00100000:0.0:1746065205.441465:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265041920 00000100:00100000:0.0:1746065205.441480:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16715 00000100:00100000:0.0:1746065205.441484:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265041920:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065205.441514:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265041920:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 29us (80us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.441518:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16715 00000100:00100000:0.0:1746065205.452140:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265042048 00000100:00100000:0.0:1746065205.452148:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265042048 00000100:00100000:0.0:1746065205.452191:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16716 00000100:00100000:0.0:1746065205.452197:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265042048:12345-192.168.202.27@tcp:22:mirror_io.0 00002000:00010000:0.0:1746065205.452335:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065205.452338:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065205.452340:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065205.452342:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065205.452343:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:0.0:1746065205.455361:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265042048:12345-192.168.202.27@tcp:22:mirror_io.0 Request processed in 3155us (3283us total) trans 21474841565 rc 0/0 00000100:00100000:0.0:1746065205.455373:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16716 00000100:00100000:0.0:1746065205.463092:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.477941:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.478032:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.478061:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.478410:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.483624:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5825 00000100:00100000:1.0:1746065205.483641:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881265042688:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065205.483676:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009af08600/0xad6b7ddc147773e lrc: 3/1,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.483688:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.483690:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.483694:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08600/0xad6b7ddc147773e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.483710:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009af08600/0xad6b7ddc147773e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065205.484274:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5826 00000100:00100000:1.0:1746065205.484280:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:02506576-29fe-43be-8266-ebca0ccafd52+15:2007:x1830881265042944:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065205.484293:0:29491:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1477745 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.484299:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.484301:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.484304:0:29491:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1477745 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.484311:0:29491:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1477745 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065205.485984:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.486008:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265043456 00000100:00100000:0.0:1746065205.486013:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265043456 00000100:00100000:0.0:1746065205.486058:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5827 00000100:00100000:0.0:1746065205.486064:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+16:2007:x1830881265043456:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065205.486084:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc147774c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.486094:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065205.486096:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065205.486099:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc147774c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.486108:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3de00/0xad6b7ddc147774c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065205.487364:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.487969:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265043712 00000100:00100000:0.0:1746065205.487974:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265043712 00000100:00100000:0.0:1746065205.488012:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5828 00000100:00100000:0.0:1746065205.488018:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:02506576-29fe-43be-8266-ebca0ccafd52+16:2007:x1830881265043712:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065205.488043:0:9555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008d857e00/0xad6b7ddc1477753 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.488053:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065205.488054:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065205.488058:0:9555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d857e00/0xad6b7ddc1477753 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.488066:0:9555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d857e00/0xad6b7ddc1477753 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065205.502240:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.502259:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265043968 00000100:00100000:1.0:1746065205.502266:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265043968 00000100:00100000:1.0:1746065205.502304:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5830 00000100:00100000:1.0:1746065205.502310:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265043968:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065205.502343:0:29490:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477761 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.502356:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.502357:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.502362:0:29490:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477761 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.502374:0:29490:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477761 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.513856:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009af08600/0xad6b7ddc147773e lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.513872:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08600/0xad6b7ddc147773e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.513880:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009af08600/0xad6b7ddc147773e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.513886:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009af08600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065205.513890:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009af08600/0xad6b7ddc147773e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.513897:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009af08600/0xad6b7ddc147773e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.513913:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009af08600/0xad6b7ddc147773e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.513919:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009af08600/0xad6b7ddc147773e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065205.514006:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:02506576-29fe-43be-8266-ebca0ccafd52+19:2007:x1830881265042688:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 30368us (35969us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065205.514017:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5825 00010000:00010000:1.0:1746065205.544717:0:29491:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1477745 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.544733:0:29491:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1477745 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.544739:0:29491:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1477745 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.544745:0:29491:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009af08000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065205.544748:0:29491:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1477745 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.544755:0:29491:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1477745 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.544769:0:29491:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1477745 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.545185:0:29491:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1477745 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065205.545933:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:02506576-29fe-43be-8266-ebca0ccafd52+15:2007:x1830881265042944:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 61646us (67864us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065205.545942:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5826 00010000:00010000:1.0:1746065205.563856:0:29490:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477761 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.563876:0:29490:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477761 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.563883:0:29490:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477761 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.563889:0:29490:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130113600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065205.563892:0:29490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477761 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.563898:0:29490:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477761 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.563913:0:29490:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477761 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.563918:0:29490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477761 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065205.565004:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265043968:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 62688us (62763us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065205.565014:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5830 00010000:00010000:0.0:1746065205.568388:0:9553:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc1477768 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.568403:0:9553:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc1477768 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.568410:0:9553:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc1477768 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.568415:0:9553:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065205.568418:0:9553:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc1477768 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.568425:0:9553:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc1477768 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.568439:0:9553:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc1477768 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.568462:0:9553:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc1477768 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065205.568536:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265044224:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 65429us (66201us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065205.568544:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5831 00000100:00100000:0.0:1746065205.579404:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065205.580737:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065205.587536:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.627667:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065205.699407:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841565 is committed 00000001:00080000:0.0:1746065205.699418:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841564 is committed 00000001:00080000:0.0:1746065205.699428:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841556 is committed 00000001:00080000:0.0:1746065205.699437:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841555 is committed 00000100:00100000:0.0:1746065205.718079:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.718129:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065205.718796:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065205.718822:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14397 00000100:00100000:0.0:1746065205.718828:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2049:x1830881265045376:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065205.718838:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065205.718845:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1477792 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938370 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.718871:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc1477799 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718877:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc1477799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718884:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc1477799 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718891:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14777a0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718895:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14777a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718899:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14777a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718931:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc14777a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718935:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc14777a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718940:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc14777a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065205.718944:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065205.718968:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc1477799 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718973:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc1477799 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718977:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc1477799 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718981:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc1477799 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718985:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065205.718987:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc1477799 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718991:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc1477799 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.718998:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065205.719000:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065205.719002:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc1477799 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.719005:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857200/0xad6b7ddc1477799 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.719016:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14777a0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.719020:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14777a0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.719024:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14777a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.719027:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d857c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065205.719029:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14777a0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.719033:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14777a0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.719038:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5700) 00010000:00010000:0.0:1746065205.719040:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065205.719042:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14777a0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.719049:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857c00/0xad6b7ddc14777a0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.719069:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856400/0xad6b7ddc1477792 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938370 expref: 29 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.719077:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856200/0xad6b7ddc14777a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938370 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.719082:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065205.719084:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065205.719085:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856200, rc 0) 00000100:00100000:0.0:1746065205.721655:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2049:x1830881265045376:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2825us (3524us total) trans 8589936856 rc 0/0 00000100:00100000:0.0:1746065205.721661:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14397 00000100:00100000:0.0:1746065205.728864:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.729987:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265045888 00000100:00100000:0.0:1746065205.729991:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265045888 00000100:00100000:0.0:1746065205.730010:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14399 00000100:00100000:0.0:1746065205.730015:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2053:x1830881265045888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065205.730024:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065205.730029:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc14777ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93837e expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.730060:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856000/0xad6b7ddc14777d1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065205.730066:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856000/0xad6b7ddc14777d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065205.730073:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856000/0xad6b7ddc14777d1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746065205.730078:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065205.730111:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d857400/0xad6b7ddc14777ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93837e expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.730139:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d856000/0xad6b7ddc14777d1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93837e expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.730143:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065205.730145:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065205.730147:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856000, rc 0) 00000100:00100000:0.0:1746065205.730176:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2053:x1830881265045888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 160us (305us total) trans 8589936858 rc 0/0 00000100:00100000:0.0:1746065205.730180:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14399 00000100:00100000:0.0:1746065205.742434:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.742469:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.742493:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.742519:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.743116:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265046016 00000100:00100000:1.0:1746065205.743120:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265046016 00000100:00100000:0.0:1746065205.743132:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.743216:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265046272 00000100:00100000:1.0:1746065205.743219:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265046272 00000100:00100000:0.0:1746065205.743228:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.743233:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265046528 00000100:00100000:1.0:1746065205.743235:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265046528 00000100:00100000:0.0:1746065205.743240:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.743353:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265046784 00000100:00100000:1.0:1746065205.743356:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265046784 00000100:00100000:0.0:1746065205.743363:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16721 00000100:00100000:0.0:1746065205.743369:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881265046016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065205.743376:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065205.743378:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16722 00010000:00010000:0.0:1746065205.743382:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856600/0xad6b7ddc14777f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938385 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065205.743383:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881265046272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065205.743388:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065205.743391:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065205.743392:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.743394:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095778800/0xad6b7ddc14777fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938393 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.743397:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856600/0xad6b7ddc14777f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938385 expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065205.743404:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.743405:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065205.743405:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856600/0xad6b7ddc14777f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938385 expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065205.743409:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095778800/0xad6b7ddc14777fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938393 expref: 21 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065205.743412:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856600, rc 0) 00010000:00010000:1.0:1746065205.743417:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095778800/0xad6b7ddc14777fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938393 expref: 21 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065205.743423:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778800, rc 0) 00000100:00100000:0.0:1746065205.743431:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881265046016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 62us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.743436:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16721 00000100:00100000:1.0:1746065205.743440:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881265046272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 57us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065205.743445:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16722 00000100:00100000:0.0:1746065205.743497:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16723 00000100:00100000:1.0:1746065205.743502:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16724 00000100:00100000:0.0:1746065205.743503:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881265046528:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065205.743507:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265046784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065205.743508:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065205.743513:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065205.743514:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1477802 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9383a1 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.743518:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477809 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9383af expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.743523:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065205.743524:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.743528:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065205.743528:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1477802 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383a1 expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065205.743529:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.743533:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383af expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065205.743535:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1477802 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383a1 expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065205.743541:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383af expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065205.743545:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856c00, rc 0) 00010000:00010000:1.0:1746065205.743547:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778e00, rc 0) 00000100:00100000:0.0:1746065205.743558:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881265046528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 57us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065205.743562:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265046784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 56us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.743563:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16723 00000100:00100000:1.0:1746065205.743567:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16724 00000100:00100000:0.0:1746065205.743674:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.743698:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.743710:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.743721:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.743741:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.754751:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.766388:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.766421:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.769318:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265047936 00000100:00100000:1.0:1746065205.769326:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265047936 00000100:00100000:0.0:1746065205.770181:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.773114:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.773130:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265048320 00000100:00100000:0.0:1746065205.773136:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265048320 00010000:00010000:0.0:1746065205.773159:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc14776f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938331 expref: 10 pid: 13395 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746065205.773248:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265048192 00000100:00100000:1.0:1746065205.773251:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265048192 00000100:00100000:0.0:1746065205.774601:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265048448 00000100:00100000:0.0:1746065205.774605:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265048448 00010000:00010000:0.0:1746065205.774619:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f800/0xad6b7ddc1477706 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938338 expref: 11 pid: 13395 timeout: 901 lvb_type: 0 00000100:00100000:0.0:1746065205.774641:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7704 00000100:00100000:0.0:1746065205.774646:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265048320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065205.774656:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065205.774659:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc14776f8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938331 expref: 11 pid: 13395 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746065205.774667:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc14776f8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938331 expref: 11 pid: 13395 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746065205.774681:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f400/0xad6b7ddc14776f8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938331 expref: 11 pid: 13395 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746065205.774692:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065205.774695:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.774700:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.774703:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065205.774718:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265048320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 72us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.774722:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7704 00000100:00100000:0.0:1746065205.774732:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7705 00000100:00100000:0.0:1746065205.774736:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265048448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065205.774742:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065205.774745:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f800/0xad6b7ddc1477706 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938338 expref: 9 pid: 13395 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746065205.774753:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f800/0xad6b7ddc1477706 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938338 expref: 9 pid: 13395 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746065205.774762:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f800/0xad6b7ddc1477706 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938338 expref: 9 pid: 13395 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746065205.774768:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065205.774771:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.774789:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.774794:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.774799:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1477848 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065205.774803:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1477848 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065205.774815:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065205.774829:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881265048448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.774834:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7705 00010000:00010000:0.0:1746065205.774862:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065205.774868:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00000040:00080000:0.0:1746065205.775060:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].974, 88 off93544 00000004:00080000:0.0:1746065205.775066:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 801793292057ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065205.775089:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].999, 88 off95744 00000004:00080000:0.0:1746065205.775093:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 801793319300ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065205.775102:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1000, 88 off95832 00000004:00080000:0.0:1746065205.775104:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 801793330685ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065205.775110:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].975, 88 off93632 00000004:00080000:0.0:1746065205.775113:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 801793339551ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065205.775120:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].976, 88 off93720 00000004:00080000:0.0:1746065205.775122:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 801793348506ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065205.775130:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1001, 88 off95920 00000004:00080000:0.0:1746065205.775132:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 801793358630ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065205.775139:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1002, 88 off96008 00000004:00080000:0.0:1746065205.775141:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 801793367720ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065205.775148:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1003, 88 off96096 00000004:00080000:0.0:1746065205.775150:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 801793376671ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065205.775157:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].977, 88 off93808 00000004:00080000:0.0:1746065205.775160:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 801793386092ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065205.775166:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1004, 88 off96184 00000004:00080000:0.0:1746065205.775169:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 801793395156ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065205.775175:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].978, 88 off93896 00000004:00080000:0.0:1746065205.775177:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 801793403636ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065205.775183:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1005, 88 off96272 00000004:00080000:0.0:1746065205.775185:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 801793411955ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065205.775192:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].979, 88 off93984 00000004:00080000:0.0:1746065205.775194:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 801793420351ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065205.775200:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].980, 88 off94072 00000004:00080000:0.0:1746065205.775202:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 801793428731ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065205.775209:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].981, 88 off94160 00000004:00080000:0.0:1746065205.775211:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 801793437784ns, next at 761143591313ns, rc = 0 00000100:00100000:1.0:1746065205.776484:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000040:00080000:0.0:1746065205.777258:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].982, 88 off94248 00000004:00080000:0.0:1746065205.777265:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 801795491765ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065205.777303:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1006, 88 off96360 00000004:00080000:0.0:1746065205.777306:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 801795532185ns, next at 761143559853ns, rc = 0 00000004:00080000:0.0:1746065205.781941:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 7 changes, 1 in progress, 0 in flight, 24 done 00010000:00010000:0.0:1746065205.782032:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383d9 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.782041:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065205.782043:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065205.782046:0:9571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1477848 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065205.782053:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383d9 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.782058:0:9571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1477848 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065205.782074:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383d9 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.782083:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383d9 expref: 10 pid: 9571 timeout: 901 lvb_type: 0 00000100:00100000:0.0:1746065205.782093:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263857792:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065205.782133:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009abfe0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065205.782148:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263857152:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065205.782164:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.782174:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263857664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065205.782183:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.782192:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065205.782196:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263856768:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065205.782206:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.782213:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263857280:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065205.782222:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.782235:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263857152 00000100:00100000:0.0:1746065205.782238:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263857152 00000100:00100000:0.0:1746065205.782250:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263857664 00000100:00100000:0.0:1746065205.782251:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263857664 00000100:00100000:0.0:1746065205.782257:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263856768 00000100:00100000:0.0:1746065205.782258:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263856768 00000100:00100000:0.0:1746065205.782266:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263857280 00000100:00100000:0.0:1746065205.782267:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263857280 00000100:00100000:0.0:1746065205.782275:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16733 00000100:00100000:0.0:1746065205.782278:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263857152:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065205.782318:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065205.782320:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065205.782322:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065205.782324:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065205.782326:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:0.0:1746065205.782343:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263857152:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (178us total) trans 21474841567 rc 0/0 00000100:00100000:0.0:1746065205.782347:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16733 00000100:00100000:0.0:1746065205.782356:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16734 00000100:00100000:0.0:1746065205.782360:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263857664:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065205.782399:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263857664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (214us total) trans 21474841568 rc 0/0 00000100:00100000:0.0:1746065205.782403:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16734 00000100:00100000:0.0:1746065205.782410:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16735 00000100:00100000:0.0:1746065205.782413:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3759:x1830881263856768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065205.782466:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3759:x1830881263856768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (259us total) trans 17179874152 rc 0/0 00000100:00100000:0.0:1746065205.782471:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16735 00000100:00100000:0.0:1746065205.782481:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16736 00000100:00100000:0.0:1746065205.782485:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263857280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065205.782518:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065205.782521:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065205.782522:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065205.782524:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065205.782525:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:0.0:1746065205.782539:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263857280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (317us total) trans 21474841569 rc 0/0 00000100:00100000:0.0:1746065205.782544:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16736 00000004:00080000:0.0:1746065205.782565:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009acef100/2, rc 0, transno 17179874152 00000100:00100000:0.0:1746065205.782569:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263856768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065205.782575:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa4000/2, rc 0, transno 21474841569 00000100:00100000:0.0:1746065205.782577:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263857280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065205.782583:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa4380/2, rc 0, transno 21474841567 00000100:00100000:0.0:1746065205.782585:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263857152:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065205.782591:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aba7100/2, rc 0, transno 21474841568 00000100:00100000:0.0:1746065205.782593:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263857664:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065205.782620:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.782634:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263857024:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065205.782648:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.782656:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263857536:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065205.782665:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.782671:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065205.782675:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263856896:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065205.782685:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.782694:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263857408:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065205.782704:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.782720:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263856512 00000100:00100000:0.0:1746065205.782722:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263856512 00000100:00100000:0.0:1746065205.782733:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263857024 00000100:00100000:0.0:1746065205.782735:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263857024 00000100:00100000:0.0:1746065205.782741:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263857536 00000100:00100000:0.0:1746065205.782742:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263857536 00000100:00100000:0.0:1746065205.782748:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263856896 00000100:00100000:0.0:1746065205.782750:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263856896 00000100:00100000:0.0:1746065205.782754:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263857408 00000100:00100000:0.0:1746065205.782755:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263857408 00000100:00100000:0.0:1746065205.782762:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16737 00000100:00100000:0.0:1746065205.782765:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3762:x1830881263856512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065205.782814:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065205.782816:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:0.0:1746065205.782817:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065198 -> 1746065198 00002000:00010000:0.0:1746065205.782819:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065200 -> 1746065200 00002000:00010000:0.0:1746065205.782821:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065205.782837:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3762:x1830881263856512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (216us total) trans 17179874153 rc 0/0 00000100:00100000:0.0:1746065205.782841:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16737 00000100:00100000:0.0:1746065205.782849:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16738 00000100:00100000:0.0:1746065205.782852:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263857024:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065205.782879:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065205.782881:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065204 -> 1746065204 00002000:00010000:0.0:1746065205.782882:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065204 -> 1746065204 00002000:00010000:0.0:1746065205.782884:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065204 -> 1746065204 00002000:00010000:0.0:1746065205.782885:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746065205.782897:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263857024:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (248us total) trans 21474841570 rc 0/0 00000100:00100000:0.0:1746065205.782900:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16738 00000100:00100000:0.0:1746065205.782908:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16739 00000100:00100000:0.0:1746065205.782911:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263857536:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065205.782943:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263857536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 32us (277us total) trans 21474841571 rc 0/0 00000100:00100000:0.0:1746065205.782947:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16739 00000100:00100000:0.0:1746065205.782954:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16740 00000100:00100000:0.0:1746065205.782957:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263856896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065205.782979:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065205.782981:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065204 -> 1746065204 00002000:00010000:0.0:1746065205.782983:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065204 -> 1746065204 00002000:00010000:0.0:1746065205.782985:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065203 -> 1746065203 00002000:00010000:0.0:1746065205.782986:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065205.782997:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263856896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (311us total) trans 21474841572 rc 0/0 00000100:00100000:0.0:1746065205.783001:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16740 00000100:00100000:0.0:1746065205.783007:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16741 00000100:00100000:0.0:1746065205.783010:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263857408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065205.783032:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:0.0:1746065205.783034:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065205.783036:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065205.783037:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065205.783039:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:0.0:1746065205.783049:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263857408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (344us total) trans 21474841573 rc 0/0 00000100:00100000:0.0:1746065205.783053:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16741 00000004:00080000:0.0:1746065205.783074:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa5c00/2, rc 0, transno 21474841572 00000100:00100000:0.0:1746065205.783076:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263856896:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065205.783081:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aba5c00/2, rc 0, transno 21474841573 00000100:00100000:0.0:1746065205.783083:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263857408:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065205.783088:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa7b80/2, rc 0, transno 21474841570 00000100:00100000:0.0:1746065205.783090:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263857024:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065205.783094:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aba6300/2, rc 0, transno 21474841571 00000100:00100000:0.0:1746065205.783096:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263857536:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065205.783101:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aceed80/2, rc 0, transno 17179874153 00000100:00100000:0.0:1746065205.783103:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263856512:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065205.784386:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263857920:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065205.784408:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065205.784419:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263858432:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065205.784459:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065205.784474:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1746065205.784478:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263858304:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065205.784494:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065205.784512:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263858048 00000100:00100000:1.0:1746065205.784514:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263858048 00000100:00100000:1.0:1746065205.784529:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263858176 00000100:00100000:1.0:1746065205.784531:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263858176 00000100:00100000:1.0:1746065205.784547:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16742 00000100:00100000:1.0:1746065205.784552:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+40:3760:x1830881263857920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065205.784590:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065205.784592:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065205.784594:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065205.784595:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065205.784597:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065205.784615:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+42:3760:x1830881263857920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (207us total) trans 17179874155 rc 0/0 00000100:00100000:1.0:1746065205.784620:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16742 00000100:00100000:1.0:1746065205.784630:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16744 00000100:00100000:1.0:1746065205.784633:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3760:x1830881263858432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065205.784670:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3760:x1830881263858432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 36us (223us total) trans 17179874157 rc 0/0 00000100:00100000:1.0:1746065205.784674:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16744 00000100:00100000:1.0:1746065205.784680:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16746 00000100:00100000:1.0:1746065205.784683:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3760:x1830881263858304:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065205.784707:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:1.0:1746065205.784709:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065205.784711:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065205.784713:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065205.784714:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:1.0:1746065205.784726:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+41:3760:x1830881263858304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (232us total) trans 17179874159 rc 0/0 00000100:00100000:1.0:1746065205.784730:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16746 00000004:00080000:1.0:1746065205.784747:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad7800/2, rc 0, transno 17179874159 00000100:00100000:1.0:1746065205.784750:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263858304:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065205.784758:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad5500/2, rc 0, transno 17179874155 00000100:00100000:1.0:1746065205.784760:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263857920:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065205.784765:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957da680/2, rc 0, transno 17179874157 00000100:00100000:1.0:1746065205.784767:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263858432:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065205.786103:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263857792:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065205.786131:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc1477833 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383d9 expref: 10 pid: 9571 timeout: 0 lvb_type: 3 00010000:00010000:0.0:1746065205.786203:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383d9 expref: 9 pid: 9571 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746065205.786211:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383d9 expref: 9 pid: 9571 timeout: 901 lvb_type: 0 00010000:00010000:0.0:1746065205.786233:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3000, rc 0) 00000100:00100000:0.0:1746065205.786393:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2051:x1830881265047680:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 31472us (31649us total) trans 8589936859 rc 0/0 00000100:00100000:0.0:1746065205.786400:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14400 00000100:00100000:0.0:1746065205.789896:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.789965:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265048704 00000100:00100000:1.0:1746065205.789972:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265048704 00010000:00010000:1.0:1746065205.790001:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383d9 expref: 9 pid: 9571 timeout: 901 lvb_type: 0 00000100:00100000:1.0:1746065205.790033:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7706 00000100:00100000:1.0:1746065205.790039:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2006:x1830881265048704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065205.790051:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065205.790056:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383d9 expref: 9 pid: 9571 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746065205.790213:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383d9 expref: 9 pid: 9571 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746065205.790232:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147783a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383d9 expref: 9 pid: 9571 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746065205.790254:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065205.790258:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1477848 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065205.790265:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1477848 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065205.790274:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1477848 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065205.790280:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46800/0xad6b7ddc147784f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383e7 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.790297:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065205.790331:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2006:x1830881265048704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 292us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065205.790336:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7706 00000001:00080000:0.0:1746065205.792568:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936860 is committed 00000004:00080000:0.0:1746065205.792577:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 994 committed 00000004:00080000:0.0:1746065205.792590:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 973 committed 00000004:00080000:0.0:1746065205.792601:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 972 committed 00000004:00080000:0.0:1746065205.792602:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 971 committed 00000004:00080000:0.0:1746065205.792604:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 970 committed 00000004:00080000:0.0:1746065205.792606:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 993 committed 00000004:00080000:0.0:1746065205.792607:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 969 committed 00000004:00080000:0.0:1746065205.792609:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 992 committed 00000004:00080000:0.0:1746065205.792610:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 968 committed 00000004:00080000:0.0:1746065205.792612:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 991 committed 00000004:00080000:0.0:1746065205.792613:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 990 committed 00000004:00080000:0.0:1746065205.792615:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 989 committed 00000004:00080000:0.0:1746065205.792617:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 967 committed 00000004:00080000:0.0:1746065205.792618:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 966 committed 00000004:00080000:0.0:1746065205.792619:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 988 committed 00000004:00080000:0.0:1746065205.792620:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 987 committed 00000004:00080000:0.0:1746065205.792622:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 965 committed 00000100:00100000:1.0:1746065205.793435:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263858944:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065205.793484:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065205.793496:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263859456:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065205.793510:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065205.793521:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065205.793525:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263858816:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065205.793539:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065205.793546:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263859328:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065205.793557:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065205.793618:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263859968:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065205.793635:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065205.793645:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263860480:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065205.793655:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065205.793665:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065205.793669:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263859840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065205.793683:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065205.793692:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263860352:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065205.793703:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065205.793715:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263858944 00000100:00100000:1.0:1746065205.793718:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263858944 00000100:00100000:1.0:1746065205.793729:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263859456 00000100:00100000:1.0:1746065205.793730:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263859456 00000100:00100000:1.0:1746065205.793736:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263858816 00000100:00100000:1.0:1746065205.793737:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263858816 00000100:00100000:1.0:1746065205.793742:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263859328 00000100:00100000:1.0:1746065205.793743:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263859328 00000100:00100000:1.0:1746065205.793748:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263859968 00000100:00100000:1.0:1746065205.793749:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263859968 00000100:00100000:1.0:1746065205.793755:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263860480 00000100:00100000:1.0:1746065205.793756:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263860480 00000100:00100000:1.0:1746065205.793761:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263859840 00000100:00100000:1.0:1746065205.793762:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263859840 00000100:00100000:1.0:1746065205.793767:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263860352 00000100:00100000:1.0:1746065205.793768:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263860352 00000100:00100000:1.0:1746065205.793800:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16751 00000100:00100000:1.0:1746065205.793804:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3760:x1830881263858944:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065205.793843:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065205.793845:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065205.793847:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065205.793848:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065205.793850:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:1.0:1746065205.793868:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263858944:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (384us total) trans 21474841578 rc 0/0 00000100:00100000:1.0:1746065205.793873:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16751 00000100:00100000:1.0:1746065205.793975:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16752 00000100:00100000:1.0:1746065205.793979:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3760:x1830881263859456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065205.794025:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263859456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (514us total) trans 21474841579 rc 0/0 00000100:00100000:1.0:1746065205.794029:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16752 00000100:00100000:1.0:1746065205.794038:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16753 00000100:00100000:1.0:1746065205.794042:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3760:x1830881263858816:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065205.794073:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065205.794075:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065204 -> 1746065204 00002000:00010000:1.0:1746065205.794077:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065204 -> 1746065204 00002000:00010000:1.0:1746065205.794079:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065204 -> 1746065204 00002000:00010000:1.0:1746065205.794080:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746065205.794096:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263858816:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (556us total) trans 21474841580 rc 0/0 00000100:00100000:1.0:1746065205.794100:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16753 00000100:00100000:1.0:1746065205.794108:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16754 00000100:00100000:1.0:1746065205.794111:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+20:3760:x1830881263859328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065205.794154:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263859328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (596us total) trans 21474841581 rc 0/0 00000100:00100000:1.0:1746065205.794158:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16754 00000100:00100000:1.0:1746065205.794165:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16755 00000100:00100000:1.0:1746065205.794170:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3760:x1830881263859968:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065205.794227:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263859968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (591us total) trans 17179874160 rc 0/0 00000100:00100000:1.0:1746065205.794231:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16755 00000100:00100000:1.0:1746065205.794240:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16756 00000100:00100000:1.0:1746065205.794244:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3760:x1830881263860480:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065205.794273:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:1.0:1746065205.794275:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065205.794277:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065205.794278:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065205.794279:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:1.0:1746065205.794294:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263860480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (637us total) trans 17179874161 rc 0/0 00000100:00100000:1.0:1746065205.794298:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16756 00000100:00100000:1.0:1746065205.794307:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16757 00000100:00100000:1.0:1746065205.794311:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3760:x1830881263859840:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065205.794341:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 4897248 -> 4897248 00002000:00010000:1.0:1746065205.794343:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065204 -> 1746065204 00002000:00010000:1.0:1746065205.794345:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065204 -> 1746065204 00002000:00010000:1.0:1746065205.794346:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065204 -> 1746065204 00002000:00010000:1.0:1746065205.794347:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5480 -> 5480 00000100:00100000:1.0:1746065205.794363:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263859840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (678us total) trans 17179874162 rc 0/0 00000100:00100000:1.0:1746065205.794366:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16757 00000100:00100000:1.0:1746065205.794375:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16758 00000100:00100000:1.0:1746065205.794379:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3760:x1830881263860352:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065205.794410:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065205.794412:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065205.794414:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065205.794415:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065205.794417:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:1.0:1746065205.794434:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263860352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (729us total) trans 17179874163 rc 0/0 00000100:00100000:1.0:1746065205.794439:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16758 00000004:00080000:1.0:1746065205.794472:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513b800/2, rc 0, transno 17179874162 00000100:00100000:1.0:1746065205.794479:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263859840:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065205.794486:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135138700/2, rc 0, transno 17179874163 00000100:00100000:1.0:1746065205.794489:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263860352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065205.794494:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135138380/2, rc 0, transno 17179874160 00000100:00100000:1.0:1746065205.794497:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263859968:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065205.794501:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513aa00/2, rc 0, transno 17179874161 00000100:00100000:1.0:1746065205.794504:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263860480:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065205.794510:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090dd8700/2, rc 0, transno 21474841580 00000100:00100000:1.0:1746065205.794513:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263858816:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065205.794519:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09c000/2, rc 0, transno 21474841581 00000100:00100000:1.0:1746065205.794521:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263859328:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065205.794527:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090ddad80/2, rc 0, transno 21474841578 00000100:00100000:1.0:1746065205.794529:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263858944:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065205.794534:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f09e680/2, rc 0, transno 21474841579 00000100:00100000:1.0:1746065205.794536:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263859456:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065205.794889:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263859712:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065205.794910:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.794922:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263860224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065205.794934:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.794943:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746065205.794946:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263859584:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065205.794957:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.794978:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263860096:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065205.794990:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.794998:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263860608:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065205.795008:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065205.795021:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263859712 00000100:00100000:0.0:1746065205.795024:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263859712 00000100:00100000:0.0:1746065205.795037:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263860224 00000100:00100000:0.0:1746065205.795039:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263860224 00000100:00100000:0.0:1746065205.795046:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263859584 00000100:00100000:0.0:1746065205.795047:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263859584 00000100:00100000:0.0:1746065205.795052:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263860096 00000100:00100000:0.0:1746065205.795054:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263860096 00000100:00100000:0.0:1746065205.795058:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263860608 00000100:00100000:0.0:1746065205.795060:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263860608 00000100:00100000:0.0:1746065205.795066:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16759 00000100:00100000:0.0:1746065205.795070:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3762:x1830881263859712:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065205.795108:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065205.795110:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:0.0:1746065205.795112:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065198 -> 1746065198 00002000:00010000:0.0:1746065205.795114:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065200 -> 1746065200 00002000:00010000:0.0:1746065205.795116:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065205.795132:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881263859712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (222us total) trans 17179874164 rc 0/0 00000100:00100000:0.0:1746065205.795137:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16759 00000100:00100000:0.0:1746065205.795147:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16760 00000100:00100000:0.0:1746065205.795151:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3762:x1830881263860224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065205.795190:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881263860224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (256us total) trans 17179874165 rc 0/0 00000100:00100000:0.0:1746065205.795195:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16760 00000100:00100000:0.0:1746065205.795204:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16761 00000100:00100000:0.0:1746065205.795207:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3762:x1830881263859584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065205.795236:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065205.795238:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065204 -> 1746065204 00002000:00010000:0.0:1746065205.795240:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065204 -> 1746065204 00002000:00010000:0.0:1746065205.795241:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065204 -> 1746065204 00002000:00010000:0.0:1746065205.795243:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 1752 -> 1752 00000100:00100000:0.0:1746065205.795256:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881263859584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (298us total) trans 17179874166 rc 0/0 00000100:00100000:0.0:1746065205.795260:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16761 00000100:00100000:0.0:1746065205.795268:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16762 00000100:00100000:0.0:1746065205.795271:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3762:x1830881263860096:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065205.795302:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065205.795304:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065205.795305:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065205.795307:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065205.795308:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065205.795321:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881263860096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (330us total) trans 17179874167 rc 0/0 00000100:00100000:0.0:1746065205.795326:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16762 00000100:00100000:0.0:1746065205.795333:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16763 00000100:00100000:0.0:1746065205.795336:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+49:3762:x1830881263860608:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065205.795376:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881263860608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (366us total) trans 17179874168 rc 0/0 00000100:00100000:0.0:1746065205.795381:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16763 00000004:00080000:0.0:1746065205.795400:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d8700/2, rc 0, transno 17179874166 00000100:00100000:0.0:1746065205.795403:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263859584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065205.795409:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513bb80/2, rc 0, transno 17179874167 00000100:00100000:0.0:1746065205.795411:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263860096:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065205.795417:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135139f80/2, rc 0, transno 17179874168 00000100:00100000:0.0:1746065205.795419:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263860608:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065205.795425:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513a300/2, rc 0, transno 17179874164 00000100:00100000:0.0:1746065205.795427:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263859712:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065205.795432:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513b480/2, rc 0, transno 17179874165 00000100:00100000:0.0:1746065205.795434:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263860224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065205.799227:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.800380:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.801350:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.808635:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.808718:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265049216 00000100:00100000:1.0:1746065205.808726:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265049216 00000100:00100000:1.0:1746065205.808799:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 823 00000100:00100000:1.0:1746065205.808806:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265049216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065205.808818:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065205.808838:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009af08600/0xad6b7ddc147785d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383f5 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.808871:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065205.808874:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065205.808909:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265049216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065205.808915:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 823 00000100:00100000:0.0:1746065205.811372:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.811723:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.811796:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.811859:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265049472 00000100:00100000:1.0:1746065205.811865:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265049472 00002000:00100000:1.0:1746065205.811898:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009a6dca80 x1830881265049472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:121/0 lens 488/0 e 0 to 0 dl 1746065216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.811906:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dca80 with x1830881265049472 ext(0->1048575) 00002000:00010000:1.0:1746065205.811910:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dca80 00000100:00100000:1.0:1746065205.811922:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265049728 00000100:00100000:1.0:1746065205.811924:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265049728 00002000:00100000:1.0:1746065205.811933:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009ac67480 x1830881265049728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:121/0 lens 488/0 e 0 to 0 dl 1746065216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.811939:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac67480 with x1830881265049728 ext(1048576->2097151) 00002000:00010000:1.0:1746065205.811942:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac67480 00000100:00100000:1.0:1746065205.811948:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265049984 00000100:00100000:1.0:1746065205.811950:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265049984 00002000:00100000:1.0:1746065205.811957:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009ac67800 x1830881265049984/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:121/0 lens 488/0 e 0 to 0 dl 1746065216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.811963:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac67800 with x1830881265049984 ext(1048576->2097151) 00002000:00010000:1.0:1746065205.811966:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac67800 00000100:00100000:1.0:1746065205.811974:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5832 00000100:00100000:1.0:1746065205.811979:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265049472:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065205.814175:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.814990:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.817324:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265050368 00000100:00100000:1.0:1746065205.817334:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265050368 00000100:00100000:1.0:1746065205.817379:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16764 00000100:00100000:1.0:1746065205.817385:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2049:x1830881265050368:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065205.817400:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065205.817413:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1477864 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9383fc expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.817441:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc147771b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938354 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065205.817459:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147781e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383c4 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065205.817465:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2800/0xad6b7ddc14777e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93839a expref: 40 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065205.817471:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.817472:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.817475:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc1477864 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1867776->2097151] (req 1867776->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383fc expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.817503:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2800/0xad6b7ddc14777e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93839a expref: 40 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065205.817513:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2800/0xad6b7ddc14777e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93839a expref: 40 pid: 10219 timeout: 901 lvb_type: 1 00000100:00100000:1.0:1746065205.817523:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263860992:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065205.817594:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147781e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383c4 expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065205.817602:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147781e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383c4 expref: 17 pid: 9548 timeout: 901 lvb_type: 1 00000100:00100000:1.0:1746065205.817609:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263861120:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065205.817626:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc147771b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938354 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065205.817632:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835ca00/0xad6b7ddc147771b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938354 expref: 12 pid: 9549 timeout: 901 lvb_type: 1 00000100:00100000:1.0:1746065205.817639:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263861248:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065205.817650:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fd63840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065205.817666:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265050240 00000100:00100000:1.0:1746065205.817669:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265050240 00002000:00100000:1.0:1746065205.817688:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009ac65f80 x1830881265050240/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:121/0 lens 488/0 e 0 to 0 dl 1746065216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.817696:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac65f80 with x1830881265050240 ext(1048576->2097151) 00010000:00010000:1.0:1746065205.817701:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2800/0xad6b7ddc14777e6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93839a expref: 41 pid: 10219 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746065205.817708:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2800/0xad6b7ddc14777e6 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93839a expref: 41 pid: 10219 timeout: 901 lvb_type: 1 00002000:00010000:1.0:1746065205.817714:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ac65f80 00000100:00100000:1.0:1746065205.817725:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1926 00000100:00100000:1.0:1746065205.817730:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265050240:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065205.823025:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.823042:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265051136 00000100:00100000:0.0:1746065205.823057:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265051136 00002000:00100000:0.0:1746065205.823075:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88013615ca80 x1830881265051136/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:121/0 lens 488/0 e 0 to 0 dl 1746065216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065205.823083:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615ca80 with x1830881265051136 ext(1048576->2097151) 00002000:00010000:0.0:1746065205.823087:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615ca80 00000100:00100000:0.0:1746065205.823100:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5837 00000100:00100000:0.0:1746065205.823105:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265051136:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065205.834380:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.838139:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265049472:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26150us (26764us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065205.838148:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5832 00002000:00100000:1.0:1746065205.838157:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009a6dca80 x1830881265049472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:121/0 lens 488/440 e 0 to 0 dl 1746065216 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.838165:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dca80 with x1830881265049472 ext(0->1048575) 00002000:00010000:1.0:1746065205.838170:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dca80 00000100:00100000:1.0:1746065205.842001:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881265050240:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24263us (27823us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065205.842011:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1926 00002000:00100000:1.0:1746065205.842020:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009ac65f80 x1830881265050240/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:121/0 lens 488/440 e 0 to 0 dl 1746065216 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.842033:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac65f80 with x1830881265050240 ext(1048576->2097151) 00010000:00010000:1.0:1746065205.842042:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2800/0xad6b7ddc14777e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93839a expref: 38 pid: 10219 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746065205.842052:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2800/0xad6b7ddc14777e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93839a expref: 38 pid: 10219 timeout: 901 lvb_type: 1 00002000:00010000:1.0:1746065205.842058:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009ac65f80 00000100:00100000:0.0:1746065205.859894:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.860087:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265051648 00000100:00100000:1.0:1746065205.860095:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265051648 00010000:00010000:1.0:1746065205.860129:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2800/0xad6b7ddc14777e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93839a expref: 38 pid: 10219 timeout: 901 lvb_type: 1 00000100:00100000:1.0:1746065205.860171:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7708 00000100:00100000:1.0:1746065205.860178:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881265051648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065205.860189:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065205.860204:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2800/0xad6b7ddc14777e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93839a expref: 38 pid: 10219 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746065205.860214:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2800/0xad6b7ddc14777e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93839a expref: 38 pid: 10219 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746065205.860232:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2800/0xad6b7ddc14777e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93839a expref: 38 pid: 10219 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746065205.860251:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065205.860287:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881265051648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 110us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065205.860294:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7708 00000100:00100000:1.0:1746065205.869883:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265051136:12345-192.168.202.27@tcp:3:cat.0 Request processed in 46773us (46855us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065205.869891:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5837 00002000:00100000:1.0:1746065205.869896:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88013615ca80 x1830881265051136/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:121/0 lens 488/440 e 0 to 0 dl 1746065216 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.869904:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615ca80 with x1830881265051136 ext(1048576->2097151) 00002000:00010000:1.0:1746065205.869908:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615ca80 00000100:00100000:0.0:1746065205.879650:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.880254:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.883666:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.883736:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265052032 00000100:00100000:1.0:1746065205.883741:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265052032 00000100:00100000:1.0:1746065205.884874:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16767 00000100:00100000:1.0:1746065205.884887:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2054:x1830881265052032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065205.884906:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065205.884923:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1477879 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938411 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.884946:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.884952:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1477879 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938411 expref: 23 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.884962:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1477879 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938411 expref: 23 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.884971:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61200, rc 0) 00000100:00100000:1.0:1746065205.885019:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2054:x1830881265052032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 136us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065205.885026:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16767 00000100:00100000:0.0:1746065205.895563:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.895595:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.895625:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.895638:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265052288 00000100:00100000:0.0:1746065205.895642:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265052288 00010000:00010000:0.0:1746065205.895656:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc147770d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93833f expref: 12 pid: 9549 timeout: 901 lvb_type: 1 00000100:00100000:0.0:1746065205.895679:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265052416 00000100:00100000:0.0:1746065205.895681:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265052416 00010000:00010000:0.0:1746065205.895689:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856600/0xad6b7ddc14777f4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938385 expref: 38 pid: 9550 timeout: 901 lvb_type: 1 00000100:00100000:0.0:1746065205.895700:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7710 00000100:00100000:0.0:1746065205.895705:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265052160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065205.895711:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065205.895820:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477809 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383af expref: 22 pid: 3068 timeout: 901 lvb_type: 1 00010000:00010000:0.0:1746065205.895828:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477809 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383af expref: 22 pid: 3068 timeout: 901 lvb_type: 1 00010000:00010000:0.0:1746065205.895851:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778e00/0xad6b7ddc1477809 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383af expref: 22 pid: 3068 timeout: 901 lvb_type: 1 00010000:00010000:0.0:1746065205.895866:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065205.895899:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265052160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 193us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.895907:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7710 00000100:00100000:0.0:1746065205.902683:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.905596:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.906223:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.906464:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5838 00000100:00100000:0.0:1746065205.906471:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881265052800:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065205.906578:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881265052800:12345-192.168.202.27@tcp:3:cat.0 Request processed in 107us (986us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065205.906587:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5838 00002000:00100000:0.0:1746065205.906592:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (978944->983039) req@ffff880091b64700 x1830881265052800/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:121/0 lens 488/4536 e 0 to 0 dl 1746065216 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065205.906598:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64700 with x1830881265052800 ext(978944->983039) 00002000:00010000:0.0:1746065205.906601:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b64700 00000100:00100000:0.0:1746065205.913377:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.913426:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.913725:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.927624:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7715 00000100:00100000:1.0:1746065205.927632:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265053952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065205.927639:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065205.927686:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc1477729 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93835b expref: 11 pid: 11461 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746065205.927698:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc1477729 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93835b expref: 11 pid: 11461 timeout: 901 lvb_type: 1 00010000:00010000:1.0:1746065205.927709:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.927711:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065205.927717:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477880 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938418 expref: 39 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.927724:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477880 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938418 expref: 39 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065205.927747:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477880 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938418 expref: 39 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065205.927757:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263862528:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065205.927817:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012fd63840 going to sleep for 11 seconds 00010000:00010000:0.0:1746065205.927911:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f47400/0xad6b7ddc1477825 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383cb expref: 17 pid: 9548 timeout: 901 lvb_type: 1 00000100:00100000:0.0:1746065205.927937:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263862272:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065205.927948:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc1477729 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93835b expref: 11 pid: 11461 timeout: 901 lvb_type: 1 00000100:00100000:0.0:1746065205.927956:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263862400:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065205.927977:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477880 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938418 expref: 39 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065205.927985:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130113600, rc 0) 00000100:00100000:0.0:1746065205.928019:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2049:x1830881265053312:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 12961us (14648us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065205.928025:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16768 00000100:00100000:0.0:1746065205.928921:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.933688:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263862528:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065205.933708:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065205.933746:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265053952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6115us (6225us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065205.933755:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7715 00000100:00100000:0.0:1746065205.934560:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.935665:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265054720 00000100:00100000:1.0:1746065205.935669:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265054720 00002000:00100000:1.0:1746065205.935685:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012f3c0380 x1830881265054720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:121/0 lens 488/0 e 0 to 0 dl 1746065216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.935692:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0380 with x1830881265054720 ext(1048576->2097151) 00002000:00010000:1.0:1746065205.935696:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c0380 00000100:00100000:1.0:1746065205.935717:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265054976 00000100:00100000:1.0:1746065205.935719:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265054976 00002000:00100000:1.0:1746065205.935730:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012f3c1c00 x1830881265054976/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:121/0 lens 488/0 e 0 to 0 dl 1746065216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.935736:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c1c00 with x1830881265054976 ext(1048576->2097151) 00002000:00010000:1.0:1746065205.935738:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c1c00 00000100:00100000:1.0:1746065205.935749:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5840 00000100:00100000:1.0:1746065205.935753:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881265054720:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065205.946741:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881265054720:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10977us (11197us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065205.946752:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5840 00002000:00100000:1.0:1746065205.946761:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012f3c0380 x1830881265054720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:121/0 lens 488/440 e 0 to 0 dl 1746065216 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.946800:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0380 with x1830881265054720 ext(1048576->2097151) 00002000:00010000:1.0:1746065205.946805:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c0380 00000100:00100000:0.0:1746065205.955074:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.957819:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.961680:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.961873:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265055744 00000100:00100000:1.0:1746065205.961881:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265055744 00002000:00100000:1.0:1746065205.961913:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (2387968->4194303) req@ffff8800a4e50a80 x1830881265055744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:121/0 lens 488/0 e 0 to 0 dl 1746065216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.961921:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50a80 with x1830881265055744 ext(2387968->4194303) 00010000:00010000:1.0:1746065205.961929:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477880 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938418 expref: 40 pid: 11461 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746065205.961940:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477880 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938418 expref: 40 pid: 11461 timeout: 901 lvb_type: 0 00002000:00010000:1.0:1746065205.961946:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4e50a80 00000100:00100000:1.0:1746065205.961975:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1931 00000100:00100000:1.0:1746065205.961981:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265055744:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065205.971370:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265055744:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9381us (9689us total) trans 0 rc 1806336/1806336 00000100:00100000:1.0:1746065205.971378:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1931 00002000:00100000:1.0:1746065205.971386:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (2387968->4194303) req@ffff8800a4e50a80 x1830881265055744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:121/0 lens 488/440 e 0 to 0 dl 1746065216 ref 1 fl Complete:H/200/0 rc 1806336/1806336 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.971393:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50a80 with x1830881265055744 ext(2387968->4194303) 00010000:00010000:1.0:1746065205.971400:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477880 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938418 expref: 40 pid: 11461 timeout: 901 lvb_type: 0 00010000:00010000:1.0:1746065205.971409:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130113600/0xad6b7ddc1477880 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2387967) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938418 expref: 40 pid: 11461 timeout: 901 lvb_type: 0 00002000:00010000:1.0:1746065205.971414:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800a4e50a80 00000100:00100000:0.0:1746065205.978160:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.979715:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.984543:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065205.987383:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065205.987482:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265056768 00000100:00100000:1.0:1746065205.987489:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265056768 00002000:00100000:1.0:1746065205.987521:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880097a6f100 x1830881265056768/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:121/0 lens 488/0 e 0 to 0 dl 1746065216 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065205.987529:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6f100 with x1830881265056768 ext(2097152->4194303) 00002000:00010000:1.0:1746065205.987534:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6f100 00000100:00100000:1.0:1746065205.987567:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5844 00000100:00100000:1.0:1746065205.987573:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265056768:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065205.989084:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.003633:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.003745:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265056768:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16169us (16366us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065206.003754:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5844 00002000:00100000:1.0:1746065206.003764:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880097a6f100 x1830881265056768/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:121/0 lens 488/440 e 0 to 0 dl 1746065216 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.003803:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6f100 with x1830881265056768 ext(2097152->4194303) 00002000:00010000:1.0:1746065206.003807:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6f100 00000100:00100000:0.0:1746065206.014501:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.018752:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.021231:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.026321:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.028308:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.034669:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.042957:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.061071:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.066503:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.069986:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.131283:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.135293:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.135324:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.135358:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.173484:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.174604:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.174624:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.177495:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265060864 00000100:00100000:1.0:1746065206.177505:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265060864 00010000:00010000:1.0:1746065206.177539:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97600/0xad6b7ddc14778e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938449 expref: 9 pid: 9571 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746065206.177569:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265060992 00000100:00100000:1.0:1746065206.177571:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265060992 00010000:00010000:1.0:1746065206.177580:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14778bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938442 expref: 13 pid: 9571 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746065206.177596:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7718 00000100:00100000:1.0:1746065206.177607:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265060864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065206.177619:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065206.177624:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97600/0xad6b7ddc14778e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938449 expref: 9 pid: 9571 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.177633:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97600/0xad6b7ddc14778e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938449 expref: 9 pid: 9571 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.177651:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97600/0xad6b7ddc14778e2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938449 expref: 9 pid: 9571 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.177666:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065206.177671:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1477905 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065206.177678:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1477905 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065206.177682:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065206.177720:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2007:x1830881265060864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 113us (3116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.177725:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7718 00000100:00100000:1.0:1746065206.177740:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7719 00000100:00100000:1.0:1746065206.177744:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265060992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065206.177750:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065206.177754:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14778bf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938442 expref: 13 pid: 9571 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.177766:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14778bf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938442 expref: 13 pid: 9571 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.177791:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14778bf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938442 expref: 13 pid: 9571 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.177799:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065206.177802:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1477905 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065206.177808:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1477905 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065206.177814:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1477905 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065206.177838:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065206.177853:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265060992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 109us (3228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.177858:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7719 00010000:00010000:1.0:1746065206.178002:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1477905 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065206.178009:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1477905 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065206.178022:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065206.178116:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e400/0xad6b7ddc14778fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938465 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.178132:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1477905 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938465 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.178139:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065206.178141:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065206.178143:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656ec00, rc 0) 00000100:00100000:1.0:1746065206.178164:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2062:x1830881265060224:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 27476us (27981us total) trans 8589936867 rc 0/0 00000100:00100000:1.0:1746065206.178170:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14407 00000100:00100000:1.0:1746065206.178183:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265060736 00000100:00100000:1.0:1746065206.178185:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265060736 00000100:00100000:0.0:1746065206.185571:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.190825:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.190903:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265061504 00000100:00100000:0.0:1746065206.190910:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265061504 00000100:00100000:0.0:1746065206.190941:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14411 00000100:00100000:0.0:1746065206.190947:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2062:x1830881265061504:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065206.190960:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.191185:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065206.191196:0:9571:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1477905 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938465 expref: 8 pid: 13395 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746065206.191212:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065206.191217:0:9571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1477952 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065206.191225:0:9571:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1477952 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065206.191231:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1477952 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065206.191243:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065206.191250:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc1477960 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938488 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.191321:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1477967 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065206.191329:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1477967 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065206.191335:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1477967 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065206.191345:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065206.191416:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc1477960 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938488 expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.191432:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1477967 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938488 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.191438:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065206.191440:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065206.191458:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6600, rc 0) 00000100:00100000:0.0:1746065206.191493:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2062:x1830881265061504:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 546us (635us total) trans 8589936870 rc 0/0 00000100:00100000:0.0:1746065206.191499:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14411 00000100:00100000:0.0:1746065206.202062:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265061632 00000100:00100000:0.0:1746065206.202069:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265061632 00000100:00100000:0.0:1746065206.202108:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14412 00000100:00100000:0.0:1746065206.202114:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2062:x1830881265061632:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065206.202130:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.202144:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1477975 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93848f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.202185:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1477975 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93848f expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.202196:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1477975 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93848f expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.202209:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065206.202212:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065206.202214:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7c00, rc 0) 00000100:00100000:0.0:1746065206.202256:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2062:x1830881265061632:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 142us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.202261:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14412 00000100:00100000:0.0:1746065206.207185:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.209730:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.213363:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.213704:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.213720:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265062400 00000100:00100000:0.0:1746065206.213723:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265062400 00000100:00100000:0.0:1746065206.213741:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16779 00000100:00100000:0.0:1746065206.213745:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265062400:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065206.213764:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.213792:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065206.213796:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 41 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.213801:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065206.213804:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.213828:0:12260:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 41 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.213837:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065206.213861:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.213873:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.213883:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.213893:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.213906:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.217095:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265062784 00000100:00100000:1.0:1746065206.217100:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265062784 00000100:00100000:1.0:1746065206.217122:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16784 00000100:00100000:1.0:1746065206.217127:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881265062784:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065206.217141:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc14779de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.217152:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc147786b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938403 expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.217159:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009d358800/0xad6b7ddc14778f0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938457 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.217166:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1477879 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938411 expref: 19 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.217173:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.217174:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.217176:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc14779de lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.217190:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1477879 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938411 expref: 19 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.217196:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1477879 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938411 expref: 19 pid: 12260 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746065206.217204:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263866112:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065206.217258:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009d358800/0xad6b7ddc14778f0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938457 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.217266:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009d358800/0xad6b7ddc14778f0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938457 expref: 14 pid: 9550 timeout: 902 lvb_type: 1 00000100:00100000:1.0:1746065206.217273:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263866240:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065206.217290:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc147786b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938403 expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.217297:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7acc00/0xad6b7ddc147786b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938403 expref: 41 pid: 11461 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746065206.217308:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263866368:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065206.217319:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800999ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065206.217934:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263864192:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065206.217947:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 41 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.217957:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489200, rc 0) 00000100:00100000:0.0:1746065206.217979:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+41:2069:x1830881265061760:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9725us (10799us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.217985:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16778 00000100:00100000:0.0:1746065206.235689:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.235838:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.235860:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.235871:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.235882:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.235900:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265063552 00000100:00100000:0.0:1746065206.235907:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265063552 00010000:00010000:0.0:1746065206.235934:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1477967 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938488 expref: 10 pid: 9571 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746065206.235953:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265063808 00000100:00100000:0.0:1746065206.235956:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265063808 00010000:00010000:0.0:1746065206.235964:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46400/0xad6b7ddc1477817 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383bd expref: 8 pid: 9548 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746065206.235973:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265064064 00000100:00100000:0.0:1746065206.235975:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265064064 00010000:00010000:0.0:1746065206.235983:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44a00/0xad6b7ddc147788e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938426 expref: 41 pid: 11461 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746065206.235990:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265064320 00000100:00100000:0.0:1746065206.235991:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265064320 00010000:00010000:0.0:1746065206.235998:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc1477887 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93841f expref: 20 pid: 11461 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746065206.236005:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265063680 00000100:00100000:0.0:1746065206.236006:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265063680 00010000:00010000:0.0:1746065206.236012:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095778800/0xad6b7ddc14777fb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938393 expref: 21 pid: 3068 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746065206.236020:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7720 00000100:00100000:0.0:1746065206.236026:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265063552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065206.236037:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065206.236041:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1477967 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938488 expref: 10 pid: 9571 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746065206.236050:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1477967 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938488 expref: 10 pid: 9571 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746065206.236069:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1477967 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938488 expref: 10 pid: 9571 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746065206.236089:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065206.237374:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488e00/0xad6b7ddc1477998 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065206.237384:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488e00/0xad6b7ddc1477998 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065206.237388:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488e00/0xad6b7ddc1477998 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065206.237395:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc14779d7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065206.237399:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc14779d7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065206.237404:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800727a9200/0xad6b7ddc14779d7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065206.237420:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065206.237530:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265063552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1502us (1848us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.237536:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7720 00000100:00100000:0.0:1746065206.237646:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.237658:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265064448 00000100:00100000:0.0:1746065206.237661:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265064448 00010000:00010000:0.0:1746065206.237672:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc14777df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93838c expref: 20 pid: 3067 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746065206.237685:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7727 00000100:00100000:0.0:1746065206.237690:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881265064448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065206.237696:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065206.237704:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc14777df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93838c expref: 20 pid: 3067 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746065206.237711:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc14777df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93838c expref: 20 pid: 3067 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746065206.237721:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc14777df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93838c expref: 20 pid: 3067 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746065206.237729:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065206.237739:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+19:2006:x1830881265064448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.237744:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7727 00000100:00100000:0.0:1746065206.237912:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263865728:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065206.237943:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263865856:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065206.237963:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263865984:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065206.237976:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc14779bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065206.238010:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263866112:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065206.238037:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263866240:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065206.238061:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263866368:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065206.238077:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc14779de lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065206.238099:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.238109:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265064576 00000100:00100000:0.0:1746065206.238111:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265064576 00010000:00010000:0.0:1746065206.238121:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1477714 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938346 expref: 12 pid: 9550 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746065206.238133:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7728 00000100:00100000:0.0:1746065206.238137:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265064576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065206.238143:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065206.238150:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1477714 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938346 expref: 12 pid: 9550 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746065206.238157:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1477714 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938346 expref: 12 pid: 9550 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746065206.238167:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1477714 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938346 expref: 12 pid: 9550 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746065206.238175:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065206.238186:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265064576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 49us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.238190:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7728 00000100:00100000:0.0:1746065206.260313:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.260958:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265065600 00000100:00100000:0.0:1746065206.260965:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265065600 00000100:00100000:0.0:1746065206.260995:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16785 00000100:00100000:0.0:1746065206.261001:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2068:x1830881265065600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065206.261015:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.261030:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091bafe00/0xad6b7ddc14779f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9384ab expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065206.261047:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d730, atime: 0x6812d730, ctime: 0x6812d730, blocks: 0x800 00010000:00010000:0.0:1746065206.261061:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.261062:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.261068:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091bafe00/0xad6b7ddc14779f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ab expref: 6 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.261079:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091bafe00/0xad6b7ddc14779f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ab expref: 6 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.261087:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bafe00, rc 0) 00000100:00100000:0.0:1746065206.261123:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+6:2068:x1830881265065600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 122us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.261129:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16785 00000001:00080000:0.0:1746065206.271843:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874171 is committed 00000001:00080000:0.0:1746065206.271857:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874170 is committed 00000001:00080000:0.0:1746065206.271866:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874168 is committed 00000001:00080000:0.0:1746065206.271889:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874150 is committed 00000100:00100000:0.0:1746065206.273463:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.277663:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.284937:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.285082:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265066112 00000100:00100000:1.0:1746065206.285091:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265066112 00010000:00010000:1.0:1746065206.285119:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095778200/0xad6b7ddc1477872 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 593920->983039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93840a expref: 6 pid: 11461 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746065206.285143:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7736 00000100:00100000:1.0:1746065206.285148:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+6:2007:x1830881265066112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065206.285160:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065206.285173:0:7192:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 1752 -> 1864 00010000:00010000:1.0:1746065206.285178:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095778200/0xad6b7ddc1477872 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 593920->983039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93840a expref: 6 pid: 11461 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.285189:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095778200/0xad6b7ddc1477872 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 593920->983039) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93840a expref: 6 pid: 11461 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.285207:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778200/0xad6b7ddc1477872 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 593920->983039) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93840a expref: 6 pid: 11461 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.285329:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.285331:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.285337:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 24 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.285349:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 24 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.285375:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 24 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.285384:0:7192:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 24 pid: 3067 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746065206.285395:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263866496:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065206.286703:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800999ac6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065206.288140:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.295647:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263866496:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065206.295665:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065206.295699:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2007:x1830881265066112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10550us (10770us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.295708:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7736 00000100:00100000:0.0:1746065206.295905:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.295921:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265066496 00000100:00100000:1.0:1746065206.295927:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265066496 00000100:00100000:0.0:1746065206.295930:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.295943:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265066752 00000100:00100000:0.0:1746065206.295947:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265066752 00000100:00100000:1.0:1746065206.295995:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16787 00000100:00100000:1.0:1746065206.296001:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+6:2068:x1830881265066496:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065206.296012:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065206.296025:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1477a01 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9384b9 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.296044:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a656ee00/0xad6b7ddc14779fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1572863) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384b2 expref: 18 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.296051:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065206.296052:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065206.296055:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1477a01 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384b9 expref: 7 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.296078:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a656ee00/0xad6b7ddc14779fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1572863) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384b2 expref: 18 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.296087:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a656ee00/0xad6b7ddc14779fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1572863) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384b2 expref: 18 pid: 9548 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746065206.296098:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263866624:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065206.296171:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d643c0 going to sleep for 11 seconds 00002000:00100000:0.0:1746065206.297533:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009c5f0380 x1830881265066752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065206.297542:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0380 with x1830881265066752 ext(0->1048575) 00010000:00010000:0.0:1746065206.297549:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 25 pid: 3067 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746065206.297559:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 25 pid: 3067 timeout: 902 lvb_type: 0 00002000:00010000:0.0:1746065206.297564:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f0380 00000100:00100000:1.0:1746065206.304913:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263866624:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065206.304942:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1477a01 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384b9 expref: 7 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.304957:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46600, rc 0) 00000100:00100000:0.0:1746065206.304970:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.305008:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2068:x1830881265066496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9006us (9103us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.305016:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16787 00000100:00100000:0.0:1746065206.316928:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.316978:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.329939:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.329986:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.330293:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265067648 00000100:00100000:0.0:1746065206.330299:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265067648 00000100:00100000:0.0:1746065206.330337:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16788 00000100:00100000:0.0:1746065206.330343:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2069:x1830881265067648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065206.330354:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.330365:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc1477a08 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9384c0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.330383:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.330384:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.330391:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc1477a08 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c0 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.330403:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc1477a08 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c0 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.330411:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baea00, rc 0) 00000100:00100000:0.0:1746065206.330430:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2069:x1830881265067648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 88us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.330435:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16788 00000100:00100000:1.0:1746065206.331162:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265067776 00000100:00100000:1.0:1746065206.331166:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265067776 00010000:00010000:1.0:1746065206.331183:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 25 pid: 3067 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746065206.331206:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7737 00000100:00100000:1.0:1746065206.331211:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265067776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065206.331219:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065206.331232:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 25 pid: 3067 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.331240:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 25 pid: 3067 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.331255:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc147797c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938496 expref: 25 pid: 3067 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.331278:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.331279:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.331282:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.331288:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.331303:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065206.331324:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265067776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 112us (1337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.331329:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7737 00010000:00010000:0.0:1746065206.331424:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.331432:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.331454:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.331460:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.331467:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.331472:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099524200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065206.331475:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.331486:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.331495:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.331501:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc147799f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065206.331541:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+8:2007:x1830881265062400:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 117795us (117837us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.331546:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16779 00000100:00100000:0.0:1746065206.334533:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.342046:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.353949:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.353987:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.354240:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265068416 00000100:00100000:1.0:1746065206.354249:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265068416 00002000:00100000:1.0:1746065206.354282:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009c5f2d80 x1830881265068416/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.354292:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2d80 with x1830881265068416 ext(1048576->2097151) 00002000:00010000:1.0:1746065206.354296:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f2d80 00000100:00100000:1.0:1746065206.354318:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5853 00000100:00100000:1.0:1746065206.354324:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2007:x1830881265068416:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065206.354668:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.354682:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265068800 00000100:00100000:0.0:1746065206.354685:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265068800 00000100:00100000:0.0:1746065206.358202:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16789 00000100:00100000:0.0:1746065206.358214:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2073:x1830881265068800:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065206.358227:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.358242:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1477a0f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9384c7 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065206.358259:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 4897248, mtime: 0x6812d736, atime: 0x6812d734, ctime: 0x6812d736, blocks: 0x1568 00010000:00010000:0.0:1746065206.358274:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.358276:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.358282:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1477a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c7 expref: 6 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.358293:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1477a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c7 expref: 6 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.358306:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baf200, rc 0) 00000100:00100000:0.0:1746065206.360654:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+6:2073:x1830881265068800:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2438us (5980us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.360666:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16789 00000100:00100000:0.0:1746065206.361876:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265068160:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 19454us (19834us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065206.361885:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5852 00002000:00100000:0.0:1746065206.361893:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009c5f1f80 x1830881265068160/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065206.361902:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1f80 with x1830881265068160 ext(1048576->2097151) 00002000:00010000:0.0:1746065206.361906:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f1f80 00000100:00100000:0.0:1746065206.370308:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.372158:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.372396:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265069312 00000100:00100000:1.0:1746065206.372404:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265069312 00002000:00100000:1.0:1746065206.372438:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (4087808->4091903) req@ffff88012edaf100 x1830881265069312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.372459:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf100 with x1830881265069312 ext(4087808->4091903) 00002000:00010000:1.0:1746065206.372463:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf100 00000100:00100000:1.0:1746065206.372485:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5854 00000100:00100000:1.0:1746065206.372491:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+6:2005:x1830881265069312:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065206.373142:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+6:2005:x1830881265069312:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 649us (988us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065206.373149:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5854 00002000:00100000:1.0:1746065206.373154:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (4087808->4091903) req@ffff88012edaf100 x1830881265069312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/4536 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.373162:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf100 with x1830881265069312 ext(4087808->4091903) 00002000:00010000:1.0:1746065206.373165:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf100 00000100:00100000:0.0:1746065206.374318:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2007:x1830881265068416:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19989us (20372us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065206.374325:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5853 00002000:00100000:0.0:1746065206.374331:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009c5f2d80 x1830881265068416/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065206.374344:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2d80 with x1830881265068416 ext(1048576->2097151) 00002000:00010000:0.0:1746065206.374348:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f2d80 00000100:00100000:1.0:1746065206.379264:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.379302:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.383848:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.384494:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265069696 00000100:00100000:1.0:1746065206.384501:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265069696 00000100:00100000:1.0:1746065206.384547:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16792 00000100:00100000:1.0:1746065206.384554:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2069:x1830881265069696:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065206.384568:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065206.384583:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc1477a24 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9384dc expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.384602:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.384604:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.384610:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc1477a24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384dc expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.384622:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc1477a24 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384dc expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.384630:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46c00, rc 0) 00000100:00100000:1.0:1746065206.384963:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5039850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2069:x1830881265069696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 408us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.384969:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16792 00000100:00100000:1.0:1746065206.387261:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265070208 00000100:00100000:1.0:1746065206.387267:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265070208 00002000:00100000:1.0:1746065206.387301:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f3e5880 x1830881265070208/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.387309:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5880 with x1830881265070208 ext(1048576->2097151) 00002000:00010000:1.0:1746065206.387314:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e5880 00000100:00100000:1.0:1746065206.387330:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5855 00000100:00100000:1.0:1746065206.387336:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2006:x1830881265070208:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065206.388644:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265069952 00000100:00100000:0.0:1746065206.388650:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265069952 00000100:00100000:0.0:1746065206.388687:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5359 00000100:00100000:0.0:1746065206.388692:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2062:x1830881265069952:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:0.0:1746065206.388859:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2062:x1830881265069952:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 166us (1754us total) trans 8589936875 rc 0/0 00000100:00100000:0.0:1746065206.388864:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5359 00000100:00100000:0.0:1746065206.391439:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.397625:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2006:x1830881265070208:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10284us (10419us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065206.397635:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5855 00002000:00100000:1.0:1746065206.397645:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f3e5880 x1830881265070208/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.397654:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5880 with x1830881265070208 ext(1048576->2097151) 00002000:00010000:1.0:1746065206.397659:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e5880 00000100:00100000:1.0:1746065206.397680:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265070720 00000100:00100000:1.0:1746065206.397686:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265070720 00002000:00100000:1.0:1746065206.397711:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009834c380 x1830881265070720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.397717:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834c380 with x1830881265070720 ext(1048576->2097151) 00002000:00010000:1.0:1746065206.397720:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834c380 00000100:00100000:1.0:1746065206.397732:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5857 00000100:00100000:1.0:1746065206.397737:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265070720:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065206.405471:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.409861:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265070720:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 12117us (13178us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065206.409872:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5857 00002000:00100000:1.0:1746065206.409880:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009834c380 x1830881265070720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.409889:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834c380 with x1830881265070720 ext(1048576->2097151) 00002000:00010000:1.0:1746065206.409894:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834c380 00000100:00100000:0.0:1746065206.416642:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.416802:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265071232 00000100:00100000:1.0:1746065206.416809:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265071232 00002000:00100000:1.0:1746065206.416842:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4087807) req@ffff8800a4e52d80 x1830881265071232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.416851:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52d80 with x1830881265071232 ext(2097152->4087807) 00002000:00010000:1.0:1746065206.416855:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e52d80 00000100:00100000:1.0:1746065206.416869:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5858 00000100:00100000:1.0:1746065206.416874:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2007:x1830881265071232:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065206.417392:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.418470:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.418484:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265071616 00000100:00100000:0.0:1746065206.418487:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265071616 00002000:00100000:0.0:1746065206.418504:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880099e11880 x1830881265071616/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 504/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065206.418512:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11880 with x1830881265071616 ext(2097152->4194303) 00002000:00010000:0.0:1746065206.418515:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e11880 00000100:00100000:0.0:1746065206.418536:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5859 00000100:00100000:0.0:1746065206.418541:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265071616:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065206.421650:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.421673:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265071744 00000100:00100000:1.0:1746065206.421680:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265071744 00000100:00100000:1.0:1746065206.421723:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 235 00000100:00100000:1.0:1746065206.421730:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2006:x1830881265071744:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:1.0:1746065206.421767:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c72b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2006:x1830881265071744:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 38us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.421801:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 235 00000100:00100000:1.0:1746065206.421838:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.423517:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.423560:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065206.425036:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065206.427987:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.437588:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2007:x1830881265071232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20703us (20943us total) trans 0 rc 1990656/1990656 00000100:00100000:1.0:1746065206.437598:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5858 00002000:00100000:1.0:1746065206.437608:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4087807) req@ffff8800a4e52d80 x1830881265071232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1990656/1990656 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.437617:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52d80 with x1830881265071232 ext(2097152->4087807) 00002000:00010000:1.0:1746065206.437622:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e52d80 00000100:00100000:0.0:1746065206.456286:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.456320:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.456346:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.456374:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.456408:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265072512 00000100:00100000:0.0:1746065206.456415:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265072512 00000100:00100000:0.0:1746065206.456456:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265072768 00000100:00100000:0.0:1746065206.456459:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265072768 00000100:00100000:0.0:1746065206.456470:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265072640 00000100:00100000:0.0:1746065206.456471:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265072640 00000100:00100000:0.0:1746065206.456491:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265072896 00000100:00100000:0.0:1746065206.456493:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265072896 00000100:00100000:0.0:1746065206.456506:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16794 00000100:00100000:0.0:1746065206.456512:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2007:x1830881265072512:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065206.456525:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.456539:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc1477a32 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9384ea expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065206.456558:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d736, atime: 0x6812d734, ctime: 0x6812d736, blocks: 0x748 00010000:00010000:0.0:1746065206.456573:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.456575:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.456581:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc1477a32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ea expref: 8 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.456593:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc1477a32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ea expref: 8 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.456602:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:0.0:1746065206.456639:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265072512:12345-192.168.202.27@tcp:101:cat.0 Request processed in 127us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.456645:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16794 00000100:00100000:0.0:1746065206.456658:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16795 00000100:00100000:0.0:1746065206.456663:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265072768:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065206.456669:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.456675:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46400/0xad6b7ddc1477a39 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9384f8 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065206.456706:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263866880:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065206.456753:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065206.456770:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16796 00000100:00100000:0.0:1746065206.456794:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265072640:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065206.456799:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.456804:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc1477a40 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9384f1 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.456811:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.456812:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.456816:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc1477a40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384f1 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.456823:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc1477a40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384f1 expref: 28 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.456828:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46e00, rc 0) 00000100:00100000:0.0:1746065206.456840:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265072640:12345-192.168.202.27@tcp:101:cat.0 Request processed in 46us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.456844:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16796 00000100:00100000:0.0:1746065206.456853:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16797 00000100:00100000:0.0:1746065206.456856:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265072896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065206.456861:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.456867:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46000/0xad6b7ddc1477a47 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9384ff expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065206.456883:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263867008:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065206.456907:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00002000:00010000:1.0:1746065206.461471:0:9548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746065204 -> 1746065206 00002000:00010000:1.0:1746065206.461475:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065204 -> 1746065206 00002000:00010000:1.0:1746065206.461477:0:9548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746065204 -> 1746065206 00000100:00100000:1.0:1746065206.461491:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263867008:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065206.461515:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46000/0xad6b7ddc1477a47 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ff expref: 23 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.461527:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46000/0xad6b7ddc1477a47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ff expref: 23 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.461537:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46000, rc 0) 00000100:00100000:1.0:1746065206.461677:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265072896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4818us (5301us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065206.461685:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16797 00000100:00100000:0.0:1746065206.461922:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.463849:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.463913:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265073536 00000100:00100000:1.0:1746065206.463917:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265073536 00000100:00100000:1.0:1746065206.463949:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16798 00000100:00100000:1.0:1746065206.463954:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2069:x1830881265073536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065206.463961:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065206.463970:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc1477a71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93850d expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.463989:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1477a0f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c7 expref: 9 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.463996:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065206.463997:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065206.464000:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc1477a71 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93850d expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.464021:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1477a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c7 expref: 9 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.464029:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1477a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c7 expref: 9 pid: 12260 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746065206.464040:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263867136:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065206.464081:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065206.468578:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263867136:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065206.468602:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc1477a71 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93850d expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.468623:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7000, rc 0) 00000100:00100000:1.0:1746065206.469019:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2069:x1830881265073536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5063us (5169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.469025:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16798 00000100:00100000:0.0:1746065206.473870:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265073664:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5049us (5459us total) trans 17179874172 rc 0/0 00000100:00100000:0.0:1746065206.475819:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1937 00002000:00100000:0.0:1746065206.475837:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4087808->4194303) req@ffff88009834df80 x1830881265073664/t17179874172(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/448 e 0 to 0 dl 1746065217 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065206.475847:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834df80 with x1830881265073664 ext(4087808->4194303) 00010000:00010000:0.0:1746065206.475856:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1477a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c7 expref: 10 pid: 12260 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746065206.475878:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1477a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c7 expref: 10 pid: 12260 timeout: 902 lvb_type: 0 00002000:00010000:0.0:1746065206.475885:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009834df80 00000100:00100000:1.0:1746065206.477758:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065206.481383:0:9548:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff88009834fb80 x1830881263867264) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1477a0f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c7 expref: 12 pid: 12260 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746065206.481412:0:9548:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1477a0f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c7 expref: 12 pid: 12260 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746065206.481433:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1477a0f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384c7 expref: 12 pid: 12260 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746065206.481468:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263867264:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065206.481485:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.481487:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.481493:0:9548:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc1477a71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93850d expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.481501:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc1477a71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93850d expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.481525:0:9548:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc1477a71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93850d expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065206.483171:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263867392:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065206.483254:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065206.490276:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.499329:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.506550:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.507189:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265074560 00000100:00100000:1.0:1746065206.507196:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265074560 00002000:00100000:1.0:1746065206.507229:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (4894720->4898815) req@ffff88013103ac50 x1830881265074560/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.507237:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013103ac50 with x1830881265074560 ext(4894720->4898815) 00002000:00010000:1.0:1746065206.507242:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013103ac50 00000100:00100000:1.0:1746065206.507263:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5863 00000100:00100000:1.0:1746065206.507269:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013103ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265074560:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065206.507415:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013103ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265074560:12345-192.168.202.27@tcp:3:cat.0 Request processed in 145us (871us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065206.507421:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5863 00002000:00100000:1.0:1746065206.507426:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (4894720->4898815) req@ffff88013103ac50 x1830881265074560/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/4536 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.507433:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013103ac50 with x1830881265074560 ext(4894720->4898815) 00002000:00010000:1.0:1746065206.507435:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013103ac50 00000100:00100000:0.0:1746065206.512588:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.515883:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.517231:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.517271:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265074944 00000100:00100000:1.0:1746065206.517275:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265074944 00002000:00100000:1.0:1746065206.517303:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3747839) req@ffff880099ec6a00 x1830881265074944/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.517311:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6a00 with x1830881265074944 ext(3145728->3747839) 00010000:00010000:1.0:1746065206.517317:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc1477a16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3747839) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ce expref: 8 pid: 9548 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.517325:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc1477a16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3747839) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ce expref: 8 pid: 9548 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746065206.517330:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec6a00 00000100:00100000:1.0:1746065206.517354:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1938 00000100:00100000:1.0:1746065206.517360:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265074944:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065206.531822:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.535043:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265074944:12345-192.168.202.27@tcp:4:cat.0 Request processed in 17675us (17804us total) trans 21474841583 rc 0/0 00000100:00100000:1.0:1746065206.535058:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1938 00002000:00100000:1.0:1746065206.535067:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3747839) req@ffff880099ec6a00 x1830881265074944/t21474841583(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/448 e 0 to 0 dl 1746065217 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.535075:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6a00 with x1830881265074944 ext(3145728->3747839) 00010000:00010000:1.0:1746065206.535083:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc1477a16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3747839) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ce expref: 9 pid: 9548 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.535095:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c000/0xad6b7ddc1477a16 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3747839) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ce expref: 9 pid: 9548 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746065206.535100:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec6a00 00000100:00100000:0.0:1746065206.535769:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.535917:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265075456 00000100:00100000:1.0:1746065206.535923:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265075456 00002000:00100000:1.0:1746065206.535945:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1945600->1949695) req@ffff880099ec4380 x1830881265075456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.535953:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4380 with x1830881265075456 ext(1945600->1949695) 00002000:00010000:1.0:1746065206.535956:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec4380 00000100:00100000:1.0:1746065206.535980:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5864 00000100:00100000:1.0:1746065206.535986:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265075456:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065206.536085:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265075456:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 99us (316us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065206.536091:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5864 00002000:00100000:1.0:1746065206.536096:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1945600->1949695) req@ffff880099ec4380 x1830881265075456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/4536 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.536108:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4380 with x1830881265075456 ext(1945600->1949695) 00002000:00010000:1.0:1746065206.536111:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec4380 00000100:00100000:0.0:1746065206.543255:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.543306:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.548293:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.549642:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.558128:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.560527:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.560565:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.561001:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265076736 00000100:00100000:1.0:1746065206.561006:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265076736 00002000:00100000:1.0:1746065206.561023:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880099ec5180 x1830881265076736/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.561030:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5180 with x1830881265076736 ext(3145728->4194303) 00002000:00010000:1.0:1746065206.561034:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec5180 00000100:00100000:1.0:1746065206.561099:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5867 00000100:00100000:1.0:1746065206.561105:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265076736:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065206.561566:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.561582:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265076992 00000100:00100000:0.0:1746065206.561585:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265076992 00000100:00100000:0.0:1746065206.561618:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5361 00000100:00100000:0.0:1746065206.561623:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2078:x1830881265076992:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065206.561805:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2078:x1830881265076992:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 181us (238us total) trans 8589936878 rc 0/0 00000100:00100000:0.0:1746065206.561811:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5361 00000100:00100000:1.0:1746065206.569914:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265076736:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8800us (9338us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065206.569924:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5867 00002000:00100000:1.0:1746065206.569934:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880099ec5180 x1830881265076736/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.569942:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5180 with x1830881265076736 ext(3145728->4194303) 00002000:00010000:1.0:1746065206.569948:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec5180 00000100:00100000:0.0:1746065206.596333:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.615536:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.622312:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.629294:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.629334:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.629361:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.629374:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.629399:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.629422:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.629453:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265077760 00000100:00100000:0.0:1746065206.629460:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265077760 00000100:00100000:0.0:1746065206.629494:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265078016 00000100:00100000:0.0:1746065206.629496:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265078016 00000100:00100000:0.0:1746065206.629505:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265078272 00000100:00100000:0.0:1746065206.629506:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265078272 00000100:00100000:0.0:1746065206.629514:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265077888 00000100:00100000:0.0:1746065206.629516:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265077888 00000100:00100000:0.0:1746065206.629525:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265078144 00000100:00100000:0.0:1746065206.629526:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265078144 00000100:00100000:0.0:1746065206.629533:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265078400 00000100:00100000:0.0:1746065206.629534:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265078400 00000100:00100000:0.0:1746065206.629544:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16804 00000100:00100000:0.0:1746065206.629550:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265077760:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065206.629564:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.629579:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc1477ab7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93853e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.629602:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.629603:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.629612:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc1477ab7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93853e expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.629627:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc1477ab7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93853e expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.629637:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0600, rc 0) 00000100:00100000:0.0:1746065206.629673:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265077760:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 123us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.629679:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16804 00000100:00100000:0.0:1746065206.629693:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16805 00000100:00100000:0.0:1746065206.629697:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265078016:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065206.629703:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.629712:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb1200/0xad6b7ddc1477abe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93854c expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065206.629745:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263868544:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065206.629829:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065206.629847:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16806 00000100:00100000:0.0:1746065206.629852:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265078272:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065206.629858:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.629864:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1477ac5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93855a expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.629874:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.629875:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.629879:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1477ac5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93855a expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.629888:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1477ac5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93855a expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.629896:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0200, rc 0) 00000100:00100000:0.0:1746065206.629910:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265078272:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 58us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.629915:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16806 00000100:00100000:0.0:1746065206.629925:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16807 00000100:00100000:0.0:1746065206.629930:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265077888:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065206.629935:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.629940:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1477acc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938545 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.629948:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.629949:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.629953:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1477acc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938545 expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.629961:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc1477acc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938545 expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.629967:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1600, rc 0) 00000100:00100000:0.0:1746065206.629981:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265077888:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 51us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.629986:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16807 00000100:00100000:0.0:1746065206.629995:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16808 00000100:00100000:0.0:1746065206.629999:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265078144:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065206.630004:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.630010:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1477ad3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938553 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065206.630030:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263868672:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065206.630048:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065206.630062:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16809 00000100:00100000:0.0:1746065206.630067:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265078400:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065206.630073:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.630079:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1477ada lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938561 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.630087:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.630089:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.630092:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1477ada lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938561 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.630100:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1477ada lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938561 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.630107:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2d600, rc 0) 00000100:00100000:0.0:1746065206.630121:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265078400:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 53us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.630125:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16809 00002000:00010000:1.0:1746065206.634053:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065204 -> 1746065206 00000100:00100000:1.0:1746065206.634073:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263868544:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065206.634098:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1200/0xad6b7ddc1477abe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93854c expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.634110:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1200/0xad6b7ddc1477abe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93854c expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.634123:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1200, rc 0) 00000100:00100000:1.0:1746065206.634158:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265078016:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4459us (4822us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065206.634167:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16805 00002000:00010000:0.0:1746065206.634409:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065198 -> 1746065206 00000100:00100000:0.0:1746065206.634421:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263868672:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065206.634437:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1477ad3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938553 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.634456:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1477ad3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938553 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.637126:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0a00, rc 0) 00000100:00100000:1.0:1746065206.637468:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265078144:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7464us (8065us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065206.637476:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16808 00000100:00100000:0.0:1746065206.640755:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.641451:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.644676:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.645592:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263868928:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065206.645608:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e600/0xad6b7ddc1477b0b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938576 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.645616:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7e600/0xad6b7ddc1477b0b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938576 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.645623:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7e600, rc 0) 00000100:00100000:0.0:1746065206.645644:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265078912:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4449us (4654us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065206.645649:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16811 00000100:00100000:0.0:1746065206.649832:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.649866:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.649898:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.650127:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7747 00000100:00100000:1.0:1746065206.650135:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265079552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065206.650142:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065206.650146:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc1477ab0 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938537 expref: 13 pid: 9571 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.650155:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abada00/0xad6b7ddc1477ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938537 expref: 13 pid: 9571 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.650165:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065206.650168:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc1477b19 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065206.650173:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc1477b19 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065206.650178:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065206.650196:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265079552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 62us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.650201:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7747 00000100:00100000:0.0:1746065206.653020:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.655481:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.663473:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.669296:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.669625:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265080448 00000100:00100000:1.0:1746065206.669631:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265080448 00000100:00100000:1.0:1746065206.669660:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16813 00000100:00100000:1.0:1746065206.669665:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265080448:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065206.670994:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065206.671011:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1477b3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938592 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065206.671056:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263869696:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065206.671118:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065206.671535:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.679710:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263869696:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065206.679751:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1477b3c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938592 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.679766:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1477b3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938592 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.679826:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67600, rc 0) 00000100:00100000:1.0:1746065206.679880:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265080448:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 10211us (10590us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065206.679888:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16813 00000100:00100000:0.0:1746065206.691740:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.698925:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.698992:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.699363:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.706182:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.747145:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.756416:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.758308:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.767757:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265082368 00000100:00100000:0.0:1746065206.767767:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265082368 00000100:00100000:0.0:1746065206.767844:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16816 00000100:00100000:0.0:1746065206.767851:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265082368:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065206.767867:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.767881:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1477b97 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9385bc expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.767900:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.767902:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.767909:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1477b97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385bc expref: 25 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.767923:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1477b97 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385bc expref: 25 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.767932:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1c00, rc 0) 00000100:00100000:0.0:1746065206.767982:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265082368:12345-192.168.202.27@tcp:101:cat.0 Request processed in 130us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.767988:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16816 00000100:00100000:0.0:1746065206.777857:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.778001:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.778033:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265083136 00000100:00100000:0.0:1746065206.778040:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265083136 00000100:00100000:0.0:1746065206.778070:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16817 00000100:00100000:0.0:1746065206.778076:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2085:x1830881265083136:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065206.778089:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.778102:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1477b9e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9385c3 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.778129:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc1477a71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93850d expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.778136:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1477ac5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93855a expref: 9 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.778141:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc1477a7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93851b expref: 10 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.778146:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.778148:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.778150:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1477b9e lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2809856->3145727] (req 2809856->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385c3 expref: 10 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.778172:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc1477a7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93851b expref: 10 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.778180:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc1477a7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4894720->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93851b expref: 10 pid: 9548 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746065206.778189:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263870208:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065206.778262:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1477ac5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93855a expref: 9 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065206.778269:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc1477ac5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93855a expref: 9 pid: 13375 timeout: 902 lvb_type: 1 00000100:00100000:0.0:1746065206.778280:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263870336:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065206.778297:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc1477a71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93850d expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.778303:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ae7000/0xad6b7ddc1477a71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93850d expref: 26 pid: 9548 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746065206.778309:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263870464:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065206.778319:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065206.778390:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265082752 00000100:00100000:1.0:1746065206.778394:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265082752 00002000:00100000:1.0:1746065206.778413:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880092529f80 x1830881265082752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.778420:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529f80 with x1830881265082752 ext(0->1048575) 00002000:00010000:1.0:1746065206.778424:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092529f80 00000100:00100000:1.0:1746065206.778434:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5871 00000100:00100000:1.0:1746065206.778448:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265082752:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065206.780189:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5873 00000100:00100000:0.0:1746065206.780196:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265083264:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065206.786739:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.786847:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.786921:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.786953:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265083648 00000100:00100000:0.0:1746065206.786961:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265083648 00000100:00100000:0.0:1746065206.787006:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16818 00000100:00100000:0.0:1746065206.787015:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2087:x1830881265083648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065206.787033:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.787051:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1477ba5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9385ca expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.787079:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1477a94 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938530 expref: 30 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.787090:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065206.787092:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065206.787096:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1477ba5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ca expref: 12 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.787124:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1477a94 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938530 expref: 30 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.787135:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a800/0xad6b7ddc1477a94 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938530 expref: 30 pid: 9548 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746065206.787146:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263870592:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065206.787232:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065206.789896:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265082752:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11450us (12038us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065206.789906:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5871 00002000:00100000:1.0:1746065206.789914:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880092529f80 x1830881265082752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.789923:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529f80 with x1830881265082752 ext(0->1048575) 00002000:00010000:1.0:1746065206.789927:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092529f80 00000100:00100000:0.0:1746065206.791751:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.792608:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.792685:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263870592:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065206.792705:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1477ba5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ca expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.792714:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a200, rc 0) 00000100:00100000:1.0:1746065206.792735:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2087:x1830881265083648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5723us (5826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.792741:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16818 00000100:00100000:0.0:1746065206.796588:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.802559:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.802750:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265084288 00000100:00100000:1.0:1746065206.802758:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265084288 00000100:00100000:1.0:1746065206.802836:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16819 00000100:00100000:1.0:1746065206.802843:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2093:x1830881265084288:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065206.802857:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065206.802926:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc1477bac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9385d1 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.802950:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065206.802956:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc1477bac lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385d1 expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.802966:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc1477bac lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385d1 expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.802974:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835dc00, rc 0) 00000100:00100000:1.0:1746065206.803023:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2093:x1830881265084288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 180us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.803029:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16819 00000100:00100000:0.0:1746065206.803639:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.803697:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265084416 00000100:00100000:1.0:1746065206.803701:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265084416 00000100:00100000:1.0:1746065206.803763:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16820 00000100:00100000:1.0:1746065206.803769:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2085:x1830881265084416:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065206.803807:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065206.803817:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835d800/0xad6b7ddc1477bb3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9385d8 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.803832:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc1477a86 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938522 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.803844:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc1477b20 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93857d expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.803850:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1477ada lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938561 expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.803856:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.803857:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.803859:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835d800/0xad6b7ddc1477bb3 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2514943] (req 2097152->2514943) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385d8 expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.803879:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1477ada lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938561 expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.803888:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1477ada lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938561 expref: 9 pid: 9549 timeout: 902 lvb_type: 1 00000100:00100000:1.0:1746065206.803898:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263870848:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065206.803953:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc1477b20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93857d expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065206.803960:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc1477b20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93857d expref: 11 pid: 13375 timeout: 902 lvb_type: 1 00000100:00100000:1.0:1746065206.803967:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263870976:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065206.803987:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc1477a86 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938522 expref: 24 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.803994:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc1477a86 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938522 expref: 24 pid: 1880 timeout: 902 lvb_type: 0 00000100:00100000:1.0:1746065206.804001:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263871104:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065206.804041:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065206.808048:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.808112:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.808125:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.808193:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265084800 00000100:00100000:1.0:1746065206.808197:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265084800 00010000:00010000:1.0:1746065206.808212:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc1477b20 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93857d expref: 12 pid: 13375 timeout: 902 lvb_type: 1 00000100:00100000:1.0:1746065206.808231:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7755 00000100:00100000:1.0:1746065206.808235:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265084800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065206.808239:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263870848:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065206.808248:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263870976:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065206.808254:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065206.808254:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263871104:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065206.808262:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc1477b20 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93857d expref: 12 pid: 13375 timeout: 902 lvb_type: 1 00010000:00010000:1.0:1746065206.808271:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc1477b20 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93857d expref: 12 pid: 13375 timeout: 902 lvb_type: 1 00010000:00010000:1.0:1746065206.808720:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc1477b20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93857d expref: 12 pid: 13375 timeout: 902 lvb_type: 1 00010000:00010000:0.0:1746065206.808720:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835d800/0xad6b7ddc1477bb3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->2514943] (req 2097152->2514943) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385d8 expref: 12 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.808730:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d800, rc 0) 00010000:00010000:1.0:1746065206.808735:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065206.808752:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265084800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 516us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.808758:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7755 00000100:00100000:0.0:1746065206.808769:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2085:x1830881265084416:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5001us (5131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065206.808793:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16820 00000100:00100000:0.0:1746065206.810052:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.823317:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.823361:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.823415:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265085184 00000100:00100000:0.0:1746065206.823422:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265085184 00002000:00100000:0.0:1746065206.823465:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800984d8e00 x1830881265085184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065206.823474:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d8e00 with x1830881265085184 ext(1048576->2097151) 00002000:00010000:0.0:1746065206.823478:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d8e00 00000100:00100000:0.0:1746065206.823499:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5875 00000100:00100000:0.0:1746065206.823661:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265085184:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065206.827154:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.835734:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265085184:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12120us (12417us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065206.835745:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5875 00002000:00100000:0.0:1746065206.835756:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800984d8e00 x1830881265085184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065206.835766:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d8e00 with x1830881265085184 ext(1048576->2097151) 00002000:00010000:0.0:1746065206.835770:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d8e00 00000100:00100000:0.0:1746065206.844481:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.844517:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.844541:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265086080 00000100:00100000:0.0:1746065206.844548:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265086080 00000100:00100000:0.0:1746065206.844596:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16821 00000100:00100000:0.0:1746065206.844604:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265086080:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065206.844619:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.844633:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc1477bba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9385df expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065206.844689:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263871616:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065206.844792:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065206.845055:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265085952 00000100:00100000:1.0:1746065206.845059:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265085952 00000100:00100000:1.0:1746065206.845082:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5364 00000100:00100000:1.0:1746065206.845087:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2085:x1830881265085952:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065206.845305:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2085:x1830881265085952:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 217us (831us total) trans 8589936885 rc 0/0 00000100:00100000:1.0:1746065206.845310:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5364 00000100:00100000:1.0:1746065206.845418:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.845461:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265086336 00000100:00100000:0.0:1746065206.845465:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265086336 00000100:00100000:0.0:1746065206.845488:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16823 00000100:00100000:0.0:1746065206.845492:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2089:x1830881265086336:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065206.845498:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.845504:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1477bc8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9385ed expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.845518:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1477ba5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ca expref: 11 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.845524:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc1477bac lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385d1 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.845529:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.845531:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065206.845534:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1477bc8 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1454080->2097151] (req 1454080->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ed expref: 31 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.845549:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc1477bac lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385d1 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.845558:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835dc00/0xad6b7ddc1477bac lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385d1 expref: 31 pid: 9550 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746065206.845565:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263871872:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065206.845589:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1477ba5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ca expref: 10 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.845596:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1477ba5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ca expref: 10 pid: 9550 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746065206.845602:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263872000:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065206.845715:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065206.852383:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.852868:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.857912:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.857998:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.858035:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265086848 00000100:00100000:0.0:1746065206.858042:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265086848 00002000:00100000:0.0:1746065206.858083:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2809856->3145727) req@ffff88012f09d500 x1830881265086848/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065206.858390:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d500 with x1830881265086848 ext(2809856->3145727) 00010000:00010000:0.0:1746065206.858397:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1477b9e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385c3 expref: 10 pid: 11461 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746065206.858406:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1477b9e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385c3 expref: 10 pid: 11461 timeout: 902 lvb_type: 0 00002000:00010000:0.0:1746065206.858411:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09d500 00000100:00100000:0.0:1746065206.858452:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1941 00000100:00100000:0.0:1746065206.858458:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265086848:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065206.862242:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.862583:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265087104 00000100:00100000:1.0:1746065206.862589:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265087104 00002000:00100000:1.0:1746065206.862617:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x77:0x0] (1454080->1458175) req@ffff88012f09ed80 x1830881265087104/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.862627:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ed80 with x1830881265087104 ext(1454080->1458175) 00002000:00010000:1.0:1746065206.862631:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09ed80 00000100:00100000:1.0:1746065206.862658:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5878 00000100:00100000:1.0:1746065206.862665:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265087104:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065206.862760:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265087104:12345-192.168.202.27@tcp:3:cat.0 Request processed in 95us (525us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065206.862767:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5878 00002000:00100000:1.0:1746065206.862787:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x77:0x0] (1454080->1458175) req@ffff88012f09ed80 x1830881265087104/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/4536 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.862799:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ed80 with x1830881265087104 ext(1454080->1458175) 00002000:00010000:1.0:1746065206.862802:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09ed80 00000100:00100000:0.0:1746065206.864638:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265086848:12345-192.168.202.27@tcp:4:cat.0 Request processed in 6174us (6633us total) trans 17179874174 rc 0/0 00000100:00100000:0.0:1746065206.864647:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1941 00002000:00100000:0.0:1746065206.864653:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2809856->3145727) req@ffff88012f09d500 x1830881265086848/t17179874174(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/448 e 0 to 0 dl 1746065217 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065206.864661:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d500 with x1830881265086848 ext(2809856->3145727) 00010000:00010000:0.0:1746065206.864669:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1477b9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385c3 expref: 11 pid: 11461 timeout: 902 lvb_type: 0 00010000:00010000:0.0:1746065206.864681:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1477b9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385c3 expref: 11 pid: 11461 timeout: 902 lvb_type: 0 00002000:00010000:0.0:1746065206.864688:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09d500 00000100:00100000:0.0:1746065206.873474:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.873506:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.873538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.873555:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265087488 00000100:00100000:0.0:1746065206.873561:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265087744 00000100:00100000:1.0:1746065206.873563:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265087488 00000100:00100000:0.0:1746065206.873564:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265087744 00002000:00100000:1.0:1746065206.873594:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88012f09d880 x1830881265087488/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 504/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065206.873594:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2514944->4194303) req@ffff88012f09f480 x1830881265087744/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.873602:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d880 with x1830881265087488 ext(2097152->4194303) 00002000:00100000:0.0:1746065206.873602:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f480 with x1830881265087744 ext(2514944->4194303) 00002000:00010000:0.0:1746065206.873606:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09f480 00010000:00010000:1.0:1746065206.873609:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1477b9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385c3 expref: 11 pid: 11461 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.873620:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1477b9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385c3 expref: 11 pid: 11461 timeout: 902 lvb_type: 0 00000100:00100000:0.0:1746065206.873624:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5879 00002000:00010000:1.0:1746065206.873626:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09d880 00000100:00100000:0.0:1746065206.873630:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265087744:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065206.873649:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1942 00000100:00100000:1.0:1746065206.873653:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265087488:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065206.894532:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265087488:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20870us (21016us total) trans 0 rc 1761280/1761280 00000100:00100000:1.0:1746065206.894543:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1942 00002000:00100000:1.0:1746065206.894552:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88012f09d880 x1830881265087488/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 504/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:H/200/0 rc 1761280/1761280 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.894561:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d880 with x1830881265087488 ext(2097152->4194303) 00010000:00010000:1.0:1746065206.894570:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1477b9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385c3 expref: 11 pid: 11461 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.894583:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0400/0xad6b7ddc1477b9e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2809856->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385c3 expref: 11 pid: 11461 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746065206.894590:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09d880 00000100:00100000:0.0:1746065206.898527:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.901241:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.907837:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.907905:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265088256 00000100:00100000:1.0:1746065206.907912:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265088256 00002000:00100000:1.0:1746065206.907944:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012f09d180 x1830881265088256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.907953:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881265088256 ext(2097152->3145727) 00010000:00010000:1.0:1746065206.907961:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc1477bcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385f4 expref: 30 pid: 11461 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.907973:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc1477bcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385f4 expref: 30 pid: 11461 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746065206.907979:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09d180 00000100:00100000:1.0:1746065206.908002:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1943 00000100:00100000:1.0:1746065206.908008:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265088256:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065206.915629:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265088256:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7614us (7790us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065206.915639:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1943 00002000:00100000:1.0:1746065206.915648:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012f09d180 x1830881265088256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.915657:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881265088256 ext(2097152->3145727) 00010000:00010000:1.0:1746065206.915671:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc1477bcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385f4 expref: 30 pid: 11461 timeout: 902 lvb_type: 0 00010000:00010000:1.0:1746065206.915684:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc1477bcf lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385f4 expref: 30 pid: 11461 timeout: 902 lvb_type: 0 00002000:00010000:1.0:1746065206.915690:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09d180 00000100:00100000:0.0:1746065206.920636:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.920686:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.929264:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.929332:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265088768 00000100:00100000:1.0:1746065206.929338:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265088768 00002000:00100000:1.0:1746065206.929371:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2306048->2310143) req@ffff88012f1a7800 x1830881265088768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.929379:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7800 with x1830881265088768 ext(2306048->2310143) 00002000:00010000:1.0:1746065206.929382:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7800 00000100:00100000:1.0:1746065206.929405:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5880 00000100:00100000:1.0:1746065206.929412:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265088768:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065206.929566:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.929598:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.929622:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265089152 00000100:00100000:0.0:1746065206.929625:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265089152 00002000:00100000:0.0:1746065206.929640:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012f1a4000 x1830881265089152/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065206.929648:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265088768:12345-192.168.202.27@tcp:3:cat.0 Request processed in 236us (385us total) trans 0 rc 4096/4096 00002000:00100000:0.0:1746065206.929648:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4000 with x1830881265089152 ext(3145728->4194303) 00002000:00010000:0.0:1746065206.929651:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a4000 00000100:00100000:1.0:1746065206.929653:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5880 00002000:00100000:1.0:1746065206.929658:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2306048->2310143) req@ffff88012f1a7800 x1830881265088768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/4536 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.929663:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7800 with x1830881265088768 ext(2306048->2310143) 00002000:00010000:1.0:1746065206.929666:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7800 00000100:00100000:0.0:1746065206.929667:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5881 00000100:00100000:0.0:1746065206.929672:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265089152:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065206.937138:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.940985:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265089152:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11310us (11384us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065206.940994:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5881 00002000:00100000:1.0:1746065206.941002:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012f1a4000 x1830881265089152/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.941011:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4000 with x1830881265089152 ext(3145728->4194303) 00002000:00010000:1.0:1746065206.941016:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a4000 00000100:00100000:0.0:1746065206.948285:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.948451:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.955140:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.966106:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.966128:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265090176 00000100:00100000:0.0:1746065206.966134:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265090176 00002000:00100000:0.0:1746065206.966165:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88012f1a4380 x1830881265090176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065206.966173:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4380 with x1830881265090176 ext(2097152->3145727) 00002000:00010000:0.0:1746065206.966177:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a4380 00000100:00100000:0.0:1746065206.966192:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5883 00000100:00100000:0.0:1746065206.966198:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265090176:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065206.971988:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265090176:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5782us (5876us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065206.971997:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5883 00002000:00100000:1.0:1746065206.972006:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88012f1a4380 x1830881265090176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.972014:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4380 with x1830881265090176 ext(2097152->3145727) 00002000:00010000:1.0:1746065206.972019:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a4380 00000100:00100000:0.0:1746065206.978066:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.978482:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.979382:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.980202:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16830 00000100:00100000:1.0:1746065206.980207:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16831 00000100:00100000:0.0:1746065206.980207:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265090304:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065206.980214:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2093:x1830881265090560:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065206.980224:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065206.980224:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065206.980238:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095778800/0xad6b7ddc1477bf2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938625 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065206.980238:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012d03c400/0xad6b7ddc1477c00 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938617 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.980257:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.980259:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065206.980265:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095778800/0xad6b7ddc1477bf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938625 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065206.980276:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263873152:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065206.980280:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778800/0xad6b7ddc1477bf2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938625 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065206.980287:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778800, rc 0) 00000100:00100000:1.0:1746065206.980319:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2093:x1830881265090560:12345-192.168.202.27@tcp:101:cat.0 Request processed in 106us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065206.980325:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16831 00000100:00100000:0.0:1746065206.980332:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065206.987973:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.988048:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265090816 00000100:00100000:1.0:1746065206.988054:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265090816 00002000:00100000:1.0:1746065206.988093:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012f1a6d80 x1830881265090816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.988102:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6d80 with x1830881265090816 ext(3145728->4194303) 00002000:00010000:1.0:1746065206.988106:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a6d80 00000100:00100000:1.0:1746065206.988129:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5884 00000100:00100000:1.0:1746065206.988135:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265090816:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065206.997172:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065206.997363:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065206.997548:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265091072 00000100:00100000:1.0:1746065206.997555:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265091072 00002000:00100000:1.0:1746065206.997588:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880091bc2300 x1830881265091072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.997598:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc2300 with x1830881265091072 ext(3145728->4194303) 00002000:00010000:1.0:1746065206.997602:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc2300 00000100:00100000:1.0:1746065206.997900:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265091328 00000100:00100000:1.0:1746065206.997904:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265091328 00002000:00100000:1.0:1746065206.997917:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff880091bc2a00 x1830881265091328/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:122/0 lens 488/0 e 0 to 0 dl 1746065217 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065206.997924:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc2a00 with x1830881265091328 ext(4194304->4898815) 00002000:00010000:1.0:1746065206.997927:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc2a00 00000100:00100000:1.0:1746065206.997938:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5885 00000100:00100000:1.0:1746065206.997943:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265091072:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065207.002027:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265090816:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13884us (14051us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065207.002037:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5884 00002000:00100000:1.0:1746065207.002047:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012f1a6d80 x1830881265090816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.002056:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6d80 with x1830881265090816 ext(3145728->4194303) 00002000:00010000:1.0:1746065207.002061:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a6d80 00000100:00100000:1.0:1746065207.010707:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265091072:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12752us (13532us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065207.010718:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5885 00002000:00100000:1.0:1746065207.010727:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880091bc2300 x1830881265091072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:122/0 lens 488/440 e 0 to 0 dl 1746065217 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.010735:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc2300 with x1830881265091072 ext(3145728->4194303) 00002000:00010000:1.0:1746065207.010740:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc2300 00000100:00100000:0.0:1746065207.014356:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065207.015050:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065207.016712:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.016958:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.017804:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16834 00000100:00100000:1.0:1746065207.017969:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265091712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.017977:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.017984:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1477c15 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93863a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.018000:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1477c15 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93863a expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.018009:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1477c15 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93863a expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.018024:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779600, rc 0) 00000100:00100000:1.0:1746065207.018046:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265091712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 80us (1088us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065207.018052:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16834 00000100:00100000:1.0:1746065207.020653:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.022675:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.022722:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.022739:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265092096 00000100:00100000:1.0:1746065207.022742:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265092096 00000100:00100000:1.0:1746065207.022771:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265092224 00000100:00100000:1.0:1746065207.022786:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265092224 00000100:00100000:1.0:1746065207.022797:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16835 00000100:00100000:1.0:1746065207.022802:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265092096:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.022813:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.022824:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095778200/0xad6b7ddc1477c1c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938641 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.022862:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263873408:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065207.022911:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065207.025121:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263873408:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065207.025143:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778200/0xad6b7ddc1477c1c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938641 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.025155:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778200/0xad6b7ddc1477c1c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938641 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.025299:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778200, rc 0) 00000100:00100000:1.0:1746065207.025596:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265092096:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2792us (2923us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065207.025604:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16835 00000100:00100000:0.0:1746065207.030972:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.031086:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265092352 00000100:00100000:1.0:1746065207.031094:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265092352 00000100:00100000:1.0:1746065207.031137:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16837 00000100:00100000:1.0:1746065207.031144:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265092352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.031158:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.031170:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc1477c2a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93864f expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.031196:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc1477c2a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93864f expref: 31 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.031204:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc1477c2a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93864f expref: 31 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.031213:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2000, rc 0) 00000100:00100000:1.0:1746065207.031259:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265092352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 115us (296us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065207.031264:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16837 00000100:00100000:0.0:1746065207.046017:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265092480 00000100:00100000:0.0:1746065207.046024:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265092480 00000100:00100000:0.0:1746065207.058134:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:0.0:1746065207.059081:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065207.061971:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.062956:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265092736 00000100:00100000:1.0:1746065207.062964:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265092736 00000100:00100000:1.0:1746065207.063025:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16839 00000100:00100000:1.0:1746065207.063033:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265092736:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065207.063048:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.063063:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477c54 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938664 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.063080:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.063082:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.063090:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477c54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938664 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065207.063090:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065207.063103:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477c54 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938664 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065207.063106:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065207.063113:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3600, rc 0) 00000100:00100000:0.0:1746065207.063117:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.063143:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.063147:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5039450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265092736:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 116us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.063152:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16839 00000100:00100000:0.0:1746065207.063211:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265092864 00000100:00100000:0.0:1746065207.063214:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265092864 00000100:00100000:0.0:1746065207.063230:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265092992 00000100:00100000:0.0:1746065207.063232:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265092992 00000100:00100000:0.0:1746065207.063239:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265093120 00000100:00100000:0.0:1746065207.063240:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265093120 00000100:00100000:0.0:1746065207.063249:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16840 00000100:00100000:0.0:1746065207.063254:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265092864:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065207.063260:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065207.063267:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16841 00010000:00010000:0.0:1746065207.063267:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1477c5b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93866b expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.063271:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265092992:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065207.063276:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.063280:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc1477c62 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938672 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.063292:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc1477c62 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938672 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.063298:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2000/0xad6b7ddc1477c62 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938672 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065207.063298:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263873536:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065207.063310:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2000, rc 0) 00000100:00100000:0.0:1746065207.063352:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065207.063469:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265092992:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 196us (361us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065207.065269:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16841 00000100:00100000:0.0:1746065207.065274:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265093248 00000100:00100000:0.0:1746065207.065279:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265093248 00000100:00100000:0.0:1746065207.065318:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 824 00000100:00100000:0.0:1746065207.065323:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265093248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065207.065334:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065207.065350:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ba00/0xad6b7ddc1477c4d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93865d expref: 14 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.065364:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065207.065368:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065207.065405:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265093248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (2260us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.065410:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 824 00000100:00100000:0.0:1746065207.069008:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263873536:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065207.069037:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1477c5b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93866b expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.069051:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1477c5b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93866b expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.069060:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2000, rc 0) 00000100:00100000:0.0:1746065207.069110:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265092864:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 5854us (6018us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065207.069118:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16840 00000100:00100000:0.0:1746065207.071056:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.073675:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.073754:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.073902:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7764 00000100:00100000:1.0:1746065207.073909:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881265093632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065207.073915:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.073919:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc1477b74 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ae expref: 42 pid: 7205 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.073926:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc1477b74 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ae expref: 42 pid: 7205 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.073935:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc1477b74 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ae expref: 42 pid: 7205 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.073942:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.073945:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc1477c77 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065207.073950:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc1477c77 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065207.073955:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc1477c77 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065207.073967:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.073981:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265093632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.073986:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7764 00000100:00100000:0.0:1746065207.078992:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.082860:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.085026:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265094272 00000100:00100000:0.0:1746065207.085031:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265094272 00000100:00100000:0.0:1746065207.085057:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16843 00000100:00100000:0.0:1746065207.085063:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265094272:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065207.085090:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.085104:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc1477a32 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ea expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.085111:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc1477ab7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93853e expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.085117:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc1477a40 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384f1 expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.085123:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.085125:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.085127:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.085147:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc1477a40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384f1 expref: 29 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.085158:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc1477a40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384f1 expref: 29 pid: 9548 timeout: 903 lvb_type: 1 00000100:00100000:0.0:1746065207.085167:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263873920:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065207.086292:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16847 00000100:00100000:1.0:1746065207.086298:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265094656:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065207.086310:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.086318:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1477bc8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ed expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.086323:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065207.086324:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065207.086326:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.086337:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1477bc8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ed expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.086344:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1477bc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ed expref: 29 pid: 13375 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.086350:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263874944:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065207.086375:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00010000:00010000:0.0:1746065207.086426:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc1477ab7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93853e expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.086445:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc1477ab7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93853e expref: 11 pid: 9550 timeout: 903 lvb_type: 1 00000100:00100000:0.0:1746065207.086454:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263875328:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065207.086477:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc1477a32 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ea expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.086484:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46a00/0xad6b7ddc1477a32 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384ea expref: 10 pid: 1880 timeout: 903 lvb_type: 1 00000100:00100000:0.0:1746065207.086491:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263875456:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065207.086501:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.086513:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265094912 00000100:00100000:0.0:1746065207.086515:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265094912 00000100:00100000:0.0:1746065207.086532:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16848 00000100:00100000:0.0:1746065207.086536:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265094912:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065207.086549:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.086558:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1477be4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938609 expref: 24 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.086565:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60200/0xad6b7ddc1477c69 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938679 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.086571:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc1477beb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938610 expref: 11 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.086575:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.086577:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.086579:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.086591:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc1477beb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938610 expref: 11 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.086597:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc1477beb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938610 expref: 11 pid: 13375 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746065207.086604:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263875584:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065207.086640:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60200/0xad6b7ddc1477c69 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938679 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.086647:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f60200/0xad6b7ddc1477c69 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938679 expref: 13 pid: 9548 timeout: 903 lvb_type: 1 00000100:00100000:0.0:1746065207.086660:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263875712:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065207.086678:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1477be4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938609 expref: 24 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.086684:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1477be4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938609 expref: 24 pid: 13375 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746065207.086691:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263875840:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065207.086700:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065207.089347:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263873920:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065207.096012:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.096038:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265095424 00000100:00100000:0.0:1746065207.096048:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265095424 00010000:00010000:0.0:1746065207.096086:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc1477a40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384f1 expref: 30 pid: 9548 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746065207.096102:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263875584:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065207.096110:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7765 00000100:00100000:1.0:1746065207.096113:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263875712:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065207.096116:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265095424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065207.096129:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263875328:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065207.096136:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263875456:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065207.096158:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.096175:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065207.096180:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263874944:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065207.096190:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.096194:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc1477a40 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384f1 expref: 30 pid: 9548 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746065207.096203:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc1477a40 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384f1 expref: 30 pid: 9548 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746065207.096225:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46e00/0xad6b7ddc1477a40 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9384f1 expref: 30 pid: 9548 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746065207.096240:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065207.096273:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265095424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 156us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.096279:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7765 00000100:00100000:0.0:1746065207.096344:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.096363:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265096064 00000100:00100000:0.0:1746065207.096366:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265096064 00010000:00010000:0.0:1746065207.096376:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136166600/0xad6b7ddc1477bdd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938602 expref: 11 pid: 13375 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746065207.096403:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7766 00000100:00100000:0.0:1746065207.096407:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265096064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065207.096413:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065207.096421:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136166600/0xad6b7ddc1477bdd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938602 expref: 11 pid: 13375 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746065207.096427:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136166600/0xad6b7ddc1477bdd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938602 expref: 11 pid: 13375 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746065207.096515:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166600/0xad6b7ddc1477bdd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938602 expref: 11 pid: 13375 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746065207.096528:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065207.096544:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265096064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 136us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.096549:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7766 00000100:00100000:0.0:1746065207.096589:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097075:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097119:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097167:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097183:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097196:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097211:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097258:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097272:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097281:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097291:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097300:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097337:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.097889:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265095936 00000100:00100000:0.0:1746065207.097892:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265095936 00002000:00100000:0.0:1746065207.097913:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1454080->2097151) req@ffff88012dc3d500 x1830881265095936/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.097922:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d500 with x1830881265095936 ext(1454080->2097151) 00010000:00010000:0.0:1746065207.097926:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1477bc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ed expref: 28 pid: 13375 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746065207.097938:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1477bc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ed expref: 28 pid: 13375 timeout: 903 lvb_type: 0 00002000:00010000:0.0:1746065207.098201:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dc3d500 00000100:00100000:1.0:1746065207.098220:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263875840:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065207.098236:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.099133:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1946 00000100:00100000:1.0:1746065207.099140:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265095936:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:1.0:1746065207.099231:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.099238:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.099247:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.099256:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.099262:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.099267:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3a00 already unused, calling callback (ffffffffa086fd70) 00000100:00100000:0.0:1746065207.099519:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065207.099749:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.099757:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.099767:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.099787:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477ca1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.099823:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265094272:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 14760us (14838us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065207.099970:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.099976:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.099988:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.099994:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.099999:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.100004:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065207.100006:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.100012:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.100025:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.100029:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477cc4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065207.100062:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265094912:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 13525us (13575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.100068:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16848 00000100:00100000:1.0:1746065207.100108:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16843 00000100:00100000:0.0:1746065207.107693:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.112298:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265095936:12345-192.168.202.27@tcp:4:cat.0 Request processed in 13151us (15170us total) trans 17179874176 rc 0/0 00000100:00100000:1.0:1746065207.112310:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1946 00002000:00100000:1.0:1746065207.112319:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (1454080->2097151) req@ffff88012dc3d500 x1830881265095936/t17179874176(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/448 e 0 to 0 dl 1746065218 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.112329:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d500 with x1830881265095936 ext(1454080->2097151) 00010000:00010000:1.0:1746065207.112339:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1477bc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ed expref: 31 pid: 13375 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.113028:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc1477bc8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1454080->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9385ed expref: 31 pid: 13375 timeout: 903 lvb_type: 0 00002000:00010000:1.0:1746065207.113036:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012dc3d500 00000100:00100000:0.0:1746065207.116410:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065207.116929:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.116940:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.116955:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.116962:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.116968:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.116973:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065207.116977:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.116989:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.116998:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.117003:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3a00/0xad6b7ddc1477cbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.117057:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265094656:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 30759us (31043us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.117065:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16847 00000100:00100000:0.0:1746065207.118422:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.123196:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.123228:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.123246:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.123277:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.123331:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.124421:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7783 00000100:00100000:1.0:1746065207.124429:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265098368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065207.124445:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.124449:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1477848 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383e0 expref: 41 pid: 13395 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.124456:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1477848 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383e0 expref: 41 pid: 13395 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.124467:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc1477848 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9383e0 expref: 41 pid: 13395 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.124474:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.124477:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1477ccb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065207.124482:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.124498:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881265098368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (1167us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.124503:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7783 00000100:00100000:0.0:1746065207.124709:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.125235:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265098496 00000100:00100000:1.0:1746065207.125238:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265098496 00010000:00010000:1.0:1746065207.125250:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc147793d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93846c expref: 40 pid: 7203 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.126066:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7784 00000100:00100000:1.0:1746065207.126074:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265098496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065207.126081:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.126085:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc147793d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93846c expref: 40 pid: 7203 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.126092:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc147793d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93846c expref: 40 pid: 7203 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.126105:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97000/0xad6b7ddc147793d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93846c expref: 40 pid: 7203 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.126113:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.126115:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1477ccb lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065207.126120:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.126296:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881265098496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 222us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.126305:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7784 00000100:00100000:0.0:1746065207.126418:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.126506:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.138736:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263876736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065207.138760:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.138791:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263877248:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065207.138805:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.138819:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263877760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065207.138833:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.138843:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065207.138847:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263877120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065207.138859:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.138867:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263877632:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065207.138878:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.138896:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263876736 00000100:00100000:0.0:1746065207.138899:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263876736 00000100:00100000:0.0:1746065207.138915:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263877248 00000100:00100000:0.0:1746065207.138917:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263877248 00000100:00100000:0.0:1746065207.138924:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263877760 00000100:00100000:0.0:1746065207.138926:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263877760 00000100:00100000:0.0:1746065207.138931:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263877120 00000100:00100000:0.0:1746065207.138932:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263877120 00000100:00100000:0.0:1746065207.138937:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263877632 00000100:00100000:0.0:1746065207.138938:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263877632 00000100:00100000:0.0:1746065207.138944:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16853 00000100:00100000:0.0:1746065207.138948:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263876736:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065207.139008:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263876736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (247us total) trans 17179874181 rc 0/0 00000100:00100000:0.0:1746065207.139013:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16853 00000100:00100000:0.0:1746065207.139022:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16854 00000100:00100000:0.0:1746065207.139026:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263877248:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065207.139060:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1746065207.139062:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1746065207.139064:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065207.139065:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:0.0:1746065207.139067:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065207.139083:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263877248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (277us total) trans 17179874182 rc 0/0 00000100:00100000:0.0:1746065207.139088:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16854 00000100:00100000:0.0:1746065207.139096:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16855 00000100:00100000:0.0:1746065207.139100:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263877760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065207.139145:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263877760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (311us total) trans 17179874183 rc 0/0 00000100:00100000:0.0:1746065207.139150:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16855 00000100:00100000:0.0:1746065207.139158:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16856 00000100:00100000:0.0:1746065207.139162:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263877120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065207.139202:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263877120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (341us total) trans 17179874184 rc 0/0 00000100:00100000:0.0:1746065207.139206:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16856 00000100:00100000:0.0:1746065207.139215:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16857 00000100:00100000:0.0:1746065207.139219:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263877632:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065207.139250:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:0.0:1746065207.139253:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065207.139254:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065207.139256:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065207.139258:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:0.0:1746065207.139273:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263877632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (394us total) trans 17179874185 rc 0/0 00000100:00100000:0.0:1746065207.139277:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16857 00000100:00100000:0.0:1746065207.139383:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263877888:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.139402:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.139413:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263878400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.139424:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.139433:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065207.139451:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263878016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.139466:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.139476:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263878528:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.139487:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.139500:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263877888 00000100:00100000:0.0:1746065207.139503:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263877888 00000100:00100000:0.0:1746065207.139516:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263878400 00000100:00100000:0.0:1746065207.139518:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263878400 00000100:00100000:0.0:1746065207.139523:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263878016 00000100:00100000:0.0:1746065207.139525:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263878016 00000100:00100000:0.0:1746065207.139530:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263878528 00000100:00100000:0.0:1746065207.139531:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263878528 00000100:00100000:0.0:1746065207.139537:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16858 00000100:00100000:0.0:1746065207.139541:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3759:x1830881263877888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.139613:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3759:x1830881263877888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (209us total) trans 21474841586 rc 0/0 00000100:00100000:0.0:1746065207.139618:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16858 00000100:00100000:0.0:1746065207.139627:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16859 00000100:00100000:0.0:1746065207.139631:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3759:x1830881263878400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065207.139668:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065207.139670:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065207.139672:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065207.139674:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065207.139675:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:0.0:1746065207.139692:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3759:x1830881263878400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (266us total) trans 21474841587 rc 0/0 00000100:00100000:0.0:1746065207.139696:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16859 00000100:00100000:0.0:1746065207.139705:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16860 00000100:00100000:0.0:1746065207.139709:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3759:x1830881263878016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.139754:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3759:x1830881263878016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (286us total) trans 21474841588 rc 0/0 00000100:00100000:0.0:1746065207.139758:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16860 00000100:00100000:0.0:1746065207.139768:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16861 00000100:00100000:0.0:1746065207.139795:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3759:x1830881263878528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065207.139833:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:0.0:1746065207.139835:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065207.139837:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065207.139839:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065207.139840:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:0.0:1746065207.139858:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+25:3759:x1830881263878528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 86us (370us total) trans 21474841589 rc 0/0 00000100:00100000:0.0:1746065207.139862:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16861 00000004:00080000:0.0:1746065207.139889:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ea00/2, rc 0, transno 21474841588 00000100:00100000:0.0:1746065207.139893:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263878016:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065207.139899:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a78000/2, rc 0, transno 21474841589 00000100:00100000:0.0:1746065207.139902:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263878528:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065207.139907:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3f100/2, rc 0, transno 21474841586 00000100:00100000:0.0:1746065207.139910:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263877888:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065207.139915:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a78a80/2, rc 0, transno 21474841587 00000100:00100000:0.0:1746065207.139918:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263878400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.139928:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263878272:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.139944:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.139958:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263878784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.139970:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065207.139982:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec4000/2, rc 0, transno 17179874184 00000100:00100000:0.0:1746065207.139984:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263877120:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065207.139990:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bc3480/2, rc 0, transno 17179874185 00000100:00100000:0.0:1746065207.139992:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263877632:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065207.139998:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec5f80/2, rc 0, transno 17179874181 00000100:00100000:0.0:1746065207.140001:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263876736:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065207.140006:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec7b80/2, rc 0, transno 17179874182 00000100:00100000:0.0:1746065207.140009:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263877248:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065207.140015:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bc0a80/2, rc 0, transno 17179874183 00000100:00100000:0.0:1746065207.140017:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263877760:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065207.140023:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1746065207.140027:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263878144:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.140039:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.140048:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263878656:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.140057:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.140070:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263878272 00000100:00100000:0.0:1746065207.140072:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263878272 00000100:00100000:0.0:1746065207.140080:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263878784 00000100:00100000:0.0:1746065207.140082:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263878784 00000100:00100000:0.0:1746065207.140087:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263878144 00000100:00100000:0.0:1746065207.140088:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263878144 00000100:00100000:0.0:1746065207.140092:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263878656 00000100:00100000:0.0:1746065207.140093:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263878656 00000100:00100000:0.0:1746065207.140098:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16862 00000100:00100000:0.0:1746065207.140102:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3762:x1830881263878272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065207.140138:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065207.140140:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065207.140142:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065207.140143:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065207.140145:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:0.0:1746065207.140164:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263878272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (219us total) trans 21474841590 rc 0/0 00000100:00100000:0.0:1746065207.140168:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16862 00000100:00100000:0.0:1746065207.140176:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16863 00000100:00100000:0.0:1746065207.140180:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3762:x1830881263878784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.140228:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263878784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (256us total) trans 21474841591 rc 0/0 00000100:00100000:0.0:1746065207.140232:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16863 00000100:00100000:0.0:1746065207.140240:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16864 00000100:00100000:0.0:1746065207.140244:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3762:x1830881263878144:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.140283:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263878144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (243us total) trans 21474841592 rc 0/0 00000100:00100000:0.0:1746065207.140288:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16864 00000100:00100000:0.0:1746065207.140295:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16865 00000100:00100000:0.0:1746065207.140298:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+28:3762:x1830881263878656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.140350:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881263878656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (284us total) trans 21474841593 rc 0/0 00000100:00100000:0.0:1746065207.140354:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16865 00000004:00080000:0.0:1746065207.140376:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ed80/2, rc 0, transno 21474841592 00000100:00100000:0.0:1746065207.140380:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263878144:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065207.140386:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a7a680/2, rc 0, transno 21474841593 00000100:00100000:0.0:1746065207.140388:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263878656:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065207.142365:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a78e00/2, rc 0, transno 21474841590 00000100:00100000:0.0:1746065207.142372:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263878272:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065207.142380:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a78700/2, rc 0, transno 21474841591 00000100:00100000:0.0:1746065207.142383:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263878784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.143430:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.148065:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.148183:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265099008 00000100:00100000:1.0:1746065207.148192:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265099008 00000100:00100000:1.0:1746065207.148250:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 825 00000100:00100000:1.0:1746065207.148258:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2099:x1830881265099008:12345-192.168.202.27@tcp:103:mirror_io.0 00010000:00010000:1.0:1746065207.148270:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.149188:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1477c8c lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938687 expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.149802:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.149808:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.149863:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2099:x1830881265099008:12345-192.168.202.27@tcp:103:mirror_io.0 Request processed in 1604us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.149871:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 825 00000100:00100000:0.0:1746065207.151563:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.162035:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.183246:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.189268:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.193603:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.194350:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.195379:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.195393:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.195870:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265100416 00000100:00100000:1.0:1746065207.195874:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265100416 00000100:00100000:1.0:1746065207.195892:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265100544 00000100:00100000:1.0:1746065207.195893:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265100544 00000100:00100000:1.0:1746065207.195905:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16868 00000100:00100000:1.0:1746065207.195910:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265100416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.195917:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.195925:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1477d2d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9386b8 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065207.195936:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d736, atime: 0x6812d734, ctime: 0x6812d736, blocks: 0x808 00010000:00010000:1.0:1746065207.195944:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.195945:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.195949:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1477d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b8 expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.195958:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1477d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b8 expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.195964:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2a00, rc 0) 00000100:00100000:1.0:1746065207.195986:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265100416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 76us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.195991:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16868 00000100:00100000:1.0:1746065207.196002:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16869 00000100:00100000:1.0:1746065207.196006:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265100544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.196012:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.196020:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2e00/0xad6b7ddc1477d34 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9386bf expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065207.196030:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d737, atime: 0x6812d736, ctime: 0x6812d737, blocks: 0x808 00010000:00010000:1.0:1746065207.196037:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.196039:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.196043:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2e00/0xad6b7ddc1477d34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386bf expref: 32 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.196051:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2e00/0xad6b7ddc1477d34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386bf expref: 32 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.196061:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2e00, rc 0) 00000100:00100000:1.0:1746065207.196076:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265100544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 69us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.196081:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16869 00000100:00100000:0.0:1746065207.196151:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.196181:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.196200:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265100672 00000100:00100000:0.0:1746065207.196203:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265100672 00000100:00100000:0.0:1746065207.196216:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265100800 00000100:00100000:0.0:1746065207.196217:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265100800 00000100:00100000:0.0:1746065207.196228:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16870 00000100:00100000:0.0:1746065207.196233:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265100672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065207.196239:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065207.196245:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1477d3b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9386c6 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065207.196254:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 4897248, mtime: 0x6812d737, atime: 0x6812d737, ctime: 0x6812d737, blocks: 0x1568 00010000:00010000:0.0:1746065207.196261:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.196262:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.196266:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1477d3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386c6 expref: 33 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.196275:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1477d3b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386c6 expref: 33 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.196281:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a200, rc 0) 00000100:00100000:0.0:1746065207.196301:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265100672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 68us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.196305:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16870 00000100:00100000:0.0:1746065207.196315:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16871 00000100:00100000:0.0:1746065207.196319:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265100800:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065207.196324:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065207.196330:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc1477d42 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9386cd expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065207.196338:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d737, atime: 0x6812d737, ctime: 0x6812d737, blocks: 0x1008 00010000:00010000:0.0:1746065207.196345:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.196346:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.196350:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc1477d42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386cd expref: 25 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.196358:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc1477d42 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386cd expref: 25 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.196364:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ae00, rc 0) 00000100:00100000:0.0:1746065207.196378:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265100800:12345-192.168.202.27@tcp:101:cat.0 Request processed in 59us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.196382:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16871 00000100:00100000:0.0:1746065207.198468:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.202214:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265101312 00000100:00100000:1.0:1746065207.202219:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265101312 00000100:00100000:1.0:1746065207.202249:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14433 00000100:00100000:1.0:1746065207.202254:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2104:x1830881265101312:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065207.202269:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.202281:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc1477d57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9386db expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.202356:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477d5e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065207.202365:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477d5e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065207.202372:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477d5e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065207.211180:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.211222:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.211282:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265101440 00000100:00100000:1.0:1746065207.211285:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265101440 00010000:00010000:1.0:1746065207.211306:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc1477cd2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938695 expref: 9 pid: 7205 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.211341:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7787 00000100:00100000:1.0:1746065207.211347:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265101440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065207.211359:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.211364:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc1477cd2 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938695 expref: 9 pid: 7205 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.211375:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc1477cd2 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938695 expref: 9 pid: 7205 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.211393:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc1477cd2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938695 expref: 9 pid: 7205 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.211409:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.211413:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477d5e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065207.211419:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1477d50 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065207.211424:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477d5e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065207.211428:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1477d50 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065207.211442:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.211477:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881265101440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 129us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.211483:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7787 00010000:00010000:1.0:1746065207.211661:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477d5e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065207.211667:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477d5e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065207.211682:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065207.211794:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc1477d57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386db expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.211804:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477d5e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386db expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.211809:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.211811:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065207.211812:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3600, rc 0) 00000100:00100000:1.0:1746065207.213339:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2104:x1830881265101312:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11080us (11302us total) trans 8589936896 rc 0/0 00000100:00100000:1.0:1746065207.213346:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14433 00000100:00100000:0.0:1746065207.217032:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.217116:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.217129:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.217146:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265101824 00000100:00100000:0.0:1746065207.217153:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265101824 00002000:00100000:0.0:1746065207.217185:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880091a91180 x1830881265101824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.217192:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91180 with x1830881265101824 ext(0->1048575) 00002000:00010000:0.0:1746065207.217198:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a91180 00000100:00100000:0.0:1746065207.217212:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265102080 00000100:00100000:0.0:1746065207.217214:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265102080 00002000:00100000:0.0:1746065207.217225:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880091a90a80 x1830881265102080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.217236:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90a80 with x1830881265102080 ext(1048576->2097151) 00002000:00010000:0.0:1746065207.217239:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90a80 00000100:00100000:0.0:1746065207.217247:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265102336 00000100:00100000:0.0:1746065207.217248:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265102336 00002000:00100000:0.0:1746065207.217256:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880091a92680 x1830881265102336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.217261:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92680 with x1830881265102336 ext(1048576->2097151) 00002000:00010000:0.0:1746065207.217263:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a92680 00000100:00100000:0.0:1746065207.217273:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5888 00000100:00100000:0.0:1746065207.217278:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265101824:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065207.217923:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5889 00000100:00100000:0.0:1746065207.217930:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265102080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065207.218477:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.228218:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263879168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065207.228256:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065207.228290:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065207.228294:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263879296:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065207.228306:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065207.228323:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263879168 00000100:00100000:1.0:1746065207.228328:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263879168 00000100:00100000:1.0:1746065207.228350:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263879296 00000100:00100000:1.0:1746065207.228352:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263879296 00000100:00100000:1.0:1746065207.228362:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16872 00000100:00100000:1.0:1746065207.228367:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881263879168:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065207.228476:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065207.228479:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065200 -> 1746065200 00002000:00010000:1.0:1746065207.228481:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00002000:00010000:1.0:1746065207.228483:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065200 -> 1746065200 00002000:00010000:1.0:1746065207.228484:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746065207.228506:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3759:x1830881263879168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 139us (250us total) trans 21474841594 rc 0/0 00000100:00100000:1.0:1746065207.228511:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16872 00000100:00100000:1.0:1746065207.228521:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16873 00000100:00100000:1.0:1746065207.228526:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263879296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065207.228572:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065207.228574:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065206 -> 1746065206 00002000:00010000:1.0:1746065207.228575:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065204 -> 1746065204 00002000:00010000:1.0:1746065207.228577:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065206 -> 1746065206 00002000:00010000:1.0:1746065207.228579:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:1.0:1746065207.228594:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+15:3759:x1830881263879296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (286us total) trans 17179874186 rc 0/0 00000100:00100000:1.0:1746065207.228599:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16873 00000004:00080000:1.0:1746065207.228625:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bc0e00/2, rc 0, transno 17179874186 00000100:00100000:1.0:1746065207.228629:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263879296:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065207.228637:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a92300/2, rc 0, transno 21474841594 00000100:00100000:0.0:1746065207.229210:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263879552:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065207.229231:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.229247:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263880064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.229258:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.229277:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263880576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.229291:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.229301:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1746065207.229305:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263879424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065207.229317:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.229324:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263879936:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.229335:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.229343:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263880448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.229352:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.229366:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263879552 00000100:00100000:0.0:1746065207.229369:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263879552 00000100:00100000:0.0:1746065207.229382:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263880064 00000100:00100000:0.0:1746065207.229383:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263880064 00000100:00100000:0.0:1746065207.229390:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263880576 00000100:00100000:0.0:1746065207.229391:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263880576 00000100:00100000:0.0:1746065207.229398:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263879424 00000100:00100000:0.0:1746065207.229399:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263879424 00000100:00100000:0.0:1746065207.229405:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263879936 00000100:00100000:0.0:1746065207.229406:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263879936 00000100:00100000:0.0:1746065207.229412:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263880448 00000100:00100000:0.0:1746065207.229413:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263880448 00000100:00100000:0.0:1746065207.229418:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16874 00000100:00100000:0.0:1746065207.229422:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+16:3762:x1830881263879552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065207.229481:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 4897248 -> 4897248 00002000:00010000:0.0:1746065207.229483:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065207 -> 1746065207 00002000:00010000:0.0:1746065207.229485:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065207 -> 1746065207 00002000:00010000:0.0:1746065207.229487:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065207 -> 1746065207 00002000:00010000:0.0:1746065207.229488:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5480 -> 5480 00000100:00100000:0.0:1746065207.229505:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+17:3762:x1830881263879552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 83us (274us total) trans 17179874187 rc 0/0 00000100:00100000:0.0:1746065207.229510:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16874 00000100:00100000:1.0:1746065207.230616:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263879168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065207.230629:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263879680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065207.230649:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065207.231377:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263880192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065207.231397:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065207.231680:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135221f80/2, rc 0, transno 21474841599 00000100:00100000:1.0:1746065207.231683:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263880192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065207.231687:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263880704:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065207.231701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065207.232136:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263881216:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065207.232153:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065207.232171:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3f480/2, rc 0, transno 17179874191 00000100:00100000:1.0:1746065207.232175:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263879680:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065207.232178:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1746065207.232183:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263879808:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065207.232198:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065207.232209:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263880320:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065207.232222:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065207.232228:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263880832:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065207.232241:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065207.232263:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263880704 00000100:00100000:1.0:1746065207.232265:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263880704 00000100:00100000:1.0:1746065207.232277:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263881216 00000100:00100000:1.0:1746065207.232279:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263881216 00000100:00100000:1.0:1746065207.232284:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263879808 00000100:00100000:1.0:1746065207.232286:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263879808 00000100:00100000:1.0:1746065207.232291:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263880320 00000100:00100000:1.0:1746065207.232292:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263880320 00000100:00100000:1.0:1746065207.232297:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263880832 00000100:00100000:1.0:1746065207.232299:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263880832 00000100:00100000:1.0:1746065207.232306:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16884 00000100:00100000:1.0:1746065207.232310:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263880704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065207.232358:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065207.232361:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065207.232363:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065207.232364:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:1.0:1746065207.232366:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065207.232387:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263880704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 77us (685us total) trans 17179874192 rc 0/0 00000100:00100000:1.0:1746065207.232392:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16884 00000100:00100000:1.0:1746065207.232403:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16885 00000100:00100000:1.0:1746065207.232407:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263881216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065207.232471:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263881216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (316us total) trans 17179874193 rc 0/0 00000100:00100000:1.0:1746065207.232475:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16885 00000100:00100000:1.0:1746065207.232485:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16886 00000100:00100000:1.0:1746065207.232488:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881263879808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065207.232525:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065207.232527:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065206 -> 1746065206 00002000:00010000:1.0:1746065207.232528:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065204 -> 1746065204 00002000:00010000:1.0:1746065207.232530:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065206 -> 1746065206 00002000:00010000:1.0:1746065207.232532:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065207.232547:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3759:x1830881263879808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (349us total) trans 21474841600 rc 0/0 00000100:00100000:1.0:1746065207.232551:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16886 00000100:00100000:1.0:1746065207.232559:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16887 00000100:00100000:1.0:1746065207.232563:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881263880320:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065207.232598:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:1.0:1746065207.232600:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065207.232602:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065207.232604:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065207.232605:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:1.0:1746065207.232621:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3759:x1830881263880320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (398us total) trans 21474841601 rc 0/0 00000100:00100000:1.0:1746065207.232625:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16887 00000100:00100000:1.0:1746065207.232634:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16888 00000100:00100000:1.0:1746065207.232637:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263880832:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065207.232681:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263880832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (439us total) trans 17179874194 rc 0/0 00000100:00100000:1.0:1746065207.232686:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16888 00000004:00080000:1.0:1746065207.232705:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a91500/2, rc 0, transno 21474841600 00000100:00100000:1.0:1746065207.232708:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263879808:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065207.232713:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135221880/2, rc 0, transno 21474841601 00000100:00100000:1.0:1746065207.232716:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263880320:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065207.232721:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e4e00/2, rc 0, transno 17179874194 00000100:00100000:1.0:1746065207.232723:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263880832:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065207.232728:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e6300/2, rc 0, transno 17179874192 00000100:00100000:1.0:1746065207.232730:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263880704:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065207.232735:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e5880/2, rc 0, transno 17179874193 00000100:00100000:1.0:1746065207.232737:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263881216:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065207.234375:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bc0000/2, rc 0, transno 17179874188 00000100:00100000:0.0:1746065207.234382:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263879424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065207.234391:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a90000/2, rc 0, transno 21474841597 00000100:00100000:0.0:1746065207.234395:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263879936:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065207.234402:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135222680/2, rc 0, transno 21474841598 00000100:00100000:0.0:1746065207.234404:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263880448:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065207.234411:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3e300/2, rc 0, transno 17179874187 00000100:00100000:0.0:1746065207.234414:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263879552:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065207.234421:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135223100/2, rc 0, transno 21474841595 00000100:00100000:0.0:1746065207.234423:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135223100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263880064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065207.234430:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135220000/2, rc 0, transno 21474841596 00000100:00100000:0.0:1746065207.234432:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263880576:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065207.235848:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265101824:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18561us (18814us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065207.235857:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5888 00002000:00100000:0.0:1746065207.235870:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880091a91180 x1830881265101824/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/440 e 0 to 0 dl 1746065218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.235879:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91180 with x1830881265101824 ext(0->1048575) 00002000:00010000:0.0:1746065207.235884:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a91180 00000100:00100000:0.0:1746065207.266859:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.267114:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.267358:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.267385:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265103104 00000100:00100000:0.0:1746065207.267389:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265103104 00000100:00100000:0.0:1746065207.267415:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14435 00000100:00100000:0.0:1746065207.267421:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2108:x1830881265103104:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065207.267431:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065207.267449:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1477d88 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9386f0 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.267477:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1477d88 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f0 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.267485:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1477d88 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f0 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.268638:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.268642:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065207.268644:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ca00, rc 0) 00000100:00100000:1.0:1746065207.268669:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2108:x1830881265103104:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1247us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.268675:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14435 00000100:00100000:0.0:1746065207.274232:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.277674:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.277704:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.277718:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.277729:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.277740:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.277762:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.277806:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265103360 00000100:00100000:1.0:1746065207.277812:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265103360 00000100:00100000:1.0:1746065207.277839:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265103488 00000100:00100000:1.0:1746065207.277840:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265103488 00000100:00100000:1.0:1746065207.277851:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265103616 00000100:00100000:1.0:1746065207.277852:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265103616 00000100:00100000:1.0:1746065207.277861:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265103744 00000100:00100000:1.0:1746065207.277862:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265103744 00000100:00100000:1.0:1746065207.277870:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265103872 00000100:00100000:1.0:1746065207.277871:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265103872 00000100:00100000:1.0:1746065207.277879:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265104000 00000100:00100000:1.0:1746065207.277880:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265104000 00000100:00100000:1.0:1746065207.277889:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16890 00000100:00100000:1.0:1746065207.277895:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265103360:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.277908:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.277922:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477d9d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9386f7 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.277939:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.277942:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.277948:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f7 expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.277960:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f7 expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.277969:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3c00, rc 0) 00000100:00100000:1.0:1746065207.277997:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265103360:12345-192.168.202.27@tcp:101:cat.0 Request processed in 103us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.278002:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16890 00000100:00100000:1.0:1746065207.278015:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16891 00000100:00100000:1.0:1746065207.278020:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265103488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.278026:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.278034:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477da4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9386fe expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.278043:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.278044:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.278048:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477da4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386fe expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.278056:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477da4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386fe expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.278062:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3a00, rc 0) 00000100:00100000:1.0:1746065207.278077:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265103488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 57us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.278084:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16891 00000100:00100000:1.0:1746065207.278093:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16892 00000100:00100000:1.0:1746065207.278097:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265103616:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.278102:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.278107:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1477dab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938705 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.278116:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.278117:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.278120:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1477dab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938705 expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.278128:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1477dab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938705 expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.278134:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3e00, rc 0) 00000100:00100000:1.0:1746065207.278147:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265103616:12345-192.168.202.27@tcp:101:cat.0 Request processed in 50us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.278151:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16892 00000100:00100000:1.0:1746065207.278161:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16893 00000100:00100000:1.0:1746065207.278164:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265103744:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.278169:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.278175:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1477db2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93870c expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.278183:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.278185:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.278188:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1477db2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93870c expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.278196:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1477db2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93870c expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.278201:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3200, rc 0) 00000100:00100000:1.0:1746065207.278214:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265103744:12345-192.168.202.27@tcp:101:cat.0 Request processed in 49us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.278219:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16893 00000100:00100000:1.0:1746065207.278227:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16894 00000100:00100000:1.0:1746065207.278230:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265103872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.278235:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.278240:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1477db9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938713 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.278271:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263881600:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065207.278305:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065207.278323:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16895 00000100:00100000:1.0:1746065207.278328:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265104000:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.278333:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.278338:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc1477dc0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93871a expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.278346:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.278347:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.278351:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc1477dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93871a expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.278358:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc1477dc0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93871a expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.278363:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2000, rc 0) 00000100:00100000:1.0:1746065207.278377:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265104000:12345-192.168.202.27@tcp:101:cat.0 Request processed in 50us (614us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.278380:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16895 00000100:00100000:1.0:1746065207.279978:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265104128 00000100:00100000:1.0:1746065207.279984:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265104128 00000100:00100000:1.0:1746065207.280033:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14436 00000100:00100000:1.0:1746065207.280039:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2104:x1830881265104128:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065207.280051:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.280064:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1477dc7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938721 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.280108:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1477dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938721 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.280117:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1477dc7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938721 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.280130:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.280133:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065207.280135:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3800, rc 0) 00000100:00100000:1.0:1746065207.280173:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2104:x1830881265104128:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 134us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.280179:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14436 00000100:00100000:1.0:1746065207.281239:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263881600:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065207.281261:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1477db9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938713 expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.281270:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1477db9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938713 expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.282276:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3600, rc 0) 00000100:00100000:1.0:1746065207.282320:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265103872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4085us (4576us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065207.282327:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16894 00000100:00100000:0.0:1746065207.282998:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.287281:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.288048:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.288150:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265104512 00000100:00100000:1.0:1746065207.288158:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265104512 00000100:00100000:1.0:1746065207.288202:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16896 00000100:00100000:1.0:1746065207.288209:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+32:2104:x1830881265104512:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065207.288223:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.288239:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938728 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.288263:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1477d6c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3137535) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386e2 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.288270:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065207.288272:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065207.288274:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3764224->4161535] (req 3764224->4161535) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.288298:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1477d6c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3137535) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386e2 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.288309:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1477d6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3137535) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386e2 expref: 11 pid: 11461 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.288320:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263881728:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065207.288390:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.289559:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.289592:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.289618:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.289638:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.289652:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265105408 00000100:00100000:0.0:1746065207.289655:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265105408 00002000:00100000:0.0:1746065207.289671:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880135220380 x1830881265105408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.289679:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220380 with x1830881265105408 ext(1048576->2097151) 00002000:00010000:0.0:1746065207.289682:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135220380 00000100:00100000:0.0:1746065207.289694:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5894 00000100:00100000:0.0:1746065207.289698:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265105280:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065207.290194:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263881728:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065207.290212:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3764224->4161535] (req 3764224->4161535) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 35 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.290222:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2a00, rc 0) 00000100:00100000:1.0:1746065207.290238:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2104:x1830881265104512:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2031us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.290244:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16896 00000100:00100000:0.0:1746065207.293300:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.293346:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.293677:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265106176 00000100:00100000:1.0:1746065207.293681:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265106176 00002000:00100000:1.0:1746065207.293699:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880129f41500 x1830881265106176/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.293706:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41500 with x1830881265106176 ext(1048576->2097151) 00002000:00010000:1.0:1746065207.293709:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f41500 00000100:00100000:1.0:1746065207.295684:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5897 00000100:00100000:1.0:1746065207.295695:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265106176:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065207.298295:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265106432 00000100:00100000:1.0:1746065207.298304:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265106432 00002000:00100000:1.0:1746065207.298350:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009834c380 x1830881265106432/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.298359:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834c380 with x1830881265106432 ext(1048576->2097151) 00002000:00010000:1.0:1746065207.298364:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834c380 00000100:00100000:1.0:1746065207.298384:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265106688 00000100:00100000:1.0:1746065207.298386:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265106688 00002000:00100000:1.0:1746065207.298395:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009834dc00 x1830881265106688/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.298401:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834dc00 with x1830881265106688 ext(1048576->2097151) 00002000:00010000:1.0:1746065207.298404:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834dc00 00000100:00100000:0.0:1746065207.298555:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265107072 00000100:00100000:0.0:1746065207.298559:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265107072 00000100:00100000:0.0:1746065207.298581:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5370 00000100:00100000:0.0:1746065207.298585:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2105:x1830881265107072:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065207.298768:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2105:x1830881265107072:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 181us (290us total) trans 8589936899 rc 0/0 00000100:00100000:0.0:1746065207.298795:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5370 00000100:00100000:0.0:1746065207.298814:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265107200 00000100:00100000:0.0:1746065207.298816:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265107200 00002000:00100000:0.0:1746065207.298829:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (3092480->3137535) req@ffff88008f3e7800 x1830881265107200/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.298835:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7800 with x1830881265107200 ext(3092480->3137535) 00010000:00010000:0.0:1746065207.298843:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1477d6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3137535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386e2 expref: 15 pid: 11461 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746065207.298856:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad000/0xad6b7ddc1477d6c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3092480->3137535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386e2 expref: 15 pid: 11461 timeout: 903 lvb_type: 0 00002000:00010000:0.0:1746065207.298863:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3e7800 00000100:00100000:1.0:1746065207.298902:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5899 00000100:00100000:1.0:1746065207.298909:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265106688:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065207.301859:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1948 00000100:00100000:0.0:1746065207.301870:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265107200:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065207.316971:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265105280:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 27262us (27368us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065207.316982:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5894 00002000:00100000:0.0:1746065207.316991:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880135223b80 x1830881265105280/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/440 e 0 to 0 dl 1746065218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.317001:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223b80 with x1830881265105280 ext(1048576->2097151) 00002000:00010000:0.0:1746065207.317005:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135223b80 00000100:00100000:1.0:1746065207.323448:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265106176:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27736us (30080us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065207.323459:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5897 00002000:00100000:1.0:1746065207.323468:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880129f41500 x1830881265106176/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/440 e 0 to 0 dl 1746065218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.323477:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41500 with x1830881265106176 ext(1048576->2097151) 00002000:00010000:1.0:1746065207.323481:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f41500 00000100:00100000:0.0:1746065207.325651:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.327178:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.329025:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265107456 00000100:00100000:1.0:1746065207.329035:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265107456 00000100:00100000:1.0:1746065207.329083:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16897 00000100:00100000:1.0:1746065207.329090:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265107456:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.329106:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.329120:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc1477dd5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93872f expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.329164:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263881984:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065207.329233:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.329535:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.330189:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265106688:12345-192.168.202.27@tcp:3:cat.0 Request processed in 31280us (31957us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065207.330196:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5899 00002000:00100000:1.0:1746065207.330201:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009834dc00 x1830881265106688/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/440 e 0 to 0 dl 1746065218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.330208:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834dc00 with x1830881265106688 ext(1048576->2097151) 00002000:00010000:1.0:1746065207.330211:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834dc00 00000100:00100000:1.0:1746065207.333244:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263881984:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065207.333273:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc1477dd5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93872f expref: 34 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.333286:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2e00/0xad6b7ddc1477dd5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93872f expref: 34 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.333309:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2e00, rc 0) 00000100:00100000:1.0:1746065207.333353:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265107456:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4263us (6176us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065207.333361:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16897 00000100:00100000:0.0:1746065207.337022:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.337102:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265107968 00000100:00100000:1.0:1746065207.337109:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265107968 00002000:00100000:1.0:1746065207.337146:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4157440->4161535) req@ffff880129f40380 x1830881265107968/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.337155:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40380 with x1830881265107968 ext(4157440->4161535) 00002000:00010000:1.0:1746065207.337160:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f40380 00000100:00100000:1.0:1746065207.337178:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5901 00000100:00100000:1.0:1746065207.337184:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265107968:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065207.337298:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265107968:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 114us (284us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065207.337304:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5901 00002000:00100000:1.0:1746065207.337309:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4157440->4161535) req@ffff880129f40380 x1830881265107968/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/4536 e 0 to 0 dl 1746065218 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.337315:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40380 with x1830881265107968 ext(4157440->4161535) 00002000:00010000:1.0:1746065207.337318:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f40380 00000100:00100000:0.0:1746065207.338969:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.339926:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265108096 00000100:00100000:1.0:1746065207.339936:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265108096 00000100:00100000:1.0:1746065207.339988:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16898 00000100:00100000:1.0:1746065207.339995:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2111:x1830881265108096:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.340011:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.340026:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1477ddc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938736 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.340054:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4161535) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.340061:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065207.340063:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065207.340066:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1477ddc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938736 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.340093:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4161535) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.340104:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4161535) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 32 pid: 3067 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.340115:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263882112:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065207.340196:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065207.341284:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263882112:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065207.341301:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1477ddc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938736 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.341311:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3600, rc 0) 00000100:00100000:1.0:1746065207.341335:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2111:x1830881265108096:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1340us (2372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.341341:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16898 00000100:00100000:0.0:1746065207.343099:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.344351:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.344381:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.344567:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265108864 00000100:00100000:1.0:1746065207.344572:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265108864 00002000:00100000:1.0:1746065207.344588:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3764224->4161535) req@ffff880129f43800 x1830881265108864/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.344596:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43800 with x1830881265108864 ext(3764224->4161535) 00010000:00010000:1.0:1746065207.344601:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 34 pid: 3067 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.344610:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 34 pid: 3067 timeout: 903 lvb_type: 0 00002000:00010000:1.0:1746065207.344616:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f43800 00000100:00100000:1.0:1746065207.344628:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1950 00000100:00100000:1.0:1746065207.344633:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881265108864:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065207.344728:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5902 00000100:00100000:1.0:1746065207.344734:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265108608:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065207.364686:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881265108864:12345-192.168.202.27@tcp:4:cat.0 Request processed in 20044us (20296us total) trans 17179874196 rc 0/0 00000100:00100000:1.0:1746065207.364698:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1950 00002000:00100000:1.0:1746065207.364708:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3764224->4161535) req@ffff880129f43800 x1830881265108864/t17179874196(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/448 e 0 to 0 dl 1746065218 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.364717:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43800 with x1830881265108864 ext(3764224->4161535) 00010000:00010000:1.0:1746065207.364725:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 37 pid: 3067 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.364739:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 37 pid: 3067 timeout: 903 lvb_type: 0 00002000:00010000:1.0:1746065207.364746:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f43800 00000100:00100000:1.0:1746065207.366520:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265108608:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21783us (22168us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065207.366527:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5902 00002000:00100000:1.0:1746065207.366532:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880129f41880 x1830881265108608/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/440 e 0 to 0 dl 1746065218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.366540:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41880 with x1830881265108608 ext(2097152->3145727) 00002000:00010000:1.0:1746065207.366543:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f41880 00000100:00100000:0.0:1746065207.370156:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.371563:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265109120 00000100:00100000:1.0:1746065207.371572:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265109120 00002000:00100000:1.0:1746065207.371613:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (4161536->4194303) req@ffff880129f43480 x1830881265109120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.371622:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43480 with x1830881265109120 ext(4161536->4194303) 00010000:00010000:1.0:1746065207.371630:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 35 pid: 3067 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.371643:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3764224->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 35 pid: 3067 timeout: 903 lvb_type: 0 00002000:00010000:1.0:1746065207.371650:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f43480 00000100:00100000:1.0:1746065207.371685:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1951 00000100:00100000:1.0:1746065207.371692:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265109120:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065207.372094:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.375464:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.375522:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265109504 00000100:00100000:1.0:1746065207.375530:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265109504 00000100:00100000:1.0:1746065207.375579:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16899 00000100:00100000:1.0:1746065207.375586:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2108:x1830881265109504:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.375600:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.375614:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1477de3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93873d expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.375637:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065207.375639:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065207.375643:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1477de3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93873d expref: 38 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.375653:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1477de3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93873d expref: 38 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.375662:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c4800, rc 0) 00000100:00100000:1.0:1746065207.376478:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+38:2108:x1830881265109504:12345-192.168.202.27@tcp:101:cat.0 Request processed in 887us (1015us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.376485:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16899 00000100:00100000:1.0:1746065207.380611:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881265109120:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8911us (10454us total) trans 0 rc 32768/32768 00000100:00100000:1.0:1746065207.380621:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1951 00002000:00100000:1.0:1746065207.380631:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (4161536->4194303) req@ffff880129f43480 x1830881265109120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/440 e 0 to 0 dl 1746065218 ref 1 fl Complete:H/200/0 rc 32768/32768 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.380641:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43480 with x1830881265109120 ext(4161536->4194303) 00010000:00010000:1.0:1746065207.380649:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3764224->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 36 pid: 3067 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.380667:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc1477dce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3764224->4161535) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938728 expref: 36 pid: 3067 timeout: 903 lvb_type: 0 00002000:00010000:1.0:1746065207.380675:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f43480 00000100:00100000:0.0:1746065207.384124:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.390652:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.398429:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.398476:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.399497:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5906 00000100:00100000:0.0:1746065207.399510:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265110400:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065207.404553:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.404613:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265110656 00000100:00100000:1.0:1746065207.404621:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265110656 00002000:00100000:1.0:1746065207.405243:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff880129f42d80 x1830881265110656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.405254:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42d80 with x1830881265110656 ext(4194304->4898815) 00002000:00010000:1.0:1746065207.405258:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f42d80 00000100:00100000:1.0:1746065207.405286:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5907 00000100:00100000:1.0:1746065207.405294:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265110656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065207.426546:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.429260:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.432334:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.432373:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.438821:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.438893:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265111680 00000100:00100000:1.0:1746065207.438899:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265111680 00000100:00100000:1.0:1746065207.438944:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16900 00000100:00100000:1.0:1746065207.438951:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2116:x1830881265111680:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065207.438964:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.438978:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1477e0d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93874b expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.438999:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1477d1f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386aa expref: 34 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.439010:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477d9d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f7 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.439016:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.439017:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.439020:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1477e0d lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [847872->1048575] (req 847872->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93874b expref: 17 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.439045:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477d9d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f7 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.439055:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477d9d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f7 expref: 17 pid: 3067 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746065207.439065:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263882496:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065207.439148:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1477d1f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386aa expref: 34 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.439156:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1477d1f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386aa expref: 34 pid: 9548 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746065207.439163:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263882624:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065207.439183:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.444144:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.444177:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065207.445387:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3c00/0xad6b7ddc1477d9d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f7 expref: 16 pid: 3067 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746065207.445415:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263882496:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065207.445425:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac400/0xad6b7ddc1477d1f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386aa expref: 34 pid: 9548 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746065207.445440:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263882624:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065207.445458:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1477e0d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 847872->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93874b expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.445466:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c000, rc 0) 00000100:00100000:1.0:1746065207.445486:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2116:x1830881265111680:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6535us (6673us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.445492:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16900 00000100:00100000:0.0:1746065207.446032:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.446250:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265112064 00000100:00100000:1.0:1746065207.446253:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265112064 00000100:00100000:1.0:1746065207.446323:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16901 00000100:00100000:1.0:1746065207.446328:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265112064:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.446337:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.446345:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1477e14 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938752 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.446364:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263882880:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065207.446408:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.447967:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.452491:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.457447:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.458208:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.458231:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.458336:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265112832 00000100:00100000:0.0:1746065207.458341:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265112832 00010000:00010000:0.0:1746065207.458375:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477da4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386fe expref: 14 pid: 3067 timeout: 903 lvb_type: 1 00000100:00100000:0.0:1746065207.458389:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265112960 00000100:00100000:0.0:1746065207.458391:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265112960 00010000:00010000:0.0:1746065207.458398:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477d26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b1 expref: 25 pid: 9548 timeout: 903 lvb_type: 1 00000100:00100000:0.0:1746065207.458413:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7794 00000100:00100000:0.0:1746065207.458417:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265112832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065207.458423:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065207.458449:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477da4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386fe expref: 14 pid: 3067 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746065207.458457:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477da4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386fe expref: 14 pid: 3067 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746065207.458473:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1477da4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386fe expref: 14 pid: 3067 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746065207.458485:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065207.458499:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265112832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.458505:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7794 00000100:00100000:0.0:1746065207.458517:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7795 00000100:00100000:0.0:1746065207.458521:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265112960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065207.458526:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065207.458532:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477d26 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b1 expref: 25 pid: 9548 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746065207.458539:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477d26 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b1 expref: 25 pid: 9548 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746065207.458549:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477d26 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b1 expref: 25 pid: 9548 timeout: 903 lvb_type: 1 00010000:00010000:0.0:1746065207.458557:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.458558:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.458564:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1477e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938759 expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.458570:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1477e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938759 expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.458591:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1477e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938759 expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065207.458600:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263883264:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065207.458640:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065207.464082:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.464375:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265113216 00000100:00100000:0.0:1746065207.464383:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265113216 00002000:00100000:0.0:1746065207.464421:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x94:0x0] (1097728->1101823) req@ffff88012f1a6a00 x1830881265113216/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.464429:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6a00 with x1830881265113216 ext(1097728->1101823) 00002000:00010000:0.0:1746065207.464460:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a6a00 00000100:00100000:0.0:1746065207.465377:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5910 00000100:00100000:0.0:1746065207.465388:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265113216:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065207.465524:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265113216:12345-192.168.202.27@tcp:3:cat.0 Request processed in 138us (1447us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065207.465530:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5910 00002000:00100000:0.0:1746065207.465536:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x94:0x0] (1097728->1101823) req@ffff88012f1a6a00 x1830881265113216/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/4536 e 0 to 0 dl 1746065218 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.465543:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6a00 with x1830881265113216 ext(1097728->1101823) 00002000:00010000:0.0:1746065207.465546:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a6a00 00000100:00100000:0.0:1746065207.468540:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.474963:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.505857:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.505934:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265114112 00000100:00100000:1.0:1746065207.505941:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265114112 00000100:00100000:1.0:1746065207.505985:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14439 00000100:00100000:1.0:1746065207.505991:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+6:2122:x1830881265114112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065207.506010:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.506024:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1477e45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938767 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.506076:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477e4c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.506087:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.506095:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477e4c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.506104:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc1477e53 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.506109:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc1477e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.506113:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc1477e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.506170:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc1477e5a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.506177:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477d5e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386db expref: 31 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.506182:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc1477e5a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.506208:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477d5e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386db expref: 31 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.506218:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1477d5e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386db expref: 31 pid: 7205 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.506226:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263883392:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065207.506294:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.511940:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.512028:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263883392:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065207.512046:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc1477e5a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512722:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc1477e5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512728:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc1477e5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065207.512768:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:1.0:1746065207.512791:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065207.512807:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc1477e5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512815:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc1477e5a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512824:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477e4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512829:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477e4c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512836:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477e4c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512841:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477e4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512845:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835da00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065207.512848:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477e4c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512853:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477e4c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512861:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065207.512863:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065207.512866:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477e4c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512871:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477e4c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512883:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc1477e53 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512888:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc1477e53 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512892:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc1477e53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512896:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065207.512898:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc1477e53 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512906:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc1477e53 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512912:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009a4b5600) 00010000:00010000:1.0:1746065207.512914:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065207.512916:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc1477e53 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512920:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c600/0xad6b7ddc1477e53 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.512946:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1477e45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938767 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.512956:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc1477e5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938767 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.512961:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.512963:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065207.512964:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c200, rc 0) 00000100:00100000:1.0:1746065207.512989:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+7:2122:x1830881265114112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6998us (7139us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.512994:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14439 00000100:00100000:0.0:1746065207.517626:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.517661:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.517685:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.517698:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.517711:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.517731:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265114368 00000100:00100000:0.0:1746065207.517738:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265114368 00000100:00100000:0.0:1746065207.517768:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265114496 00000100:00100000:1.0:1746065207.520078:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16905 00000100:00100000:1.0:1746065207.520085:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265114752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065207.520092:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.520100:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1477e6f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938783 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.520113:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.520115:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.520119:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1477e6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938783 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.520128:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1477e6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938783 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.520134:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d800, rc 0) 00000100:00100000:0.0:1746065207.520177:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265114496 00000100:00100000:0.0:1746065207.520203:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16906 00000100:00100000:0.0:1746065207.520207:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265114880:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065207.520212:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065207.520217:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1477e76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93878a expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.520224:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.520225:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.520229:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1477e76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93878a expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.520236:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1477e76 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93878a expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.520242:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda600, rc 0) 00000100:00100000:0.0:1746065207.524135:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265114880:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3922us (6417us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.524143:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16906 00000100:00100000:1.0:1746065207.524412:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265114752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4326us (6710us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.524418:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16905 00000100:00100000:1.0:1746065207.525872:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265115008 00000100:00100000:1.0:1746065207.525879:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265115008 00000100:00100000:1.0:1746065207.525914:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16908 00000100:00100000:1.0:1746065207.525920:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265115008:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065207.525933:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.525944:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1477e84 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938791 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.525961:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.525962:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.525968:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1477e84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938791 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.525979:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835d400/0xad6b7ddc1477e84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938791 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.525994:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d400, rc 0) 00000100:00100000:1.0:1746065207.526029:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265115008:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 109us (1154us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.526034:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16908 00000100:00100000:0.0:1746065207.539697:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263883520:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065207.539725:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc1477e61 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93876e expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.539738:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a600/0xad6b7ddc1477e61 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93876e expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.539766:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a600, rc 0) 00000100:00100000:0.0:1746065207.539827:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265114368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 20946us (22207us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065207.539835:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16903 00000100:00100000:0.0:1746065207.556093:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.556176:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265115264 00000100:00100000:1.0:1746065207.556183:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265115264 00000100:00100000:1.0:1746065207.556227:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14440 00000100:00100000:1.0:1746065207.556232:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+7:2122:x1830881265115264:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065207.556247:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.556261:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc1477e8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938798 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.556336:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1477e92 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.556347:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc1477e5a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938767 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.556354:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1477e92 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.556379:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc1477e5a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938767 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.556389:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc1477e5a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938767 expref: 8 pid: 7231 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.556399:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263883776:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065207.556482:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.560267:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.560441:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263883776:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065207.560457:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1477e92 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.561724:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1477e92 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.561731:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1477e92 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065207.561746:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065207.561849:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc1477e8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938798 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.563057:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1477e92 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938798 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.563064:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.563066:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065207.563068:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835de00, rc 0) 00000100:00100000:1.0:1746065207.563103:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2122:x1830881265115264:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6870us (7017us total) trans 8589936906 rc 0/0 00000100:00100000:1.0:1746065207.563108:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14440 00000100:00100000:0.0:1746065207.563833:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.563888:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265115648 00000100:00100000:1.0:1746065207.563893:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265115648 00000100:00100000:1.0:1746065207.563928:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14441 00000100:00100000:1.0:1746065207.563934:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2125:x1830881265115648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.563949:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.563960:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477ea0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93879f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.564006:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477ea7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564015:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564023:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477ea7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564032:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc1477eae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564037:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc1477eae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564041:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc1477eae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564108:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6556e00/0xad6b7ddc1477eb5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564115:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6556e00/0xad6b7ddc1477eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564120:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6556e00/0xad6b7ddc1477eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065207.564125:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065207.564166:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477ea7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564171:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477ea7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564176:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477ea7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564181:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564185:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd3a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065207.564188:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477ea7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564193:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477ea7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564200:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065207.564202:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065207.564204:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477ea7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564208:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc1477ea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564215:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc1477eae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564219:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc1477eae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564222:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc1477eae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564226:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009019ec00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065207.564228:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc1477eae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564235:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc1477eae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564240:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009a4b5600) 00010000:00010000:1.0:1746065207.564242:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065207.564244:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc1477eae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564248:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009019ec00/0xad6b7ddc1477eae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.564270:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835da00/0xad6b7ddc1477ea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93879f expref: 34 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.564278:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6556e00/0xad6b7ddc1477eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93879f expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.564282:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.564284:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065207.564285:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6556e00, rc 0) 00000100:00100000:1.0:1746065207.564315:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2125:x1830881265115648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 380us (482us total) trans 8589936907 rc 0/0 00000100:00100000:1.0:1746065207.564320:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14441 00000100:00100000:0.0:1746065207.566885:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.568048:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.568876:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b22040c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.568893:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265115904 00000100:00100000:0.0:1746065207.568896:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265115904 00000100:00100000:0.0:1746065207.568922:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16909 00000100:00100000:0.0:1746065207.568928:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265115904:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065207.568937:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065207.568947:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc1477ed1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9387ad expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065207.568978:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263884032:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065207.569011:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.571060:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.572006:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.572737:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263883904:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065207.572756:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1477eca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065207.572831:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263884032:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065207.572849:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc1477ed1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387ad expref: 35 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.572859:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc1477ed1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387ad expref: 35 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.572871:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb800, rc 0) 00000100:00100000:0.0:1746065207.572902:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265115904:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3974us (4855us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065207.572909:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16909 00000100:00100000:0.0:1746065207.572927:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265116032 00000100:00100000:0.0:1746065207.572930:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265116032 00000100:00100000:1.0:1746065207.573486:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16910 00000100:00100000:1.0:1746065207.573492:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881265116032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.573501:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.573511:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1477ed8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9387b4 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.573545:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263884160:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065207.573587:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.575910:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.576733:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.576752:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.577024:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263884160:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065207.577041:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1477ed8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387b4 expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.577049:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1477ed8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387b4 expref: 27 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.577055:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae23c00, rc 0) 00000100:00100000:1.0:1746065207.577076:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881265116032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3584us (6020us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065207.577081:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16910 00000100:00100000:1.0:1746065207.577309:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265116672 00000100:00100000:1.0:1746065207.577312:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265116672 00000100:00100000:1.0:1746065207.577337:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16913 00000100:00100000:1.0:1746065207.577341:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265116672:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065207.577346:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.577350:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1477ee6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9387c9 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.577370:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263884672:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065207.577505:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065207.578841:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263884672:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065207.578856:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1477ee6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387c9 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.578864:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1477ee6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387c9 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065207.578871:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c200, rc 0) 00000100:00100000:1.0:1746065207.578888:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265116672:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1546us (2135us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065207.578894:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16913 00000100:00100000:0.0:1746065207.579666:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.581166:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.583392:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.584035:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.584364:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.584900:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.584916:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265117696 00000100:00100000:1.0:1746065207.584919:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265117696 00000100:00100000:1.0:1746065207.584939:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5375 00000100:00100000:1.0:1746065207.584944:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b208450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2122:x1830881265117696:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065207.585042:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b208450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2122:x1830881265117696:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 97us (142us total) trans 8589936908 rc 0/0 00000100:00100000:1.0:1746065207.585047:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5375 00000100:00100000:0.0:1746065207.586680:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263884928:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065207.586700:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc1477f02 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387d7 expref: 35 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.586711:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f6e00, rc 0) 00000100:00100000:0.0:1746065207.586825:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2125:x1830881265117312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2373us (2789us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.586832:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16914 00000100:00100000:1.0:1746065207.587037:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.588340:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.593513:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.594259:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.598316:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263885184:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065207.598328:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263885312:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065207.598335:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263885440:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065207.598359:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc1477f09 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->4636671] (req 4194304->4636671) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387de expref: 36 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.598373:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6c00, rc 0) 00000100:00100000:0.0:1746065207.598420:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2119:x1830881265118208:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4566us (4909us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.598428:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16915 00000100:00100000:1.0:1746065207.598839:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.598871:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.598885:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265118720 00000100:00100000:1.0:1746065207.598888:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265118720 00010000:00010000:1.0:1746065207.598901:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1477e76 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93878a expref: 10 pid: 11461 timeout: 903 lvb_type: 1 00000100:00100000:1.0:1746065207.598924:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265118464 00000100:00100000:1.0:1746065207.598927:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265118464 00010000:00010000:1.0:1746065207.598935:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4800/0xad6b7ddc1477de3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93873d expref: 37 pid: 3067 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.602399:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265118976 00000100:00100000:1.0:1746065207.602410:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265118976 00010000:00010000:1.0:1746065207.602444:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1477ddc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938736 expref: 15 pid: 3067 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.602467:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7805 00000100:00100000:1.0:1746065207.602473:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265118976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065207.602484:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.602499:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1477ddc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938736 expref: 15 pid: 3067 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.602509:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1477ddc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938736 expref: 15 pid: 3067 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.602529:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3600/0xad6b7ddc1477ddc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938736 expref: 15 pid: 3067 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.602543:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.602545:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.602550:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc1477f09 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4636671) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387de expref: 36 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.602557:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc1477f09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4636671) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387de expref: 36 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.602587:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc1477f09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4636671) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387de expref: 36 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.602596:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263885696:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065207.602657:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.607944:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.608006:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263885696:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065207.608020:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.608042:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265118976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5570us (5727us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.608051:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7805 00000100:00100000:0.0:1746065207.611287:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.617200:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.617378:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265119616 00000100:00100000:0.0:1746065207.617386:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265119616 00000100:00100000:0.0:1746065207.617915:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16916 00000100:00100000:0.0:1746065207.617923:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+24:2125:x1830881265119616:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065207.617936:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065207.617948:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc1477f10 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9387e5 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.617975:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1477e1b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938759 expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.617986:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065207.617987:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065207.617990:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc1477f10 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387e5 expref: 25 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.618014:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1477e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938759 expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.618023:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1477e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938759 expref: 10 pid: 3067 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746065207.618033:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263885824:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065207.618107:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.620768:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263885824:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065207.620813:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc1477f10 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387e5 expref: 25 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.620829:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdaa00, rc 0) 00000100:00100000:0.0:1746065207.620864:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+25:2125:x1830881265119616:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2942us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.620872:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16916 00000100:00100000:1.0:1746065207.621425:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.627309:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.627451:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265119872 00000100:00100000:1.0:1746065207.627459:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265119872 00010000:00010000:1.0:1746065207.627488:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1477e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938759 expref: 13 pid: 3067 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.627521:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7806 00000100:00100000:1.0:1746065207.627527:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265119872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065207.627538:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.627552:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1477e1b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938759 expref: 13 pid: 3067 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.627562:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1477e1b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938759 expref: 13 pid: 3067 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.627582:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1477e1b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1101823) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938759 expref: 13 pid: 3067 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.627609:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.627611:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.627617:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc1477f10 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387e5 expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.627625:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc1477f10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387e5 expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.627651:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc1477f10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387e5 expref: 24 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.627661:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263885952:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065207.627736:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065207.629289:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263885952:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065207.629312:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.629351:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265119872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1824us (2047us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.629359:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7806 00000100:00100000:0.0:1746065207.631561:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.654873:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.656198:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.656253:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265120640 00000100:00100000:0.0:1746065207.656257:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265120640 00002000:00100000:0.0:1746065207.656271:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3973119) req@ffff88009aba6680 x1830881265120640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.656278:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba6680 with x1830881265120640 ext(2097152->3973119) 00002000:00010000:0.0:1746065207.656281:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba6680 00000100:00100000:0.0:1746065207.656302:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5916 00000100:00100000:0.0:1746065207.656308:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265120640:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065207.688307:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.688373:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265120896 00000100:00100000:1.0:1746065207.688380:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265120896 00000100:00100000:1.0:1746065207.690214:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14444 00000100:00100000:1.0:1746065207.690226:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2130:x1830881265120896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065207.690249:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065207.690266:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc1477f17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9387ec expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.690331:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1477f1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690343:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1477f1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690353:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1477f1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690365:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc1477f25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690370:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc1477f25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690374:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc1477f25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690466:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc1477f2c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690474:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc1477f2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690479:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc1477f2c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065207.690487:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065207.690549:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1477f1e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690557:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1477f1e lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690562:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1477f1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690567:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1477f1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690571:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065207.690574:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1477f1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690579:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1477f1e lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690589:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065207.690591:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065207.690594:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1477f1e lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690599:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1477f1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690623:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc1477f25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690627:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc1477f25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690631:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc1477f25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690634:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065207.690636:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc1477f25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690640:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc1477f25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690645:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009a4b5600) 00010000:00010000:1.0:1746065207.690647:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065207.690649:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc1477f25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690653:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc1477f25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065207.690679:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4600/0xad6b7ddc1477f17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387ec expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.690687:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc1477f2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387ec expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.690692:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.690694:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065207.690695:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5c00, rc 0) 00000100:00100000:1.0:1746065207.690743:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2130:x1830881265120896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 521us (2443us total) trans 8589936910 rc 0/0 00000100:00100000:1.0:1746065207.690749:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14444 00000100:00100000:0.0:1746065207.692228:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.692257:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265121152 00000100:00100000:0.0:1746065207.692262:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265121152 00002000:00100000:0.0:1746065207.692290:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4636672->4898815) req@ffff880097a6dc00 x1830881265121152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.692298:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6dc00 with x1830881265121152 ext(4636672->4898815) 00002000:00010000:0.0:1746065207.692302:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6dc00 00000100:00100000:0.0:1746065207.698271:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.698291:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265121280 00000100:00100000:0.0:1746065207.698305:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265121280 00000100:00100000:0.0:1746065207.698344:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16917 00000100:00100000:0.0:1746065207.698349:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265121280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065207.698362:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065207.698375:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46800/0xad6b7ddc1477f3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9387f3 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.698395:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.698397:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.698404:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46800/0xad6b7ddc1477f3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387f3 expref: 15 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.698416:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46800/0xad6b7ddc1477f3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387f3 expref: 15 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065207.698424:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46800, rc 0) 00000100:00100000:0.0:1746065207.698448:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265121280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 99us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.698453:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16917 00000100:00100000:1.0:1746065207.698481:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.698490:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.698500:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265121408 00000100:00100000:0.0:1746065207.698503:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265121408 00000100:00100000:0.0:1746065207.701645:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.704263:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.704309:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.704329:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265122048 00000100:00100000:0.0:1746065207.704334:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265122048 00000100:00100000:1.0:1746065207.704398:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265122176 00000100:00100000:1.0:1746065207.704402:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265122176 00010000:00010000:1.0:1746065207.704426:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1477eca lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387a6 expref: 9 pid: 13395 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.704462:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7807 00000100:00100000:1.0:1746065207.704467:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265122176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065207.704476:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.704480:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1477eca lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387a6 expref: 9 pid: 13395 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.704488:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1477eca lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387a6 expref: 9 pid: 13395 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.704504:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.704508:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1477f48 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065207.704516:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1477f48 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065207.704520:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.704836:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2006:x1830881265122176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 367us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.704842:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7807 00010000:00010000:0.0:1746065207.704853:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc1477f2c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387ec expref: 18 pid: 7231 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746065207.704873:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7808 00000100:00100000:0.0:1746065207.704878:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265122048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065207.705157:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065207.705162:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc1477f2c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387ec expref: 18 pid: 7231 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746065207.705170:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc1477f2c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387ec expref: 18 pid: 7231 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746065207.705181:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc1477f2c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387ec expref: 18 pid: 7231 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746065207.705192:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065207.705194:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1477f48 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065207.705201:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1477f48 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065207.705206:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1477f48 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065207.705257:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065207.705668:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881265122048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 789us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.705674:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7808 00000100:00100000:1.0:1746065207.718539:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.718563:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.718588:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.718608:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265122432 00000100:00100000:1.0:1746065207.718614:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265122432 00000100:00100000:1.0:1746065207.718646:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5377 00000100:00100000:1.0:1746065207.718652:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2125:x1830881265122432:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065207.718803:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2125:x1830881265122432:12345-192.168.202.27@tcp:35:cat.0 Request processed in 151us (270us total) trans 8589936912 rc 0/0 00000100:00100000:1.0:1746065207.718808:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5377 00000100:00100000:0.0:1746065207.744409:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.744507:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.747267:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.748658:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.752470:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.752539:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.752646:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265123840 00000100:00100000:1.0:1746065207.752651:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265123840 00000100:00100000:1.0:1746065207.752679:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 829 00000100:00100000:1.0:1746065207.752684:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265123840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065207.752698:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.752715:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc1477f8e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938824 expref: 36 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.752797:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.752800:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.752822:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265123840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 137us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.752828:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 829 00000100:00100000:0.0:1746065207.756950:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065207.756967:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263886976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065207.757012:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065207.757656:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263886976:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746065207.768509:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265123712:12345-192.168.202.27@tcp:4:cat.0 Request processed in 15820us (16035us total) trans 17179874198 rc 0/0 00000100:00100000:1.0:1746065207.768518:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1954 00002000:00100000:1.0:1746065207.768528:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4636671) req@ffff880097fa0000 x1830881265123712/t17179874198(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/448 e 0 to 0 dl 1746065218 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.768537:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0000 with x1830881265123712 ext(4194304->4636671) 00010000:00010000:1.0:1746065207.768546:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc1477f09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4636671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387de expref: 37 pid: 12258 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.768557:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc1477f09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4636671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387de expref: 37 pid: 12258 timeout: 903 lvb_type: 0 00002000:00010000:1.0:1746065207.768563:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa0000 00000100:00100000:0.0:1746065207.776025:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.777480:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265124096 00000100:00100000:1.0:1746065207.777489:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265124096 00002000:00100000:1.0:1746065207.777528:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3973120->4194303) req@ffff880097fa1180 x1830881265124096/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.777539:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1180 with x1830881265124096 ext(3973120->4194303) 00010000:00010000:1.0:1746065207.777548:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc1477edf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387bb expref: 25 pid: 12258 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.777561:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc1477edf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387bb expref: 25 pid: 12258 timeout: 903 lvb_type: 0 00002000:00010000:1.0:1746065207.777567:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa1180 00000100:00100000:1.0:1746065207.777590:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1955 00000100:00100000:1.0:1746065207.777596:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265124096:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065207.778020:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.779004:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265124224 00000100:00100000:1.0:1746065207.779009:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265124224 00010000:00010000:1.0:1746065207.779032:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc1477f09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4636671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387de expref: 37 pid: 12258 timeout: 903 lvb_type: 0 00000100:00100000:1.0:1746065207.779051:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7809 00000100:00100000:1.0:1746065207.779057:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265124224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065207.779067:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.779081:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc1477f09 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4636671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387de expref: 37 pid: 12258 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.779091:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc1477f09 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4636671) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387de expref: 37 pid: 12258 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.779110:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc1477f09 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4636671) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387de expref: 37 pid: 12258 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.779125:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.779127:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.779132:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1477f9c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93882b expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.779139:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1477f9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93882b expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.779163:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1477f9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93882b expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.779173:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263887232:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065207.780067:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065207.784648:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265124096:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7045us (8624us total) trans 21474841603 rc 0/0 00000100:00100000:1.0:1746065207.784658:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1955 00002000:00100000:1.0:1746065207.784668:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3973120->4194303) req@ffff880097fa1180 x1830881265124096/t21474841603(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/448 e 0 to 0 dl 1746065218 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.784678:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1180 with x1830881265124096 ext(3973120->4194303) 00010000:00010000:1.0:1746065207.784688:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc1477edf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387bb expref: 27 pid: 12258 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.784706:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c1a600/0xad6b7ddc1477edf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3973120->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387bb expref: 27 pid: 12258 timeout: 903 lvb_type: 0 00002000:00010000:1.0:1746065207.784712:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa1180 00000100:00100000:0.0:1746065207.792615:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.793031:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265124480 00000100:00100000:1.0:1746065207.793039:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265124480 00002000:00100000:1.0:1746065207.793071:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880097fa2d80 x1830881265124480/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.793080:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2d80 with x1830881265124480 ext(2097152->3145727) 00002000:00010000:1.0:1746065207.793085:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa2d80 00000100:00100000:1.0:1746065207.793112:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5920 00000100:00100000:1.0:1746065207.793119:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265124480:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065207.803177:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.803835:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265124480:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10716us (11226us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065207.803841:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5920 00002000:00100000:1.0:1746065207.803846:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880097fa2d80 x1830881265124480/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/440 e 0 to 0 dl 1746065218 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.803852:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa2d80 with x1830881265124480 ext(2097152->3145727) 00002000:00010000:1.0:1746065207.803855:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa2d80 00000100:00100000:1.0:1746065207.812681:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265125120 00000100:00100000:1.0:1746065207.812690:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265125120 00002000:00100000:1.0:1746065207.812727:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2301951) req@ffff88009834e300 x1830881265125120/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.812736:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834e300 with x1830881265125120 ext(2097152->2301951) 00002000:00010000:1.0:1746065207.812741:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834e300 00000100:00100000:1.0:1746065207.815343:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265125376 00000100:00100000:1.0:1746065207.815355:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265125376 00002000:00100000:1.0:1746065207.815396:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2379776->3145727) req@ffff88009834e680 x1830881265125376/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065207.815405:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834e680 with x1830881265125376 ext(2379776->3145727) 00002000:00010000:1.0:1746065207.815410:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834e680 00000100:00100000:0.0:1746065207.815901:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5923 00000100:00100000:0.0:1746065207.815911:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265125376:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065207.816702:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.816909:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.823517:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265125376:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 7607us (10962us total) trans 0 rc 765952/765952 00000100:00100000:0.0:1746065207.823524:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5923 00002000:00100000:0.0:1746065207.823530:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2379776->3145727) req@ffff88009834e680 x1830881265125376/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:123/0 lens 488/440 e 0 to 0 dl 1746065218 ref 1 fl Complete:/200/0 rc 765952/765952 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065207.823536:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834e680 with x1830881265125376 ext(2379776->3145727) 00002000:00010000:0.0:1746065207.823539:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834e680 00000100:00100000:0.0:1746065207.849353:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.867010:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.867073:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265126400 00000100:00100000:1.0:1746065207.867080:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265126400 00000100:00100000:1.0:1746065207.867131:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5378 00000100:00100000:1.0:1746065207.867138:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2130:x1830881265126400:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065207.867342:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2130:x1830881265126400:12345-192.168.202.27@tcp:35:cat.0 Request processed in 203us (340us total) trans 8589936914 rc 0/0 00000100:00100000:1.0:1746065207.867348:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5378 00000100:00100000:0.0:1746065207.876103:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065207.876514:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc200/0xad6b7ddc1477fa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2908159) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938832 expref: 13 pid: 9548 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746065207.876531:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263887488:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065207.876607:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065207.879892:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263887488:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065207.879914:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc1477faa lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2981888->3145727] (req 2981888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938839 expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065207.879929:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc400, rc 0) 00000100:00100000:3.0:1746065207.879964:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2135:x1830881265126528:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3582us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065207.879971:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16925 00000100:00100000:1.0:1746065207.880845:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.895024:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.895073:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265126784 00000100:00100000:0.0:1746065207.895080:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265126784 00010000:00010000:0.0:1746065207.895107:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc200/0xad6b7ddc1477fa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2301952->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938832 expref: 16 pid: 9548 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746065207.895137:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7811 00000100:00100000:0.0:1746065207.895143:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265126784:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065207.895156:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065207.895169:0:7192:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065207 -> 1746065208 00002000:00010000:0.0:1746065207.895171:0:7192:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065207 -> 1746065208 00002000:00010000:0.0:1746065207.895173:0:7192:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065207 -> 1746065208 00010000:00010000:0.0:1746065207.895178:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc200/0xad6b7ddc1477fa3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2301952->2908159) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938832 expref: 16 pid: 9548 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746065207.895188:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc200/0xad6b7ddc1477fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2301952->2908159) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938832 expref: 16 pid: 9548 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746065207.895206:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc200/0xad6b7ddc1477fa3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2301952->2908159) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938832 expref: 16 pid: 9548 timeout: 903 lvb_type: 0 00010000:00010000:0.0:1746065207.895228:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.895229:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065207.895235:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc1477faa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938839 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.895242:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc1477faa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938839 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065207.895268:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc1477faa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938839 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065207.895278:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263887616:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065207.897620:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065207.900738:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.901130:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263887616:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065207.901149:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.901185:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265126784:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6041us (6165us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.901197:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7811 00000100:00100000:0.0:1746065207.907240:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065207.908463:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265127168 00000100:00100000:3.0:1746065207.908545:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265127168 00000100:00100000:3.0:1746065207.908952:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16926 00000100:00100000:3.0:1746065207.908961:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2135:x1830881265127168:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065207.908982:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065207.909003:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1477fb1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938840 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065207.909039:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1477f9c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93882b expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065207.909047:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065207.909049:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065207.909052:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1477fb1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->3874815] (req 3145728->3874815) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938840 expref: 37 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065207.909089:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1477f9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93882b expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065207.909101:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1477f9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93882b expref: 15 pid: 9548 timeout: 903 lvb_type: 0 00000100:00100000:3.0:1746065207.909113:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263887744:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065207.909685:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065207.912174:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263887744:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065207.912203:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1477fb1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->3874815] (req 3145728->3874815) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938840 expref: 37 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065207.912220:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3ddc00, rc 0) 00000100:00100000:3.0:1746065207.912268:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2135:x1830881265127168:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3307us (5040us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065207.912276:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16926 00000100:00100000:0.0:1746065207.916653:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.916747:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265127296 00000100:00100000:1.0:1746065207.916866:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265127296 00000100:00100000:0.0:1746065207.916886:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1746065207.916900:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263887872:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1746065207.916912:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1477f9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93882b expref: 16 pid: 9548 timeout: 903 lvb_type: 0 00000100:00100000:0.0:1746065207.916938:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065207.916977:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263887872 00000100:00100000:0.0:1746065207.916983:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263887872 00000100:00100000:1.0:1746065207.917005:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7812 00000100:00100000:1.0:1746065207.917014:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265127296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065207.917056:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:0.0:1746065207.917062:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263887872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746065207.917079:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1068549568 pending 2703360 free 3910598656 avail 3679076352 00000100:00100000:0.0:1746065207.917108:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263887872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065207.917112:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00000100:00100000:0.0:1746065207.917143:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263887872:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1746065207.917293:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.917315:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1477f9c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93882b expref: 16 pid: 9548 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.917494:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1477f9c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93882b expref: 16 pid: 9548 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.917521:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1477f9c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93882b expref: 16 pid: 9548 timeout: 903 lvb_type: 0 00010000:00010000:1.0:1746065207.917859:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.917862:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065207.917869:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1477fb1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938840 expref: 36 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.917877:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1477fb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938840 expref: 36 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.917909:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1477fb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938840 expref: 36 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065207.917920:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263888000:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065207.918990:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065207.920597:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263888000:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065207.920618:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.920657:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265127296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3643us (4009us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.920669:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7812 00000100:00100000:0.0:1746065207.928849:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065207.930380:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265127552 00000100:00100000:3.0:1746065207.930395:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265127552 00002000:00100000:3.0:1746065207.930465:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (3870720->3874815) req@ffff880097a6f480 x1830881265127552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/0 e 0 to 0 dl 1746065218 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065207.930477:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6f480 with x1830881265127552 ext(3870720->3874815) 00002000:00010000:3.0:1746065207.930483:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6f480 00000100:00100000:3.0:1746065207.930585:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5928 00000100:00100000:3.0:1746065207.930594:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265127552:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065207.930763:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265127552:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 169us (1925us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065207.930769:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5928 00002000:00100000:3.0:1746065207.932055:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (3870720->3874815) req@ffff880097a6f480 x1830881265127552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:123/0 lens 488/4536 e 0 to 0 dl 1746065218 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065207.932066:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6f480 with x1830881265127552 ext(3870720->3874815) 00002000:00010000:3.0:1746065207.932071:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6f480 00000100:00100000:0.0:1746065207.940520:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.940915:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265127808 00000100:00100000:1.0:1746065207.940929:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265127808 00000100:00100000:1.0:1746065207.941285:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5379 00000100:00100000:1.0:1746065207.941294:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2135:x1830881265127808:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065207.941557:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2135:x1830881265127808:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 263us (1044us total) trans 8589936915 rc 0/0 00000100:00100000:1.0:1746065207.941563:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5379 00000100:00100000:0.0:1746065207.960924:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.969185:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065207.970308:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265128192 00000100:00100000:1.0:1746065207.970317:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265128192 00000100:00100000:1.0:1746065207.970377:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 830 00000100:00100000:1.0:1746065207.970386:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881265128192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065207.970398:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065207.970419:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f4d9000/0xad6b7ddc1477fcd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938847 expref: 38 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065207.970455:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065207.970459:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065207.970514:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881265128192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 129us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065207.970520:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 830 00000100:00100000:0.0:1746065207.981972:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.983021:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065207.984142:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5930 00000100:00100000:0.0:1746065207.984156:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265128704:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065207.991379:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.011986:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.012025:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.012480:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.012502:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265129344 00000100:00100000:1.0:1746065208.012505:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265129344 00000100:00100000:1.0:1746065208.012524:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265129600 00000100:00100000:1.0:1746065208.012526:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265129600 00000100:00100000:1.0:1746065208.012550:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16928 00000100:00100000:1.0:1746065208.012554:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265129600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065208.012560:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.012570:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477ffe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93885c expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.012605:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263888128:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065208.013857:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.015319:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.015384:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265129472 00000100:00100000:0.0:1746065208.015394:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265129472 00000100:00100000:0.0:1746065208.015446:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 831 00000100:00100000:0.0:1746065208.015452:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265129472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065208.015463:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065208.016096:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1477ff0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93884e expref: 20 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.016122:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065208.016126:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065208.016159:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881265129472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 707us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.016165:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 831 00000100:00100000:1.0:1746065208.020126:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881263888128:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065208.020146:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477ffe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93885c expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.020155:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc1477ffe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93885c expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.020166:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ae00, rc 0) 00000100:00100000:1.0:1746065208.020192:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265129600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7636us (7711us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065208.020199:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16928 00000100:00100000:0.0:1746065208.027394:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.027475:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265129856 00000100:00100000:3.0:1746065208.027483:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265129856 00000100:00100000:3.0:1746065208.027525:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5380 00000100:00100000:3.0:1746065208.027531:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2142:x1830881265129856:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065208.027695:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2142:x1830881265129856:12345-192.168.202.27@tcp:35:cat.0 Request processed in 164us (308us total) trans 8589936918 rc 0/0 00000100:00100000:3.0:1746065208.027701:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5380 00000100:00100000:0.0:1746065208.037009:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.037061:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.037149:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265129984 00000100:00100000:1.0:1746065208.037157:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265129984 00000100:00100000:1.0:1746065208.037191:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265130112 00000100:00100000:1.0:1746065208.037193:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265130112 00000100:00100000:1.0:1746065208.037219:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16929 00000100:00100000:1.0:1746065208.037226:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265129984:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065208.037242:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.037256:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc147800c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938863 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.037301:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263888384:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065208.037371:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d640c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.037802:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16930 00000100:00100000:0.0:1746065208.037810:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265130112:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065208.037817:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.037825:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478013 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93886a expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065208.037849:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263888512:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065208.037883:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.047184:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881263888384:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065208.047213:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc147800c lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938863 expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.047226:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b000/0xad6b7ddc147800c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938863 expref: 16 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.047238:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b000, rc 0) 00000100:00100000:1.0:1746065208.047278:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265129984:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10051us (10276us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065208.047286:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16929 00000100:00100000:1.0:1746065208.051319:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.056139:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.060349:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.068206:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265130752 00000100:00100000:0.0:1746065208.068211:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265130752 00000100:00100000:0.0:1746065208.068237:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 832 00000100:00100000:0.0:1746065208.068242:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265130752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065208.068251:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065208.068270:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478036 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938878 expref: 22 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.068292:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065208.068295:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065208.068315:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265130752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.068321:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 832 00000100:00100000:1.0:1746065208.076417:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.076442:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.076541:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265131392 00000100:00100000:3.0:1746065208.076547:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265131392 00000100:00100000:3.0:1746065208.076581:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16932 00000100:00100000:3.0:1746065208.076587:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2148:x1830881265131392:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065208.076601:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.076614:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938886 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.076637:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc1477faa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938839 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.076648:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065208.076650:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065208.076653:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3354624->3502079] (req 3354624->3502079) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 16 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.076677:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc1477faa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938839 expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.076685:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc1477faa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938839 expref: 26 pid: 9548 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.076694:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263888768:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065208.076758:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265131264 00000100:00100000:0.0:1746065208.076762:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265131264 00000100:00100000:0.0:1746065208.076803:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14450 00000100:00100000:0.0:1746065208.076808:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2150:x1830881265131264:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065208.076820:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.076829:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc147804b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93887f expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.076879:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478052 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.076888:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.076897:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.076907:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478059 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.076913:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.076918:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.076993:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779c00/0xad6b7ddc1478060 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.077001:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095779c00/0xad6b7ddc1478060 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.077006:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095779c00/0xad6b7ddc1478060 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065208.077013:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000100:00100000:3.0:1746065208.077891:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4540 going to sleep for 11 seconds 00010000:00010000:3.0:1746065208.078832:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.078840:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478052 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.078845:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478052 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.078849:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065208.078852:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478052 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.078857:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478052 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.078872:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065208.078874:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065208.078877:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478052 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.078881:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478052 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.078907:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.078912:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478059 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.078916:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478059 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.078921:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065208.078923:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478059 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.078927:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478059 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.079314:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5df00) 00010000:00010000:3.0:1746065208.079317:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065208.079319:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478059 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.079323:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478059 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.079361:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5400/0xad6b7ddc147804b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93887f expref: 41 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.079373:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779c00/0xad6b7ddc1478060 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93887f expref: 40 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.079379:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065208.079381:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065208.079382:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779c00, rc 0) 00000100:00100000:3.0:1746065208.080047:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2150:x1830881265131264:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3238us (3604us total) trans 8589936921 rc 0/0 00000100:00100000:3.0:1746065208.080053:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14450 00000100:00100000:0.0:1746065208.080294:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065208.083003:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065208.086336:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.086388:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265131648 00000100:00100000:1.0:1746065208.086396:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265131648 00000100:00100000:1.0:1746065208.086460:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 833 00000100:00100000:1.0:1746065208.086468:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265131648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.086480:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.086500:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779c00/0xad6b7ddc1478060 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93887f expref: 40 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.086525:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.086529:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.086560:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881265131648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.086566:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 833 00000100:00100000:0.0:1746065208.092821:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.092889:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265131776 00000100:00100000:3.0:1746065208.092896:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265131776 00010000:00010000:3.0:1746065208.092927:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1477fb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938840 expref: 39 pid: 9548 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.092958:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7813 00000100:00100000:3.0:1746065208.092964:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881265131776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.092979:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.092995:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1477fb1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938840 expref: 39 pid: 9548 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.093032:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1477fb1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938840 expref: 39 pid: 9548 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.093052:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1477fb1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938840 expref: 39 pid: 9548 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.093080:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.093082:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.093088:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc147801a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938871 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.093096:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc147801a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938871 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.093123:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc147801a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938871 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.093135:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263888896:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065208.095034:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.098335:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.098399:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265131904 00000100:00100000:1.0:1746065208.098407:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265131904 00010000:00010000:1.0:1746065208.098444:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc1477faa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938839 expref: 29 pid: 9548 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.098473:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7814 00000100:00100000:1.0:1746065208.098479:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265131904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.098489:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.098505:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc1477faa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938839 expref: 29 pid: 9548 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.098515:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc1477faa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938839 expref: 29 pid: 9548 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.098520:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263888896:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065208.098536:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.098567:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881265131776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5602us (5752us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.098573:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7813 00010000:00010000:1.0:1746065208.098712:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc400/0xad6b7ddc1477faa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938839 expref: 29 pid: 9548 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.098736:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.098738:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.098745:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.098752:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.098800:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.098811:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263889024:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065208.100466:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d640c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.107878:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.108913:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263889024:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065208.108930:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.108964:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265131904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10485us (10636us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.108972:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7814 00000100:00100000:1.0:1746065208.117454:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.118257:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265132416 00000100:00100000:0.0:1746065208.118266:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265132416 00002000:00100000:0.0:1746065208.118302:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3354624->3358719) req@ffff880098dd8a80 x1830881265132416/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065208.118310:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8a80 with x1830881265132416 ext(3354624->3358719) 00002000:00010000:0.0:1746065208.118315:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8a80 00000100:00100000:0.0:1746065208.118540:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5933 00000100:00100000:0.0:1746065208.118547:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265132416:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065208.118797:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265132416:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 249us (1349us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065208.118803:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5933 00002000:00100000:0.0:1746065208.118809:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3354624->3358719) req@ffff880098dd8a80 x1830881265132416/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/4536 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065208.118817:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8a80 with x1830881265132416 ext(3354624->3358719) 00002000:00010000:0.0:1746065208.118819:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8a80 00000100:00100000:0.0:1746065208.119354:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.122595:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.122729:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263889152:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.122748:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3817472->4194303] (req 3817472->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.122760:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73a00, rc 0) 00000100:00100000:3.0:1746065208.123404:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2150:x1830881265132544:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3442us (4049us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.123411:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16933 00000100:00100000:0.0:1746065208.129944:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.129992:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.130083:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265133056 00000100:00100000:1.0:1746065208.130091:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265133056 00002000:00100000:1.0:1746065208.130128:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3354624->3502079) req@ffff880097fa0380 x1830881265133056/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.130143:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0380 with x1830881265133056 ext(3354624->3502079) 00010000:00010000:1.0:1746065208.130151:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 16 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.130163:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 16 pid: 3067 timeout: 904 lvb_type: 0 00002000:00010000:1.0:1746065208.130170:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa0380 00000100:00100000:1.0:1746065208.130201:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265133184 00000100:00100000:1.0:1746065208.130204:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265133184 00002000:00100000:1.0:1746065208.130215:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880097fa1c00 x1830881265133184/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.130221:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1c00 with x1830881265133184 ext(2097152->3145727) 00010000:00010000:1.0:1746065208.130225:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 17 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.130234:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 17 pid: 3067 timeout: 904 lvb_type: 0 00002000:00010000:1.0:1746065208.130239:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa1c00 00000100:00100000:1.0:1746065208.130353:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1961 00000100:00100000:1.0:1746065208.130360:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265133184:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065208.131286:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.132297:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265133568 00000100:00100000:3.0:1746065208.132304:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265133568 00002000:00100000:3.0:1746065208.132333:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012f1a7b80 x1830881265133568/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.132342:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7b80 with x1830881265133568 ext(3145728->4194303) 00002000:00010000:3.0:1746065208.132346:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7b80 00000100:00100000:3.0:1746065208.132369:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5934 00000100:00100000:3.0:1746065208.132376:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265133568:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065208.135628:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265133056:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 5374us (5690us total) trans 21474841606 rc 0/0 00000100:00100000:3.0:1746065208.135635:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1960 00002000:00100000:3.0:1746065208.135641:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3354624->3502079) req@ffff880097fa0380 x1830881265133056/t21474841606(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/448 e 0 to 0 dl 1746065219 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.135648:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0380 with x1830881265133056 ext(3354624->3502079) 00010000:00010000:3.0:1746065208.135653:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 21 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.135662:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 21 pid: 3067 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746065208.135667:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa0380 00000100:00100000:1.0:1746065208.138226:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265133184:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 7860us (8227us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065208.138234:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1961 00002000:00100000:1.0:1746065208.138243:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880097fa1c00 x1830881265133184/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.138251:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1c00 with x1830881265133184 ext(2097152->3145727) 00010000:00010000:1.0:1746065208.138259:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 19 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.138269:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 19 pid: 3067 timeout: 904 lvb_type: 0 00002000:00010000:1.0:1746065208.138275:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa1c00 00000100:00100000:3.0:1746065208.141584:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265133568:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9200us (10292us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065208.141596:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5934 00002000:00100000:3.0:1746065208.141605:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012f1a7b80 x1830881265133568/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.141613:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7b80 with x1830881265133568 ext(3145728->4194303) 00002000:00010000:3.0:1746065208.141618:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7b80 00000100:00100000:0.0:1746065208.146571:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.146691:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265133824 00000100:00100000:1.0:1746065208.146702:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265133824 00010000:00010000:1.0:1746065208.146734:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 19 pid: 3067 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.146768:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7815 00000100:00100000:1.0:1746065208.146797:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2007:x1830881265133824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.146809:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.146825:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 19 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.146835:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 19 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.146852:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc1478044 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3354624->3502079) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938886 expref: 19 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.146886:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.146888:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.146895:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.146902:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.146911:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.146912:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.146915:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1478075 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938894 expref: 18 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.146921:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1478075 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938894 expref: 18 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.146947:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1478075 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938894 expref: 18 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.146958:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263889280:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065208.147041:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.147049:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263889408:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065208.147068:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.148591:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263889280:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065208.148600:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263889408:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065208.148612:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.148647:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2007:x1830881265133824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1872us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.148655:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7815 00000100:00100000:0.0:1746065208.149030:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.149630:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265134080 00000100:00100000:3.0:1746065208.149635:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265134080 00002000:00100000:3.0:1746065208.149663:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3817472->3821567) req@ffff880097a6ca80 x1830881265134080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.149672:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ca80 with x1830881265134080 ext(3817472->3821567) 00002000:00010000:3.0:1746065208.149676:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6ca80 00000100:00100000:3.0:1746065208.149700:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5935 00000100:00100000:3.0:1746065208.149706:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265134080:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065208.150402:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265134080:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 693us (1370us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065208.150408:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5935 00002000:00100000:3.0:1746065208.150414:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (3817472->3821567) req@ffff880097a6ca80 x1830881265134080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/4536 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.150420:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ca80 with x1830881265134080 ext(3817472->3821567) 00002000:00010000:3.0:1746065208.150423:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6ca80 00000100:00100000:0.0:1746065208.150731:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.150786:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265134336 00000100:00100000:3.0:1746065208.150790:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265134336 00002000:00100000:3.0:1746065208.150804:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880097a6e300 x1830881265134336/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.150816:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6e300 with x1830881265134336 ext(2097152->3145727) 00002000:00010000:3.0:1746065208.150819:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6e300 00000100:00100000:3.0:1746065208.150836:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5936 00000100:00100000:3.0:1746065208.150841:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265134336:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065208.160002:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.160315:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265134336:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9471us (9583us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065208.160324:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5936 00002000:00100000:3.0:1746065208.160333:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880097a6e300 x1830881265134336/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.160341:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6e300 with x1830881265134336 ext(2097152->3145727) 00002000:00010000:3.0:1746065208.160346:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6e300 00000100:00100000:0.0:1746065208.167166:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.167420:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.168187:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265134720 00000100:00100000:1.0:1746065208.168192:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265134720 00010000:00010000:1.0:1746065208.168210:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc147801a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938871 expref: 17 pid: 3067 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.168228:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7816 00000100:00100000:1.0:1746065208.168233:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265134720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.168241:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.168256:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc147801a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938871 expref: 17 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.168265:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc147801a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938871 expref: 17 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.168277:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73600/0xad6b7ddc147801a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938871 expref: 17 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.168289:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.168290:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.168293:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 38 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.168303:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 38 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.168325:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 38 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.168333:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263889664:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065208.168381:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.170664:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263889664:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065208.170679:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.170746:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265134720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2511us (3325us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.170755:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7816 00000100:00100000:0.0:1746065208.170796:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.170838:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265134976 00000100:00100000:3.0:1746065208.170843:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265134976 00002000:00100000:3.0:1746065208.170969:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (4218880->4222975) req@ffff88013615f800 x1830881265134976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.170978:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615f800 with x1830881265134976 ext(4218880->4222975) 00002000:00010000:3.0:1746065208.170981:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013615f800 00000100:00100000:3.0:1746065208.171009:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5937 00000100:00100000:3.0:1746065208.171015:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881265134976:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065208.171099:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881265134976:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 85us (325us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065208.171105:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5937 00002000:00100000:3.0:1746065208.171110:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (4218880->4222975) req@ffff88013615f800 x1830881265134976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/4536 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.171116:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615f800 with x1830881265134976 ext(4218880->4222975) 00002000:00010000:3.0:1746065208.171118:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013615f800 00000100:00100000:0.0:1746065208.171701:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.172706:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265135232 00000100:00100000:1.0:1746065208.172711:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265135232 00002000:00100000:1.0:1746065208.172733:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88013615f480 x1830881265135232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.172740:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615f480 with x1830881265135232 ext(3145728->4194303) 00002000:00010000:1.0:1746065208.172744:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013615f480 00000100:00100000:1.0:1746065208.172770:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5938 00000100:00100000:1.0:1746065208.172796:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265135232:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065208.174109:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.174307:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265135488 00000100:00100000:3.0:1746065208.174312:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265135488 00000100:00100000:3.0:1746065208.174352:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5382 00000100:00100000:3.0:1746065208.174359:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2150:x1830881265135488:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065208.174542:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2150:x1830881265135488:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 183us (436us total) trans 8589936922 rc 0/0 00000100:00100000:3.0:1746065208.174548:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5382 00000100:00100000:1.0:1746065208.181059:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265135232:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8255us (9350us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065208.181073:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5938 00002000:00100000:1.0:1746065208.181084:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88013615f480 x1830881265135232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.181094:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615f480 with x1830881265135232 ext(3145728->4194303) 00002000:00010000:1.0:1746065208.181100:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013615f480 00000100:00100000:0.0:1746065208.186855:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.187793:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265135616 00000100:00100000:3.0:1746065208.187802:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265135616 00000100:00100000:3.0:1746065208.187851:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16937 00000100:00100000:3.0:1746065208.187858:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2145:x1830881265135616:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.187872:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.187889:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc147808a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9388a9 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.187914:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.187921:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065208.187922:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065208.187925:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc147808a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388a9 expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.187954:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.187964:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 28 pid: 3067 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.187974:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263889792:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065208.188684:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.190860:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263889792:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.190884:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc147808a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388a9 expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.190897:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046c00, rc 0) 00000100:00100000:3.0:1746065208.190965:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2145:x1830881265135616:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3106us (4118us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.190974:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16937 00000100:00100000:0.0:1746065208.191196:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.191263:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265135744 00000100:00100000:1.0:1746065208.191268:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265135744 00002000:00100000:1.0:1746065208.191299:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3817472->4194303) req@ffff88013615df80 x1830881265135744/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.191308:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615df80 with x1830881265135744 ext(3817472->4194303) 00010000:00010000:1.0:1746065208.191313:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 29 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.191325:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 29 pid: 3067 timeout: 904 lvb_type: 0 00002000:00010000:1.0:1746065208.191330:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013615df80 00000100:00100000:1.0:1746065208.191420:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1962 00000100:00100000:1.0:1746065208.191435:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265135744:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065208.195461:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265135744:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 4027us (4258us total) trans 21474841607 rc 0/0 00000100:00100000:1.0:1746065208.195471:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1962 00002000:00100000:1.0:1746065208.195480:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3817472->4194303) req@ffff88013615df80 x1830881265135744/t21474841607(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/448 e 0 to 0 dl 1746065219 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.195494:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615df80 with x1830881265135744 ext(3817472->4194303) 00010000:00010000:1.0:1746065208.195503:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 31 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.195515:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 31 pid: 3067 timeout: 904 lvb_type: 0 00002000:00010000:1.0:1746065208.195521:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013615df80 00000100:00100000:0.0:1746065208.202285:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.202333:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265135872 00000100:00100000:1.0:1746065208.202340:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265135872 00010000:00010000:1.0:1746065208.202485:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 31 pid: 3067 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.202521:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7817 00000100:00100000:1.0:1746065208.202528:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265135872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.202539:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.202555:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 31 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.202566:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 31 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.202584:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73a00/0xad6b7ddc147806e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3817472->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93888d expref: 31 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.202646:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.202648:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.202654:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc147808a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388a9 expref: 18 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.202662:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc147808a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388a9 expref: 18 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.202691:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131046c00/0xad6b7ddc147808a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388a9 expref: 18 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.202702:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263889920:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065208.202788:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.205563:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263889920:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065208.205578:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.205618:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265135872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3091us (3339us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.205626:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7817 00000100:00100000:0.0:1746065208.210285:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.210459:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265136128 00000100:00100000:1.0:1746065208.210467:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265136128 00002000:00100000:1.0:1746065208.210502:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88013615ca80 x1830881265136128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.210511:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615ca80 with x1830881265136128 ext(3145728->4194303) 00002000:00010000:1.0:1746065208.210515:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615ca80 00000100:00100000:1.0:1746065208.210546:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5939 00000100:00100000:1.0:1746065208.210553:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265136128:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065208.219408:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265136128:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8848us (9123us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065208.219418:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5939 00002000:00100000:1.0:1746065208.219434:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88013615ca80 x1830881265136128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.219442:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615ca80 with x1830881265136128 ext(3145728->4194303) 00002000:00010000:1.0:1746065208.219447:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615ca80 00000100:00100000:0.0:1746065208.223882:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.224147:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265136256 00000100:00100000:3.0:1746065208.224156:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265136256 00000100:00100000:3.0:1746065208.224206:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16938 00000100:00100000:3.0:1746065208.224213:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265136256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.224228:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.224243:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478091 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9388b0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.224288:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263890048:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065208.225433:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.226080:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263890048:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065208.226103:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478091 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388b0 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.226115:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478091 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388b0 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.226128:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5200, rc 0) 00000100:00100000:3.0:1746065208.226169:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265136256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1956us (2292us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065208.226175:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16938 00000100:00100000:0.0:1746065208.228718:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.228796:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265136384 00000100:00100000:3.0:1746065208.228802:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265136384 00000100:00100000:3.0:1746065208.229168:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16939 00000100:00100000:3.0:1746065208.229176:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2145:x1830881265136384:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.229192:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.229204:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc1478098 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9388b7 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.229226:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 38 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.229232:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065208.229234:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065208.229238:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc1478098 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388b7 expref: 17 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.229260:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 38 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.229270:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 38 pid: 12258 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.229280:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263890176:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065208.229348:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.231302:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263890176:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.231324:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc1478098 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->4898815] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388b7 expref: 17 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.231337:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5800, rc 0) 00000100:00100000:3.0:1746065208.231637:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2145:x1830881265136384:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2461us (2924us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.231644:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16939 00000100:00100000:0.0:1746065208.231881:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.232717:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265136512 00000100:00100000:1.0:1746065208.232723:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265136512 00002000:00100000:1.0:1746065208.232755:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4222975) req@ffff88013615fb80 x1830881265136512/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.232764:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615fb80 with x1830881265136512 ext(4194304->4222975) 00010000:00010000:1.0:1746065208.232788:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 39 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.232801:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 39 pid: 12258 timeout: 904 lvb_type: 0 00002000:00010000:1.0:1746065208.232806:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013615fb80 00000100:00100000:1.0:1746065208.232831:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1963 00000100:00100000:1.0:1746065208.232838:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881265136512:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065208.247656:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265136512:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 14810us (15767us total) trans 17179874200 rc 0/0 00000100:00100000:1.0:1746065208.247669:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1963 00002000:00100000:1.0:1746065208.247682:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4222975) req@ffff88013615fb80 x1830881265136512/t17179874200(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/448 e 0 to 0 dl 1746065219 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.247691:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615fb80 with x1830881265136512 ext(4194304->4222975) 00010000:00010000:1.0:1746065208.247700:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 41 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.247715:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 41 pid: 12258 timeout: 904 lvb_type: 0 00002000:00010000:1.0:1746065208.247722:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013615fb80 00000100:00100000:0.0:1746065208.250524:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.250746:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265136640 00000100:00100000:1.0:1746065208.250754:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265136640 00010000:00010000:1.0:1746065208.250870:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 41 pid: 12258 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.251375:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7818 00000100:00100000:1.0:1746065208.251384:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265136640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.251394:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.251411:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 41 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.251421:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 41 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.251451:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2c400/0xad6b7ddc147807c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4222975) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93889b expref: 41 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.252364:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.252367:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.252375:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc1478098 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388b7 expref: 16 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.252384:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc1478098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388b7 expref: 16 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.252415:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc1478098 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388b7 expref: 16 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.252435:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263890304:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065208.253269:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.254530:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.254796:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265136896 00000100:00100000:3.0:1746065208.254804:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265136896 00000100:00100000:3.0:1746065208.255531:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14451 00000100:00100000:3.0:1746065208.255539:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2154:x1830881265136896:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065208.255557:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.255573:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc147809f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9388be expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.255630:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc14780a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255641:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc14780a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255648:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc14780a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255657:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc14780ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255662:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc14780ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255666:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc14780ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255732:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc14780b4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255738:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc14780b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255743:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc14780b4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065208.255749:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065208.255827:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc14780a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255833:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc14780a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255841:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc14780a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255845:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993e600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065208.255848:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc14780a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255854:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc14780a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255862:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065208.255864:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065208.255867:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc14780a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255872:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc14780a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255887:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc14780ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255891:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc14780ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255896:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc14780ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255899:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993fa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065208.255901:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc14780ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255904:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc14780ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255913:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5700) 00010000:00010000:3.0:1746065208.255914:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065208.255916:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc14780ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255920:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993fa00/0xad6b7ddc14780ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.255947:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc147809f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388be expref: 24 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.255957:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc14780b4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388be expref: 23 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.255962:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065208.255964:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065208.255966:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f800, rc 0) 00000100:00100000:3.0:1746065208.256000:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2154:x1830881265136896:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 461us (1473us total) trans 8589936923 rc 0/0 00000100:00100000:3.0:1746065208.256005:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14451 00000100:00100000:0.0:1746065208.259394:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.259708:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263890304:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065208.259723:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.259762:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265136640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8380us (9244us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.259770:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7818 00000100:00100000:1.0:1746065208.261055:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265137408 00000100:00100000:1.0:1746065208.261059:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265137408 00000100:00100000:1.0:1746065208.261085:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14452 00000100:00100000:1.0:1746065208.261090:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2157:x1830881265137408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065208.261104:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.261117:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc14780c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9388c5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.261170:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc14780c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261181:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc14780c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261190:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc14780c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261199:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c000/0xad6b7ddc14780d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261204:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c000/0xad6b7ddc14780d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261208:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c000/0xad6b7ddc14780d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261276:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc14780d7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261284:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc14780d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261289:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc14780d7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065208.261295:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065208.261345:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc14780c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261354:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc14780c9 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261358:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc14780c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261363:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc14780c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261368:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3d600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065208.261371:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc14780c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261377:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc14780c9 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261386:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065208.261388:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065208.261392:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc14780c9 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261397:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc14780c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261414:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c000/0xad6b7ddc14780d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261419:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c000/0xad6b7ddc14780d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261422:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c000/0xad6b7ddc14780d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261434:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065208.261437:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c000/0xad6b7ddc14780d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261440:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c000/0xad6b7ddc14780d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261446:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a9bccd00) 00010000:00010000:1.0:1746065208.261448:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065208.261449:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c000/0xad6b7ddc14780d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261453:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c000/0xad6b7ddc14780d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.261480:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc14780c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388c5 expref: 43 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.261490:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc14780d7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388c5 expref: 42 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.261495:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.261497:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065208.261499:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c600, rc 0) 00000100:00100000:1.0:1746065208.261523:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2157:x1830881265137408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 433us (2138us total) trans 8589936924 rc 0/0 00000100:00100000:1.0:1746065208.261528:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14452 00000100:00100000:0.0:1746065208.262878:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.262922:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.263237:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265137792 00000100:00100000:1.0:1746065208.263244:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265137792 00000100:00100000:1.0:1746065208.263266:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 834 00000100:00100000:1.0:1746065208.263271:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265137792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.263282:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.263295:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc14780b4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388be expref: 25 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.263306:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.263308:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.263468:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265137792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 195us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.263474:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 834 00000100:00100000:3.0:1746065208.267025:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.267551:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.267848:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.267961:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265138048 00000100:00100000:0.0:1746065208.267965:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265138048 00000100:00100000:0.0:1746065208.267983:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265138176 00000100:00100000:0.0:1746065208.267984:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265138176 00000100:00100000:0.0:1746065208.267995:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16940 00000100:00100000:0.0:1746065208.268000:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265138048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065208.268011:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.268022:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc14780e5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9388cc expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.268039:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.268041:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.268048:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc14780e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388cc expref: 41 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.268060:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc14780e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388cc expref: 41 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.268067:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5600, rc 0) 00000100:00100000:3.0:1746065208.268255:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16941 00000100:00100000:3.0:1746065208.268261:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265138176:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.268268:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.268276:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac600/0xad6b7ddc14780ec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9388d3 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.268286:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.268287:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.268292:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac600/0xad6b7ddc14780ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388d3 expref: 31 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.268300:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac600/0xad6b7ddc14780ec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388d3 expref: 31 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.268306:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac600, rc 0) 00000100:00100000:0.0:1746065208.268400:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265138048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 399us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.268412:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16940 00000100:00100000:3.0:1746065208.268468:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265138176:12345-192.168.202.27@tcp:101:cat.0 Request processed in 207us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.268472:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16941 00000100:00100000:0.0:1746065208.273826:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.273910:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265138432 00000100:00100000:3.0:1746065208.273919:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265138432 00000100:00100000:3.0:1746065208.273965:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5384 00000100:00100000:3.0:1746065208.273972:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2145:x1830881265138432:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065208.274123:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2145:x1830881265138432:12345-192.168.202.27@tcp:35:cat.0 Request processed in 151us (351us total) trans 8589936926 rc 0/0 00000100:00100000:3.0:1746065208.274130:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5384 00000100:00100000:0.0:1746065208.292978:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.301055:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265138944 00000100:00100000:1.0:1746065208.301063:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265138944 00002000:00100000:1.0:1746065208.301101:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009834ea00 x1830881265138944/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.301111:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834ea00 with x1830881265138944 ext(2097152->4194303) 00002000:00010000:1.0:1746065208.301116:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834ea00 00000100:00100000:1.0:1746065208.301147:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5942 00000100:00100000:1.0:1746065208.301155:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265138944:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065208.319481:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265138944:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18318us (18514us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065208.319492:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5942 00002000:00100000:1.0:1746065208.319501:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009834ea00 x1830881265138944/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.319510:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834ea00 with x1830881265138944 ext(2097152->4194303) 00002000:00010000:1.0:1746065208.319516:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834ea00 00000100:00100000:0.0:1746065208.321106:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.321156:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265139200 00000100:00100000:1.0:1746065208.321163:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265139200 00002000:00100000:1.0:1746065208.321204:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff880091b65880 x1830881265139200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.321213:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65880 with x1830881265139200 ext(4194304->4898815) 00002000:00010000:1.0:1746065208.321217:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65880 00000100:00100000:1.0:1746065208.321244:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5943 00000100:00100000:1.0:1746065208.321250:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265139200:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065208.327296:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265139200:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6037us (6186us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746065208.327306:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5943 00002000:00100000:1.0:1746065208.327315:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff880091b65880 x1830881265139200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.327323:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65880 with x1830881265139200 ext(4194304->4898815) 00002000:00010000:1.0:1746065208.327329:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65880 00000100:00100000:0.0:1746065208.330422:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.338639:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.338673:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.338688:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.338724:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.338759:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265139456 00000100:00100000:0.0:1746065208.338766:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265139456 00010000:00010000:0.0:1746065208.338815:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478083 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388a2 expref: 19 pid: 12258 timeout: 904 lvb_type: 0 00000100:00100000:0.0:1746065208.338837:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265139840 00000100:00100000:0.0:1746065208.338839:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265139840 00010000:00010000:0.0:1746065208.338845:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc1478098 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388b7 expref: 20 pid: 3067 timeout: 904 lvb_type: 0 00000100:00100000:0.0:1746065208.338856:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265139968 00000100:00100000:0.0:1746065208.338857:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265139968 00010000:00010000:0.0:1746065208.338863:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc14780e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388cc expref: 41 pid: 3067 timeout: 904 lvb_type: 1 00000100:00100000:0.0:1746065208.338874:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7819 00000100:00100000:0.0:1746065208.338879:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265139456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065208.338889:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065208.338904:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478083 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388a2 expref: 20 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.338916:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478083 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388a2 expref: 20 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.338933:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478083 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->4194303] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388a2 expref: 19 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.338944:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065208.338960:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2007:x1830881265139456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.339135:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265139712 00000100:00100000:3.0:1746065208.339139:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265139712 00000100:00100000:3.0:1746065208.339164:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5385 00000100:00100000:3.0:1746065208.339169:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2157:x1830881265139712:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065208.339514:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2157:x1830881265139712:12345-192.168.202.27@tcp:35:cat.0 Request processed in 345us (882us total) trans 8589936927 rc 0/0 00000100:00100000:3.0:1746065208.339523:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5385 00000100:00100000:0.0:1746065208.339963:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7819 00000100:00100000:1.0:1746065208.340001:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7821 00000100:00100000:1.0:1746065208.340009:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265139968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.340017:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.340027:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc14780e5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388cc expref: 41 pid: 3067 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.340035:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc14780e5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388cc expref: 41 pid: 3067 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.340047:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc14780e5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388cc expref: 41 pid: 3067 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.340059:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.340076:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265139968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.340082:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7821 00000100:00100000:0.0:1746065208.345875:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.351052:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.351218:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265140224 00000100:00100000:3.0:1746065208.351227:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265140224 00010000:00010000:3.0:1746065208.351257:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1478075 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938894 expref: 21 pid: 3067 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.351283:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7822 00000100:00100000:3.0:1746065208.351289:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265140224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.351300:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.351318:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1478075 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938894 expref: 21 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.351328:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc1478075 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938894 expref: 21 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.351348:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.351381:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265140224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.351387:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7822 00000100:00100000:0.0:1746065208.352613:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.354890:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.360767:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.360835:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265140736 00000100:00100000:1.0:1746065208.360842:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265140736 00002000:00100000:1.0:1746065208.360879:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2502656->2506751) req@ffff880091b66d80 x1830881265140736/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.360887:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66d80 with x1830881265140736 ext(2502656->2506751) 00002000:00010000:1.0:1746065208.360892:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b66d80 00000100:00100000:1.0:1746065208.360924:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5944 00000100:00100000:1.0:1746065208.360930:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265140736:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065208.361057:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265140736:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 126us (297us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065208.361063:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5944 00002000:00100000:1.0:1746065208.361072:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x96:0x0] (2502656->2506751) req@ffff880091b66d80 x1830881265140736/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/4536 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.361079:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66d80 with x1830881265140736 ext(2502656->2506751) 00002000:00010000:1.0:1746065208.361081:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b66d80 00000100:00100000:0.0:1746065208.376273:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.376714:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265140864 00000100:00100000:3.0:1746065208.376722:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265140864 00000100:00100000:3.0:1746065208.376798:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14453 00000100:00100000:3.0:1746065208.376810:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2161:x1830881265140864:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065208.376832:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.376848:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc1478101 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9388e8 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.376903:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc1478108 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.376915:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc1478108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.376923:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac400/0xad6b7ddc1478108 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.376935:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc147810f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.376939:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc147810f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.376944:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc147810f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.377000:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478116 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.377010:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1477f48 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938808 expref: 23 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.377016:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478116 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.377041:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1477f48 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938808 expref: 23 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.377052:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1477f48 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938808 expref: 23 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.377072:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263891456:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065208.378460:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.381740:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263891456:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.381765:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478116 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065208.381860:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.382680:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265141120 00000100:00100000:3.0:1746065208.382688:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265141120 00000100:00100000:3.0:1746065208.382742:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5386 00000100:00100000:3.0:1746065208.382749:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:30397:x1830881265141120:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065208.383207:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:30397:x1830881265141120:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 457us (1346us total) trans 8589936928 rc 0/0 00000100:00100000:3.0:1746065208.383214:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5386 00000100:00100000:0.0:1746065208.385094:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.390836:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.390859:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.390870:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.390893:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.390946:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265141376 00000100:00100000:0.0:1746065208.390955:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265141376 00000100:00100000:0.0:1746065208.390992:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265141504 00000100:00100000:0.0:1746065208.390994:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265141504 00000100:00100000:0.0:1746065208.391004:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265141632 00000100:00100000:0.0:1746065208.391006:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265141632 00000100:00100000:0.0:1746065208.391014:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265141760 00000100:00100000:0.0:1746065208.391016:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265141760 00000100:00100000:0.0:1746065208.391028:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16944 00000100:00100000:0.0:1746065208.391034:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265141376:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065208.391051:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.391065:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147811d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9388ef expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.391085:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.391087:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.391094:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147811d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388ef expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.391107:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147811d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388ef expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.391116:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97e00, rc 0) 00000100:00100000:0.0:1746065208.391158:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265141376:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 124us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.391165:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16944 00000100:00100000:0.0:1746065208.391178:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16945 00000100:00100000:0.0:1746065208.391181:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265141504:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065208.391187:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.391195:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478124 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9388f6 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.391204:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.391205:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.391209:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478124 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388f6 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.391217:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478124 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388f6 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.391224:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96600, rc 0) 00000100:00100000:0.0:1746065208.391238:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265141504:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 56us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.391242:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16945 00000100:00100000:0.0:1746065208.391250:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16946 00000100:00100000:0.0:1746065208.391254:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265141632:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065208.391259:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.391265:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc147812b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9388fd expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065208.391296:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263891584:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065208.391377:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16947 00000100:00100000:3.0:1746065208.391384:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265141760:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065208.391390:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.391397:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc1478132 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938904 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.391419:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263891712:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065208.392175:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.392224:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.394988:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263891712:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065208.395008:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc1478132 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938904 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.395017:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc1478132 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938904 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.395028:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad000, rc 0) 00000100:00100000:3.0:1746065208.395050:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265141760:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3667us (4156us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065208.395055:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16947 00000100:00100000:0.0:1746065208.398088:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.404099:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.404344:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265142144 00000100:00100000:3.0:1746065208.404351:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265142144 00010000:00010000:3.0:1746065208.404380:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478116 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e8 expref: 11 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.404403:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7826 00000100:00100000:3.0:1746065208.404408:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265142144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.404418:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.404434:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478116 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e8 expref: 11 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.404444:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478116 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e8 expref: 11 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.404465:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478116 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e8 expref: 11 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.404489:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065208.404493:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1478140 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.404502:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1478140 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.404507:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1478140 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.404524:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.404566:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265142144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 157us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.404572:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7826 00010000:00010000:0.0:1746065208.405653:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1478140 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.405663:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1478140 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065208.405678:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065208.405838:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc1478139 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93890b expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.405870:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1478140 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93890b expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.405877:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.405880:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065208.405882:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1c00, rc 0) 00000100:00100000:1.0:1746065208.405916:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2161:x1830881265142016:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 7273us (7837us total) trans 8589936929 rc 0/0 00000100:00100000:1.0:1746065208.405922:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14454 00000100:00100000:0.0:1746065208.408989:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.409045:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265142400 00000100:00100000:1.0:1746065208.409053:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265142400 00000100:00100000:1.0:1746065208.409107:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14455 00000100:00100000:1.0:1746065208.409113:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2161:x1830881265142400:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065208.409135:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.409137:0:13395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065208.409158:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1c00/0xad6b7ddc1478140 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93890b expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.409171:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.409175:0:13395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065208.409184:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147814e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938912 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.409259:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc1478155 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.409274:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc1478155 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.409281:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc1478155 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065208.409290:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065208.409364:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147814e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938912 expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.409375:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc1478155 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938912 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.409381:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.409383:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065208.409384:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3da00, rc 0) 00000100:00100000:1.0:1746065208.409436:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2161:x1830881265142400:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 311us (442us total) trans 8589936930 rc 0/0 00000100:00100000:1.0:1746065208.409442:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14455 00000100:00100000:0.0:1746065208.410678:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.410741:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265142528 00000100:00100000:1.0:1746065208.410746:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265142528 00000100:00100000:1.0:1746065208.412226:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14456 00000100:00100000:1.0:1746065208.412239:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2161:x1830881265142528:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065208.412258:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.413353:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc1478163 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938919 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.413407:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc1478163 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938919 expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.413419:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc1478163 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938919 expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.413446:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.413449:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065208.413452:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d600, rc 0) 00000100:00100000:1.0:1746065208.413509:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2161:x1830881265142528:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1275us (2836us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.413516:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14456 00000100:00100000:0.0:1746065208.415925:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.415959:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.415977:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.415997:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.416010:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.416032:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.416222:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265143296 00000100:00100000:0.0:1746065208.416225:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265143296 00000100:00100000:3.0:1746065208.416592:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16949 00000100:00100000:3.0:1746065208.416601:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265142912:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065208.416623:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc1478171 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.416634:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1477d2d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b8 expref: 29 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.416640:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a200/0xad6b7ddc1477e68 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93877c expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.416647:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1477dab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938705 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.416653:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.416654:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.416655:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc1478171 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065208.416673:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16950 00010000:00010000:3.0:1746065208.416675:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1477dab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938705 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065208.416679:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265143168:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065208.416682:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1477dab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938705 expref: 17 pid: 3067 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.416689:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263892224:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065208.416696:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.416706:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc14780f3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388da expref: 15 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.416712:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065208.416713:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065208.416715:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.416717:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1a200/0xad6b7ddc1477e68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93877c expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.416724:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c1a200/0xad6b7ddc1477e68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93877c expref: 12 pid: 13375 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.416729:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc14780f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388da expref: 15 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.416731:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263892352:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065208.416737:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc14780f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388da expref: 15 pid: 12258 timeout: 904 lvb_type: 0 00000100:00100000:0.0:1746065208.416745:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263892480:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.416750:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1477d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b8 expref: 29 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.416758:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1477d2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b8 expref: 29 pid: 1880 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.416764:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263892608:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065208.416768:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.416796:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.416823:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16951 00000100:00100000:3.0:1746065208.416829:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265142784:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065208.416846:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.416855:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc1477f10 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387e5 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.416861:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478124 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388f6 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.416867:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c51a400/0xad6b7ddc1477f4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387fa expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.416871:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.416872:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.416874:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 6/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.416888:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c51a400/0xad6b7ddc1477f4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387fa expref: 17 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.416895:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c51a400/0xad6b7ddc1477f4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387fa expref: 17 pid: 9548 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.416901:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263892736:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.416920:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16952 00010000:00010000:3.0:1746065208.416928:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478124 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388f6 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065208.416933:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16953 00010000:00010000:3.0:1746065208.416938:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478124 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388f6 expref: 12 pid: 12260 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.416939:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265143296:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:3.0:1746065208.416944:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263892864:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.416956:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.416965:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc14780fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e1 expref: 17 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.416970:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065208.416971:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065208.416973:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.416978:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc1477f10 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387e5 expref: 29 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.416984:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc1477f10 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387e5 expref: 29 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.416987:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc14780fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e1 expref: 17 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.416991:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263892992:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.416998:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc14780fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e1 expref: 17 pid: 12258 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.417005:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.417005:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263893120:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.417025:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.417039:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265143040:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065208.417051:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.417058:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2e00/0xad6b7ddc1477d34 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386bf expref: 39 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.417070:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1477e6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938783 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.417077:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1477db2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93870c expref: 15 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.417081:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.417082:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.417084:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.417095:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1477db2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93870c expref: 15 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.417106:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1477db2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93870c expref: 15 pid: 3067 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.417113:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263893248:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.417132:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1477e6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938783 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.417138:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1477e6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938783 expref: 12 pid: 9550 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.417144:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263893376:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.417157:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b2e00/0xad6b7ddc1477d34 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386bf expref: 39 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.417163:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2e00/0xad6b7ddc1477d34 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386bf expref: 39 pid: 1880 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.417169:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263893504:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.417178:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.421152:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263892224:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065208.421325:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263892352:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.421367:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263892480:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065208.421382:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263892992:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.421388:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.421442:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263893248:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.421451:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263893376:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.421458:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263893504:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.421472:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065208.421657:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263893120:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065208.421669:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065208.421976:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.422010:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.422093:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265143552 00000100:00100000:1.0:1746065208.422097:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265143552 00002000:00100000:1.0:1746065208.422127:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (2981888->3145727) req@ffff880091aa4a80 x1830881265143552/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.422134:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa4a80 with x1830881265143552 ext(2981888->3145727) 00010000:00010000:1.0:1746065208.422140:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc14780f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388da expref: 16 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.422148:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc14780f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388da expref: 16 pid: 12258 timeout: 904 lvb_type: 0 00002000:00010000:1.0:1746065208.422154:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091aa4a80 00000100:00100000:1.0:1746065208.422183:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1964 00000100:00100000:1.0:1746065208.422189:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265143552:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065208.422367:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265143424 00000100:00100000:3.0:1746065208.422372:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265143424 00010000:00010000:3.0:1746065208.422389:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1a200/0xad6b7ddc1477e68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93877c expref: 13 pid: 13375 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.422407:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7827 00000100:00100000:3.0:1746065208.422412:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265143424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.422420:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.422444:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1a200/0xad6b7ddc1477e68 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93877c expref: 13 pid: 13375 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.422453:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1a200/0xad6b7ddc1477e68 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93877c expref: 13 pid: 13375 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.422470:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a200/0xad6b7ddc1477e68 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93877c expref: 13 pid: 13375 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.422486:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.422509:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265143424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.422515:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7827 00000100:00100000:3.0:1746065208.428476:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263892608:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.428505:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc1478171 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.429929:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263892736:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065208.429939:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263892864:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.429958:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.431739:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265144704 00000100:00100000:1.0:1746065208.431749:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265144704 00010000:00010000:1.0:1746065208.431770:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478124 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388f6 expref: 12 pid: 12260 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.431815:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265144832 00000100:00100000:1.0:1746065208.431819:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265144832 00010000:00010000:1.0:1746065208.431828:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51a400/0xad6b7ddc1477f4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387fa expref: 17 pid: 9548 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.431840:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7835 00000100:00100000:1.0:1746065208.431845:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265144704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.431853:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.431867:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478124 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388f6 expref: 12 pid: 12260 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.431874:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478124 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388f6 expref: 12 pid: 12260 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.431890:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478124 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388f6 expref: 12 pid: 12260 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.431978:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7836 00000100:00100000:3.0:1746065208.431986:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265144832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.431994:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.432003:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c51a400/0xad6b7ddc1477f4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387fa expref: 17 pid: 9548 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.432011:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c51a400/0xad6b7ddc1477f4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387fa expref: 17 pid: 9548 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.432023:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51a400/0xad6b7ddc1477f4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9387fa expref: 17 pid: 9548 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.432036:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.432038:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.432041:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.432048:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.432064:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065208.432077:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.432085:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.432097:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.432104:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.432114:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.432119:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b21f5600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065208.432121:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.432127:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.432134:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.432139:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b21f5600/0xad6b7ddc147817f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.432177:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265142784:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 15348us (16179us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.432184:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16951 00000100:00100000:3.0:1746065208.432208:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265144832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 224us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.432213:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7836 00000100:00100000:0.0:1746065208.432324:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.432376:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.432397:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7837 00000100:00100000:0.0:1746065208.432403:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265145088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065208.432410:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065208.432417:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1477d2d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b8 expref: 29 pid: 1880 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.432437:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1477d2d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b8 expref: 29 pid: 1880 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.432448:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2a00/0xad6b7ddc1477d2d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386b8 expref: 29 pid: 1880 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.432460:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.432461:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.432463:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc1478171 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.432469:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718200/0xad6b7ddc1478171 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.432486:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065208.432502:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265145088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 100us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.432507:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7837 00000100:00100000:0.0:1746065208.432583:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265144576 00000100:00100000:0.0:1746065208.432586:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265144576 00010000:00010000:1.0:1746065208.432598:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:0.0:1746065208.432607:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2506751) req@ffff880091b64000 x1830881265144576/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065208.432614:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265144704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 769us (2224us total) trans 0 rc 0/0 00002000:00100000:0.0:1746065208.432615:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64000 with x1830881265144576 ext(2097152->2506751) 00000100:00100000:1.0:1746065208.432619:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7835 00010000:00010000:0.0:1746065208.432621:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc14780fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e1 expref: 16 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.432629:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc14780fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e1 expref: 16 pid: 12258 timeout: 904 lvb_type: 0 00002000:00010000:0.0:1746065208.432635:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091b64000 00000100:00100000:0.0:1746065208.432646:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1965 00010000:00010000:1.0:1746065208.432649:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065208.432651:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265144576:12345-192.168.202.27@tcp:4:multiop.0 00010000:00010000:1.0:1746065208.432655:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.432665:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.432670:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.432676:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.432680:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3cc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065208.432682:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.432688:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.432695:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.432700:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3cc00/0xad6b7ddc147818d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.433201:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265143040:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 16274us (17189us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.433207:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16952 00000100:00100000:1.0:1746065208.434593:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265143552:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 12399us (12576us total) trans 17179874201 rc 0/0 00000100:00100000:1.0:1746065208.434602:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1964 00002000:00100000:1.0:1746065208.434610:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (2981888->3145727) req@ffff880091aa4a80 x1830881265143552/t17179874201(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/448 e 0 to 0 dl 1746065219 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.434618:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa4a80 with x1830881265143552 ext(2981888->3145727) 00010000:00010000:1.0:1746065208.434624:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc14780f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388da expref: 16 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.434633:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc14780f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388da expref: 16 pid: 12258 timeout: 904 lvb_type: 0 00002000:00010000:1.0:1746065208.434638:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091aa4a80 00000100:00100000:0.0:1746065208.437084:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.439146:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265145216 00000100:00100000:3.0:1746065208.439155:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265145216 00010000:00010000:3.0:1746065208.439183:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc14780f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388da expref: 16 pid: 12258 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.439213:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7839 00000100:00100000:3.0:1746065208.439218:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265145216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.439229:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.439243:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc14780f3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388da expref: 16 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.439252:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc14780f3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388da expref: 16 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.439269:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0200/0xad6b7ddc14780f3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2981888->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388da expref: 16 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.439281:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.439282:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.439286:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.439293:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.439313:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.439363:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265145216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 143us (2284us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.439369:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7839 00010000:00010000:1.0:1746065208.439627:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.439635:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.439649:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.439655:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.439660:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.439669:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065208.439672:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.439679:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.439689:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.439694:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96c00/0xad6b7ddc1478178 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.439729:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881265143168:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 23050us (23751us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.439736:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16950 00000100:00100000:0.0:1746065208.442184:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.442235:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265145344 00000100:00100000:1.0:1746065208.442241:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265145344 00010000:00010000:1.0:1746065208.442260:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc14780fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e1 expref: 18 pid: 12258 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.442288:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7840 00000100:00100000:1.0:1746065208.442293:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2007:x1830881265145344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.442301:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.442313:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc14780fa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e1 expref: 18 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.442322:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc14780fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e1 expref: 18 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.442337:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1600/0xad6b7ddc14780fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9388e1 expref: 18 pid: 12258 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.442347:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.442349:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.442352:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.442358:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.442377:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.442409:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2007:x1830881265145344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 116us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.442414:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7840 00010000:00010000:0.0:1746065208.442548:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.442557:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.442576:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.442582:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.442589:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.442594:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065208.442597:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.442603:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.442613:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.442618:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1478186 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065208.442661:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881265143296:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 25722us (26627us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.442668:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16953 00000100:00100000:1.0:1746065208.447210:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265145600 00000100:00100000:1.0:1746065208.447217:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265145600 00000100:00100000:1.0:1746065208.447263:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14457 00000100:00100000:1.0:1746065208.447269:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2161:x1830881265145600:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:1.0:1746065208.447302:0:13395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.447321:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d600/0xad6b7ddc1478163 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938919 expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.447337:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.447340:0:13395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065208.447358:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.447367:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc1477d8f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386e9 expref: 23 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.447374:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dca00/0xad6b7ddc1477e37 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938760 expref: 41 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.447379:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1477d50 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386d4 expref: 23 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.447384:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1477d88 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f0 expref: 41 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.447388:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 7/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.447410:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1477d88 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f0 expref: 41 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.447419:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1477d88 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f0 expref: 41 pid: 7231 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.447440:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263893760:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.447523:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1477d50 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386d4 expref: 23 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.447530:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1477d50 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386d4 expref: 23 pid: 9571 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.447536:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263893888:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.447552:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dca00/0xad6b7ddc1477e37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938760 expref: 41 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.447557:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dca00/0xad6b7ddc1477e37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938760 expref: 41 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.447563:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263894016:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.447576:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc1477d8f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386e9 expref: 23 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.447581:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc1477d8f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386e9 expref: 23 pid: 9571 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.447587:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263894144:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.447598:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d649c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.451348:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263893760:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.451360:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263893888:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.451367:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263894016:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.451374:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263894144:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.451398:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065208.452513:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.452543:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.452568:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.453000:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265145728 00000100:00100000:1.0:1746065208.453007:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265145728 00010000:00010000:1.0:1746065208.453035:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1477d88 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f0 expref: 42 pid: 7231 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.453188:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265146112 00000100:00100000:1.0:1746065208.453191:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265146112 00010000:00010000:1.0:1746065208.453201:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046400/0xad6b7ddc1477d8f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386e9 expref: 24 pid: 9571 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.453217:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7841 00000100:00100000:1.0:1746065208.453223:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881265145728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.453233:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.453238:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1477d88 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f0 expref: 42 pid: 7231 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.453247:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1477d88 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f0 expref: 42 pid: 7231 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.453266:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1477d88 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386f0 expref: 42 pid: 7231 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.453277:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.453282:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.453289:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.453300:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7843 00000100:00100000:3.0:1746065208.453307:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265145856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.453315:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.453318:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1477d50 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386d4 expref: 25 pid: 9571 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.453323:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265145728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 100us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.453329:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7841 00010000:00010000:3.0:1746065208.453475:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1477d50 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386d4 expref: 23 pid: 9571 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.453486:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1477d50 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9386d4 expref: 23 pid: 9571 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.453725:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065208.453729:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.453734:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.453752:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265145856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 446us (1183us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.453758:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7843 00000100:00100000:0.0:1746065208.454012:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.454408:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265145984 00000100:00100000:3.0:1746065208.454412:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265145984 00010000:00010000:3.0:1746065208.454435:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dca00/0xad6b7ddc1477e37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938760 expref: 41 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.454455:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7844 00000100:00100000:3.0:1746065208.454460:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265145984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.454466:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.454470:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dca00/0xad6b7ddc1477e37 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938760 expref: 41 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.454482:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dca00/0xad6b7ddc1477e37 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938760 expref: 41 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.454491:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dca00/0xad6b7ddc1477e37 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938760 expref: 41 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.454498:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065208.454501:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.454507:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.454513:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.454528:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.454543:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265145984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (531us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065208.455033:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.455040:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:3.0:1746065208.455267:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7844 00000040:00080000:0.0:1746065208.455513:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1010, 88 off96712 00000004:00080000:0.0:1746065208.455520:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804473745666ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065208.455555:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1032, 88 off98656 00000004:00080000:0.0:1746065208.455560:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804473786536ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065208.455586:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1033, 88 off98744 00000004:00080000:0.0:1746065208.455589:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804473815323ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065208.455599:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1011, 88 off96800 00000004:00080000:0.0:1746065208.455602:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804473828183ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065208.456335:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1012, 88 off96888 00000004:00080000:0.0:1746065208.456340:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804474566478ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065208.456350:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1034, 88 off98832 00000004:00080000:0.0:1746065208.456352:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804474578913ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065208.456669:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1035, 88 off98920 00000004:00080000:0.0:1746065208.456673:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804474899718ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065208.456681:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1036, 88 off99008 00000004:00080000:0.0:1746065208.456684:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804474910311ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065208.456691:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1013, 88 off96976 00000004:00080000:0.0:1746065208.456693:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804474919741ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065208.456701:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1037, 88 off99096 00000004:00080000:0.0:1746065208.456704:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804474930259ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065208.456711:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1014, 88 off97064 00000004:00080000:0.0:1746065208.456713:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804474939997ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065208.456720:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1038, 88 off99184 00000004:00080000:0.0:1746065208.456722:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804474948792ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065208.456729:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1015, 88 off97152 00000004:00080000:0.0:1746065208.456731:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804474957758ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065208.456738:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1016, 88 off97240 00000004:00080000:0.0:1746065208.456740:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804474966678ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065208.456747:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1017, 88 off97328 00000004:00080000:0.0:1746065208.456749:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804474975778ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065208.456756:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1018, 88 off97416 00000004:00080000:0.0:1746065208.456759:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804474985878ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065208.456766:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1039, 88 off99272 00000004:00080000:0.0:1746065208.456769:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804474995427ns, next at 761143559853ns, rc = 0 00000100:00100000:0.0:1746065208.460813:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16956 00000100:00100000:0.0:1746065208.460821:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+30:3761:x1830881263894272:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065208.461075:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881263894272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 254us (749us total) trans 17179874207 rc 0/0 00000100:00100000:0.0:1746065208.461081:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16956 00000100:00100000:0.0:1746065208.461095:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263895296:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065208.461677:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065208.461688:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263895296 00000100:00100000:3.0:1746065208.461691:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263895296 00000100:00100000:0.0:1746065208.461692:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263895808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065208.461706:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065208.461711:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263895808 00000100:00100000:3.0:1746065208.461713:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263895808 00000100:00100000:0.0:1746065208.461720:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263896320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065208.461725:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16964 00000100:00100000:3.0:1746065208.461729:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+40:3762:x1830881263895296:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065208.461733:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065208.461751:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263895552:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065208.461764:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065208.461789:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263896064:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065208.461807:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065208.461808:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+41:3762:x1830881263895296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (130us total) trans 21474841611 rc 0/0 00000100:00100000:3.0:1746065208.461814:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16964 00000100:00100000:3.0:1746065208.461823:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263896320 00000100:00100000:3.0:1746065208.461825:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263896320 00000004:00080000:0.0:1746065208.461828:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d9c00/2, rc 0, transno 17179874209 00000100:00100000:0.0:1746065208.461831:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263894400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065208.461835:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263895552 00000100:00100000:3.0:1746065208.461837:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263895552 00000004:00080000:0.0:1746065208.461838:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615c000/2, rc 0, transno 17179874208 00000100:00100000:0.0:1746065208.461841:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263894912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065208.461843:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263896064 00000100:00100000:3.0:1746065208.461844:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263896064 00000004:00080000:0.0:1746065208.461846:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984da680/2, rc 0, transno 17179874205 00000100:00100000:0.0:1746065208.461848:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263894528:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065208.461851:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16965 00000100:00100000:3.0:1746065208.461855:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+42:3762:x1830881263895808:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065208.461855:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615d880/2, rc 0, transno 17179874206 00000100:00100000:0.0:1746065208.461857:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263895040:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065208.461863:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065208.461867:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263895424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065208.461883:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065208.461891:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263895936:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065208.461894:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746065208.461896:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065208.461898:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065208.461899:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065208.461901:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:0.0:1746065208.461902:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065208.461913:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263895424 00000100:00100000:0.0:1746065208.461916:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263895424 00000100:00100000:3.0:1746065208.461919:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3762:x1830881263895808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (212us total) trans 21474841612 rc 0/0 00000100:00100000:3.0:1746065208.461924:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16965 00000100:00100000:0.0:1746065208.461928:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263895936 00000100:00100000:0.0:1746065208.461930:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263895936 00000100:00100000:3.0:1746065208.461934:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16966 00000100:00100000:3.0:1746065208.461939:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881263896320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065208.461939:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16967 00000100:00100000:0.0:1746065208.461943:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3760:x1830881263895552:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065208.461986:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+32:3762:x1830881263896320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (252us total) trans 17179874210 rc 0/0 00000100:00100000:3.0:1746065208.461991:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16966 00000100:00100000:3.0:1746065208.461999:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16968 00000100:00100000:3.0:1746065208.462003:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263896064:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065208.462007:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263895552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (242us total) trans 21474841613 rc 0/0 00000100:00100000:0.0:1746065208.462014:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16967 00000100:00100000:0.0:1746065208.462024:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16969 00000100:00100000:0.0:1746065208.462028:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+44:3760:x1830881263895424:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065208.462044:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d06680/2, rc 0, transno 21474841613 00000100:00100000:0.0:1746065208.462046:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263895552:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065208.462061:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263896064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (253us total) trans 21474841614 rc 0/0 00000100:00100000:3.0:1746065208.462066:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16968 00000100:00100000:3.0:1746065208.462075:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16970 00000100:00100000:3.0:1746065208.462080:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263895936:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065208.462099:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263895424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (214us total) trans 21474841615 rc 0/0 00000100:00100000:0.0:1746065208.462103:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16969 00002000:00010000:3.0:1746065208.462117:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:3.0:1746065208.462119:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:3.0:1746065208.462121:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:0.0:1746065208.462121:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d06300/2, rc 0, transno 21474841615 00002000:00010000:3.0:1746065208.462122:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:3.0:1746065208.462124:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:0.0:1746065208.462124:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263895424:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065208.462129:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d06d80/2, rc 0, transno 21474841614 00000100:00100000:0.0:1746065208.462131:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263896064:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065208.462142:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e4700/2, rc 0, transno 17179874210 00000100:00100000:3.0:1746065208.462144:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3760:x1830881263895936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (241us total) trans 21474841616 rc 0/0 00000100:00100000:0.0:1746065208.462144:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263896320:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065208.462149:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16970 00000004:00080000:0.0:1746065208.462150:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d07100/2, rc 0, transno 21474841611 00000100:00100000:0.0:1746065208.462152:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263895296:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065208.462157:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d04a80/2, rc 0, transno 21474841612 00000100:00100000:0.0:1746065208.462160:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263895808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065208.462171:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d07480/2, rc 0, transno 21474841616 00000100:00100000:0.0:1746065208.462173:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263895936:0@lo:2:osp-syn-0-0.0 00000004:00010000:1.0:1746065208.462268:0:13395:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880091b67480 reply state ffff880136be2400 transno 8589936931 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.462288:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.462295:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.462298:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065208.462301:0:13395:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746065208.462364:0:13395:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065208.462374:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2161:x1830881265145600:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 15104us (15216us total) trans 8589936931 rc 0/0 00000100:00100000:1.0:1746065208.462380:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14457 00010000:00010000:1.0:1746065208.462397:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.462403:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.462409:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.462414:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065208.462417:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.462434:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.462442:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.462443:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065208.462446:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.462451:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478194 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065208.468009:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.468220:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265146240 00000100:00100000:1.0:1746065208.468227:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265146240 00000100:00100000:1.0:1746065208.468277:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14458 00000100:00100000:1.0:1746065208.468284:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+7:2161:x1830881265146240:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065208.468302:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.468318:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc147819b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938920 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.468363:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc147819b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938920 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.468375:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc147819b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938920 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.468389:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.468391:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065208.468395:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ae00, rc 0) 00000100:00100000:1.0:1746065208.469111:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2161:x1830881265146240:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 825us (1111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.469117:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14458 00000100:00100000:0.0:1746065208.473186:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265146368 00000100:00100000:0.0:1746065208.473195:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265146368 00000100:00100000:0.0:1746065208.473250:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 836 00000100:00100000:0.0:1746065208.473257:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2161:x1830881265146368:12345-192.168.202.27@tcp:103:mirror_io.0 00010000:00010000:0.0:1746065208.473269:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065208.473296:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3da00/0xad6b7ddc1478155 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938912 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.473313:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065208.473317:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065208.473365:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+7:2161:x1830881265146368:12345-192.168.202.27@tcp:103:mirror_io.0 Request processed in 108us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.473370:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 836 00000100:00100000:0.0:1746065208.476293:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.476378:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265146624 00000100:00100000:3.0:1746065208.476385:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265146624 00000100:00100000:3.0:1746065208.476994:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5387 00000100:00100000:3.0:1746065208.477002:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2161:x1830881265146624:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065208.477195:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b27c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2161:x1830881265146624:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 194us (909us total) trans 8589936932 rc 0/0 00000100:00100000:3.0:1746065208.477202:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5387 00000100:00100000:0.0:1746065208.478837:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.478885:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265146880 00000100:00100000:1.0:1746065208.478891:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265146880 00000100:00100000:1.0:1746065208.478930:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5388 00000100:00100000:1.0:1746065208.478937:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2161:x1830881265146880:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065208.479082:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2161:x1830881265146880:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 144us (248us total) trans 8589936933 rc 0/0 00000100:00100000:1.0:1746065208.479088:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5388 00000100:00100000:0.0:1746065208.488419:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.488511:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265147136 00000100:00100000:1.0:1746065208.488519:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265147136 00000100:00100000:1.0:1746065208.488571:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14459 00000100:00100000:1.0:1746065208.488578:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+26:2172:x1830881265147136:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065208.488598:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.488612:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc14781a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938927 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.488674:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc14781a9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.488685:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc14781a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.488695:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc14781a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.488706:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc14781b0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.488711:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc14781b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.488716:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc14781b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.488902:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a600/0xad6b7ddc14781b7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.488914:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a600/0xad6b7ddc14781b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.488920:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a600/0xad6b7ddc14781b7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065208.488928:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065208.488983:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc14781a9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.488989:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc14781a9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.488994:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc14781a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.488998:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065208.489001:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc14781a9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.489006:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc14781a9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.489015:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065208.489017:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065208.489020:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc14781a9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.489025:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b000/0xad6b7ddc14781a9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.489037:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc14781b0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.489044:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc14781b0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.489048:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc14781b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.489052:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065208.489054:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc14781b0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.489058:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc14781b0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.489062:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008c512700) 00010000:00010000:1.0:1746065208.489064:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065208.489066:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc14781b0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.489385:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc14781b0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.489418:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc14781a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938927 expref: 29 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.489438:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a600/0xad6b7ddc14781b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938927 expref: 28 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.489444:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.489446:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065208.489448:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a600, rc 0) 00000100:00100000:1.0:1746065208.489941:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2172:x1830881265147136:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1362us (1528us total) trans 8589936934 rc 0/0 00000100:00100000:1.0:1746065208.489948:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14459 00000100:00100000:0.0:1746065208.491723:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265147392 00000100:00100000:0.0:1746065208.491729:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265147392 00000100:00100000:0.0:1746065208.491761:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14460 00000100:00100000:0.0:1746065208.491768:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2169:x1830881265147392:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065208.491798:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.491810:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14781c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93892e expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.491860:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc14781cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.491871:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc14781cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.491882:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc14781cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.491892:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14781d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.491897:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14781d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.491901:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14781d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.491967:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc14781da lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.491975:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc14781da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.491980:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc14781da lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065208.491988:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065208.492040:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc14781cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492046:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc14781cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492051:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc14781cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492056:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065208.492058:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc14781cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492067:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc14781cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492075:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065208.492077:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065208.492080:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc14781cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492084:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97a00/0xad6b7ddc14781cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492110:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14781d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492114:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14781d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492118:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14781d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492121:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065208.492123:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14781d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492127:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14781d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492132:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5d800) 00010000:00010000:0.0:1746065208.492134:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065208.492135:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14781d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492139:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14781d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.492167:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14781c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93892e expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.492176:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc14781da lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93892e expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.492181:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065208.492182:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065208.492184:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2a00, rc 0) 00000100:00100000:0.0:1746065208.492215:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2169:x1830881265147392:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 447us (913us total) trans 8589936935 rc 0/0 00000100:00100000:0.0:1746065208.492220:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14460 00000100:00100000:3.0:1746065208.494597:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265147520 00000100:00100000:3.0:1746065208.494603:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265147520 00000100:00100000:3.0:1746065208.494634:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16971 00000100:00100000:3.0:1746065208.494639:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881265147520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.494651:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.494666:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc14781e8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938935 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065208.494683:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d737, atime: 0x6812d737, ctime: 0x6812d737, blocks: 0x748 00010000:00010000:3.0:1746065208.494695:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.494697:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.494703:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc14781e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938935 expref: 39 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.494713:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc14781e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938935 expref: 39 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.494721:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718200, rc 0) 00000100:00100000:3.0:1746065208.494757:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881265147520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 118us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.494762:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16971 00000100:00100000:1.0:1746065208.494789:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.494831:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265147904 00000100:00100000:3.0:1746065208.494834:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265147904 00000100:00100000:3.0:1746065208.494851:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16972 00000100:00100000:3.0:1746065208.494856:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265147904:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.494862:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.494871:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc14781fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938943 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065208.494883:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d737, atime: 0x6812d730, ctime: 0x6812d737, blocks: 0x800 00010000:00010000:3.0:1746065208.494890:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.494891:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.494896:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc14781fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938943 expref: 29 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.494903:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc14781fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938943 expref: 29 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.494914:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719800, rc 0) 00000100:00100000:3.0:1746065208.494929:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265147904:12345-192.168.202.27@tcp:101:cat.0 Request processed in 73us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.494934:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16972 00000100:00100000:1.0:1746065208.495061:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265148928 00000100:00100000:1.0:1746065208.495065:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265148928 00000100:00100000:1.0:1746065208.495092:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14462 00000100:00100000:1.0:1746065208.495097:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2173:x1830881265148928:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065208.495106:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.495112:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc1478204 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93896d expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.495199:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265148032 00000100:00100000:3.0:1746065208.495202:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265148032 00000100:00100000:3.0:1746065208.495217:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16973 00000100:00100000:3.0:1746065208.495221:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265148032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.495231:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.495239:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147820b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93894a expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065208.495248:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d736, atime: 0x6812d734, ctime: 0x6812d736, blocks: 0x808 00010000:00010000:3.0:1746065208.495254:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.495255:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.495259:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147820b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93894a expref: 30 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.495266:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147820b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93894a expref: 30 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.495272:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718a00, rc 0) 00000100:00100000:3.0:1746065208.495299:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265148032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 77us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.495304:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16973 00010000:00010000:1.0:1746065208.495416:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1478212 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495451:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1478212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495459:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1478212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495470:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478219 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495475:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495480:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495541:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc1478220 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495548:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc1478220 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495553:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc1478220 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065208.495560:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065208.495612:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1478212 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495617:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1478212 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495621:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1478212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495625:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5a800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065208.495628:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1478212 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495632:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1478212 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495639:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065208.495642:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065208.495644:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1478212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495648:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc1478212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495657:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478219 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495661:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478219 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495670:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495673:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c7ad200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065208.495675:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478219 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495680:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478219 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495685:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008c512e00) 00010000:00010000:1.0:1746065208.495687:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065208.495689:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478219 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495693:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad200/0xad6b7ddc1478219 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.495721:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc1478204 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93896d expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.495730:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc1478220 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93896d expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.495735:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.495737:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065208.495739:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7aca00, rc 0) 00000100:00100000:1.0:1746065208.495770:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2173:x1830881265148928:12345-192.168.202.27@tcp:101:cat.0 Request processed in 672us (819us total) trans 8589936936 rc 0/0 00000100:00100000:1.0:1746065208.495794:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14462 00000100:00100000:0.0:1746065208.496059:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.496223:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.496235:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.496250:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.497099:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265148416 00000100:00100000:1.0:1746065208.497103:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265148416 00000100:00100000:1.0:1746065208.497134:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14463 00000100:00100000:1.0:1746065208.497139:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2169:x1830881265148416:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065208.497147:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.497149:0:13395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065208.497156:0:13395:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc14781da lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93892e expref: 11 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.497168:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.497171:0:13395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.497176:0:13395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065208.497181:0:13395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065208.497187:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0xad6b7ddc1478243 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938958 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.497210:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.497217:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc1478220 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93896d expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.497223:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc147819b lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938920 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.497228:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 5/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.497250:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc147819b lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938920 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.497258:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc147819b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938920 expref: 8 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.497268:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263896704:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.497321:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc1478220 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93896d expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.497327:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc1478220 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93896d expref: 12 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.497334:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263896832:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.497351:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.498011:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.498027:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265149056 00000100:00100000:0.0:1746065208.498030:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265149056 00010000:00010000:0.0:1746065208.498044:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a600/0xad6b7ddc14781b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938927 expref: 30 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:0.0:1746065208.498376:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7845 00000100:00100000:0.0:1746065208.498382:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265149056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065208.498390:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065208.498394:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a600/0xad6b7ddc14781b7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938927 expref: 30 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.498402:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a600/0xad6b7ddc14781b7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938927 expref: 30 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.498414:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a600/0xad6b7ddc14781b7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938927 expref: 30 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.498434:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065208.498437:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065208.498443:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065208.498447:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065208.498453:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.498457:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.498691:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065208.498727:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265149056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 344us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.498734:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7845 00000100:00100000:3.0:1746065208.499447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.499509:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.499536:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.499719:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265149440 00000100:00100000:0.0:1746065208.499722:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265149440 00000100:00100000:0.0:1746065208.499737:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16979 00000100:00100000:0.0:1746065208.499742:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265149440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065208.499746:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.499752:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1478266 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938982 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.499759:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.499760:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.499764:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1478266 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938982 expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.499787:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1478266 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938982 expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.499794:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97e00, rc 0) 00000100:00100000:0.0:1746065208.499805:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265149440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 63us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.499809:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16979 00000100:00100000:1.0:1746065208.499983:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.500000:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.500012:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.500037:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.500188:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265149696 00000100:00100000:0.0:1746065208.500188:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265149568 00000100:00100000:3.0:1746065208.500192:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265149696 00000100:00100000:0.0:1746065208.500192:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265149568 00000100:00100000:3.0:1746065208.500205:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265149824 00000100:00100000:3.0:1746065208.500207:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265149824 00000100:00100000:0.0:1746065208.500288:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16980 00000100:00100000:3.0:1746065208.500295:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16981 00000100:00100000:0.0:1746065208.500297:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265149696:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065208.500300:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265149568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065208.500303:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.500304:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.500309:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478274 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938989 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.500309:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc147826d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938990 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.500318:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.500318:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.500319:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.500319:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.500323:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478274 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938989 expref: 19 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.500323:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc147826d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938990 expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.500332:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478274 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938989 expref: 19 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.500335:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc147826d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938990 expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.500338:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71aa00, rc 0) 00010000:00010000:0.0:1746065208.500341:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96800, rc 0) 00000100:00100000:3.0:1746065208.500355:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265149568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.500449:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 16982 00000100:00100000:1.0:1746065208.500455:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265149824:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065208.500462:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.500468:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147827b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938997 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.500477:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.500478:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.500482:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147827b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938997 expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.500490:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147827b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938997 expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.500497:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c200, rc 0) 00000100:00100000:0.0:1746065208.500642:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265149696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 346us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.500647:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16980 00000100:00100000:1.0:1746065208.500684:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265149824:12345-192.168.202.27@tcp:101:cat.0 Request processed in 229us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.500689:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16982 00000100:00100000:3.0:1746065208.500798:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 16981 00000100:00100000:0.0:1746065208.501221:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.501233:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265150080 00000100:00100000:0.0:1746065208.501236:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265150080 00010000:00010000:0.0:1746065208.501248:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc147819b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938920 expref: 9 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.501367:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.501753:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265150208 00000100:00100000:0.0:1746065208.501757:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265150208 00000100:00100000:1.0:1746065208.501760:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7846 00000100:00100000:1.0:1746065208.501766:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265150080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065208.501769:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc1478220 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93896d expref: 12 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.501787:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.501791:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc147819b lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938920 expref: 9 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.501799:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc147819b lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938920 expref: 9 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:0.0:1746065208.501806:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7847 00010000:00010000:1.0:1746065208.501811:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00000100:00100000:0.0:1746065208.501811:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265150208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.501814:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.501817:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.501819:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.501820:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc1478220 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93896d expref: 12 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.501823:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065208.501827:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc1478220 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93896d expref: 12 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.501836:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265150080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (617us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065208.501840:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00000100:00100000:1.0:1746065208.501842:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7846 00010000:00010000:0.0:1746065208.501842:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.501847:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.501852:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40290400000020 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.501859:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1478282 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93899e expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.501868:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065208.501880:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265150208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 69us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.501885:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7847 00010000:00010000:1.0:1746065208.501905:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc147819b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938920 expref: 8 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.501916:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263896704:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.501990:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7aca00/0xad6b7ddc1478220 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93896d expref: 11 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.501999:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43b80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263896832:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.502013:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.502020:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.502024:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 13395 initiator: MDT0 00000040:00080000:1.0:1746065208.502213:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1019, 88 off97504 00000004:00080000:1.0:1746065208.502218:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804520444228ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065208.502254:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1040, 88 off99360 00000004:00080000:1.0:1746065208.502258:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804520484156ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065208.502279:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1041, 88 off99448 00000004:00080000:1.0:1746065208.502283:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804520508972ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065208.502291:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1020, 88 off97592 00000004:00080000:1.0:1746065208.502293:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804520520000ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065208.502312:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1021, 88 off97680 00000004:00080000:1.0:1746065208.502315:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804520541592ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065208.502323:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1042, 88 off99536 00000004:00080000:1.0:1746065208.502326:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804520552108ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065208.502332:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1043, 88 off99624 00000004:00080000:1.0:1746065208.502335:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804520561356ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065208.502359:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1044, 88 off99712 00000004:00080000:1.0:1746065208.502362:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804520588951ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065208.502372:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1022, 88 off97768 00000004:00080000:1.0:1746065208.502374:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804520600892ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065208.502382:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1045, 88 off99800 00000004:00080000:1.0:1746065208.502384:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804520610808ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065208.502391:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1023, 88 off97856 00000004:00080000:1.0:1746065208.502394:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804520620468ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065208.502401:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1046, 88 off99888 00000004:00080000:1.0:1746065208.502403:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804520629722ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065208.502411:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1024, 88 off97944 00000004:00080000:1.0:1746065208.502413:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804520639408ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065208.502419:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1025, 88 off98032 00000004:00080000:1.0:1746065208.502436:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804520647787ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065208.502444:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1026, 88 off98120 00000004:00080000:1.0:1746065208.502446:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804520672731ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065208.502452:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1027, 88 off98208 00000004:00080000:1.0:1746065208.502454:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 804520680207ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065208.502460:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1047, 88 off99976 00000004:00080000:1.0:1746065208.502462:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 804520688388ns, next at 761143559853ns, rc = 0 00000100:00100000:1.0:1746065208.504030:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.504341:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263896960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065208.504376:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065208.504490:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263897088:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065208.504703:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263896960 00000100:00100000:3.0:1746065208.504706:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263896960 00000100:00100000:3.0:1746065208.504723:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263897216 00000100:00100000:3.0:1746065208.504725:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263897216 00000100:00100000:3.0:1746065208.504735:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263897728 00000100:00100000:3.0:1746065208.504737:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263897728 00000100:00100000:3.0:1746065208.504744:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263897344 00000100:00100000:3.0:1746065208.504745:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263897344 00000100:00100000:3.0:1746065208.504750:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263897856 00000100:00100000:3.0:1746065208.504752:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263897856 00000100:00100000:3.0:1746065208.504757:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263898240 00000100:00100000:3.0:1746065208.504758:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263898240 00000100:00100000:3.0:1746065208.504763:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263898752 00000100:00100000:3.0:1746065208.504765:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263898752 00000100:00100000:3.0:1746065208.504770:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263898368 00000100:00100000:3.0:1746065208.504788:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263898368 00000100:00100000:3.0:1746065208.504797:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16983 00000100:00100000:3.0:1746065208.504801:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881263896960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065208.504877:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065208.504879:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065207 -> 1746065207 00002000:00010000:3.0:1746065208.504881:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065207 -> 1746065207 00002000:00010000:3.0:1746065208.504883:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065207 -> 1746065207 00002000:00010000:3.0:1746065208.504885:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 1864 -> 1864 00000100:00100000:3.0:1746065208.504904:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+37:3759:x1830881263896960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 102us (527us total) trans 17179874211 rc 0/0 00000100:00100000:0.0:1746065208.504952:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065208.504963:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263897600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065208.504977:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065208.504987:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263898112:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065208.504999:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065208.505005:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263898624:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065208.505016:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065208.505017:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263897472:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065208.505032:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065208.505037:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263897088 00000100:00100000:1.0:1746065208.505040:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263897984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065208.505040:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263897088 00000100:00100000:1.0:1746065208.505050:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065208.505056:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263898496:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065208.505066:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065208.505086:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077e300/2, rc 0, transno 17179874211 00000100:00100000:1.0:1746065208.505093:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263896960:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065208.505105:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263897600 00000100:00100000:1.0:1746065208.505107:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263897600 00000100:00100000:3.0:1746065208.505129:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16983 00000100:00100000:3.0:1746065208.505138:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263898112 00000100:00100000:3.0:1746065208.505140:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263898112 00000100:00100000:3.0:1746065208.505186:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263898624 00000100:00100000:3.0:1746065208.505188:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263898624 00000100:00100000:3.0:1746065208.505193:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263897472 00000100:00100000:3.0:1746065208.505194:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263897472 00000100:00100000:3.0:1746065208.505199:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263897984 00000100:00100000:3.0:1746065208.505200:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263897984 00000100:00100000:3.0:1746065208.505204:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263898496 00000100:00100000:3.0:1746065208.505206:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263898496 00000100:00100000:3.0:1746065208.505211:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16985 00000100:00100000:3.0:1746065208.505215:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3761:x1830881263897728:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065208.505296:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:3.0:1746065208.505298:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:3.0:1746065208.505300:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065208.505301:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:3.0:1746065208.505303:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:3.0:1746065208.505318:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3761:x1830881263897728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 103us (695us total) trans 21474841618 rc 0/0 00000100:00100000:3.0:1746065208.505323:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16985 00000100:00100000:3.0:1746065208.505330:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16986 00000100:00100000:3.0:1746065208.505333:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3761:x1830881263897344:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065208.505360:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065208.505362:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065208 -> 1746065208 00002000:00010000:3.0:1746065208.505363:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065208 -> 1746065208 00002000:00010000:3.0:1746065208.505365:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065208 -> 1746065208 00002000:00010000:3.0:1746065208.505366:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746065208.505378:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3761:x1830881263897344:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (726us total) trans 21474841619 rc 0/0 00000100:00100000:3.0:1746065208.505382:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16986 00000100:00100000:3.0:1746065208.505388:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16987 00000100:00100000:3.0:1746065208.505391:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3761:x1830881263897856:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065208.505436:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3761:x1830881263897856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (761us total) trans 21474841620 rc 0/0 00000100:00100000:3.0:1746065208.505441:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16987 00000100:00100000:3.0:1746065208.505448:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16988 00000100:00100000:3.0:1746065208.505451:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3761:x1830881263898240:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065208.505480:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 4897248 -> 4897248 00002000:00010000:3.0:1746065208.505482:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065208 -> 1746065208 00002000:00010000:3.0:1746065208.505483:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065208 -> 1746065208 00002000:00010000:3.0:1746065208.505485:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065208 -> 1746065208 00002000:00010000:3.0:1746065208.505487:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5480 -> 5480 00000100:00100000:3.0:1746065208.505499:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3761:x1830881263898240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (800us total) trans 17179874212 rc 0/0 00000100:00100000:3.0:1746065208.505503:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16988 00000100:00100000:3.0:1746065208.505509:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16989 00000100:00100000:3.0:1746065208.505512:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3761:x1830881263898752:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065208.505538:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065208.505540:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065208.505541:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065208.505543:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065208.505544:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:3.0:1746065208.505556:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3761:x1830881263898752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (836us total) trans 17179874213 rc 0/0 00000100:00100000:3.0:1746065208.505560:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16989 00000100:00100000:3.0:1746065208.505566:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16990 00000100:00100000:3.0:1746065208.505569:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3761:x1830881263898368:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065208.505601:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3761:x1830881263898368:12345-0@lo:2:osp-syn-1-0.0 Request processed in 31us (856us total) trans 17179874214 rc 0/0 00000100:00100000:3.0:1746065208.505605:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16990 00000100:00100000:3.0:1746065208.505611:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16991 00000100:00100000:3.0:1746065208.505615:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3761:x1830881263898880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065208.505638:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:3.0:1746065208.505640:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065208.505642:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065208.505643:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065208.505645:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:3.0:1746065208.505657:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3761:x1830881263898880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (892us total) trans 17179874215 rc 0/0 00000100:00100000:3.0:1746065208.505661:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16991 00000100:00100000:3.0:1746065208.505680:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16993 00000100:00100000:3.0:1746065208.505683:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3760:x1830881263898624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065208.505729:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3760:x1830881263898624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (712us total) trans 17179874216 rc 0/0 00000100:00100000:3.0:1746065208.505734:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16993 00000100:00100000:3.0:1746065208.505742:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16994 00000100:00100000:3.0:1746065208.505746:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+52:3759:x1830881263897472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065208.505799:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065208.505801:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065208.505803:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065208.505804:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065208.505806:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:3.0:1746065208.505824:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+53:3759:x1830881263897472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (791us total) trans 21474841621 rc 0/0 00000100:00100000:3.0:1746065208.505828:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16994 00000100:00100000:3.0:1746065208.505837:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16996 00000100:00100000:3.0:1746065208.505841:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3759:x1830881263898496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065208.505872:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065208.505874:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065208.505876:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065208.505877:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065208.505879:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065208.505893:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+41:3759:x1830881263898496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 52us (826us total) trans 17179874218 rc 0/0 00000100:00100000:3.0:1746065208.505898:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16996 00000100:00100000:0.0:1746065208.506454:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16997 00000100:00100000:1.0:1746065208.506457:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16998 00000100:00100000:0.0:1746065208.506460:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+52:3760:x1830881263897088:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065208.506462:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+52:3760:x1830881263897600:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065208.506508:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746065208.506510:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00000004:00080000:0.0:1746065208.506511:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077ca80/2, rc 0, transno 17179874217 00002000:00010000:1.0:1746065208.506512:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065208.506513:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00000100:00100000:0.0:1746065208.506514:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263898112:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065208.506515:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000004:00080000:0.0:1746065208.506520:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077d880/2, rc 0, transno 17179874216 00000100:00100000:0.0:1746065208.506522:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263898624:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065208.506535:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+54:3760:x1830881263897600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (1557us total) trans 21474841623 rc 0/0 00000004:00080000:0.0:1746065208.506536:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4e9f80/2, rc 0, transno 21474841623 00000100:00100000:0.0:1746065208.506539:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263897600:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065208.506540:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16998 00002000:00010000:0.0:1746065208.506556:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065208.506558:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065207 -> 1746065207 00000004:00080000:1.0:1746065208.506560:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4e8a80/2, rc 0, transno 21474841621 00000100:00100000:1.0:1746065208.506562:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263897472:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065208.506567:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065200 -> 1746065200 00000004:00080000:1.0:1746065208.506568:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fc000/2, rc 0, transno 21474841622 00002000:00010000:0.0:1746065208.506568:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065207 -> 1746065207 00000100:00100000:1.0:1746065208.506570:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263897984:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065208.506570:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000004:00080000:1.0:1746065208.506576:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077ed80/2, rc 0, transno 17179874218 00000100:00100000:1.0:1746065208.506579:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263898496:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065208.506589:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+53:3760:x1830881263897088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (1637us total) trans 21474841624 rc 0/0 00000100:00100000:0.0:1746065208.506594:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16997 00000100:00100000:1.0:1746065208.506607:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263899008:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065208.506610:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4e8380/2, rc 0, transno 21474841624 00000100:00100000:0.0:1746065208.506612:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263897088:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065208.506626:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1746065208.506749:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938958 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.506758:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.506760:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:1.0:1746065208.506763:0:13395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1478282 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93899e expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.506787:0:13395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1478282 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93899e expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.506794:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1478282 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93899e expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.506800:0:13395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc1478289 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389a5 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.506805:0:13395:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc1478289 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389a5 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.506809:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc1478289 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389a5 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.506829:0:13395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc1478289 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389a5 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.506837:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263899136:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065208.506868:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263899008 00000100:00100000:0.0:1746065208.506872:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263899008 00010000:00010000:1.0:1746065208.506888:0:13395:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1478282 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93899e expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.506896:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263899264:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065208.506897:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16999 00000100:00100000:0.0:1746065208.506901:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+40:3759:x1830881263899008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065208.506942:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.506976:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+41:3759:x1830881263899008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (349us total) trans 17179874219 rc 0/0 00000100:00100000:0.0:1746065208.506985:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16999 00000004:00080000:1.0:1746065208.506992:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880129f41f80/2, rc 0, transno 17179874219 00000100:00100000:1.0:1746065208.506995:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263899008:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065208.508477:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.508881:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263899136:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065208.508892:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263899264:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065208.508916:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0xad6b7ddc1478243 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938958 expref: 10 pid: 13395 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065208.508931:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938958 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.508946:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac600, rc 0) 00000100:00100000:0.0:1746065208.509619:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.509763:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265150592 00000100:00100000:3.0:1746065208.509767:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265150592 00000100:00100000:1.0:1746065208.509933:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2169:x1830881265148416:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 12792us (13708us total) trans 8589936938 rc 0/0 00000100:00100000:1.0:1746065208.509940:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14463 00000100:00100000:3.0:1746065208.510037:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5390 00000100:00100000:3.0:1746065208.510043:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2172:x1830881265150592:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:3.0:1746065208.510119:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2172:x1830881265150592:12345-192.168.202.27@tcp:49:cat.0 Request processed in 75us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.510124:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5390 00000100:00100000:0.0:1746065208.511278:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.513012:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.514444:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265150848 00000100:00100000:3.0:1746065208.514448:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265150848 00010000:00010000:3.0:1746065208.514469:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25400/0xad6b7ddc1478235 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93895f expref: 41 pid: 10219 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.514516:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7848 00000100:00100000:3.0:1746065208.514524:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265150848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.514534:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.514553:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25400/0xad6b7ddc1478235 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93895f expref: 41 pid: 10219 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.514563:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25400/0xad6b7ddc1478235 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93895f expref: 41 pid: 10219 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.514580:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25400/0xad6b7ddc1478235 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93895f expref: 41 pid: 10219 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.514601:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.514625:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881265150848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.514630:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7848 00000100:00100000:0.0:1746065208.515126:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.515312:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265151104 00000100:00100000:3.0:1746065208.515316:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265151104 00010000:00010000:3.0:1746065208.515331:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc147826d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938990 expref: 19 pid: 10219 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.515359:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7849 00000100:00100000:3.0:1746065208.515363:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881265151104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.515369:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.515377:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc147826d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938990 expref: 19 pid: 10219 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.515386:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc147826d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938990 expref: 19 pid: 10219 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.515398:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96800/0xad6b7ddc147826d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938990 expref: 19 pid: 10219 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.515407:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.515408:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.515413:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 18 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.515420:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 18 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.515455:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 18 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.515464:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263899648:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065208.515514:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.525766:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263899648:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065208.525807:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.525846:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265151104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10481us (10719us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.525856:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7849 00000100:00100000:3.0:1746065208.529663:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265151360 00000100:00100000:3.0:1746065208.529671:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265151360 00002000:00100000:3.0:1746065208.529707:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3518464->3522559) req@ffff88009adf7480 x1830881265151360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.529716:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7480 with x1830881265151360 ext(3518464->3522559) 00002000:00010000:3.0:1746065208.529720:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf7480 00000100:00100000:3.0:1746065208.529749:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5945 00000100:00100000:3.0:1746065208.529756:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265151360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065208.529912:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265151360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 156us (326us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065208.529918:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5945 00002000:00100000:3.0:1746065208.529923:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3518464->3522559) req@ffff88009adf7480 x1830881265151360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/4536 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.529929:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7480 with x1830881265151360 ext(3518464->3522559) 00002000:00010000:3.0:1746065208.529932:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf7480 00000100:00100000:0.0:1746065208.531747:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.534571:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265151616 00000100:00100000:3.0:1746065208.534582:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265151616 00002000:00100000:3.0:1746065208.534618:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88008f7fdc00 x1830881265151616/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.534628:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fdc00 with x1830881265151616 ext(0->1048575) 00002000:00010000:3.0:1746065208.534632:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fdc00 00000100:00100000:3.0:1746065208.534661:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5946 00000100:00100000:3.0:1746065208.534668:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265151616:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065208.541709:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.541744:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.541814:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.541843:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265151872 00000100:00100000:0.0:1746065208.541850:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265151872 00002000:00100000:0.0:1746065208.541882:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (3526656->3530751) req@ffff88008f7fca80 x1830881265151872/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065208.541890:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fca80 with x1830881265151872 ext(3526656->3530751) 00002000:00010000:0.0:1746065208.541895:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fca80 00000100:00100000:0.0:1746065208.541911:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265152128 00000100:00100000:0.0:1746065208.541913:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265152128 00002000:00100000:0.0:1746065208.541922:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008f7fe680 x1830881265152128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065208.541928:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe680 with x1830881265152128 ext(1048576->2097151) 00002000:00010000:0.0:1746065208.541930:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fe680 00000100:00100000:0.0:1746065208.541936:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265152384 00000100:00100000:0.0:1746065208.541938:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265152384 00002000:00100000:0.0:1746065208.541945:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88008f7ff100 x1830881265152384/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065208.541950:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff100 with x1830881265152384 ext(1048576->2097151) 00002000:00010000:0.0:1746065208.541953:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7ff100 00000100:00100000:0.0:1746065208.541962:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5947 00000100:00100000:0.0:1746065208.541968:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265151872:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065208.542063:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265151872:12345-192.168.202.27@tcp:3:cat.0 Request processed in 95us (362us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065208.542068:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5947 00002000:00100000:0.0:1746065208.542073:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (3526656->3530751) req@ffff88008f7fca80 x1830881265151872/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/4536 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065208.542079:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fca80 with x1830881265151872 ext(3526656->3530751) 00002000:00010000:0.0:1746065208.542081:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fca80 00000100:00100000:0.0:1746065208.542091:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5948 00000100:00100000:0.0:1746065208.542095:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265152128:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065208.542620:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5949 00000100:00100000:0.0:1746065208.542625:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265152384:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065208.548317:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265152640 00000100:00100000:1.0:1746065208.548323:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265152896 00000100:00100000:3.0:1746065208.548327:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265152640 00000100:00100000:1.0:1746065208.548327:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265152896 00002000:00100000:1.0:1746065208.548364:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009adf5c00 x1830881265152896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.548365:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009adf4e00 x1830881265152640/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.548374:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4e00 with x1830881265152640 ext(1048576->2097151) 00002000:00100000:1.0:1746065208.548378:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5c00 with x1830881265152896 ext(0->1048575) 00002000:00010000:3.0:1746065208.548379:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4e00 00002000:00010000:1.0:1746065208.548382:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf5c00 00000100:00100000:3.0:1746065208.548405:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5950 00000100:00100000:1.0:1746065208.548410:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5951 00000100:00100000:3.0:1746065208.548414:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265152640:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065208.548417:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265152896:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065208.549021:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5953 00000100:00100000:1.0:1746065208.549027:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265153280:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065208.549087:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5954 00000100:00100000:3.0:1746065208.549092:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265153664:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065208.549417:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265153920 00000100:00100000:3.0:1746065208.549420:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265153920 00000100:00100000:1.0:1746065208.554524:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265152128:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12419us (12770us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065208.554532:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5948 00002000:00100000:1.0:1746065208.554542:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008f7fe680 x1830881265152128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.554551:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe680 with x1830881265152128 ext(1048576->2097151) 00002000:00010000:1.0:1746065208.554556:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fe680 00000100:00100000:1.0:1746065208.563993:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265152896:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15567us (16328us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065208.564003:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5951 00002000:00100000:1.0:1746065208.564014:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009adf5c00 x1830881265152896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.564023:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5c00 with x1830881265152896 ext(0->1048575) 00002000:00010000:1.0:1746065208.564028:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf5c00 00000100:00100000:3.0:1746065208.567745:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265152640:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19324us (20126us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065208.567755:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5950 00002000:00100000:3.0:1746065208.567765:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009adf4e00 x1830881265152640/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.567800:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4e00 with x1830881265152640 ext(1048576->2097151) 00002000:00010000:3.0:1746065208.567804:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4e00 00000100:00100000:3.0:1746065208.579640:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265153664:12345-192.168.202.27@tcp:3:cat.0 Request processed in 30539us (31019us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065208.579650:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5954 00002000:00100000:3.0:1746065208.579660:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009adf7800 x1830881265153664/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.579668:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7800 with x1830881265153664 ext(1048576->2097151) 00002000:00010000:3.0:1746065208.579673:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf7800 00000100:00100000:1.0:1746065208.582387:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265153280:12345-192.168.202.27@tcp:3:cat.0 Request processed in 33352us (33777us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065208.582399:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5953 00002000:00100000:1.0:1746065208.582408:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009adf5f80 x1830881265153280/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.582416:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5f80 with x1830881265153280 ext(1048576->2097151) 00002000:00010000:1.0:1746065208.582430:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf5f80 00000100:00100000:0.0:1746065208.587418:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.587475:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.587572:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265154304 00000100:00100000:1.0:1746065208.587580:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265154304 00002000:00100000:1.0:1746065208.587617:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009577d880 x1830881265154304/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.587625:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d880 with x1830881265154304 ext(2097152->4194303) 00000100:00100000:3.0:1746065208.587627:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265154432 00002000:00010000:1.0:1746065208.587629:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577d880 00000100:00100000:3.0:1746065208.587631:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265154432 00002000:00100000:3.0:1746065208.587650:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009577f480 x1830881265154432/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 504/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.587657:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f480 with x1830881265154432 ext(2097152->4194303) 00000100:00100000:1.0:1746065208.587660:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5955 00002000:00010000:3.0:1746065208.587661:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577f480 00000100:00100000:1.0:1746065208.587668:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265154304:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065208.587676:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5956 00000100:00100000:3.0:1746065208.587680:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265154432:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065208.588954:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.596959:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.597012:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265154688 00000100:00100000:3.0:1746065208.597019:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265154688 00010000:00010000:3.0:1746065208.597048:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc147825f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93897b expref: 22 pid: 11461 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.597071:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7850 00000100:00100000:3.0:1746065208.597077:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265154688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.597087:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.597103:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc147825f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93897b expref: 22 pid: 11461 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.597110:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc147825f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93897b expref: 22 pid: 11461 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.597126:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b49f7400/0xad6b7ddc147825f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93897b expref: 22 pid: 11461 timeout: 904 lvb_type: 1 00010000:00010000:3.0:1746065208.597140:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.597153:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265154688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.597158:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7850 00000100:00100000:0.0:1746065208.599190:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265154816 00000100:00100000:0.0:1746065208.599195:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265154816 00010000:00010000:0.0:1746065208.599220:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc14781fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938943 expref: 32 pid: 11461 timeout: 904 lvb_type: 1 00000100:00100000:0.0:1746065208.599257:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7851 00000100:00100000:0.0:1746065208.599264:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265154816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065208.599278:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065208.599293:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc14781fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938943 expref: 32 pid: 11461 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.599304:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc14781fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938943 expref: 32 pid: 11461 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.599324:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c719800/0xad6b7ddc14781fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938943 expref: 32 pid: 11461 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.599353:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.599355:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.599362:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc147829e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ba expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.599369:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc147829e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ba expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.599397:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc147829e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ba expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065208.599408:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263900032:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065208.599497:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.600404:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.600569:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265154944 00000100:00100000:3.0:1746065208.600573:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265154944 00000100:00100000:3.0:1746065208.600607:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17003 00000100:00100000:3.0:1746065208.600612:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+40:2172:x1830881265154944:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.600624:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.600635:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d926800/0xad6b7ddc14782a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9389c1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.600996:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.601003:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065208.601004:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065208.601007:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926800/0xad6b7ddc14782a5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c1 expref: 41 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.601026:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 19 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.601036:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 19 pid: 3067 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.601045:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263900160:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065208.601553:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.604749:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265154304:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17080us (17341us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065208.604759:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5955 00002000:00100000:1.0:1746065208.604767:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009577d880 x1830881265154304/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.604795:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d880 with x1830881265154304 ext(2097152->4194303) 00002000:00010000:1.0:1746065208.604800:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577d880 00000100:00100000:0.0:1746065208.605302:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.605457:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265155200 00000100:00100000:1.0:1746065208.605463:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265155200 00002000:00100000:1.0:1746065208.605486:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (2019328->2023423) req@ffff88009577d500 x1830881265155200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.605499:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d500 with x1830881265155200 ext(2019328->2023423) 00002000:00010000:1.0:1746065208.605502:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577d500 00000100:00100000:1.0:1746065208.605529:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5957 00000100:00100000:1.0:1746065208.605535:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265155200:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065208.606377:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265155200:12345-192.168.202.27@tcp:3:cat.0 Request processed in 839us (1074us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065208.606385:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5957 00002000:00100000:1.0:1746065208.606391:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (2019328->2023423) req@ffff88009577d500 x1830881265155200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/4536 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.606399:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d500 with x1830881265155200 ext(2019328->2023423) 00002000:00010000:1.0:1746065208.606402:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577d500 00000100:00100000:0.0:1746065208.607811:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.608619:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265155328 00000100:00100000:1.0:1746065208.608625:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265155328 00002000:00100000:1.0:1746065208.608653:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3518464->3530751) req@ffff88009577ce00 x1830881265155328/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 12776/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.608662:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ce00 with x1830881265155328 ext(3518464->3530751) 00010000:00010000:1.0:1746065208.608667:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 20 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.608679:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 20 pid: 3067 timeout: 904 lvb_type: 0 00002000:00010000:1.0:1746065208.608685:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009577ce00 00000100:00100000:1.0:1746065208.608712:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1966 00000100:00100000:1.0:1746065208.608718:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265155328:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065208.611650:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265155328:12345-192.168.202.27@tcp:4:cat.0 Request processed in 2924us (3833us total) trans 17179874220 rc 0/0 00000100:00100000:1.0:1746065208.611661:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1966 00002000:00100000:1.0:1746065208.611669:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3518464->3530751) req@ffff88009577ce00 x1830881265155328/t17179874220(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 12776/448 e 0 to 0 dl 1746065219 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.611677:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ce00 with x1830881265155328 ext(3518464->3530751) 00010000:00010000:1.0:1746065208.611685:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 22 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.611698:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 22 pid: 3067 timeout: 904 lvb_type: 0 00002000:00010000:1.0:1746065208.611704:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009577ce00 00000100:00100000:3.0:1746065208.612224:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.613486:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17004 00000100:00100000:1.0:1746065208.613495:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2168:x1830881265155456:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065208.613507:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.613520:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc14782ac lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9389c8 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.613540:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147820b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93894a expref: 32 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.613548:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1478266 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938982 expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.613558:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.613559:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.613562:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc14782ac lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->1675263] (req 1048576->1675263) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c8 expref: 32 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.613585:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1478266 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938982 expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.613594:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1478266 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938982 expref: 18 pid: 9550 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.613604:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263900288:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.614923:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147820b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93894a expref: 32 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.614932:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147820b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93894a expref: 32 pid: 12258 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.614941:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263900416:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.614988:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.620129:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.620166:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.620168:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263900288:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065208.620245:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.620278:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265155584 00000100:00100000:0.0:1746065208.620283:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265155584 00010000:00010000:0.0:1746065208.620311:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1478266 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938982 expref: 19 pid: 9550 timeout: 904 lvb_type: 1 00000100:00100000:0.0:1746065208.620343:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265155840 00000100:00100000:0.0:1746065208.620345:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265155840 00010000:00010000:0.0:1746065208.620355:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 20 pid: 3067 timeout: 904 lvb_type: 0 00000100:00100000:0.0:1746065208.620373:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7852 00000100:00100000:0.0:1746065208.620379:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265155584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065208.620389:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065208.620404:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1478266 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938982 expref: 19 pid: 9550 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.620412:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1478266 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938982 expref: 19 pid: 9550 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.620446:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1478266 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938982 expref: 19 pid: 9550 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.620459:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065208.620488:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265155584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 109us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.620494:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7852 00000100:00100000:0.0:1746065208.620507:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7853 00000100:00100000:0.0:1746065208.620510:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265155840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065208.620517:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065208.620525:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 20 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.620532:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 20 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.620543:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3e00/0xad6b7ddc1478290 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3518464->3530751) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389ac expref: 20 pid: 3067 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.620552:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.620553:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.620559:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d926800/0xad6b7ddc14782a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c1 expref: 40 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.620566:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926800/0xad6b7ddc14782a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c1 expref: 40 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.620591:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d926800/0xad6b7ddc14782a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c1 expref: 40 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065208.620602:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263900544:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065208.620646:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.621132:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265155712 00000100:00100000:3.0:1746065208.621137:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265155712 00000100:00100000:3.0:1746065208.621164:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17005 00000100:00100000:3.0:1746065208.621169:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2173:x1830881265155712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.621179:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.621189:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14782b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9389cf expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.621201:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.621202:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.621207:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14782b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389cf expref: 21 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.621216:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14782b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389cf expref: 21 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.621222:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926200, rc 0) 00000100:00100000:3.0:1746065208.621243:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2173:x1830881265155712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 74us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.621248:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17005 00000100:00100000:0.0:1746065208.622457:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.622541:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263900544:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065208.622555:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065208.622575:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265155840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2064us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.622582:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7853 00000100:00100000:0.0:1746065208.622597:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265155968 00000100:00100000:0.0:1746065208.622600:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265155968 00010000:00010000:0.0:1746065208.622616:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147820b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93894a expref: 33 pid: 12258 timeout: 904 lvb_type: 1 00000100:00100000:0.0:1746065208.622633:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7854 00000100:00100000:0.0:1746065208.622639:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265155968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065208.622646:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065208.622808:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147820b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93894a expref: 33 pid: 12258 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.622817:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147820b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93894a expref: 33 pid: 12258 timeout: 904 lvb_type: 1 00010000:00010000:0.0:1746065208.622830:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.622831:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.622835:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc14782ac lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c8 expref: 33 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.622841:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc14782ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c8 expref: 33 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.622875:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc14782ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c8 expref: 33 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065208.622885:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263900672:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065208.622926:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00010000:00010000:1.0:1746065208.623246:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc147820b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93894a expref: 33 pid: 12258 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.623272:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263900416:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.623289:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc14782ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c8 expref: 32 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.623296:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b800, rc 0) 00000100:00100000:1.0:1746065208.623317:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2168:x1830881265155456:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9824us (11094us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.623329:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17004 00000100:00100000:0.0:1746065208.625513:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.629268:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263900672:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065208.629286:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065208.629317:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265155968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6677us (6861us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.629326:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7854 00000100:00100000:0.0:1746065208.637319:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.637347:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.637375:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.637897:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265156480 00000100:00100000:3.0:1746065208.637905:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265156480 00002000:00100000:3.0:1746065208.637937:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1671168->1675263) req@ffff880097d28e00 x1830881265156480/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.637945:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d28e00 with x1830881265156480 ext(1671168->1675263) 00002000:00010000:3.0:1746065208.637949:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d28e00 00000100:00100000:3.0:1746065208.637976:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5959 00000100:00100000:3.0:1746065208.637982:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265156864:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065208.649413:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265156864:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11422us (12056us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065208.649431:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5959 00002000:00100000:3.0:1746065208.649442:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880097d2b100 x1830881265156864/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.649456:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2b100 with x1830881265156864 ext(2097152->4194303) 00002000:00010000:3.0:1746065208.649460:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d2b100 00000100:00100000:0.0:1746065208.652962:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.655289:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265157120 00000100:00100000:1.0:1746065208.655300:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265157120 00000100:00100000:0.0:1746065208.655336:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.655873:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265157248 00000100:00100000:1.0:1746065208.655877:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265157248 00000100:00100000:1.0:1746065208.655907:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17007 00000100:00100000:1.0:1746065208.655912:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265157248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065208.655919:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.655930:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc14782c1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9389dd expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.655964:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263900800:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065208.656029:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1a4f0c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746065208.659454:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065207 -> 1746065208 00002000:00010000:3.0:1746065208.659462:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065200 -> 1746065208 00002000:00010000:3.0:1746065208.659464:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065207 -> 1746065208 00000100:00100000:3.0:1746065208.659478:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263900928:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065208.659504:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdb000/0xad6b7ddc14782ba lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389d6 expref: 21 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.659516:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdb000/0xad6b7ddc14782ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389d6 expref: 21 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.659527:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb000, rc 0) 00000100:00100000:3.0:1746065208.659550:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265157120:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3660us (6597us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065208.659556:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17006 00002000:00010000:0.0:1746065208.661047:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065206 -> 1746065208 00002000:00010000:0.0:1746065208.661052:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065204 -> 1746065208 00002000:00010000:0.0:1746065208.661054:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065206 -> 1746065208 00000100:00100000:0.0:1746065208.661066:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263900800:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065208.661084:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc14782c1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389dd expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.661093:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a000/0xad6b7ddc14782c1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389dd expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.661105:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a000, rc 0) 00000100:00100000:0.0:1746065208.661533:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265157248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5618us (6199us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065208.661540:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17007 00000100:00100000:3.0:1746065208.668932:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265157504 00000100:00100000:3.0:1746065208.668939:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265157504 00002000:00100000:3.0:1746065208.668974:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88011dad5880 x1830881265157504/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.668982:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5880 with x1830881265157504 ext(4194304->4898815) 00002000:00010000:3.0:1746065208.668987:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad5880 00000100:00100000:3.0:1746065208.669003:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5962 00000100:00100000:3.0:1746065208.669009:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265157504:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065208.676309:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.678591:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265157504:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9575us (9734us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746065208.678600:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5962 00002000:00100000:3.0:1746065208.678610:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88011dad5880 x1830881265157504/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.678618:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5880 with x1830881265157504 ext(4194304->4898815) 00002000:00010000:3.0:1746065208.678624:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad5880 00000100:00100000:3.0:1746065208.678642:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265157760 00000100:00100000:3.0:1746065208.678647:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265157760 00002000:00100000:3.0:1746065208.678669:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff880098dd9180 x1830881265157760/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.678675:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9180 with x1830881265157760 ext(4194304->4898815) 00002000:00010000:3.0:1746065208.678677:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9180 00000100:00100000:0.0:1746065208.682938:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.683290:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265158016 00000100:00100000:1.0:1746065208.683298:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265158016 00000100:00100000:1.0:1746065208.683350:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14466 00000100:00100000:1.0:1746065208.683358:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2178:x1830881265158016:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065208.683381:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.683397:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14782c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9389e4 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.683590:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc14782cf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683602:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc14782cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683613:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc14782cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683624:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14782d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683629:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14782d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683633:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14782d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683721:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc14782dd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683729:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc14782dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683735:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc14782dd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065208.683742:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065208.683835:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc14782cf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683841:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc14782cf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683850:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc14782cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683855:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065208.683858:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc14782cf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683864:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc14782cf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683873:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065208.683876:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065208.683880:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc14782cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683884:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc14782cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683927:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14782d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683933:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14782d6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683937:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14782d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683941:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065208.683944:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14782d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683948:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14782d6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683958:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008c512500) 00010000:00010000:1.0:1746065208.683960:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065208.683962:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14782d6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683966:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14782d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.683997:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14782c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389e4 expref: 13 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.684011:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc14782dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389e4 expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.684016:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.684018:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065208.684021:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1be00, rc 0) 00000100:00100000:1.0:1746065208.684061:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2178:x1830881265158016:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 704us (1129us total) trans 8589936940 rc 0/0 00000100:00100000:1.0:1746065208.684066:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14466 00000100:00100000:0.0:1746065208.684487:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.684524:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.684577:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265158272 00000100:00100000:3.0:1746065208.684581:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265158272 00000100:00100000:3.0:1746065208.684606:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265158144 00000100:00100000:3.0:1746065208.684608:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265158144 00000100:00100000:3.0:1746065208.684618:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17008 00000100:00100000:3.0:1746065208.684623:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265158272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.684630:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.684638:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc14782eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9389f2 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.684671:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263901056:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065208.684718:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.689375:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263901056:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065208.689404:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc14782eb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389f2 expref: 21 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.689417:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc14782eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389f2 expref: 21 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.689456:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61400, rc 0) 00000100:00100000:3.0:1746065208.689499:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265158272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4874us (5012us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065208.689508:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17008 00000100:00100000:0.0:1746065208.690416:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.693219:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.693975:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265158656 00000100:00100000:1.0:1746065208.693982:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265158656 00000100:00100000:1.0:1746065208.694018:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14467 00000100:00100000:1.0:1746065208.694024:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+6:2179:x1830881265158656:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065208.694044:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.694058:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14782f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9389f9 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.694105:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478300 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.694115:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478300 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.694124:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478300 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.694134:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478307 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.694138:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.694143:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.694193:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.694200:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93893c expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.694206:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.694232:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93893c expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.694243:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93893c expref: 28 pid: 7231 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.694258:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263901312:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.694348:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.698811:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.699486:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.699546:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.699597:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265158784 00000100:00100000:3.0:1746065208.699605:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265158784 00000100:00100000:3.0:1746065208.699642:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265158912 00000100:00100000:3.0:1746065208.699644:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265158912 00000100:00100000:0.0:1746065208.699699:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263901312:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065208.699718:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:3.0:1746065208.699885:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17010 00000100:00100000:3.0:1746065208.699892:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265158784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.699906:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.699917:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478315 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938a00 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.699959:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263901440:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065208.700697:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065208.705600:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263901440:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065208.705636:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478315 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a00 expref: 21 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.705655:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478315 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a00 expref: 21 pid: 11461 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065208.705731:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.705807:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265159296 00000100:00100000:1.0:1746065208.705812:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265159296 00010000:00010000:1.0:1746065208.705837:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93893c expref: 30 pid: 7231 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.705860:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7855 00000100:00100000:1.0:1746065208.705866:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265159296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.705879:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.705884:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93893c expref: 30 pid: 7231 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.705893:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93893c expref: 30 pid: 7231 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.705910:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc14781f6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93893c expref: 30 pid: 7231 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.705925:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.705930:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.705940:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.705951:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.705970:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.706008:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265159296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 141us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.706014:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7855 00010000:00010000:3.0:1746065208.706224:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e200, rc 0) 00000100:00100000:3.0:1746065208.706245:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265158784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6354us (7442us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065208.706252:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17010 00010000:00010000:0.0:1746065208.706320:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706326:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065208.706369:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:0.0:1746065208.706373:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065208.706387:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706395:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706402:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478300 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706407:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478300 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706412:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478300 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706417:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065208.706436:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478300 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706442:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478300 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706450:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065208.706453:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065208.706456:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478300 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706459:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478300 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706471:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478307 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706476:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478307 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706480:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478307 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706483:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065208.706485:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478307 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706489:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478307 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706497:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008c512800) 00010000:00010000:0.0:1746065208.706498:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065208.706500:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478307 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706504:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478307 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.706529:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14782f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389f9 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.706538:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389f9 expref: 7 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.706542:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065208.706544:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065208.706546:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b000, rc 0) 00000100:00100000:0.0:1746065208.706566:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+7:2179:x1830881265158656:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 12543us (13353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.706571:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14467 00000100:00100000:0.0:1746065208.717930:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265159424 00000100:00100000:0.0:1746065208.717939:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265159424 00000100:00100000:3.0:1746065208.717950:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265159552 00000100:00100000:3.0:1746065208.717955:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265159552 00000100:00100000:0.0:1746065208.718065:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17012 00000100:00100000:0.0:1746065208.718072:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2007:x1830881265159424:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065208.718102:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.718115:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1478323 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938a0e expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.718178:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.718180:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.718187:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1478323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a0e expref: 9 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.718198:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1478323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a0e expref: 9 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.718206:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73800, rc 0) 00000100:00100000:0.0:1746065208.718237:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265159424:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 166us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.718243:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17012 00000100:00100000:0.0:1746065208.718255:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17013 00000100:00100000:0.0:1746065208.718259:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2006:x1830881265159552:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065208.718264:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.718271:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72200/0xad6b7ddc147832a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938a15 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065208.718297:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263901696:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065208.718326:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.718722:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265159680 00000100:00100000:1.0:1746065208.718726:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265159680 00000100:00100000:1.0:1746065208.718880:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17015 00000100:00100000:1.0:1746065208.718886:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265159680:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065208.718892:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.718898:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1bc00/0xad6b7ddc1478338 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938a1c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.718919:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263901824:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065208.718943:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.719178:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.719222:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.719268:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265160064 00000100:00100000:0.0:1746065208.719272:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265160064 00000100:00100000:0.0:1746065208.719322:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17017 00000100:00100000:0.0:1746065208.719327:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265160064:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065208.719332:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.719339:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1478346 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938a31 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.719347:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.719348:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065208.719352:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1478346 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a31 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.719360:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1478346 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a31 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.719365:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72600, rc 0) 00000100:00100000:0.0:1746065208.719382:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265160064:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 55us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065208.719387:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17017 00000100:00100000:1.0:1746065208.720915:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dda680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263901824:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065208.720941:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1bc00/0xad6b7ddc1478338 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a1c expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.720953:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1bc00/0xad6b7ddc1478338 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a1c expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.720970:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1bc00, rc 0) 00000100:00100000:1.0:1746065208.721000:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265159680:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 2114us (2358us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065208.721007:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17015 00000100:00100000:0.0:1746065208.725448:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.728769:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7100 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263901952:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065208.728818:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1478354 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065208.730938:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.731038:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265160704 00000100:00100000:3.0:1746065208.731045:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265160704 00010000:00010000:3.0:1746065208.731075:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389f9 expref: 9 pid: 13395 timeout: 904 lvb_type: 0 00000100:00100000:3.0:1746065208.731112:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7856 00000100:00100000:3.0:1746065208.731118:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265160704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065208.731131:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065208.731136:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389f9 expref: 9 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.731146:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389f9 expref: 9 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.731166:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc147830e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389f9 expref: 9 pid: 13395 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.731196:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065208.731201:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1478354 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.731209:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1478354 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.731215:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1478354 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065208.731239:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.731272:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265160704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 153us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.731278:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7856 00010000:00010000:1.0:1746065208.731362:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1478354 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065208.731370:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1478354 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:1.0:1746065208.731385:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065208.731554:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5ce800/0xad6b7ddc147834d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a38 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.731708:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1478354 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a38 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.731714:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.731717:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065208.731719:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5cea00, rc 0) 00000100:00100000:1.0:1746065208.731832:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2179:x1830881265160576:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 6156us (6390us total) trans 8589936944 rc 0/0 00000100:00100000:1.0:1746065208.731838:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14468 00000100:00100000:1.0:1746065208.734003:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.734104:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265160960 00000100:00100000:0.0:1746065208.734111:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265160960 00000100:00100000:0.0:1746065208.734248:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14469 00000100:00100000:0.0:1746065208.734255:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2179:x1830881265160960:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065208.734273:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065208.734275:0:13395:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065208.734295:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1478354 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a38 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.734489:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065208.734493:0:13395:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065208.734503:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478362 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938a3f expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.734576:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478369 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.734586:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478369 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.734593:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478369 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.734601:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478369 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.734605:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478369 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.734609:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478369 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.734613:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065208.734616:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478369 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.734620:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478369 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.734625:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065208.734627:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065208.734630:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478369 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.734633:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478369 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065208.734652:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478362 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a3f expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.734659:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478362 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a3f expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065208.734665:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72400, rc 0) 00000100:00100000:0.0:1746065208.734875:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+7:2179:x1830881265160960:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 620us (875us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065208.734882:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14469 00000100:00100000:0.0:1746065208.739204:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.798936:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.810406:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.816099:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.816170:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.816430:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265161728 00000100:00100000:1.0:1746065208.816434:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265161728 00010000:00010000:1.0:1746065208.816453:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc147833f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a2a expref: 11 pid: 9550 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.816469:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265161856 00000100:00100000:1.0:1746065208.816471:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265161856 00010000:00010000:1.0:1746065208.816477:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14782b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389cf expref: 21 pid: 11461 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.816487:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7857 00000100:00100000:1.0:1746065208.816492:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265161728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.816500:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.816514:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc147833f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a2a expref: 11 pid: 9550 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.816522:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc147833f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a2a expref: 11 pid: 9550 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.816538:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6e00/0xad6b7ddc147833f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a2a expref: 11 pid: 9550 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.816551:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.816565:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265161728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.816570:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7857 00000100:00100000:1.0:1746065208.816579:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7858 00000100:00100000:1.0:1746065208.816582:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265161856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.816591:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.816596:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14782b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389cf expref: 21 pid: 11461 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.816604:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14782b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389cf expref: 21 pid: 11461 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.816613:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14782b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389cf expref: 21 pid: 11461 timeout: 904 lvb_type: 0 00010000:00010000:1.0:1746065208.816619:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.816628:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265161856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.816633:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7858 00000100:00100000:0.0:1746065208.818860:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.821462:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.822543:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263902464:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065208.822557:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065208.822580:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881265161984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3117us (3730us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.822588:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7859 00000100:00100000:0.0:1746065208.824147:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.824524:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263902592:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.824539:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f70be00/0xad6b7ddc147839a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->2506751] (req 2097152->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a54 expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.824753:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70be00, rc 0) 00000100:00100000:3.0:1746065208.824790:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2184:x1830881265162112:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2902us (3316us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.824802:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17019 00000100:00100000:0.0:1746065208.828123:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.828164:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.828943:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265162752 00000100:00100000:3.0:1746065208.828947:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265162752 00000100:00100000:3.0:1746065208.828979:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17020 00000100:00100000:3.0:1746065208.828985:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2178:x1830881265162752:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065208.828994:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.829006:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938a5b expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.829025:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc147823c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938966 expref: 30 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.829033:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1478346 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a31 expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.829039:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147827b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938997 expref: 19 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.829044:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.829046:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.829048:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2846719] (req 2097152->2846719) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.829077:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147827b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938997 expref: 19 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.829085:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147827b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938997 expref: 19 pid: 9550 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.829095:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263902720:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.829167:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1478346 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a31 expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.829175:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1478346 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a31 expref: 8 pid: 10219 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.829182:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263902848:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.829208:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc147823c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938966 expref: 30 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.829214:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc147823c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938966 expref: 30 pid: 10219 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.829221:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263902976:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065208.829235:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.833275:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.833288:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.833336:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.833402:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265162880 00000100:00100000:1.0:1746065208.833408:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265162880 00010000:00010000:1.0:1746065208.833441:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1478346 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a31 expref: 9 pid: 10219 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.833460:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265163008 00000100:00100000:1.0:1746065208.833461:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265163008 00010000:00010000:1.0:1746065208.833468:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147827b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938997 expref: 20 pid: 9550 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.833475:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265163136 00000100:00100000:1.0:1746065208.833476:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265163136 00010000:00010000:1.0:1746065208.833481:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc147823c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938966 expref: 31 pid: 10219 timeout: 904 lvb_type: 1 00000100:00100000:1.0:1746065208.833489:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7860 00000100:00100000:1.0:1746065208.833493:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265162880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.833501:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.833513:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1478346 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a31 expref: 9 pid: 10219 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.833519:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1478346 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a31 expref: 9 pid: 10219 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.833534:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.833558:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265162880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.833563:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7860 00000100:00100000:1.0:1746065208.833577:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7861 00000100:00100000:1.0:1746065208.833581:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265163008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.833587:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.833593:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147827b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938997 expref: 20 pid: 9550 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.833600:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147827b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938997 expref: 20 pid: 9550 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.833608:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.833620:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265163008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.833625:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7861 00000100:00100000:1.0:1746065208.833633:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7862 00000100:00100000:1.0:1746065208.833637:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265163136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065208.833642:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065208.833648:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc147823c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938966 expref: 31 pid: 10219 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.833655:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc147823c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938966 expref: 31 pid: 10219 timeout: 904 lvb_type: 1 00010000:00010000:1.0:1746065208.833664:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.833666:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.833671:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.833678:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.833701:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.833710:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263903104:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065208.833752:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f540 going to sleep for 11 seconds 00010000:00010000:3.0:1746065208.833849:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147827b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938997 expref: 19 pid: 9550 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.833864:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263902720:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.833890:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1478346 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a31 expref: 8 pid: 10219 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.833902:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263902848:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.833910:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25800/0xad6b7ddc147823c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938966 expref: 31 pid: 10219 timeout: 904 lvb_type: 1 00000100:00100000:3.0:1746065208.833917:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263902976:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065208.833935:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 18 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.833943:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fa00, rc 0) 00000100:00100000:3.0:1746065208.833960:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2178:x1830881265162752:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4976us (5795us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.833966:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17020 00000100:00100000:0.0:1746065208.834951:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.835395:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263903104:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065208.835405:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065208.835438:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265163136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1800us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.835445:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7862 00000100:00100000:0.0:1746065208.839280:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.842609:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.842648:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.842697:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265163776 00000100:00100000:1.0:1746065208.842701:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265163776 00000100:00100000:1.0:1746065208.842729:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14471 00000100:00100000:1.0:1746065208.842734:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2187:x1830881265163776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065208.842749:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.842761:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14783a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938a62 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.842830:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc14783af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.842841:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc14783af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.842854:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc14783af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.842864:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc14783b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.842869:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc14783b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.842873:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc14783b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.842938:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14783bd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.842945:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14783bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.842950:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14783bd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065208.842961:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065208.843013:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc14783af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843018:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc14783af lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843023:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc14783af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843027:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc14783af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843032:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065208.843035:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc14783af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843040:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc14783af lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843047:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065208.843050:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065208.843053:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc14783af lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843057:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc14783af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843069:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc14783b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843074:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc14783b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843082:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc14783b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843085:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065208.843087:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc14783b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843091:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc14783b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843096:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008c512800) 00010000:00010000:1.0:1746065208.843098:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065208.843099:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc14783b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843103:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc14783b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.843130:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14783a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a62 expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.843138:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14783bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a62 expref: 15 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.843144:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.843146:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065208.843148:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b400, rc 0) 00000100:00100000:1.0:1746065208.843174:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2187:x1830881265163776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 440us (570us total) trans 8589936947 rc 0/0 00000100:00100000:1.0:1746065208.843179:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14471 00000100:00100000:3.0:1746065208.843513:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265164032 00000100:00100000:3.0:1746065208.843518:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265164032 00002000:00100000:3.0:1746065208.843541:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2101247) req@ffff880097faa680 x1830881265164032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.843547:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faa680 with x1830881265164032 ext(2097152->2101247) 00002000:00010000:3.0:1746065208.843551:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097faa680 00000100:00100000:3.0:1746065208.843575:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5965 00000100:00100000:3.0:1746065208.843580:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265164032:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065208.843671:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265164032:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 89us (1021us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065208.843676:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5965 00002000:00100000:3.0:1746065208.843681:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2101247) req@ffff880097faa680 x1830881265164032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/4536 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.843688:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faa680 with x1830881265164032 ext(2097152->2101247) 00002000:00010000:3.0:1746065208.843690:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097faa680 00000100:00100000:0.0:1746065208.849793:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265164288 00000100:00100000:0.0:1746065208.849797:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265164288 00000100:00100000:0.0:1746065208.849827:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5396 00000100:00100000:0.0:1746065208.849832:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2178:x1830881265164288:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065208.851747:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2178:x1830881265164288:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1910us (2792us total) trans 8589936948 rc 0/0 00000100:00100000:0.0:1746065208.851755:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5396 00000100:00100000:0.0:1746065208.855589:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.858284:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263903616:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065208.858309:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc14783d9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a77 expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.858321:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7fa00/0xad6b7ddc14783d9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a77 expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.858340:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7fa00, rc 0) 00002000:00010000:3.0:1746065208.858448:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065208 -> 1746065209 00002000:00010000:3.0:1746065208.858451:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065208 -> 1746065209 00000100:00100000:3.0:1746065208.858461:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263903360:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065208.858477:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f70a400/0xad6b7ddc14783cb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a69 expref: 21 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.858486:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f70a400/0xad6b7ddc14783cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a69 expref: 21 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.858496:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70a400, rc 0) 00000100:00100000:0.0:1746065208.858744:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265164672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9100us (9711us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065208.858750:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17023 00002000:00010000:0.0:1746065208.858788:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065208 -> 1746065209 00002000:00010000:0.0:1746065208.858790:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065208 -> 1746065209 00000100:00100000:0.0:1746065208.858796:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263903488:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065208.858809:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc14783d2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a70 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.858816:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc14783d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a70 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065208.858823:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70b400, rc 0) 00000100:00100000:3.0:1746065208.859263:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265164416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9874us (10277us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065208.859269:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17021 00000100:00100000:0.0:1746065208.859834:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265164544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10308us (10818us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065208.859840:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17022 00000100:00100000:0.0:1746065208.871518:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.877058:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.887824:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.893472:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.901759:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265165824:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7937us (8283us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065208.901770:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5967 00002000:00100000:0.0:1746065208.902184:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880090dd8380 x1830881265165824/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065208.902194:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8380 with x1830881265165824 ext(1048576->2097151) 00002000:00010000:0.0:1746065208.902198:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd8380 00000100:00100000:0.0:1746065208.909917:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.912865:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.913111:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265166208 00000100:00100000:1.0:1746065208.913118:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265166208 00000100:00100000:1.0:1746065208.913158:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14472 00000100:00100000:1.0:1746065208.913164:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2192:x1830881265166208:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065208.913171:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065208.913180:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065208.913186:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265166336 00000100:00100000:0.0:1746065208.913189:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265166336 00010000:00010000:1.0:1746065208.913193:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc14783ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938a8c expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065208.913213:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1675263) req@ffff880090dd9c00 x1830881265166336/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065208.913230:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9c00 with x1830881265166336 ext(1048576->1675263) 00010000:00010000:0.0:1746065208.913235:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc14782ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c8 expref: 31 pid: 9549 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.913247:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc14782ac lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c8 expref: 31 pid: 9549 timeout: 904 lvb_type: 0 00002000:00010000:0.0:1746065208.913253:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090dd9c00 00000100:00100000:0.0:1746065208.913264:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1970 00000100:00100000:0.0:1746065208.913269:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265166336:12345-192.168.202.27@tcp:4:multiop.0 00010000:00010000:1.0:1746065208.913273:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc14783f5 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.913285:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc14783f5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065208.913294:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc14783f5 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065208.913304:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065208.913393:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ae00/0xad6b7ddc14783ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a8c expref: 35 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.913409:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc14783f5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a8c expref: 34 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.913415:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065208.913417:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065208.913432:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a400, rc 0) 00000100:00100000:1.0:1746065208.913453:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2192:x1830881265166208:12345-192.168.202.27@tcp:101:cat.0 Request processed in 289us (588us total) trans 8589936950 rc 0/0 00000100:00100000:1.0:1746065208.913458:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14472 00000100:00100000:3.0:1746065208.917631:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265166464 00000100:00100000:3.0:1746065208.917639:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265166464 00000100:00100000:3.0:1746065208.917683:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265166592 00000100:00100000:3.0:1746065208.917685:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265166592 00000100:00100000:3.0:1746065208.917701:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17026 00000100:00100000:3.0:1746065208.917707:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265166464:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.917722:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.917736:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478403 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938a93 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065208.917760:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.917761:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065208.917768:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478403 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a93 expref: 35 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.917793:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478403 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a93 expref: 35 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.917802:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61400, rc 0) 00000100:00100000:3.0:1746065208.917837:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265166464:12345-192.168.202.27@tcp:101:cat.0 Request processed in 130us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065208.917843:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17026 00000100:00100000:3.0:1746065208.917855:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17027 00000100:00100000:3.0:1746065208.918557:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265166592:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.918566:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.918573:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc147840a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938a9a expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.918607:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263904128:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065208.918648:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17028 00000100:00100000:3.0:1746065208.918650:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.918655:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265166720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065208.918662:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.918669:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc1478411 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938aa1 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065208.918698:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263904256:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065208.918732:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.921403:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881265166336:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 8126us (8225us total) trans 21474841626 rc 0/0 00000100:00100000:0.0:1746065208.921412:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1970 00002000:00100000:0.0:1746065208.921434:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1675263) req@ffff880090dd9c00 x1830881265166336/t21474841626(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/448 e 0 to 0 dl 1746065219 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065208.921443:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9c00 with x1830881265166336 ext(1048576->1675263) 00010000:00010000:0.0:1746065208.921451:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc14782ac lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c8 expref: 38 pid: 9549 timeout: 904 lvb_type: 0 00010000:00010000:0.0:1746065208.921463:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880098c1b800/0xad6b7ddc14782ac lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1675263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389c8 expref: 38 pid: 9549 timeout: 904 lvb_type: 0 00002000:00010000:0.0:1746065208.921470:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090dd9c00 00000100:00100000:3.0:1746065208.921573:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263904128:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065208.921595:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc147840a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a9a expref: 37 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.921604:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc147840a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a9a expref: 37 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.921618:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b60000, rc 0) 00002000:00010000:1.0:1746065208.921624:0:13375:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746065208 -> 1746065209 00002000:00010000:1.0:1746065208.921628:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065208 -> 1746065209 00002000:00010000:1.0:1746065208.921629:0:13375:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746065208 -> 1746065209 00000100:00100000:3.0:1746065208.921635:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265166592:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3080us (4082us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065208.921641:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17027 00000100:00100000:1.0:1746065208.921683:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263904256:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065208.921698:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc1478411 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aa1 expref: 35 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.921706:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc1478411 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aa1 expref: 35 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.921713:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b200, rc 0) 00000100:00100000:1.0:1746065208.921749:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265166720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3094us (3300us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065208.921755:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17028 00000100:00100000:0.0:1746065208.925727:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.930852:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.930911:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265167104 00000100:00100000:0.0:1746065208.930918:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265167104 00002000:00100000:0.0:1746065208.930955:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009077dc00 x1830881265167104/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065208.930963:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077dc00 with x1830881265167104 ext(1048576->2097151) 00002000:00010000:0.0:1746065208.930967:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077dc00 00000100:00100000:0.0:1746065208.930994:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5968 00000100:00100000:0.0:1746065208.931001:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265167104:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065208.931706:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065208.933203:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265167360 00000100:00100000:3.0:1746065208.933212:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265167360 00002000:00100000:3.0:1746065208.933244:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880090dda680 x1830881265167360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.933253:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dda680 with x1830881265167360 ext(1048576->2097151) 00002000:00010000:3.0:1746065208.933257:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dda680 00000100:00100000:3.0:1746065208.933273:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5969 00000100:00100000:3.0:1746065208.933280:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265167360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065208.939895:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265167104:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8885us (9039us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065208.939904:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5968 00002000:00100000:1.0:1746065208.939914:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009077dc00 x1830881265167104/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.939922:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077dc00 with x1830881265167104 ext(1048576->2097151) 00002000:00010000:1.0:1746065208.939927:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077dc00 00000100:00100000:3.0:1746065208.942982:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265167360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9692us (11267us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065208.942993:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5969 00002000:00100000:3.0:1746065208.943002:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880090dda680 x1830881265167360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.943011:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dda680 with x1830881265167360 ext(1048576->2097151) 00002000:00010000:3.0:1746065208.943016:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dda680 00000100:00100000:0.0:1746065208.947980:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.948024:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.948049:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265167488 00000100:00100000:1.0:1746065208.948057:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265167488 00000100:00100000:1.0:1746065208.948105:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265167616 00000100:00100000:1.0:1746065208.948108:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265167616 00000100:00100000:1.0:1746065208.948126:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17029 00000100:00100000:1.0:1746065208.948131:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2187:x1830881265167488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065208.948146:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065208.948163:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1478418 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938aa8 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.948187:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f70be00/0xad6b7ddc147839a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a54 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.948194:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065208.948195:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065208.948198:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1478418 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aa8 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.948223:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f70be00/0xad6b7ddc147839a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a54 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.948234:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f70be00/0xad6b7ddc147839a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a54 expref: 40 pid: 11461 timeout: 904 lvb_type: 0 00000100:00100000:1.0:1746065208.948254:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263904512:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065208.948629:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065208.952951:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.953038:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263904512:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065208.953061:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1478418 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aa8 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.953076:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a600, rc 0) 00000100:00100000:1.0:1746065208.953114:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2187:x1830881265167488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4983us (5141us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.953122:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17029 00000100:00100000:3.0:1746065208.953376:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265167872 00000100:00100000:3.0:1746065208.953383:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265167872 00002000:00100000:3.0:1746065208.953415:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2506751) req@ffff880090ddaa00 x1830881265167872/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.953433:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddaa00 with x1830881265167872 ext(2097152->2506751) 00010000:00010000:3.0:1746065208.953439:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f70be00/0xad6b7ddc147839a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a54 expref: 41 pid: 11461 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.953451:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f70be00/0xad6b7ddc147839a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a54 expref: 41 pid: 11461 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746065208.953456:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090ddaa00 00000100:00100000:3.0:1746065208.953471:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1971 00000100:00100000:3.0:1746065208.953477:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265167872:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065208.954006:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.954270:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265168000 00000100:00100000:1.0:1746065208.954273:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265168000 00002000:00100000:1.0:1746065208.954289:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880090dd9180 x1830881265168000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.954296:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9180 with x1830881265168000 ext(1048576->2097151) 00002000:00010000:1.0:1746065208.954299:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9180 00000100:00100000:1.0:1746065208.954312:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5970 00000100:00100000:1.0:1746065208.954318:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265168000:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065208.963281:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265168000:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8955us (9268us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065208.963291:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5970 00002000:00100000:1.0:1746065208.963300:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880090dd9180 x1830881265168000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.963314:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9180 with x1830881265168000 ext(1048576->2097151) 00002000:00010000:1.0:1746065208.963320:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd9180 00000100:00100000:3.0:1746065208.964309:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265167872:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10829us (11362us total) trans 17179874222 rc 0/0 00000100:00100000:3.0:1746065208.964316:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1971 00002000:00100000:3.0:1746065208.964322:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2506751) req@ffff880090ddaa00 x1830881265167872/t17179874222(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:124/0 lens 488/448 e 0 to 0 dl 1746065219 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.964329:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddaa00 with x1830881265167872 ext(2097152->2506751) 00010000:00010000:3.0:1746065208.964336:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f70be00/0xad6b7ddc147839a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a54 expref: 43 pid: 11461 timeout: 904 lvb_type: 0 00010000:00010000:3.0:1746065208.964348:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f70be00/0xad6b7ddc147839a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2506751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a54 expref: 43 pid: 11461 timeout: 904 lvb_type: 0 00002000:00010000:3.0:1746065208.964354:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090ddaa00 00000100:00100000:0.0:1746065208.968927:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.969767:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.970192:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265168256 00000100:00100000:1.0:1746065208.970196:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265168256 00000100:00100000:1.0:1746065208.970230:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17031 00000100:00100000:1.0:1746065208.970236:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265168256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065208.970247:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065208.970251:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065208.970257:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1478426 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ab6 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065208.970270:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.970271:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065208.970276:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1478426 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ab6 expref: 44 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065208.970328:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265168384 00000100:00100000:3.0:1746065208.970333:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265168384 00000100:00100000:3.0:1746065208.970362:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17032 00000100:00100000:3.0:1746065208.970367:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265168384:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065208.970374:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065208.970384:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc147842d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938abd expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065208.970410:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263904768:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065208.970527:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1478426 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ab6 expref: 44 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065208.970536:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b200, rc 0) 00000100:00100000:3.0:1746065208.970541:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065208.970697:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265168256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 323us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065208.970705:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17031 00000100:00100000:3.0:1746065208.971739:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263904768:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065208.971758:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc147842d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938abd expref: 35 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.971766:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f70b400/0xad6b7ddc147842d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938abd expref: 35 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065208.971807:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70b400, rc 0) 00000100:00100000:3.0:1746065208.971832:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265168384:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1465us (1580us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065208.971838:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17032 00000100:00100000:0.0:1746065208.978434:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065208.978481:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.978536:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265168768 00000100:00100000:1.0:1746065208.978543:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265168768 00000100:00100000:3.0:1746065208.978550:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265168896 00000100:00100000:3.0:1746065208.978553:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265168896 00002000:00100000:3.0:1746065208.978578:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880134b01500 x1830881265168896/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.978578:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2846720->4194303) req@ffff880134b00e00 x1830881265168768/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/0 e 0 to 0 dl 1746065219 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065208.978586:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01500 with x1830881265168896 ext(2097152->4194303) 00002000:00100000:1.0:1746065208.978590:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00e00 with x1830881265168768 ext(2846720->4194303) 00002000:00010000:3.0:1746065208.978591:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01500 00002000:00010000:1.0:1746065208.978593:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b00e00 00000100:00100000:3.0:1746065208.978615:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5971 00000100:00100000:1.0:1746065208.978619:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5972 00000100:00100000:3.0:1746065208.978621:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265168896:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065208.978622:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265168768:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065208.988434:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065208.992554:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265168768:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13791us (13999us total) trans 0 rc 1347584/1347584 00000100:00100000:1.0:1746065208.992566:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5972 00002000:00100000:1.0:1746065208.992576:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2846720->4194303) req@ffff880134b00e00 x1830881265168768/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 1347584/1347584 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065208.992585:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00e00 with x1830881265168768 ext(2846720->4194303) 00002000:00010000:1.0:1746065208.992590:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b00e00 00000100:00100000:3.0:1746065209.000203:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265168896:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21573us (21712us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065209.000213:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5971 00002000:00100000:3.0:1746065209.000224:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880134b01500 x1830881265168896/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:124/0 lens 488/440 e 0 to 0 dl 1746065219 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.000232:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01500 with x1830881265168896 ext(2097152->4194303) 00002000:00010000:3.0:1746065209.000237:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01500 00000100:00100000:0.0:1746065209.006460:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.006548:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265169280 00000100:00100000:3.0:1746065209.006668:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265169280 00000100:00100000:3.0:1746065209.007460:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17033 00000100:00100000:3.0:1746065209.007468:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2192:x1830881265169280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.007483:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.007498:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478434 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ac4 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.007521:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.007528:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065209.007529:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065209.007533:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478434 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ac4 expref: 35 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.007560:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 19 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.007570:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 19 pid: 11461 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.007580:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263904896:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065209.007654:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065209.009885:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263904896:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065209.009906:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478434 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ac4 expref: 35 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.009919:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61800, rc 0) 00000100:00100000:3.0:1746065209.009960:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2192:x1830881265169280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2493us (3567us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.009968:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17033 00000100:00100000:0.0:1746065209.011108:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.011562:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.011977:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265169664 00000100:00100000:3.0:1746065209.011981:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265169664 00002000:00100000:3.0:1746065209.012254:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2846719) req@ffff880134b01f80 x1830881265169664/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.012261:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01f80 with x1830881265169664 ext(2097152->2846719) 00010000:00010000:3.0:1746065209.012267:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 20 pid: 11461 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.012277:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 20 pid: 11461 timeout: 905 lvb_type: 0 00002000:00010000:3.0:1746065209.012286:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b01f80 00000100:00100000:3.0:1746065209.012296:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1972 00000100:00100000:3.0:1746065209.012301:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265169664:12345-192.168.202.27@tcp:4:cat.0 00000100:00080000:0.0:1746065209.012445:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1746065209.012447:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065209.028538:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265169664:12345-192.168.202.27@tcp:4:cat.0 Request processed in 16228us (16967us total) trans 21474841627 rc 0/0 00000100:00100000:0.0:1746065209.028548:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1972 00002000:00100000:0.0:1746065209.028557:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2846719) req@ffff880134b01f80 x1830881265169664/t21474841627(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/448 e 0 to 0 dl 1746065220 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065209.028566:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01f80 with x1830881265169664 ext(2097152->2846719) 00010000:00010000:0.0:1746065209.028574:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 22 pid: 11461 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.028588:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009580fa00/0xad6b7ddc14783a1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2846719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a5b expref: 22 pid: 11461 timeout: 905 lvb_type: 0 00002000:00010000:0.0:1746065209.028594:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b01f80 00000100:00100000:0.0:1746065209.029347:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.029568:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265169792 00000100:00100000:3.0:1746065209.029576:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265169792 00000100:00100000:3.0:1746065209.029615:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17034 00000100:00100000:3.0:1746065209.029621:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265169792:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.029634:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.029646:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f70be00/0xad6b7ddc147843b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938acb expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.029684:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263905024:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065209.029761:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065209.032147:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263905024:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065209.032173:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f70be00/0xad6b7ddc147843b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938acb expref: 23 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.032185:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f70be00/0xad6b7ddc147843b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938acb expref: 23 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.032208:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70be00, rc 0) 00000100:00100000:3.0:1746065209.032241:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265169792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2619us (2894us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065209.032247:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17034 00000100:00100000:0.0:1746065209.034168:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.039057:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.039182:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265170048 00000100:00100000:3.0:1746065209.039188:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265170048 00000100:00100000:3.0:1746065209.039230:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17035 00000100:00100000:3.0:1746065209.039237:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265170048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.039252:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.039265:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478442 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ad2 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.039285:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.039286:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.039294:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478442 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad2 expref: 22 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.039306:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478442 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad2 expref: 22 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.039315:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e200, rc 0) 00000100:00100000:3.0:1746065209.039348:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265170048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 111us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.039353:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17035 00000100:00100000:0.0:1746065209.046355:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.046394:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.046454:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.046489:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265170816 00000100:00100000:0.0:1746065209.046495:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265170816 00000100:00100000:0.0:1746065209.046541:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5398 00000100:00100000:0.0:1746065209.046547:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2187:x1830881265170816:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:0.0:1746065209.046691:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b27450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2187:x1830881265170816:12345-192.168.202.27@tcp:35:cat.0 Request processed in 144us (236us total) trans 8589936951 rc 0/0 00000100:00100000:0.0:1746065209.046696:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5398 00000100:00080000:1.0:1746065209.047534:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065209.048679:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265170560 00000100:00100000:3.0:1746065209.048686:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265170560 00002000:00100000:3.0:1746065209.048720:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880134b01880 x1830881265170560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.048728:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01880 with x1830881265170560 ext(2097152->4194303) 00002000:00010000:3.0:1746065209.048732:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b01880 00000100:00100000:3.0:1746065209.048752:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5975 00000100:00100000:3.0:1746065209.048764:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265170432:12345-192.168.202.27@tcp:3:cat.0 00000100:00080000:1.0:1746065209.049801:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065209.065278:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265170432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16509us (18919us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065209.065289:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5975 00002000:00100000:3.0:1746065209.065300:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880134b00380 x1830881265170432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/440 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.065309:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00380 with x1830881265170432 ext(3145728->4194303) 00002000:00010000:3.0:1746065209.065315:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b00380 00000100:00100000:1.0:1746065209.065397:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:1.0:1746065209.067127:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065209.076850:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.079120:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265171200 00000100:00100000:1.0:1746065209.079130:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265171200 00000100:00100000:1.0:1746065209.079206:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17036 00000100:00100000:1.0:1746065209.079213:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265171200:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065209.079227:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065209.079241:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc1478465 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ae7 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.079264:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.079267:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.079277:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc1478465 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae7 expref: 9 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.079290:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc1478465 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae7 expref: 9 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.079299:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c718a00, rc 0) 00000100:00100000:1.0:1746065209.079344:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265171200:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 132us (2504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.079349:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17036 00000100:00100000:3.0:1746065209.079469:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.079577:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.079611:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.079631:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17038 00000100:00100000:3.0:1746065209.079637:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265171072:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065209.079643:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.079651:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1478473 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ae0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.079661:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.079662:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.079666:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1478473 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae0 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.079674:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1478473 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae0 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.079681:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779200, rc 0) 00000100:00100000:3.0:1746065209.079700:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265171072:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 64us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.079706:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17038 00000100:00100000:0.0:1746065209.088312:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.088897:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.088928:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265171968 00000100:00100000:0.0:1746065209.088932:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265171968 00000100:00100000:0.0:1746065209.088958:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14474 00000100:00100000:0.0:1746065209.088964:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2198:x1830881265171968:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065209.088981:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065209.088995:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a600/0xad6b7ddc1478481 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938afc expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.089075:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.089088:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478385 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a46 expref: 33 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.089094:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14783bd lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a62 expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.089100:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc147845e lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad9 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.089106:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.089131:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc147845e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad9 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.089141:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc147845e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad9 expref: 8 pid: 9571 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.089150:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263905280:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065209.093599:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14783bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a62 expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.093613:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14783bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a62 expref: 18 pid: 9571 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.093625:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263905408:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065209.093673:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478385 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a46 expref: 33 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.093679:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478385 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a46 expref: 33 pid: 13395 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.093686:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263905536:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065209.093700:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065209.093818:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.093839:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265172480 00000100:00100000:3.0:1746065209.093844:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265172480 00000100:00100000:3.0:1746065209.093885:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14475 00000100:00100000:3.0:1746065209.093891:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2193:x1830881265172480:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065209.093904:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.093917:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc147848f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b0a expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.093993:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.094005:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.094013:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:3.0:1746065209.094075:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.094120:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265172224 00000100:00100000:3.0:1746065209.094123:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265172224 00000100:00100000:3.0:1746065209.094149:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14476 00000100:00100000:3.0:1746065209.094154:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2197:x1830881265172224:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065209.094163:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.094169:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46a00/0xad6b7ddc147849d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b03 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.094204:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784a4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065209.094211:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784a4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065209.094216:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784a4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00080000:3.0:1746065209.094234:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065209.100727:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.101114:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265172608 00000100:00100000:3.0:1746065209.101122:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265172608 00010000:00010000:3.0:1746065209.101149:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc147845e lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad9 expref: 11 pid: 9571 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.101565:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7868 00000100:00100000:3.0:1746065209.101573:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265172608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.101585:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.101590:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc147845e lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad9 expref: 11 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.101600:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc147845e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad9 expref: 11 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.101618:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc147845e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad9 expref: 11 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.101642:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.101647:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.101655:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.101660:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.101702:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265172608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 129us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.101708:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7868 00000100:00100000:0.0:1746065209.102600:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.102641:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265172736 00000100:00100000:1.0:1746065209.102646:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265172736 00010000:00010000:1.0:1746065209.102664:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14783bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a62 expref: 19 pid: 9571 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746065209.102847:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7869 00000100:00100000:1.0:1746065209.102853:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265172736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065209.102861:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065209.102866:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14783bd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a62 expref: 19 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.102873:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14783bd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a62 expref: 19 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.102887:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc14783bd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a62 expref: 19 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.102900:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065209.102904:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.102910:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.102914:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065209.102935:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265172736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.102941:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7869 00000100:00100000:0.0:1746065209.103301:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.103361:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265171712:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12398us (15055us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746065209.103368:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5977 00002000:00100000:3.0:1746065209.103376:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88009577f800 x1830881265171712/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/440 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.103385:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f800 with x1830881265171712 ext(4194304->4898815) 00000100:00100000:1.0:1746065209.103411:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265172864 00000100:00100000:1.0:1746065209.103426:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265172864 00010000:00010000:1.0:1746065209.103437:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478385 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a46 expref: 36 pid: 13395 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746065209.103452:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7870 00000100:00100000:1.0:1746065209.103456:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265172864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065209.103463:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065209.103466:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478385 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a46 expref: 36 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.103474:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478385 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a46 expref: 36 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.103485:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478385 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a46 expref: 36 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.103493:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065209.103496:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.103503:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.103509:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.103515:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065209.103519:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065209.103523:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065209.103528:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784a4 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065209.103533:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784a4 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065209.103537:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784a4 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065209.103566:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065209.103581:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265172864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 124us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.103586:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7870 00002000:00010000:3.0:1746065209.103680:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577f800 00010000:00010000:3.0:1746065209.103702:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.103707:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065209.103717:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065209.103768:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc147848f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b0a expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.103794:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b0a expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.103799:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.103801:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065209.103803:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778200, rc 0) 00000100:00100000:3.0:1746065209.103820:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2193:x1830881265172480:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 9929us (10003us total) trans 8589936953 rc 0/0 00000100:00100000:3.0:1746065209.103825:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14475 00000100:00100000:0.0:1746065209.116917:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265172992 00000100:00100000:0.0:1746065209.116925:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265172992 00000100:00100000:0.0:1746065209.116962:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14477 00000100:00100000:0.0:1746065209.116969:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2193:x1830881265172992:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065209.116987:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065209.117002:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784c0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b11 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.117075:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.117089:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938afc expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.117095:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b0a expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.117102:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784a4 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b03 expref: 34 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.117108:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 6/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.117136:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784a4 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b03 expref: 34 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.117145:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784a4 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b03 expref: 34 pid: 7231 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.117155:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459c00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263905664:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065209.117239:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b0a expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.117246:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b0a expref: 11 pid: 9571 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.117253:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263905792:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065209.117276:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938afc expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.117283:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938afc expref: 17 pid: 13395 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.117289:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263905920:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065209.117304:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065209.130191:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265173120 00000100:00100000:1.0:1746065209.130198:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265173120 00010000:00010000:1.0:1746065209.130226:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b0a expref: 12 pid: 9571 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746065209.130718:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7871 00000100:00100000:1.0:1746065209.130727:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265173120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065209.130862:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065209.130868:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b0a expref: 12 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.130877:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b0a expref: 12 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.130895:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095778200/0xad6b7ddc1478496 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b0a expref: 12 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.130909:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065209.130913:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.130920:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.130925:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.130929:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065209.133766:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265173120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3032us (3813us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.133795:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7871 00000100:00100000:0.0:1746065209.135402:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.135483:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265173376 00000100:00100000:1.0:1746065209.135492:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265173376 00010000:00010000:1.0:1746065209.135523:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938afc expref: 18 pid: 13395 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746065209.135553:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7872 00000100:00100000:1.0:1746065209.135558:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265173376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065209.135568:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065209.135572:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938afc expref: 18 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.135581:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938afc expref: 18 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.135598:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478488 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938afc expref: 18 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.135609:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065209.135612:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.135619:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.135623:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.135627:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065209.135669:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265173376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.135674:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7872 00000100:00100000:0.0:1746065209.136468:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.142235:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.149410:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.150273:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265173888 00000100:00100000:1.0:1746065209.150282:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265173888 00000100:00100000:1.0:1746065209.150319:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5399 00000100:00100000:1.0:1746065209.150325:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2193:x1830881265173888:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065209.150495:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2193:x1830881265173888:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 168us (1094us total) trans 8589936955 rc 0/0 00000100:00100000:1.0:1746065209.150501:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5399 00000100:00100000:0.0:1746065209.165271:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.165543:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265174016 00000100:00100000:1.0:1746065209.165552:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265174016 00000100:00100000:1.0:1746065209.165958:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17040 00000100:00100000:1.0:1746065209.165967:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2197:x1830881265174016:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065209.165982:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065209.166167:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b1f expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.166191:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478434 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ac4 expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.166198:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46200/0xad6b7ddc147846c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938af5 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.166203:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478442 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad2 expref: 21 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.166208:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.166209:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.166212:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2871296->3145727] (req 2871296->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.166240:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478442 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad2 expref: 21 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.166249:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478442 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad2 expref: 21 pid: 3067 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746065209.166259:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263906048:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.166350:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46200/0xad6b7ddc147846c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938af5 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.166358:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d46200/0xad6b7ddc147846c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938af5 expref: 10 pid: 3067 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746065209.166366:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263906176:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.166394:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478434 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ac4 expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.166401:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478434 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ac4 expref: 36 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746065209.166407:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263906304:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065209.166702:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.171668:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.171839:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263906048:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065209.171850:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263906176:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065209.171856:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263906304:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.171885:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2871296->3145727] (req 2871296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.171898:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:1.0:1746065209.171938:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+36:2197:x1830881265174016:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5973us (6678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.171947:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17040 00000100:00100000:0.0:1746065209.172370:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.172576:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265174144 00000100:00100000:3.0:1746065209.172582:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265174144 00010000:00010000:3.0:1746065209.172606:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478442 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad2 expref: 22 pid: 3067 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746065209.172625:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265174272 00000100:00100000:3.0:1746065209.172627:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265174272 00010000:00010000:3.0:1746065209.172637:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46200/0xad6b7ddc147846c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938af5 expref: 11 pid: 3067 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746065209.173198:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7874 00000100:00100000:3.0:1746065209.173206:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265174144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.173218:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.173237:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478442 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad2 expref: 22 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.173246:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478442 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad2 expref: 22 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.173266:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009580e200/0xad6b7ddc1478442 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ad2 expref: 22 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.173289:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.173318:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265174144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 113us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.173327:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7874 00000100:00100000:3.0:1746065209.173339:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7875 00000100:00100000:3.0:1746065209.173343:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265174272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.173348:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.173354:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d46200/0xad6b7ddc147846c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938af5 expref: 11 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.173361:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d46200/0xad6b7ddc147846c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938af5 expref: 11 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.173370:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46200/0xad6b7ddc147846c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938af5 expref: 11 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.173376:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.173387:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265174272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 43us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.173391:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7875 00000100:00100000:0.0:1746065209.174043:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.174655:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265174400 00000100:00100000:3.0:1746065209.174662:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265174400 00010000:00010000:3.0:1746065209.174684:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478434 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ac4 expref: 36 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.174708:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7876 00000100:00100000:3.0:1746065209.174714:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881265174400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.174721:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.174733:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478434 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ac4 expref: 36 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.174743:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478434 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ac4 expref: 36 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.174757:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478434 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ac4 expref: 36 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.174767:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.174769:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.174792:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.174800:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.174828:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.174837:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263906432:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065209.174902:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065209.178006:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263906432:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065209.178376:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.178413:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265174400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3698us (4370us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.178430:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7876 00000100:00100000:0.0:1746065209.178607:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.179049:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265174656 00000100:00100000:3.0:1746065209.179055:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265174656 00002000:00100000:3.0:1746065209.179084:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2871296->2875391) req@ffff8800900f2680 x1830881265174656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.179093:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2680 with x1830881265174656 ext(2871296->2875391) 00002000:00010000:3.0:1746065209.179098:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f2680 00000100:00100000:3.0:1746065209.179113:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5978 00000100:00100000:3.0:1746065209.179118:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265174656:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065209.179212:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265174656:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 93us (605us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065209.179218:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5978 00002000:00100000:3.0:1746065209.179222:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2871296->2875391) req@ffff8800900f2680 x1830881265174656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/4536 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.179228:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2680 with x1830881265174656 ext(2871296->2875391) 00002000:00010000:3.0:1746065209.179230:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f2680 00000100:00100000:0.0:1746065209.185911:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.185999:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.186910:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265175040 00000100:00100000:3.0:1746065209.186915:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265175040 00000100:00100000:3.0:1746065209.186943:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14479 00000100:00100000:3.0:1746065209.186948:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c1bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2203:x1830881265175040:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.186961:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.186971:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095779c00/0xad6b7ddc14784ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b2d expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.187025:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc14784f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187038:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc14784f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187046:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc14784f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187058:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc14784f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187062:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc14784f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187068:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc14784f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187263:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784ff lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187272:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187278:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784ff lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065209.187285:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065209.187344:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc14784f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187350:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc14784f1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187354:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc14784f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187359:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc14784f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187364:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095779600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065209.187367:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc14784f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187372:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc14784f1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187380:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065209.187382:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065209.187385:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc14784f1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187388:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779600/0xad6b7ddc14784f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187411:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc14784f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187425:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc14784f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187430:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc14784f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187433:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c284a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065209.187436:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc14784f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187440:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc14784f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187446:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5700) 00010000:00010000:3.0:1746065209.187448:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065209.187453:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc14784f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187457:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc14784f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.187488:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779c00/0xad6b7ddc14784ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b2d expref: 20 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.187497:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b2d expref: 19 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.187501:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.187503:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065209.187505:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c285800, rc 0) 00000100:00100000:3.0:1746065209.187544:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c1bd850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2203:x1830881265175040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 595us (1544us total) trans 8589936956 rc 0/0 00000100:00100000:3.0:1746065209.187550:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14479 00000100:00100000:0.0:1746065209.191968:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.192058:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.192086:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265175168 00000100:00100000:0.0:1746065209.192091:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265175168 00010000:00010000:0.0:1746065209.192112:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1478426 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ab6 expref: 44 pid: 13375 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746065209.192144:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265175296 00000100:00100000:0.0:1746065209.192147:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265175296 00010000:00010000:0.0:1746065209.192157:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc147847a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aee expref: 11 pid: 9549 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746065209.192187:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7877 00000100:00100000:0.0:1746065209.192194:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265175168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.192206:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065209.192225:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1478426 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ab6 expref: 44 pid: 13375 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746065209.192234:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1478426 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ab6 expref: 44 pid: 13375 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746065209.192254:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc1478426 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ab6 expref: 44 pid: 13375 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746065209.192269:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065209.192296:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265175168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 102us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.192301:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7877 00000100:00100000:0.0:1746065209.192338:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7878 00000100:00100000:0.0:1746065209.192344:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265175296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.192351:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065209.192360:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc147847a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aee expref: 11 pid: 9549 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746065209.192369:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc147847a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aee expref: 11 pid: 9549 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746065209.192384:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae23c00/0xad6b7ddc147847a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aee expref: 11 pid: 9549 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746065209.192392:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065209.192410:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265175296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.192427:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7878 00000100:00100000:0.0:1746065209.193433:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.194097:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.194172:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265175424 00000100:00100000:3.0:1746065209.194177:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265175424 00000100:00100000:3.0:1746065209.194218:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265175552 00000100:00100000:3.0:1746065209.194222:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265175552 00000100:00100000:3.0:1746065209.194539:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17042 00000100:00100000:3.0:1746065209.194548:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265175424:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.194563:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.194582:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095778200/0xad6b7ddc147850d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b34 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.194602:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.194610:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095778200/0xad6b7ddc147850d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b34 expref: 23 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.194620:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095778200/0xad6b7ddc147850d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b34 expref: 23 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.194633:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095778200, rc 0) 00000100:00100000:0.0:1746065209.194869:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17043 00000100:00100000:0.0:1746065209.194877:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265175552:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065209.194885:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065209.194895:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b6000/0xad6b7ddc1478514 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b3b expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.194934:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263906944:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065209.195089:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265175424:12345-192.168.202.27@tcp:101:cat.0 Request processed in 541us (1656us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065209.195095:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17042 00000100:00100000:0.0:1746065209.195624:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.196701:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.197238:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265175680 00000100:00100000:3.0:1746065209.197244:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265175680 00010000:00010000:3.0:1746065209.197266:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1478418 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aa8 expref: 22 pid: 13375 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.197330:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7879 00000100:00100000:3.0:1746065209.197337:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265175680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.197347:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.197361:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1478418 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aa8 expref: 22 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.197369:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1478418 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aa8 expref: 22 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.197385:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5a600/0xad6b7ddc1478418 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aa8 expref: 22 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.197395:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.197397:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.197402:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc14784e3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b26 expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.197409:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc14784e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b26 expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.197441:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc14784e3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b26 expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.197449:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263907072:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065209.197858:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065209.205267:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263907072:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065209.205286:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.205331:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265175680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7993us (8631us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.205341:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7879 00000100:00100000:0.0:1746065209.215522:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265175936 00000100:00100000:0.0:1746065209.215530:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265175936 00002000:00100000:0.0:1746065209.215565:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3371008->3375103) req@ffff880129f41c00 x1830881265175936/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065209.215573:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41c00 with x1830881265175936 ext(3371008->3375103) 00002000:00010000:0.0:1746065209.215578:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f41c00 00000100:00100000:0.0:1746065209.215602:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5979 00000100:00100000:0.0:1746065209.215608:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265175936:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065209.216128:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265175936:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 519us (937us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065209.216134:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5979 00002000:00100000:0.0:1746065209.216140:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3371008->3375103) req@ffff880129f41c00 x1830881265175936/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/4536 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065209.216147:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41c00 with x1830881265175936 ext(3371008->3375103) 00002000:00010000:0.0:1746065209.216149:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f41c00 00000100:00100000:1.0:1746065209.216968:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.218624:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265176064 00000100:00100000:3.0:1746065209.218633:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265176064 00000100:00100000:3.0:1746065209.218671:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265176192 00000100:00100000:3.0:1746065209.218673:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265176192 00000100:00100000:3.0:1746065209.218694:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17044 00000100:00100000:3.0:1746065209.218701:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265176064:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.218715:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.218730:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc147851b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b42 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.218787:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263907200:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065209.218861:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065209.218879:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17045 00000100:00100000:3.0:1746065209.218885:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2198:x1830881265176192:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065209.218892:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.218901:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1478522 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b49 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.218917:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d47e00/0xad6b7ddc14783e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a7e expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.218925:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1478473 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae0 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.218931:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478403 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a93 expref: 34 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.218937:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.218939:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.218942:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1478522 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1548288->2097151] (req 1548288->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b49 expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.218959:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478403 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a93 expref: 34 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.218968:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478403 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a93 expref: 34 pid: 10219 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746065209.218980:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263907328:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065209.219007:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1478473 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae0 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.219015:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1478473 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae0 expref: 9 pid: 10219 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746065209.219022:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263907456:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065209.219042:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d47e00/0xad6b7ddc14783e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a7e expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.219049:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d47e00/0xad6b7ddc14783e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a7e expref: 22 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.219056:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263907584:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065209.219069:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.220762:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.221973:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:3.0:1746065209.224479:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065208 -> 1746065209 00000100:00100000:3.0:1746065209.224493:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263907200:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065209.224518:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc147851b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b42 expref: 22 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.224529:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095779c00/0xad6b7ddc147851b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b42 expref: 22 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.224546:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779c00, rc 0) 00000100:00100000:3.0:1746065209.224598:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265176064:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5897us (8707us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065209.224606:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17044 00000100:00100000:0.0:1746065209.227143:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.227158:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.227935:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263907712:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065209.227955:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478529 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b50 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.227964:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ae00/0xad6b7ddc1478529 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b50 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.227971:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ae00, rc 0) 00000100:00100000:3.0:1746065209.227987:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265176320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6750us (7232us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065209.227992:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17046 00000100:00100000:0.0:1746065209.228081:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.228154:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265176704 00000100:00100000:3.0:1746065209.228159:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265176704 00010000:00010000:3.0:1746065209.228179:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478403 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a93 expref: 35 pid: 10219 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746065209.228205:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265176832 00000100:00100000:3.0:1746065209.228208:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265176832 00010000:00010000:3.0:1746065209.228216:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1478473 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae0 expref: 10 pid: 10219 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746065209.228231:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265176960 00000100:00100000:3.0:1746065209.228232:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265176960 00010000:00010000:3.0:1746065209.228238:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47e00/0xad6b7ddc14783e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a7e expref: 22 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.228255:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7880 00000100:00100000:3.0:1746065209.228260:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265176704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.228272:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.228280:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478403 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a93 expref: 35 pid: 10219 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.228289:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478403 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a93 expref: 35 pid: 10219 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.228305:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478403 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a93 expref: 35 pid: 10219 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.228312:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.228327:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265176704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.228332:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7880 00000100:00100000:3.0:1746065209.228342:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7881 00000100:00100000:3.0:1746065209.228346:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265176832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.228351:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.228357:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1478473 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae0 expref: 10 pid: 10219 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.228363:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1478473 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae0 expref: 10 pid: 10219 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.228372:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc1478473 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae0 expref: 10 pid: 10219 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.228379:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.228392:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265176832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (1233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.228397:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7881 00000100:00100000:3.0:1746065209.228405:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7882 00000100:00100000:3.0:1746065209.228409:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265176960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.228414:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.228430:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d47e00/0xad6b7ddc14783e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a7e expref: 22 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.228438:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d47e00/0xad6b7ddc14783e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a7e expref: 22 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.228448:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d47e00/0xad6b7ddc14783e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a7e expref: 22 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.228455:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.228457:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.228463:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1478522 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b49 expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.228470:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1478522 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b49 expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.228492:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1478522 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b49 expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.228501:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263907840:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065209.228542:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.231264:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.231668:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263907840:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065209.231682:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.231708:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265176960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3297us (3626us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.231715:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7882 00000100:00100000:0.0:1746065209.235184:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.235644:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265177216 00000100:00100000:1.0:1746065209.235651:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265177216 00002000:00100000:1.0:1746065209.235692:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3375103) req@ffff8800900f2300 x1830881265177216/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065209.235701:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2300 with x1830881265177216 ext(3145728->3375103) 00010000:00010000:1.0:1746065209.235710:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc14784e3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b26 expref: 43 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.235722:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc14784e3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b26 expref: 43 pid: 13375 timeout: 905 lvb_type: 0 00002000:00010000:1.0:1746065209.235728:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800900f2300 00000100:00100000:1.0:1746065209.235758:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1973 00000100:00100000:1.0:1746065209.235765:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265177216:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065209.238443:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.238485:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.238793:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265177472 00000100:00100000:3.0:1746065209.238797:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265177472 00000100:00100000:3.0:1746065209.238821:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14480 00000100:00100000:3.0:1746065209.238826:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2207:x1830881265177472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.238838:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.238849:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc147853e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b5e expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.238904:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478545 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.238914:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478545 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.238924:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478545 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.238934:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147854c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.238939:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147854c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.238944:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147854c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239018:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1478553 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239026:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1478553 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239031:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1478553 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065209.239038:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065209.239093:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478545 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239098:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478545 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239103:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478545 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239107:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478545 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239112:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577a200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065209.239116:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478545 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239121:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478545 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239129:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065209.239131:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065209.239134:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478545 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239138:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478545 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239161:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147854c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239166:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147854c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239170:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147854c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239174:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065209.239176:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147854c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239180:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147854c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239186:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5900) 00010000:00010000:3.0:1746065209.239188:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065209.239190:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147854c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239198:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147854c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065209.239227:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc147853e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b5e expref: 38 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.239249:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1478553 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b5e expref: 37 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.239255:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.239256:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065209.239258:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779200, rc 0) 00000100:00100000:3.0:1746065209.239283:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2207:x1830881265177472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 456us (846us total) trans 8589936958 rc 0/0 00000100:00100000:3.0:1746065209.239290:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14480 00000100:00100000:0.0:1746065209.243677:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.243714:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.243732:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265177728 00000100:00100000:0.0:1746065209.243740:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265177728 00010000:00010000:0.0:1746065209.243789:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc1478465 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae7 expref: 9 pid: 13375 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746065209.243812:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265177856 00000100:00100000:0.0:1746065209.243814:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265177856 00010000:00010000:0.0:1746065209.243825:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc147841f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aaf expref: 34 pid: 9549 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.243838:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7883 00000100:00100000:0.0:1746065209.243845:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265177728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.243855:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065209.243872:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc1478465 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae7 expref: 9 pid: 13375 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746065209.243881:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c718a00/0xad6b7ddc1478465 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ae7 expref: 9 pid: 13375 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746065209.243902:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.243917:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7884 00000100:00100000:3.0:1746065209.243925:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265177856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.243932:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065209.243934:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265177728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.243940:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7883 00010000:00010000:3.0:1746065209.243941:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc147841f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aaf expref: 34 pid: 9549 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.243950:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d47200/0xad6b7ddc147841f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938aaf expref: 34 pid: 9549 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.243963:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065209.243974:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.243980:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265177856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.243987:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265177984 00000100:00100000:3.0:1746065209.243989:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7884 00000100:00100000:0.0:1746065209.243990:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265177984 00010000:00010000:0.0:1746065209.244000:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc14783e7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a85 expref: 23 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.244013:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7885 00000100:00100000:0.0:1746065209.244017:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265177984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.244022:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065209.244029:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc14783e7 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a85 expref: 23 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.245056:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc14783e7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a85 expref: 22 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.245068:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46c00/0xad6b7ddc14783e7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a85 expref: 22 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.245090:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.245092:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.245097:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.245104:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.245129:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.245139:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263908480:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065209.245189:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065209.245486:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881265177216:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 9719us (10306us total) trans 17179874223 rc 0/0 00000100:00100000:1.0:1746065209.245493:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1973 00002000:00100000:1.0:1746065209.245500:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3375103) req@ffff8800900f2300 x1830881265177216/t17179874223(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/448 e 0 to 0 dl 1746065220 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065209.245508:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2300 with x1830881265177216 ext(3145728->3375103) 00010000:00010000:1.0:1746065209.245518:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc14784e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b26 expref: 45 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.245527:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc14784e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b26 expref: 45 pid: 13375 timeout: 905 lvb_type: 0 00002000:00010000:1.0:1746065209.245533:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800900f2300 00000100:00100000:0.0:1746065209.245832:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.245882:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265178240 00000100:00100000:1.0:1746065209.245886:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265178240 00000100:00100000:1.0:1746065209.245923:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5401 00000100:00100000:1.0:1746065209.245929:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2207:x1830881265178240:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065209.246449:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2207:x1830881265178240:12345-192.168.202.27@tcp:35:cat.0 Request processed in 518us (615us total) trans 8589936959 rc 0/0 00000100:00100000:1.0:1746065209.246455:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5401 00000100:00100000:1.0:1746065209.248240:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263908480:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065209.248260:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065209.248293:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265177984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4274us (4318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.248304:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7885 00000100:00100000:0.0:1746065209.248491:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.248727:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.248753:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.248769:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265178496 00000100:00100000:0.0:1746065209.248788:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265178496 00000100:00100000:0.0:1746065209.248814:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265178624 00000100:00100000:0.0:1746065209.248816:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265178624 00000100:00100000:0.0:1746065209.248833:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17049 00000100:00100000:0.0:1746065209.248838:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a5038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265178496:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065209.248879:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17050 00000100:00100000:3.0:1746065209.248885:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881265178624:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.248891:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.248903:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779600/0xad6b7ddc1478561 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b73 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.248941:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263908608:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065209.248980:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065209.249008:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.249018:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265178752 00000100:00100000:3.0:1746065209.249020:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265178752 00010000:00010000:0.0:1746065209.249045:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065209.249051:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b6000/0xad6b7ddc1478568 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b6c expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.249071:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263908736:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065209.249086:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.249096:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17051 00000100:00100000:0.0:1746065209.249100:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881265178752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065209.249105:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065209.249112:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc147856f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b7a expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.249128:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263908864:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065209.249140:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065209.249264:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265178368 00000100:00100000:1.0:1746065209.249268:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265178368 00010000:00010000:1.0:1746065209.249284:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc14784e3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b26 expref: 47 pid: 13375 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746065209.249300:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7886 00000100:00100000:1.0:1746065209.249305:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265178368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065209.249312:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065209.249326:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc14784e3 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b26 expref: 47 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.249336:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131beec00/0xad6b7ddc14784e3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3375103) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b26 expref: 47 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.249352:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.249354:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.249360:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1478530 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b57 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.249367:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1478530 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b57 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.249385:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1478530 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b57 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.249393:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263908992:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065209.249413:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.251209:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:0.0:1746065209.251842:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065208 -> 1746065209 00000100:00100000:0.0:1746065209.251860:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263908736:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065209.251883:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b6000/0xad6b7ddc1478568 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b6c expref: 36 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.251894:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b6000/0xad6b7ddc1478568 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b6c expref: 36 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065209.251984:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265179008 00002000:00010000:3.0:1746065209.251990:0:1880:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065208 -> 1746065209 00000100:00100000:1.0:1746065209.251990:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265179008 00000100:00100000:3.0:1746065209.251999:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263908608:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065209.252014:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779600/0xad6b7ddc1478561 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b73 expref: 35 pid: 1880 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746065209.252018:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1228800->1232895) req@ffff8800900f0700 x1830881265179008/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746065209.252023:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095779600/0xad6b7ddc1478561 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b73 expref: 35 pid: 1880 timeout: 0 lvb_type: 1 00002000:00100000:1.0:1746065209.252026:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0700 with x1830881265179008 ext(1228800->1232895) 00002000:00010000:1.0:1746065209.252030:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f0700 00000100:00100000:1.0:1746065209.252047:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5980 00010000:00010000:3.0:1746065209.252048:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779600, rc 0) 00000100:00100000:3.0:1746065209.252080:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881265178624:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3195us (3326us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065209.252087:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17050 00010000:00010000:0.0:1746065209.252200:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6000, rc 0) 00000100:00100000:0.0:1746065209.252219:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a5038050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265178496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3380us (3492us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065209.252224:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17049 00000100:00100000:1.0:1746065209.252478:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265179008:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065209.252572:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265179008:12345-192.168.202.27@tcp:3:cat.0 Request processed in 518us (1366us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065209.252577:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5980 00002000:00100000:1.0:1746065209.252582:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1228800->1232895) req@ffff8800900f0700 x1830881265179008/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/4536 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065209.252589:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0700 with x1830881265179008 ext(1228800->1232895) 00002000:00010000:1.0:1746065209.252591:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f0700 00000100:00100000:1.0:1746065209.254338:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263908992:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065209.254351:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065209.254386:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265178368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5081us (5896us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.254394:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7886 00000100:00100000:0.0:1746065209.256973:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.257847:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.258767:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265179648 00000100:00100000:1.0:1746065209.258793:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265179648 00000100:00100000:1.0:1746065209.260261:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5402 00000100:00100000:1.0:1746065209.260272:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2198:x1830881265179648:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065209.260458:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2198:x1830881265179648:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 189us (2611us total) trans 8589936960 rc 0/0 00000100:00100000:1.0:1746065209.260464:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5402 00000100:00100000:0.0:1746065209.260620:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.261266:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265179264 00000100:00100000:1.0:1746065209.261272:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265179264 00002000:00100000:1.0:1746065209.261297:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800900f1880 x1830881265179264/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065209.261305:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1880 with x1830881265179264 ext(2097152->3145727) 00002000:00010000:1.0:1746065209.261310:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f1880 00000100:00100000:0.0:1746065209.261821:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.262236:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265179776 00000100:00100000:1.0:1746065209.262240:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265179776 00002000:00100000:1.0:1746065209.262257:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1548288->2097151) req@ffff8800900f1c00 x1830881265179776/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065209.262264:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1c00 with x1830881265179776 ext(1548288->2097151) 00010000:00010000:1.0:1746065209.262269:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1478522 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b49 expref: 21 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.262279:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1478522 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b49 expref: 21 pid: 3067 timeout: 905 lvb_type: 0 00002000:00010000:1.0:1746065209.262284:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900f1c00 00000100:00100000:1.0:1746065209.262300:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1974 00000100:00100000:1.0:1746065209.262305:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265179776:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065209.270250:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265179264:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7753us (9620us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065209.270261:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5981 00002000:00100000:3.0:1746065209.270270:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800900f1880 x1830881265179264/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/440 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.270279:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1880 with x1830881265179264 ext(2097152->3145727) 00002000:00010000:3.0:1746065209.270284:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f1880 00000100:00100000:1.0:1746065209.274807:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265179904 00000100:00100000:1.0:1746065209.274815:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265179904 00010000:00010000:1.0:1746065209.274875:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1478522 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b49 expref: 23 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746065209.274910:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7887 00000100:00100000:1.0:1746065209.274917:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265179904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065209.274929:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065209.275006:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1478522 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b49 expref: 23 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.275017:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1478522 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b49 expref: 23 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.275038:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4200/0xad6b7ddc1478522 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1548288->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b49 expref: 23 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.275053:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.275054:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.275060:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1478576 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b81 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.275067:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1478576 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b81 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.275095:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1478576 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b81 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.275105:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263909248:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065209.275144:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.275171:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065209.275322:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265180032 00000100:00100000:3.0:1746065209.275326:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265180032 00000100:00100000:3.0:1746065209.275352:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17053 00000100:00100000:3.0:1746065209.275357:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2203:x1830881265180032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.275367:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.275376:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b88 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.275392:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.275397:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065209.275398:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065209.275400:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 24 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.275445:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.275455:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 33 pid: 13375 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.275466:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263909376:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065209.275502:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065209.276973:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263909376:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065209.276994:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 24 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.277005:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2c600, rc 0) 00000100:00100000:3.0:1746065209.277093:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2203:x1830881265180032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1734us (1947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.277101:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17053 00000100:00100000:1.0:1746065209.277105:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263909248:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065209.277114:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065209.277130:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265179904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2214us (2728us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.277137:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7887 00000100:00100000:1.0:1746065209.277523:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.277562:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265180160 00000100:00100000:3.0:1746065209.277566:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265180160 00002000:00100000:3.0:1746065209.277593:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2871296->3145727) req@ffff880098dd9880 x1830881265180160/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.277602:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9880 with x1830881265180160 ext(2871296->3145727) 00010000:00010000:3.0:1746065209.277607:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 34 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.277616:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 34 pid: 13375 timeout: 905 lvb_type: 0 00002000:00010000:3.0:1746065209.277622:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098dd9880 00000100:00100000:3.0:1746065209.277863:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1975 00000100:00100000:3.0:1746065209.277869:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265180160:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065209.281921:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265180416 00000100:00100000:1.0:1746065209.281931:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265180416 00002000:00100000:1.0:1746065209.281970:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008f7fed80 x1830881265180416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065209.281979:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fed80 with x1830881265180416 ext(1048576->2097151) 00002000:00010000:1.0:1746065209.281983:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fed80 00000100:00100000:1.0:1746065209.282047:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5982 00000100:00100000:1.0:1746065209.282054:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265180416:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065209.282945:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881265180160:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5073us (5421us total) trans 21474841629 rc 0/0 00000100:00100000:3.0:1746065209.282952:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1975 00002000:00100000:3.0:1746065209.282958:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2871296->3145727) req@ffff880098dd9880 x1830881265180160/t21474841629(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/448 e 0 to 0 dl 1746065220 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.282965:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9880 with x1830881265180160 ext(2871296->3145727) 00010000:00010000:3.0:1746065209.282972:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 38 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.282984:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 38 pid: 13375 timeout: 905 lvb_type: 0 00002000:00010000:3.0:1746065209.282990:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880098dd9880 00000100:00100000:0.0:1746065209.288187:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265180416:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6125us (6741us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065209.288197:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5982 00002000:00100000:0.0:1746065209.288207:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008f7fed80 x1830881265180416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/440 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065209.288215:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fed80 with x1830881265180416 ext(1048576->2097151) 00002000:00010000:0.0:1746065209.288220:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fed80 00000100:00100000:1.0:1746065209.289147:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.289355:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265180544 00000100:00100000:0.0:1746065209.289362:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265180544 00010000:00010000:0.0:1746065209.289390:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 36 pid: 13375 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.289473:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7888 00000100:00100000:0.0:1746065209.289480:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265180544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.289492:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065209.289509:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 36 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.289519:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 36 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.289536:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc14784dc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2871296->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b1f expref: 36 pid: 13375 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.289562:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.289565:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.289571:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.289578:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.289605:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.289615:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263909504:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065209.290578:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065209.296341:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.296517:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265180672 00000100:00100000:3.0:1746065209.296524:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265180672 00000100:00100000:3.0:1746065209.297102:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17054 00000100:00100000:3.0:1746065209.297109:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2207:x1830881265180672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.297124:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.297143:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938b8f expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.297166:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.297172:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065209.297174:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065209.297177:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.297201:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.297210:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 22 pid: 1880 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.297219:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263909632:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065209.297297:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.299435:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.300245:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263909632:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065209.300267:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.300283:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a200, rc 0) 00000100:00100000:0.0:1746065209.300324:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+36:2207:x1830881265180672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3215us (3988us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.300331:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17054 00000100:00100000:0.0:1746065209.305843:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.305886:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.305959:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265181312 00000100:00100000:3.0:1746065209.305967:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265181312 00002000:00100000:3.0:1746065209.306007:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1232895) req@ffff8800900f2a00 x1830881265181312/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.306015:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2a00 with x1830881265181312 ext(1048576->1232895) 00010000:00010000:3.0:1746065209.306024:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 25 pid: 1880 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.306035:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 25 pid: 1880 timeout: 905 lvb_type: 0 00002000:00010000:3.0:1746065209.306041:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900f2a00 00000100:00100000:3.0:1746065209.306056:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265181184 00000100:00100000:3.0:1746065209.306058:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265181184 00002000:00100000:3.0:1746065209.306068:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff8800900f2d80 x1830881265181184/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.306079:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2d80 with x1830881265181184 ext(3145728->4194303) 00002000:00010000:3.0:1746065209.306081:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f2d80 00000100:00100000:3.0:1746065209.306092:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1976 00000100:00100000:3.0:1746065209.306098:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265181312:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065209.306231:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5984 00000100:00100000:0.0:1746065209.306238:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265181184:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065209.313148:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2004:x1830881265181312:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7040us (7305us total) trans 21474841630 rc 0/0 00000100:00100000:3.0:1746065209.313159:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1976 00002000:00100000:3.0:1746065209.313170:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1232895) req@ffff8800900f2a00 x1830881265181312/t21474841630(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/448 e 0 to 0 dl 1746065220 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.313178:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2a00 with x1830881265181312 ext(1048576->1232895) 00010000:00010000:3.0:1746065209.313186:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 27 pid: 1880 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.313199:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 27 pid: 1880 timeout: 905 lvb_type: 0 00002000:00010000:3.0:1746065209.313205:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800900f2a00 00000100:00100000:0.0:1746065209.316960:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.317133:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265181440 00000100:00100000:3.0:1746065209.317140:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265181440 00010000:00010000:3.0:1746065209.317162:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 25 pid: 1880 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.317181:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7889 00000100:00100000:3.0:1746065209.317186:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265181440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.317196:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.317210:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 25 pid: 1880 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.317219:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 25 pid: 1880 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.317235:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5400/0xad6b7ddc1478537 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1232895) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b65 expref: 25 pid: 1880 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.317249:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.317251:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.317257:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 35 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.317263:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 35 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.317289:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 35 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.317300:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263909760:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065209.318399:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065209.323397:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263909760:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065209.323425:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.323462:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881265181440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6274us (6501us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.323473:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7889 00000100:00100000:0.0:1746065209.327077:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.327920:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.328990:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5985 00000100:00100000:3.0:1746065209.328999:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265181696:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065209.331671:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.331696:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.338900:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265181696:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9895us (11823us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746065209.338910:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5985 00002000:00100000:3.0:1746065209.338919:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88009a6df480 x1830881265181696/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/440 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.338927:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df480 with x1830881265181696 ext(4194304->4898815) 00002000:00010000:3.0:1746065209.338931:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6df480 00000100:00100000:0.0:1746065209.348347:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.349253:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265182464 00000100:00100000:1.0:1746065209.349263:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265182464 00000100:00100000:1.0:1746065209.349309:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5403 00000100:00100000:1.0:1746065209.349316:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2203:x1830881265182464:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065209.350510:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2203:x1830881265182464:12345-192.168.202.27@tcp:35:cat.0 Request processed in 1169us (2145us total) trans 8589936961 rc 0/0 00000100:00100000:1.0:1746065209.350521:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5403 00000100:00100000:0.0:1746065209.353947:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.358346:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.358412:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265182720 00000100:00100000:3.0:1746065209.358432:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265182720 00000100:00100000:3.0:1746065209.358485:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17058 00000100:00100000:3.0:1746065209.358492:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265182720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.358510:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.358526:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc14785a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938bab expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.358549:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.358551:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.358558:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc14785a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bab expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.358572:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc14785a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bab expref: 37 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.358587:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07800, rc 0) 00000100:00100000:3.0:1746065209.358636:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265182720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 144us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.358642:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17058 00000100:00100000:0.0:1746065209.365678:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.365730:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.372225:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.372619:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265183488 00000100:00100000:3.0:1746065209.372627:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265183488 00000100:00100000:3.0:1746065209.372674:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14481 00000100:00100000:3.0:1746065209.372680:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2210:x1830881265183488:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065209.372695:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.372708:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc14785a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938bb2 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.372801:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.372812:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b11 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.372819:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784ff lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b2d expref: 20 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.372824:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1478553 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b5e expref: 39 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.372830:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 6/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.372854:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1478553 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b5e expref: 39 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.372863:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1478553 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b5e expref: 39 pid: 9571 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.372873:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263909888:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065209.372946:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784ff lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b2d expref: 20 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.372953:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784ff lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b2d expref: 20 pid: 9571 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.372960:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263910016:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065209.372981:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b11 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.372988:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b11 expref: 10 pid: 13395 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.372994:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263910144:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065209.373009:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.380411:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.380451:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.380503:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265183616 00000100:00100000:0.0:1746065209.380510:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265183616 00010000:00010000:0.0:1746065209.380539:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1478553 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b5e expref: 40 pid: 9571 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.382008:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263909888:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065209.382021:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc14784ff lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b2d expref: 20 pid: 9571 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.382042:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8380 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263910016:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065209.382064:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7891 00000100:00100000:3.0:1746065209.382071:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263910144:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065209.382072:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265183616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.382080:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065209.382084:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1478553 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b5e expref: 40 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.382091:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.382092:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1478553 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b5e expref: 40 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.382103:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095779200/0xad6b7ddc1478553 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b5e expref: 40 pid: 9571 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.383261:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065209.383267:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.383277:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.383281:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065209.383337:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881265183616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1264us (2929us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.383343:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7891 00000100:00100000:0.0:1746065209.383470:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265183104:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17505us (17800us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065209.383476:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5987 00002000:00100000:0.0:1746065209.383484:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009a6dce00 x1830881265183104/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/440 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065209.383493:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dce00 with x1830881265183104 ext(2097152->4194303) 00002000:00010000:0.0:1746065209.383496:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dce00 00000100:00100000:0.0:1746065209.391440:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265183872 00000100:00100000:0.0:1746065209.391451:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265183872 00010000:00010000:0.0:1746065209.391482:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b11 expref: 11 pid: 13395 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.392631:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7892 00000100:00100000:0.0:1746065209.392642:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265183872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.392656:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065209.392663:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b11 expref: 11 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.392673:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b11 expref: 11 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.392691:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc14784c7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b11 expref: 11 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.392704:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065209.392708:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.392717:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.392722:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.392753:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065209.392811:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265183872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 171us (2692us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.392821:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7892 00010000:00010000:3.0:1746065209.392964:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.392970:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065209.392985:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065209.393077:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc14785a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb2 expref: 40 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.393089:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb2 expref: 39 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.393094:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.393097:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065209.393099:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06800, rc 0) 00000100:00100000:3.0:1746065209.393118:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2210:x1830881265183488:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 20438us (20896us total) trans 8589936962 rc 0/0 00000100:00100000:3.0:1746065209.393123:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14481 00000100:00100000:3.0:1746065209.397740:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265183232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 30716us (32000us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065209.397751:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5988 00002000:00100000:3.0:1746065209.398144:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009a6dc700 x1830881265183232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/440 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.398153:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc700 with x1830881265183232 ext(2097152->4194303) 00002000:00010000:3.0:1746065209.398158:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dc700 00000100:00100000:0.0:1746065209.400986:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.406846:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.406903:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265184128 00000100:00100000:1.0:1746065209.406910:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265184128 00010000:00010000:1.0:1746065209.406934:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1478323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a0e expref: 10 pid: 11461 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746065209.406967:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7893 00000100:00100000:1.0:1746065209.406973:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265184128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065209.406984:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065209.406999:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1478323 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a0e expref: 10 pid: 11461 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746065209.407008:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1478323 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a0e expref: 10 pid: 11461 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746065209.407025:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1478323 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a0e expref: 10 pid: 11461 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746065209.407039:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065209.407054:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265184128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.407060:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7893 00000100:00100000:0.0:1746065209.407094:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.407124:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265184256 00000100:00100000:1.0:1746065209.407126:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265184256 00010000:00010000:1.0:1746065209.407136:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc1478258 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938974 expref: 22 pid: 11461 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746065209.407163:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7894 00000100:00100000:1.0:1746065209.407168:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265184256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065209.407174:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065209.407180:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc1478258 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938974 expref: 22 pid: 11461 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746065209.407188:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc1478258 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938974 expref: 22 pid: 11461 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746065209.407198:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc1478258 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938974 expref: 22 pid: 11461 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746065209.407206:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065209.407217:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265184256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 49us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.407222:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7894 00000100:00100000:0.0:1746065209.407607:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.407897:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265184384 00000100:00100000:3.0:1746065209.407902:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265184384 00010000:00010000:3.0:1746065209.407916:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc14781e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938935 expref: 46 pid: 12258 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746065209.407932:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7895 00000100:00100000:3.0:1746065209.407937:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881265184384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.407943:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.407950:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc14781e8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938935 expref: 46 pid: 12258 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.407959:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc14781e8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938935 expref: 46 pid: 12258 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.407971:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c718200/0xad6b7ddc14781e8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938935 expref: 46 pid: 12258 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.407993:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.407994:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.408000:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc14785bc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 266240->274431) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb9 expref: 45 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.409097:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc14785bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 266240->274431) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb9 expref: 45 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.409128:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc14785bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 266240->274431) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb9 expref: 45 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.409138:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263910656:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065209.409899:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.409937:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.412370:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.412412:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263910656:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065209.412439:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.412468:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265184384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4530us (4861us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.412476:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7895 00000100:00100000:3.0:1746065209.412608:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265184768 00000100:00100000:3.0:1746065209.412613:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265184768 00002000:00100000:3.0:1746065209.412637:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (266240->270335) req@ffff88009a6dfb80 x1830881265184768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.412644:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dfb80 with x1830881265184768 ext(266240->270335) 00002000:00010000:3.0:1746065209.412648:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dfb80 00000100:00100000:3.0:1746065209.412700:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5989 00000100:00100000:3.0:1746065209.412706:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265184768:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065209.412825:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265184768:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 118us (458us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065209.412830:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5989 00002000:00100000:3.0:1746065209.412835:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (266240->270335) req@ffff88009a6dfb80 x1830881265184768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/4536 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065209.412848:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dfb80 with x1830881265184768 ext(266240->270335) 00002000:00010000:3.0:1746065209.412851:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dfb80 00000100:00100000:0.0:1746065209.415964:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.416009:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.416159:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5990 00000100:00100000:0.0:1746065209.416166:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881265185024:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065209.416267:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881265185024:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 102us (310us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065209.416273:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5990 00002000:00100000:0.0:1746065209.416277:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (270336->274431) req@ffff88009a6dca80 x1830881265185024/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:125/0 lens 488/4536 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065209.416283:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dca80 with x1830881265185024 ext(270336->274431) 00002000:00010000:0.0:1746065209.416286:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6dca80 00000100:00100000:0.0:1746065209.470768:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.471084:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265185536 00000100:00100000:3.0:1746065209.471093:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265185536 00000100:00100000:3.0:1746065209.471148:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14482 00000100:00100000:3.0:1746065209.471157:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2217:x1830881265185536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065209.471177:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.471192:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc14785ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938bc7 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.471255:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc14785d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471266:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc14785d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471275:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc14785d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471285:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471290:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471295:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471371:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc14785df lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471382:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc14785df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471388:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc14785df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065209.471396:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065209.471465:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc14785d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471471:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc14785d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471476:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc14785d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471481:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065209.471484:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc14785d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471490:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc14785d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471498:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065209.471501:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065209.471504:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc14785d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471508:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc14785d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471530:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471538:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471542:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471545:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065209.471547:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471551:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471557:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5900) 00010000:00010000:3.0:1746065209.471559:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065209.471561:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471565:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.471596:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc14785ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bc7 expref: 23 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.471606:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc14785df lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bc7 expref: 22 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.471611:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.471613:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065209.471615:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06c00, rc 0) 00000100:00100000:3.0:1746065209.471649:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2217:x1830881265185536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 493us (890us total) trans 8589936963 rc 0/0 00000100:00100000:3.0:1746065209.471655:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14482 00000100:00100000:0.0:1746065209.473899:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.473984:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.474033:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265185664 00000100:00100000:3.0:1746065209.474041:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265185664 00000100:00100000:3.0:1746065209.474141:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 837 00000100:00100000:3.0:1746065209.474148:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265185664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.474159:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.474213:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc14785df lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bc7 expref: 22 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.474226:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.474230:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.474279:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265185664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 131us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.474285:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 837 00000100:00100000:0.0:1746065209.478735:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.484635:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.484725:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.485212:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265186304 00000100:00100000:3.0:1746065209.485216:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265186304 00000100:00100000:3.0:1746065209.485253:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14483 00000100:00100000:3.0:1746065209.485259:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2219:x1830881265186304:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065209.485272:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.485287:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785fb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938bdc expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.485340:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc1478602 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485350:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc1478602 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485364:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc1478602 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485375:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc1478609 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485380:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc1478609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485385:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc1478609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485470:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1478610 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485478:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1478610 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485484:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1478610 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065209.485491:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065209.485534:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc1478602 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485540:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc1478602 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485545:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc1478602 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485550:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065209.485553:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc1478602 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485558:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc1478602 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485567:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065209.485569:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065209.485572:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc1478602 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485576:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06a00/0xad6b7ddc1478602 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485585:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc1478609 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485589:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc1478609 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485593:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc1478609 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485597:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065209.485598:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc1478609 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485603:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc1478609 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485608:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5d00) 00010000:00010000:3.0:1746065209.485609:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065209.485611:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc1478609 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485615:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07000/0xad6b7ddc1478609 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.485646:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc14785fb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bdc expref: 24 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.485655:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1478610 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bdc expref: 23 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.485661:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.485662:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065209.485664:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f877000, rc 0) 00000100:00100000:3.0:1746065209.485699:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2219:x1830881265186304:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 440us (973us total) trans 8589936964 rc 0/0 00000100:00100000:3.0:1746065209.485705:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14483 00000100:00100000:0.0:1746065209.487654:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.487860:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265186432 00000100:00100000:3.0:1746065209.487866:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265186432 00000100:00100000:3.0:1746065209.488038:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 838 00000100:00100000:3.0:1746065209.488045:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265186432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.488109:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.488127:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc1478610 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bdc expref: 23 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.488138:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.488140:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.488169:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265186432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 125us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.488175:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 838 00000100:00100000:3.0:1746065209.490305:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265186560 00000100:00100000:3.0:1746065209.490312:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265186560 00010000:00010000:3.0:1746065209.490335:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc14785bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 266240->274431) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb9 expref: 47 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746065209.492675:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7896 00000100:00100000:1.0:1746065209.492690:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265186560:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065209.492708:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065209.492730:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc14785bc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 266240->274431) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb9 expref: 47 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.492743:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc14785bc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 266240->274431) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb9 expref: 47 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.493059:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc14785bc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 266240->274431) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb9 expref: 47 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.493078:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.493080:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.493087:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61000/0xad6b7ddc14785f4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bd5 expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.493095:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61000/0xad6b7ddc14785f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bd5 expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.493132:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61000/0xad6b7ddc14785f4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bd5 expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.493143:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263911168:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065209.493788:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.502072:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.502233:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265186816 00000100:00100000:3.0:1746065209.502240:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265186816 00010000:00010000:3.0:1746065209.502268:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1478599 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ba4 expref: 47 pid: 3067 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746065209.502303:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7897 00000100:00100000:3.0:1746065209.502309:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265186816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.502320:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065209.502491:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263911168:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065209.502506:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065209.502553:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265186560:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9868us (12625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.502560:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7896 00010000:00010000:3.0:1746065209.503755:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1478599 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ba4 expref: 46 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.503767:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1478599 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ba4 expref: 46 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.503801:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1478599 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ba4 expref: 46 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.503820:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.503846:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881265186816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1537us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.503853:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7897 00000100:00100000:0.0:1746065209.510875:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.511571:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.511621:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265187328 00000100:00100000:1.0:1746065209.511628:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265187328 00002000:00100000:1.0:1746065209.511668:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009ac65c00 x1830881265187328/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065209.511684:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac65c00 with x1830881265187328 ext(1048576->2097151) 00002000:00010000:1.0:1746065209.511689:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac65c00 00000100:00100000:1.0:1746065209.511713:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265187200 00000100:00100000:1.0:1746065209.511716:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265187200 00002000:00100000:1.0:1746065209.511727:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009ac64a80 x1830881265187200/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/0 e 0 to 0 dl 1746065220 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065209.511734:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac64a80 with x1830881265187200 ext(1048576->2097151) 00002000:00010000:1.0:1746065209.511737:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac64a80 00000100:00100000:0.0:1746065209.512163:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.513015:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5993 00000100:00100000:1.0:1746065209.513021:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2004:x1830881265187200:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065209.523709:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.526490:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265187712 00000100:00100000:3.0:1746065209.526504:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265187712 00010000:00010000:3.0:1746065209.526542:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1478530 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b57 expref: 25 pid: 1880 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.526621:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7898 00000100:00100000:3.0:1746065209.526630:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265187712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.526644:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.526668:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1478530 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b57 expref: 25 pid: 1880 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.526681:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1478530 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b57 expref: 25 pid: 1880 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.526704:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c5c4600/0xad6b7ddc1478530 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b57 expref: 25 pid: 1880 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.526727:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.526729:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.526737:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147861e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->2289663) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938be3 expref: 24 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.526744:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147861e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->2289663) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938be3 expref: 24 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.526794:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147861e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->2289663) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938be3 expref: 24 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.526807:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263911552:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065209.526899:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f016d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065209.527297:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2004:x1830881265187200:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 14274us (15725us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065209.527306:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5993 00002000:00100000:1.0:1746065209.527314:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009ac64a80 x1830881265187200/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:125/0 lens 488/440 e 0 to 0 dl 1746065220 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065209.527322:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac64a80 with x1830881265187200 ext(1048576->2097151) 00002000:00010000:1.0:1746065209.527326:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac64a80 00000100:00100000:3.0:1746065209.532956:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263911552:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065209.532973:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.532990:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265187712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6363us (9293us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.532998:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7898 00000100:00100000:0.0:1746065209.533769:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.540561:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.540687:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265188224 00000100:00100000:1.0:1746065209.540696:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265188224 00000100:00100000:1.0:1746065209.541951:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5404 00000100:00100000:1.0:1746065209.541962:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2219:x1830881265188224:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065209.542153:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b27050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2219:x1830881265188224:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 193us (1597us total) trans 8589936965 rc 0/0 00000100:00100000:1.0:1746065209.542163:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5404 00000100:00100000:0.0:1746065209.553225:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.577697:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.594285:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.607213:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.607933:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265189120 00000100:00100000:3.0:1746065209.607941:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265189120 00000100:00100000:3.0:1746065209.608121:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14484 00000100:00100000:3.0:1746065209.608129:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2222:x1830881265189120:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065209.608148:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.608162:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc1478625 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938bea expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.608211:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc147862c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.608222:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc147862c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.608231:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc147862c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.608242:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e800/0xad6b7ddc1478633 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.608247:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e800/0xad6b7ddc1478633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.608252:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e800/0xad6b7ddc1478633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.609209:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.609223:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb2 expref: 38 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.609228:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.609253:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb2 expref: 38 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.609262:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb2 expref: 38 pid: 13395 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.609272:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263911680:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065209.610208:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f016d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.612108:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.612252:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881263911680:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065209.612275:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065209.615480:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.615580:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265189504 00000100:00100000:3.0:1746065209.615587:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265189504 00010000:00010000:3.0:1746065209.615619:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb2 expref: 40 pid: 13395 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.615646:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7899 00000100:00100000:3.0:1746065209.615652:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265189504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.615664:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.615670:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb2 expref: 40 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.615679:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb2 expref: 40 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.615698:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc14785ae lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bb2 expref: 40 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.615726:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.615729:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.615738:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.615744:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.615762:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065209.615874:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.615880:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:0.0:1746065209.615918:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:0.0:1746065209.615921:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065209.615935:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.615943:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.615950:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc147862c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.615955:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc147862c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.615963:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc147862c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.615967:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552ee00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065209.615970:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc147862c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.615974:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc147862c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.615981:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065209.615983:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065209.615986:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc147862c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.615989:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc147862c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.616002:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e800/0xad6b7ddc1478633 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.616006:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e800/0xad6b7ddc1478633 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.616010:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e800/0xad6b7ddc1478633 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.616014:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552e800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065209.616016:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e800/0xad6b7ddc1478633 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.616019:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e800/0xad6b7ddc1478633 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.616027:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5000) 00010000:00010000:0.0:1746065209.616028:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065209.616030:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e800/0xad6b7ddc1478633 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.616033:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552e800/0xad6b7ddc1478633 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.616059:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc1478625 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bea expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.616069:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bea expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.616074:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065209.616076:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065209.616077:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fc00, rc 0) 00000100:00100000:3.0:1746065209.616432:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881265189504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 777us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.616438:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7899 00000100:00100000:0.0:1746065209.616496:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2222:x1830881265189120:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 8368us (9290us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.616501:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14484 00000100:00100000:0.0:1746065209.627264:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265189632 00000100:00100000:0.0:1746065209.627271:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265189632 00000100:00100000:0.0:1746065209.627304:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265189760 00000100:00100000:0.0:1746065209.627306:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265189760 00000100:00100000:0.0:1746065209.627316:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265189888 00000100:00100000:0.0:1746065209.627318:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265189888 00000100:00100000:0.0:1746065209.627329:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17064 00000100:00100000:0.0:1746065209.627335:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265189632:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065209.627351:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065209.627367:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73a00/0xad6b7ddc1478641 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938bf1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.627387:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.627390:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.627397:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73a00/0xad6b7ddc1478641 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bf1 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.627411:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73a00/0xad6b7ddc1478641 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bf1 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.627449:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73a00, rc 0) 00000100:00100000:3.0:1746065209.628037:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17065 00000100:00100000:3.0:1746065209.628045:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265189760:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065209.628053:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.628062:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478648 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938bf8 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.628073:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.628075:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.628079:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bf8 expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.628089:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bf8 expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.628095:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e400, rc 0) 00000100:00100000:0.0:1746065209.629153:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265189632:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1815us (2827us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.629160:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17064 00000100:00100000:1.0:1746065209.629193:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.629217:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265190016 00000100:00100000:0.0:1746065209.629222:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265190016 00000100:00100000:0.0:1746065209.629240:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17067 00000100:00100000:0.0:1746065209.629244:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265190016:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065209.629251:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065209.629252:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065209.629259:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc1478656 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c06 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.629270:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265190144 00000100:00100000:1.0:1746065209.629273:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265190144 00000100:00100000:1.0:1746065209.629289:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17068 00000100:00100000:0.0:1746065209.629295:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263911808:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065209.629304:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265190144:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065209.629310:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065209.629315:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc147865d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c0d expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.629324:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.629326:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.629330:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc147865d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c0d expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.629339:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc147865d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c0d expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065209.629339:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00010000:00010000:1.0:1746065209.629344:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad000, rc 0) 00000100:00100000:1.0:1746065209.629358:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265190144:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 65us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.629363:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17068 00000100:00100000:3.0:1746065209.629489:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265189760:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1445us (3130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.629495:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17065 00000100:00100000:0.0:1746065209.634502:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.637009:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.637135:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265190528 00000100:00100000:3.0:1746065209.637140:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265190528 00010000:00010000:3.0:1746065209.637164:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bea expref: 13 pid: 13395 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.637196:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7900 00000100:00100000:3.0:1746065209.637202:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265190528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.637214:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.637373:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bea expref: 13 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.637384:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bea expref: 13 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.637401:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fc00/0xad6b7ddc147863a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bea expref: 13 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.637434:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.637439:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc147866b lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.637447:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc147866b lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.637453:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc147866b lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.637474:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.637514:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265190528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 311us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.637520:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7900 00000100:00100000:0.0:1746065209.640071:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.643309:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.648444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.649646:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.649663:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265191296 00000100:00100000:0.0:1746065209.649666:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265191296 00000100:00100000:1.0:1746065209.649785:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.649895:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.649903:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265191552 00000100:00100000:1.0:1746065209.649906:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265191168 00000100:00100000:0.0:1746065209.649907:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265191552 00000100:00100000:1.0:1746065209.649908:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265191168 00000100:00100000:0.0:1746065209.649923:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17070 00000100:00100000:1.0:1746065209.649926:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17071 00000100:00100000:0.0:1746065209.649928:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265191296:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:1.0:1746065209.649930:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265191552:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065209.649945:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.649945:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.649955:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147861e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->2289663) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938be3 expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.649955:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.649960:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065209.649961:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065209.649961:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60c00/0xad6b7ddc147864f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bff expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.649964:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.649967:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc1478592 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b9d expref: 25 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.649971:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.649971:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.649973:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.649977:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147861e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->2289663) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938be3 expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.649983:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147861e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->2289663) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938be3 expref: 21 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.649985:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc1478592 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b9d expref: 25 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065209.649991:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263912320:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065209.649996:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131046800/0xad6b7ddc1478592 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b9d expref: 25 pid: 13375 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746065209.650004:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263912448:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065209.650008:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065209.650024:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17072 00010000:00010000:0.0:1746065209.650025:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60c00/0xad6b7ddc147864f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bff expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065209.650028:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265191168:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065209.650032:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f60c00/0xad6b7ddc147864f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bff expref: 12 pid: 9549 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746065209.650038:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263912576:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.650041:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.650054:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1478576 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b81 expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.650057:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.650061:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478648 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bf8 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.650064:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 36 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.650067:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131046400/0xad6b7ddc147858b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b96 expref: 25 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065209.650071:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263912704:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.650072:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.650073:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.650075:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 6/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.650082:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00010000:00010000:1.0:1746065209.650086:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131046400/0xad6b7ddc147858b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b96 expref: 25 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.650092:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131046400/0xad6b7ddc147858b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b96 expref: 25 pid: 13375 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746065209.650099:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263912832:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.650117:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478648 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bf8 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.650124:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478648 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bf8 expref: 12 pid: 1880 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746065209.650125:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.650135:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263912960:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065209.650135:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265191424 00000100:00100000:0.0:1746065209.650137:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265191424 00000100:00100000:0.0:1746065209.650152:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17073 00010000:00010000:1.0:1746065209.650154:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1478576 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b81 expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.650156:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265191424:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065209.650161:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1478576 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b81 expref: 36 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746065209.650167:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263913088:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065209.650169:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.650177:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc147822e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938951 expref: 44 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065209.650179:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746065209.650184:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6000/0xad6b7ddc1478331 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a23 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.650190:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478274 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938989 expref: 21 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.650195:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.650196:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.650198:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.650210:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065209.650210:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478274 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938989 expref: 21 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.650216:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478274 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938989 expref: 21 pid: 12258 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746065209.650219:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265191680 00000100:00100000:1.0:1746065209.650222:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265191680 00000100:00100000:0.0:1746065209.650223:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263913216:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065209.650235:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17074 00000100:00100000:1.0:1746065209.650239:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265191680:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065209.650242:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6000/0xad6b7ddc1478331 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a23 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.650251:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.650253:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f6000/0xad6b7ddc1478331 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938a23 expref: 12 pid: 9550 timeout: 905 lvb_type: 1 00010000:00010000:1.0:1746065209.650259:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 25 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.650259:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263913344:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.650271:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc147865d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c0d expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.650275:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc147822e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938951 expref: 44 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.650282:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4a24c00/0xad6b7ddc147822e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938951 expref: 44 pid: 10219 timeout: 905 lvb_type: 1 00000100:00100000:0.0:1746065209.650288:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263913472:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065209.650299:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee300 going to sleep for 11 seconds 00010000:00010000:1.0:1746065209.650471:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc14785a0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bab expref: 36 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.650477:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.650479:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.650481:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.650495:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc14785a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bab expref: 36 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.650502:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc14785a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bab expref: 36 pid: 1880 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746065209.650509:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263913600:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.651494:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc147865d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c0d expref: 13 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065209.651504:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abad000/0xad6b7ddc147865d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c0d expref: 13 pid: 3067 timeout: 905 lvb_type: 1 00000100:00100000:1.0:1746065209.651513:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263913728:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.651541:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 25 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.651548:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 25 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746065209.651559:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263913856:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065209.651870:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065209.655042:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263912448:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065209.655122:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263912704:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065209.655432:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263912320:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.655452:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.656888:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.658711:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263913216:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065209.658747:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263913344:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065209.658770:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263913472:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065209.658806:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.658900:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263912576:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.658916:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.658934:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263912832:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065209.658941:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263912960:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065209.658947:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263913088:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.658959:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.658974:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263913600:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065209.658980:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263913728:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065209.658987:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263913856:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065209.658999:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.661396:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.661453:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265192192 00000100:00100000:3.0:1746065209.661459:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265192192 00010000:00010000:3.0:1746065209.661483:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 37 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.661505:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7901 00000100:00100000:3.0:1746065209.661511:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881265192192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.661522:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.661538:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 37 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.661547:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 37 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.661567:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577a200/0xad6b7ddc1478584 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b8f expref: 37 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.661597:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.661610:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881265192192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.661707:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7901 00000100:00100000:1.0:1746065209.661709:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.661719:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265191808 00000100:00100000:3.0:1746065209.661721:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265191808 00010000:00010000:3.0:1746065209.661730:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73a00/0xad6b7ddc1478641 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bf1 expref: 13 pid: 3067 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746065209.661742:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7902 00000100:00100000:3.0:1746065209.661746:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265191808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065209.661748:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065209.661752:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.661759:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73a00/0xad6b7ddc1478641 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bf1 expref: 13 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.661766:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73a00/0xad6b7ddc1478641 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bf1 expref: 13 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.661791:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73a00/0xad6b7ddc1478641 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938bf1 expref: 13 pid: 3067 timeout: 905 lvb_type: 1 00010000:00010000:3.0:1746065209.661799:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.661815:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265191808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.661879:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265193088 00000100:00100000:0.0:1746065209.661883:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265193088 00010000:00010000:0.0:1746065209.661895:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131046400/0xad6b7ddc147858b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b96 expref: 26 pid: 13375 timeout: 905 lvb_type: 1 00000100:00100000:3.0:1746065209.661912:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7902 00000100:00100000:0.0:1746065209.662127:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7903 00000100:00100000:0.0:1746065209.662133:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2006:x1830881265193088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.662140:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065209.662150:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131046400/0xad6b7ddc147858b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b96 expref: 26 pid: 13375 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746065209.662157:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131046400/0xad6b7ddc147858b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b96 expref: 26 pid: 13375 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746065209.662167:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046400/0xad6b7ddc147858b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b96 expref: 26 pid: 13375 timeout: 905 lvb_type: 1 00010000:00010000:0.0:1746065209.662178:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065209.662194:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2006:x1830881265193088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 62us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.662198:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7903 00000100:00100000:1.0:1746065209.662276:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.662658:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.662672:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.662683:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.662695:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.662706:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.662716:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065209.662733:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065209.664805:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.664814:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.664826:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.664833:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.664839:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.664844:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d926200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065209.664847:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.664853:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.664863:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.664867:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d926200/0xad6b7ddc14786b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.664899:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265191424:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 14741us (14772us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.664906:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17073 00010000:00010000:1.0:1746065209.665191:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.665198:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.665211:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.665217:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.665222:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.665231:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ae00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065209.665233:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.665238:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.665247:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.665252:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc14786a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.665290:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265191296:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 15361us (15649us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.665296:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17070 00000100:00100000:0.0:1746065209.666516:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.666556:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.666558:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265193472 00000100:00100000:3.0:1746065209.666564:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265193472 00000100:00100000:1.0:1746065209.666590:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265193728 00000100:00100000:1.0:1746065209.666597:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265193728 00010000:00010000:1.0:1746065209.666617:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147861e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2277376->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938be3 expref: 22 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:1.0:1746065209.666650:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7912 00000100:00100000:1.0:1746065209.666656:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265193728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065209.666667:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065209.666677:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147861e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->2289663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938be3 expref: 22 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.666686:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147861e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->2289663) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938be3 expref: 22 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.666700:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60a00/0xad6b7ddc147861e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2277376->2289663) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938be3 expref: 22 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:1.0:1746065209.666709:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.666711:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065209.666714:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.666721:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.666737:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065209.666760:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265193728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 105us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.666766:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7912 00010000:00010000:0.0:1746065209.666807:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.666819:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.667027:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.667034:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.667040:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.667050:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abada00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065209.667052:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.667058:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.667067:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.667071:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147869c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.667102:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265191552:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 17171us (17329us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.667109:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17071 00000100:00100000:0.0:1746065209.667327:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265193600 00000100:00100000:0.0:1746065209.667331:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265193600 00010000:00010000:0.0:1746065209.667342:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 24 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.667348:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1478576 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b81 expref: 35 pid: 3067 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.667829:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7914 00000100:00100000:0.0:1746065209.667835:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265193600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.667843:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065209.667850:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 24 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.667858:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 24 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.667869:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147857d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b88 expref: 24 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.667877:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.667878:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.667881:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065209.667887:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.667898:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7915 00000100:00100000:3.0:1746065209.668000:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265193472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.668087:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065209.668109:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265193600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 274us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.668114:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7914 00010000:00010000:1.0:1746065209.668196:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668203:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668215:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668225:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668231:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668235:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51b800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065209.668239:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668245:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668254:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668259:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51b800/0xad6b7ddc14786b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.668308:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265191680:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 18067us (18097us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.668314:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17074 00010000:00010000:3.0:1746065209.668860:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.668871:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1478576 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b81 expref: 35 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.668880:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1478576 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b81 expref: 35 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.668891:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c5c00/0xad6b7ddc1478576 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938b81 expref: 35 pid: 3067 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.668911:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.668912:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.668915:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.668920:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.668933:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065209.668940:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668946:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668957:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.668961:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265193472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1058us (2447us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065209.668963:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668968:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065209.668969:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7915 00010000:00010000:1.0:1746065209.668972:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abad600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065209.668975:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668980:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668989:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065209.668994:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abad600/0xad6b7ddc14786aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065209.669272:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265191168:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 19241us (19375us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.669279:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17072 00000100:00100000:0.0:1746065209.675103:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.680209:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.680232:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.680256:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.680277:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265194368 00000100:00100000:0.0:1746065209.680282:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265194368 00010000:00010000:0.0:1746065209.680308:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc1478289 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389a5 expref: 24 pid: 7231 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.680326:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265194496 00000100:00100000:0.0:1746065209.680328:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265194496 00010000:00010000:0.0:1746065209.680334:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1478282 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93899e expref: 39 pid: 7231 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.680345:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7916 00000100:00100000:0.0:1746065209.680350:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265194368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.680359:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065209.680365:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc1478289 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389a5 expref: 24 pid: 7231 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.680373:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc1478289 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389a5 expref: 24 pid: 7231 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.680391:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065209.680395:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.680407:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065209.680444:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265194368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.680450:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7916 00000100:00100000:0.0:1746065209.680474:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.680483:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265194624 00000100:00100000:0.0:1746065209.680485:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265194624 00010000:00010000:0.0:1746065209.680492:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938958 expref: 24 pid: 13395 timeout: 905 lvb_type: 0 00000100:00100000:0.0:1746065209.680510:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7918 00000100:00100000:0.0:1746065209.680514:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265194624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065209.680519:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065209.680522:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938958 expref: 24 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.680529:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ac600/0xad6b7ddc147824a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938958 expref: 24 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:0.0:1746065209.680538:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065209.680541:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065209.680545:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065209.680556:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265194624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.680561:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7918 00000100:00100000:3.0:1746065209.680591:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.680621:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265194752 00000100:00100000:3.0:1746065209.680624:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265194752 00000100:00100000:1.0:1746065209.680631:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265194240 00000100:00100000:1.0:1746065209.680634:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265194240 00010000:00010000:3.0:1746065209.680638:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc14782dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389e4 expref: 22 pid: 13395 timeout: 905 lvb_type: 0 00000100:00100000:3.0:1746065209.680676:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7919 00000100:00100000:1.0:1746065209.680676:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5407 00000100:00100000:1.0:1746065209.680680:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+38:31231:x1830881265194240:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065209.680682:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265194752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065209.680688:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065209.680692:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc14782dd lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389e4 expref: 22 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.680699:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc14782dd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389e4 expref: 22 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.680710:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1be00/0xad6b7ddc14782dd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9389e4 expref: 22 pid: 13395 timeout: 905 lvb_type: 0 00010000:00010000:3.0:1746065209.680721:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.680725:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.680729:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065209.680743:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265194752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.680749:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7919 00000100:00100000:1.0:1746065209.680810:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+39:31231:x1830881265194240:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 129us (608us total) trans 8589936970 rc 0/0 00000100:00100000:1.0:1746065209.680815:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5407 00000100:00100000:0.0:1746065209.683596:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065209.684944:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.684952:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000040:00080000:3.0:1746065209.685706:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1029, 88 off98392 00000004:00080000:3.0:1746065209.685713:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805703938921ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065209.685749:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1048, 88 off100064 00000004:00080000:3.0:1746065209.685753:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805703979070ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065209.685766:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1049, 88 off100152 00000004:00080000:3.0:1746065209.685769:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805703995133ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065209.685809:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1030, 88 off98480 00000004:00080000:3.0:1746065209.685812:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805704038756ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065209.685829:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1031, 88 off98568 00000004:00080000:3.0:1746065209.685832:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805704058131ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065209.685840:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1050, 88 off100240 00000004:00080000:3.0:1746065209.685842:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805704068216ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065209.685847:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1051, 88 off100328 00000004:00080000:3.0:1746065209.685849:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805704075855ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065209.685855:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1052, 88 off100416 00000004:00080000:3.0:1746065209.685857:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805704083230ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065209.685862:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1032, 88 off98656 00000004:00080000:3.0:1746065209.685864:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805704090576ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065209.685881:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1053, 88 off100504 00000004:00080000:3.0:1746065209.685883:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805704110010ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065209.685889:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1033, 88 off98744 00000004:00080000:3.0:1746065209.685891:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805704117885ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065209.685898:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1054, 88 off100592 00000004:00080000:3.0:1746065209.685901:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805704127356ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065209.685906:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1034, 88 off98832 00000004:00080000:3.0:1746065209.685908:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805704134834ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065209.685915:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1035, 88 off98920 00000004:00080000:3.0:1746065209.685917:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805704143150ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065209.685923:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1036, 88 off99008 00000004:00080000:3.0:1746065209.685925:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805704151811ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065209.685933:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1037, 88 off99096 00000004:00080000:3.0:1746065209.685934:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 805704161036ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065209.685940:0:13395:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1055, 88 off100680 00000004:00080000:3.0:1746065209.685942:0:13395:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 805704168113ns, next at 761143559853ns, rc = 0 00000100:00100000:3.0:1746065209.690911:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263914752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065209.690925:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263914624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065209.690962:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263915008:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065209.690963:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.690996:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.691021:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263915520:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065209.691034:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065209.691112:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263915136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065209.691114:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263916032:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065209.691117:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.691134:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065209.691137:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263914880:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065209.691141:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263915264:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065209.691149:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263916544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065209.691152:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.691172:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065209.691175:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263915392:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065209.691184:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000004:00010000:3.0:1746065209.691186:0:13395:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009aec9180 reply state ffff88006dc8d400 transno 8589936971 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065209.691188:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.691189:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263915648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065209.691197:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263915904:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065209.691201:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00000100:00100000:1.0:1746065209.691204:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065209.691208:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.691211:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065209.691214:0:13395:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1746065209.691214:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263914624 00000100:00100000:1.0:1746065209.691218:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263916160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065209.691219:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263914624 00000100:00100000:3.0:1746065209.691229:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.691235:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263915008 00000100:00100000:1.0:1746065209.691238:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263915008 00000100:00100000:3.0:1746065209.691246:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263915776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065209.691246:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263915520 00000100:00100000:0.0:1746065209.691248:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263915520 00000100:00100000:1.0:1746065209.691253:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263914752 00000100:00100000:0.0:1746065209.691254:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263916032 00000100:00100000:1.0:1746065209.691255:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263914752 00000100:00100000:0.0:1746065209.691256:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263916032 00000100:00100000:3.0:1746065209.691261:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.691263:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263914880 00000100:00100000:0.0:1746065209.691263:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263916544 00000100:00100000:0.0:1746065209.691264:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263916544 00000100:00100000:1.0:1746065209.691265:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263914880 00000100:00100000:3.0:1746065209.691268:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263916288:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065209.691269:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263915392 00000100:00100000:1.0:1746065209.691270:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263915648 00000100:00100000:0.0:1746065209.691270:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263915392 00000100:00100000:1.0:1746065209.691272:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263915648 00000100:00100000:0.0:1746065209.691275:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263915264 00000100:00100000:0.0:1746065209.691277:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263915264 00000100:00100000:1.0:1746065209.691278:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263915776 00000100:00100000:1.0:1746065209.691279:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263915776 00000100:00100000:3.0:1746065209.691280:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065209.691282:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263916288 00000100:00100000:0.0:1746065209.691283:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263916288 00000100:00100000:1.0:1746065209.691288:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17075 00000100:00100000:1.0:1746065209.691293:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+59:3760:x1830881263914624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065209.691398:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3760:x1830881263914624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 104us (435us total) trans 21474841631 rc 0/0 00000100:00100000:0.0:1746065209.692183:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17076 00000100:00100000:0.0:1746065209.692191:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+60:3759:x1830881263915008:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065209.692211:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17077 00000100:00100000:3.0:1746065209.692218:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3759:x1830881263915520:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065209.692288:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3759:x1830881263915520:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (1252us total) trans 21474841633 rc 0/0 00000100:00100000:3.0:1746065209.692294:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17077 00000100:00100000:3.0:1746065209.692308:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17078 00000100:00100000:3.0:1746065209.692313:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3761:x1830881263914752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065209.692366:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3761:x1830881263914752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (1248us total) trans 21474841634 rc 0/0 00000100:00100000:3.0:1746065209.692371:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17078 00000100:00100000:3.0:1746065209.692382:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17079 00000100:00100000:3.0:1746065209.692386:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+45:3759:x1830881263916032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065209.692398:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065209.692401:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065209.692403:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065209.692405:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065209.692407:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:0.0:1746065209.692443:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3759:x1830881263915008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 253us (1446us total) trans 21474841632 rc 0/0 00000100:00100000:0.0:1746065209.692450:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17076 00000100:00100000:0.0:1746065209.692460:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17080 00000100:00100000:0.0:1746065209.692464:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+45:3759:x1830881263916544:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065209.692500:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065209.692517:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263916416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065209.692526:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+47:3759:x1830881263916032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 139us (1390us total) trans 17179874226 rc 0/0 00000100:00100000:3.0:1746065209.692531:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17079 00000100:00100000:0.0:1746065209.692535:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065209.692539:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263915904 00000100:00100000:3.0:1746065209.692542:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263915904 00000100:00100000:0.0:1746065209.692550:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065209.692553:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263916416 00000100:00100000:3.0:1746065209.692555:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263916416 00000100:00100000:3.0:1746065209.692561:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263915136 00000100:00100000:3.0:1746065209.692562:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263915136 00000004:00080000:0.0:1746065209.692573:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aeca300/2, rc 0, transno 21474841631 00000100:00100000:0.0:1746065209.692577:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263914624:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065209.692597:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:0.0:1746065209.692599:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065209.692600:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065209.692602:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065209.692603:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:3.0:1746065209.692619:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17081 00000100:00100000:0.0:1746065209.692620:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3759:x1830881263916544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 155us (1447us total) trans 17179874227 rc 0/0 00000100:00100000:3.0:1746065209.692624:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3762:x1830881263914880:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065209.692625:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17080 00000100:00100000:0.0:1746065209.692635:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17082 00000100:00100000:0.0:1746065209.692639:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+61:3762:x1830881263915392:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065209.692677:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+63:3762:x1830881263914880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (1524us total) trans 21474841635 rc 0/0 00000100:00100000:3.0:1746065209.692681:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17081 00000100:00100000:0.0:1746065209.692686:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+63:3762:x1830881263915392:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (1497us total) trans 21474841636 rc 0/0 00000100:00100000:0.0:1746065209.692690:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17082 00000100:00100000:0.0:1746065209.692700:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17083 00000100:00100000:3.0:1746065209.692703:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17084 00000100:00100000:0.0:1746065209.692704:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3759:x1830881263915648:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065209.692708:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3761:x1830881263915264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065209.692732:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17075 00002000:00010000:3.0:1746065209.692741:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:3.0:1746065209.692744:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:3.0:1746065209.692746:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065209.692747:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00000100:00100000:1.0:1746065209.692748:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17085 00002000:00010000:3.0:1746065209.692749:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:0.0:1746065209.692749:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+48:3759:x1830881263915648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (1542us total) trans 17179874228 rc 0/0 00000100:00100000:1.0:1746065209.692753:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+48:3761:x1830881263915776:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065209.692754:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17083 00000100:00100000:0.0:1746065209.692763:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17086 00000100:00100000:3.0:1746065209.692765:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3761:x1830881263915264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (1535us total) trans 21474841637 rc 0/0 00000100:00100000:0.0:1746065209.692767:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+47:3761:x1830881263916288:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065209.692770:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17084 00000100:00100000:3.0:1746065209.692792:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17087 00000100:00100000:3.0:1746065209.692796:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3762:x1830881263915904:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065209.692820:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3761:x1830881263915776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 68us (1558us total) trans 17179874229 rc 0/0 00000100:00100000:1.0:1746065209.692825:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17085 00000100:00100000:0.0:1746065209.692830:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3761:x1830881263916288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (1548us total) trans 17179874230 rc 0/0 00000100:00100000:1.0:1746065209.692835:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17088 00000100:00100000:1.0:1746065209.692839:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3762:x1830881263916416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065209.692868:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881263915904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (366us total) trans 17179874231 rc 0/0 00000100:00100000:3.0:1746065209.692873:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17087 00002000:00010000:1.0:1746065209.692874:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065209.692876:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065209.692878:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065209.692879:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065209.692881:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:3.0:1746065209.692883:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17089 00000100:00100000:3.0:1746065209.692887:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3760:x1830881263915136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065209.692897:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+49:3762:x1830881263916416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (361us total) trans 17179874232 rc 0/0 00000100:00100000:1.0:1746065209.692902:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17088 00000100:00100000:1.0:1746065209.692918:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746065209.692920:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746065209.692922:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065209.692924:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065209.692925:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065209.692927:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000004:00080000:1.0:1746065209.692937:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577d180/2, rc 0, transno 17179874226 00000100:00100000:1.0:1746065209.692943:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263916032:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065209.692950:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577f100/2, rc 0, transno 17179874227 00000100:00100000:1.0:1746065209.692953:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263916544:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065209.692960:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec8000/2, rc 0, transno 21474841632 00000100:00100000:1.0:1746065209.692962:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263915008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065209.692968:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edaed80/2, rc 0, transno 21474841633 00000100:00100000:1.0:1746065209.692970:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263915520:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065209.692977:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577c000/2, rc 0, transno 17179874228 00000100:00100000:1.0:1746065209.692980:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263915648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065209.693009:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263916672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065209.693010:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+61:3760:x1830881263915136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 121us (457us total) trans 21474841638 rc 0/0 00000100:00100000:3.0:1746065209.693015:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17089 00000100:00100000:1.0:1746065209.693028:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1746065209.693031:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746065209.693034:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1746065209.693043:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec8e00/2, rc 0, transno 21474841638 00000100:00100000:1.0:1746065209.693046:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263915136:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065209.693050:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac67b80/2, rc 0, transno 21474841637 00000100:00100000:3.0:1746065209.693053:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263915264:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065209.693060:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577e680/2, rc 0, transno 17179874229 00000004:00080000:1.0:1746065209.693061:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577ca80/2, rc 0, transno 17179874233 00000100:00100000:3.0:1746065209.693063:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263915776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065209.693064:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263916160:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065209.693069:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577ea00/2, rc 0, transno 17179874230 00000100:00100000:3.0:1746065209.693071:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263916288:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065209.693076:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aecbb80/2, rc 0, transno 21474841634 00000100:00100000:3.0:1746065209.693078:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aecbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263914752:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065209.693092:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17086 00010000:00080000:3.0:1746065209.693131:0:13395:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065209.693139:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2222:x1830881265193984:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 17756us (18042us total) trans 8589936971 rc 0/0 00000100:00100000:3.0:1746065209.693144:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14488 00000004:00080000:0.0:1746065209.693188:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec9880/2, rc 0, transno 21474841635 00000100:00100000:0.0:1746065209.693192:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263914880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065209.693199:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac64700/2, rc 0, transno 21474841636 00000100:00100000:0.0:1746065209.693202:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263915392:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065209.693432:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577ed80/2, rc 0, transno 17179874231 00000100:00100000:0.0:1746065209.693435:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263915904:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065209.693442:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009577c700/2, rc 0, transno 17179874232 00000100:00100000:0.0:1746065209.693444:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263916416:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1746065209.693635:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.693748:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.693754:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.693758:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdbe00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065209.693762:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.693860:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.693872:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065209.693875:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065209.693878:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:1.0:1746065209.693882:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbe00/0xad6b7ddc14786bf lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00000004:00080000:1.0:1746065209.693908:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090dd8e00/2, rc 0, transno 17179874234 00000100:00100000:1.0:1746065209.693911:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263916672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065209.695846:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.695909:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265195008 00000100:00100000:3.0:1746065209.695914:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265195008 00000100:00100000:3.0:1746065209.695946:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14489 00000100:00100000:3.0:1746065209.695953:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+7:2222:x1830881265195008:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065209.695969:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.695982:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc14786c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c29 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.696024:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc14786c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c29 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.696033:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc14786c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c29 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.696046:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.696049:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065209.696051:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fe00, rc 0) 00000100:00100000:3.0:1746065209.696082:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2222:x1830881265195008:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 130us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.696088:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14489 00000100:00100000:0.0:1746065209.698736:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.698940:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265195136 00000100:00100000:3.0:1746065209.698947:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265195136 00000100:00100000:3.0:1746065209.698989:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14490 00000100:00100000:3.0:1746065209.698995:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+8:2222:x1830881265195136:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065209.699009:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.699023:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc14786cd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c30 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.699088:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.699098:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.699107:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065209.699131:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065209.699134:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065209.699146:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065209.699164:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc14786cd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c30 expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.699196:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c30 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.699203:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065209.699206:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065209.699208:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc400, rc 0) 00000100:00100000:3.0:1746065209.699246:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2222:x1830881265195136:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 251us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.699251:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14490 00000100:00100000:0.0:1746065209.706809:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.706838:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.706853:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.706875:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.706887:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065209.706910:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065209.708616:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265195776 00000100:00100000:3.0:1746065209.708622:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265195776 00000100:00100000:3.0:1746065209.708652:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265195392 00000100:00100000:3.0:1746065209.708654:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265195392 00000100:00100000:3.0:1746065209.708665:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265195648 00000100:00100000:3.0:1746065209.708667:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265195648 00000100:00100000:3.0:1746065209.708674:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265195904 00000100:00100000:3.0:1746065209.708675:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265195904 00000100:00100000:3.0:1746065209.708686:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17092 00000100:00100000:3.0:1746065209.708693:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265195264:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065209.708707:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.708722:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc14786db lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c37 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065209.708740:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d739, atime: 0x6812d739, ctime: 0x6812d739, blocks: 0x748 00010000:00010000:3.0:1746065209.708754:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.708756:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.708763:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc14786db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c37 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.708788:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc14786db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c37 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.708798:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdbe00, rc 0) 00000100:00100000:3.0:1746065209.708834:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265195264:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 142us (2063us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.708837:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17093 00000100:00100000:3.0:1746065209.708841:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17092 00000100:00100000:0.0:1746065209.708844:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265195520:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065209.708852:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065209.708853:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17094 00000100:00100000:3.0:1746065209.708857:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265195776:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065209.708862:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065209.708862:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc14786e2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c45 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.708869:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc14786e9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c53 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065209.708875:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d739, atime: 0x6812d738, ctime: 0x6812d739, blocks: 0x808 00002000:00010000:3.0:1746065209.708878:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 4897248, mtime: 0x6812d739, atime: 0x6812d739, ctime: 0x6812d739, blocks: 0x1568 00010000:00010000:0.0:1746065209.708882:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.708883:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.708884:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.708885:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.708888:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc14786e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c53 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.708888:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc14786e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c45 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.708896:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc14786e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c53 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.708899:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc14786e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c45 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.708902:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb800, rc 0) 00010000:00010000:0.0:1746065209.708905:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60a00, rc 0) 00000100:00100000:3.0:1746065209.708912:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265195776:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 55us (2058us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.708920:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17094 00000100:00100000:0.0:1746065209.708922:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265195520:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 79us (2083us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.708927:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17093 00000100:00100000:3.0:1746065209.709386:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17095 00000100:00100000:3.0:1746065209.709393:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265195392:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065209.709399:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.709408:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc14786f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c3e expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065209.709426:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d739, atime: 0x6812d738, ctime: 0x6812d739, blocks: 0x800 00010000:00010000:3.0:1746065209.709432:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.709434:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.709438:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc14786f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c3e expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.709446:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc14786f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c3e expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065209.709452:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdac00, rc 0) 00000100:00100000:3.0:1746065209.709466:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265195392:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 75us (2590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.709470:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17095 00000100:00100000:3.0:1746065209.709482:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17096 00000100:00100000:3.0:1746065209.709486:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265195648:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065209.709490:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.709496:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc14786f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c4c expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065209.709500:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17097 00000100:00100000:0.0:1746065209.709507:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265195904:12345-192.168.202.27@tcp:101:mirror_io.0 00002000:00010000:3.0:1746065209.709508:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d737, atime: 0x6812d736, ctime: 0x6812d737, blocks: 0x808 00010000:00010000:3.0:1746065209.709513:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.709513:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065209.709514:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065209.709518:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc14786f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c4c expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.709521:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc14786fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c5a expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065209.709525:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc14786f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c4c expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00002000:00010000:0.0:1746065209.709530:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d739, atime: 0x6812d739, ctime: 0x6812d739, blocks: 0x1008 00010000:00010000:3.0:1746065209.709531:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdba00, rc 0) 00010000:00010000:0.0:1746065209.709537:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065209.709539:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065209.709540:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265195648:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 54us (2652us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065209.709543:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc14786fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c5a expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065209.709544:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17096 00010000:00010000:0.0:1746065209.709551:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc14786fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c5a expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065209.709558:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60600, rc 0) 00000100:00100000:0.0:1746065209.709572:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265195904:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 67us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.709577:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17097 00000100:00100000:0.0:1746065209.773268:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263916800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065209.773326:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065209.774224:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263916800 00000100:00100000:3.0:1746065209.774231:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263916800 00000100:00100000:3.0:1746065209.774320:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:3.0:1746065209.774328:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263916800:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1746065209.774358:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:3.0:1746065209.774467:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263916800:12345-0@lo:41:osp-pre-1-0.0 Request processed in 139us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065209.774474:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1746065209.774542:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263916800:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065209.804962:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065209.804984:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ceddf226-8ddf-479f-9953-8a74c62285a9:3761:1830881263916928:0@lo:400:kworker.0 00000100:00100000:0.0:1746065209.805045:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.805337:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263917056:0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.805367:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.811602:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3759:1830881263917568:0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.811621:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.811632:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3759:1830881263918080:0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.811644:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.811652:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065209.811656:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3759:1830881263917184:0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.811668:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.811677:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3759:1830881263917696:0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.811688:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.811701:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263917568 00000100:00100000:1.0:1746065209.811704:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263917568 00000100:00080000:1.0:1746065209.811713:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065209.811725:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1746065209.811732:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263918080 00000100:00100000:1.0:1746065209.811735:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263918080 00000100:00100000:1.0:1746065209.811745:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263917184 00000100:00100000:1.0:1746065209.811746:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263917184 00000100:00100000:1.0:1746065209.811752:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263917696 00000100:00100000:1.0:1746065209.811753:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263917696 00000100:00100000:1.0:1746065209.811763:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1746065209.811767:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3759:x1830881263918080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.811802:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3759:x1830881263918080:12345-0@lo:400:kworker.0 Request processed in 34us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.811807:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:1.0:1746065209.811814:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1746065209.811818:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3759:x1830881263917184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.811832:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3759:x1830881263917184:12345-0@lo:400:kworker.0 Request processed in 14us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.811836:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1746065209.811842:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1746065209.811845:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3759:x1830881263917696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.811858:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3759:x1830881263917696:12345-0@lo:400:kworker.0 Request processed in 13us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.811862:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00080000:1.0:1746065209.811871:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1746065209.811881:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3759:1830881263917184:0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.811888:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3759:1830881263917696:0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.811895:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3759:1830881263918080:0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.811906:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3759:x1830881263917568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065209.811926:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3759:x1830881263917568:12345-0@lo:400:kworker.0 Request processed in 197us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.811930:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:1.0:1746065209.811942:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3759:1830881263917568:0@lo:400:kworker.0 00000100:00100000:0.0:1746065209.812256:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263917056:0@lo:400:kworker.0 00000100:00100000:0.0:1746065209.852967:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065209.852987:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263918208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065209.853041:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.853161:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263918208 00000100:00100000:1.0:1746065209.853168:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263918208 00000100:00100000:1.0:1746065209.853199:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1746065209.853205:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881263918208:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1746065209.853232:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445568512 avail 1316106240 00000100:00100000:1.0:1746065209.853266:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881263918208:12345-0@lo:41:osp-pre-0-1.0 Request processed in 60us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.853274:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:0.0:1746065209.854343:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263918208:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065209.886527:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263918336 00000100:00100000:0.0:1746065209.886535:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263918336 00000100:00100000:0.0:1746065209.886574:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1746065209.886580:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3761:x1830881263918336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746065209.886598:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1072354752 pending 6508544 free 3910598656 avail 3679076352 00000100:00100000:0.0:1746065209.886975:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3761:x1830881263918336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 394us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065209.886981:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 580 00000100:00100000:0.0:1746065209.901077:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263918464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065209.901137:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065209.901372:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263918464 00000100:00100000:1.0:1746065209.901380:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263918464 00000100:00100000:1.0:1746065209.901430:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:1.0:1746065209.901437:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881263918464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746065209.901457:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1073248576 pending 4878336 free 3906805760 avail 3675283456 00000100:00100000:1.0:1746065209.901490:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881263918464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065209.901495:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1746065209.901626:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263918464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065210.717245:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.718093:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.719042:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065210.719722:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17099 00000100:00100000:3.0:1746065210.719729:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265196416:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:3.0:1746065210.720516:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265196416:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 786us (2422us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065210.720523:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17099 00000100:00100000:0.0:1746065210.720635:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.720872:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265196032 00000100:00100000:1.0:1746065210.720876:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265196032 00000100:00100000:1.0:1746065210.720895:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17101 00000100:00100000:1.0:1746065210.720900:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265196032:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:1.0:1746065210.720936:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265196032:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 36us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065210.720942:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17101 00000100:00100000:1.0:1746065210.722895:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.722933:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.723211:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265196288 00000100:00100000:0.0:1746065210.723218:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265196288 00000100:00100000:0.0:1746065210.723250:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265196544 00000100:00100000:0.0:1746065210.723251:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265196544 00000100:00100000:0.0:1746065210.723266:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17102 00000100:00100000:0.0:1746065210.723271:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265196288:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065210.723341:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265196288:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 69us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065210.723346:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17102 00000100:00100000:0.0:1746065210.723359:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17103 00000100:00100000:0.0:1746065210.723364:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265196544:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065210.723392:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265196544:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 28us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065210.723398:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17103 00000100:00100000:0.0:1746065210.741126:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.747925:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.748039:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265197696 00000100:00100000:1.0:1746065210.748047:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265197696 00000100:00100000:1.0:1746065210.748092:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17111 00000100:00100000:1.0:1746065210.748100:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265197696:12345-192.168.202.27@tcp:22:mirror_io.0 00002000:00010000:1.0:1746065210.748243:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065210.748246:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065210.748248:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065210.748249:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065210.748251:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:1.0:1746065210.748288:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265197696:12345-192.168.202.27@tcp:22:mirror_io.0 Request processed in 189us (371us total) trans 17179874235 rc 0/0 00000100:00100000:1.0:1746065210.748295:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17111 00000100:00100000:0.0:1746065210.753714:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.771605:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.771645:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.771675:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.781645:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.781686:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.781710:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265198976 00000100:00100000:0.0:1746065210.781717:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265198976 00000100:00100000:0.0:1746065210.781757:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265199232 00000100:00100000:0.0:1746065210.781760:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265199232 00000100:00100000:0.0:1746065210.781790:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6002 00000100:00100000:0.0:1746065210.781795:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+16:2006:x1830881265198976:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065210.781817:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc1478721 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.781827:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065210.781829:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065210.781832:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc1478721 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.781842:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc1478721 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065210.782569:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6003 00000100:00100000:0.0:1746065210.782578:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+16:2006:x1830881265199232:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065210.782596:0:29490:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478728 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.782603:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065210.782605:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065210.782607:0:29490:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478728 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.782615:0:29490:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478728 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065210.785830:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.785875:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265199488 00000100:00100000:1.0:1746065210.785883:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265199488 00000100:00100000:1.0:1746065210.785930:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6004 00000100:00100000:1.0:1746065210.785938:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265199488:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065210.785966:0:9555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147872f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.785979:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.785980:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.785987:0:9555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147872f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.786003:0:9555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147872f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065210.786318:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065210.786333:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265199744 00000100:00100000:3.0:1746065210.786336:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265199744 00000100:00100000:3.0:1746065210.786366:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6005 00000100:00100000:3.0:1746065210.786371:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265199744:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:3.0:1746065210.786385:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1478736 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.786392:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065210.786393:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065210.786396:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1478736 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.786416:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1478736 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.795880:0:20324:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f84a200/0xad6b7ddc1478705 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [94208->1048575] (req 94208->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.795897:0:20324:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84a200/0xad6b7ddc1478705 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [94208->1048575] (req 94208->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.795904:0:20324:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f84a200/0xad6b7ddc1478705 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [94208->1048575] (req 94208->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.795910:0:20324:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84a200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065210.795913:0:20324:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f84a200/0xad6b7ddc1478705 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [94208->1048575] (req 94208->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.795920:0:20324:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f84a200/0xad6b7ddc1478705 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [94208->1048575] (req 94208->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.795936:0:20324:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f84a200/0xad6b7ddc1478705 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [94208->1048575] (req 94208->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.795946:0:20324:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84a200/0xad6b7ddc1478705 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [94208->1048575] (req 94208->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 20324 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065210.796014:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265197952:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 42031us (42303us total) trans 0 rc 954368/954368 00000100:00100000:0.0:1746065210.796024:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5998 00010000:00010000:3.0:1746065210.797398:0:29491:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc147870c lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.797421:0:29491:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc147870c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.797428:0:29491:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc147870c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.797434:0:29491:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065210.797438:0:29491:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc147870c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.797444:0:29491:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc147870c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.797457:0:29491:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc147870c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.797463:0:29491:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc147870c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065210.797526:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:02506576-29fe-43be-8266-ebca0ccafd52+18:2007:x1830881265198208:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 19791us (25926us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065210.797534:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5999 00010000:00010000:0.0:1746065210.815172:0:13378:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc1478721 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.815187:0:13378:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc1478721 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.815194:0:13378:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc1478721 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.815200:0:13378:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065210.815203:0:13378:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc1478721 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.815209:0:13378:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc1478721 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.815224:0:13378:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc1478721 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.815230:0:13378:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61e00/0xad6b7ddc1478721 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065210.816499:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265198976:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 34695us (34851us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065210.816509:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6002 00010000:00010000:2.0:1746065210.820297:0:29490:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478728 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.820306:0:29490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478728 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065210.821592:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265199232:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 39003us (39894us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065210.821601:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6003 00010000:00010000:1.0:1746065210.825109:0:9555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147872f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.825124:0:9555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147872f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.825131:0:9555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147872f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.825136:0:9555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abada00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065210.825139:0:9555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147872f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.825146:0:9555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147872f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.825160:0:9555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147872f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.825166:0:9555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abada00/0xad6b7ddc147872f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065210.825241:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265199488:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 39299us (39413us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065210.825252:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6004 00010000:00010000:3.0:1746065210.827417:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1478736 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.827430:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1478736 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.827437:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1478736 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.827443:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065210.827445:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1478736 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.827451:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1478736 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.827465:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1478736 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.827471:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc1478736 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065210.827768:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265199744:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 41392us (41445us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065210.827790:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6005 00000100:00100000:0.0:1746065210.836682:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.836798:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265199872 00000100:00100000:1.0:1746065210.836806:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265199872 00000100:00100000:1.0:1746065210.836852:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 839 00000100:00100000:1.0:1746065210.836859:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2222:x1830881265199872:12345-192.168.202.27@tcp:103:mirror_io.0 00010000:00010000:1.0:1746065210.836872:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065210.836892:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc1478680 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c1b expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.836919:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065210.836923:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065210.836964:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2222:x1830881265199872:12345-192.168.202.27@tcp:103:mirror_io.0 Request processed in 105us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065210.836970:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 839 00000100:00100000:0.0:1746065210.838940:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.838994:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265200128 00000100:00100000:1.0:1746065210.839001:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265200128 00000100:00100000:1.0:1746065210.839089:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5408 00000100:00100000:1.0:1746065210.839097:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2222:x1830881265200128:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065210.839256:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2222:x1830881265200128:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 159us (321us total) trans 8589936972 rc 0/0 00000100:00100000:1.0:1746065210.839262:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5408 00000100:00100000:0.0:1746065210.840561:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.840681:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265200384 00000100:00100000:1.0:1746065210.840686:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265200384 00000100:00100000:1.0:1746065210.840720:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5409 00000100:00100000:1.0:1746065210.840727:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2222:x1830881265200384:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065210.840867:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2222:x1830881265200384:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 140us (308us total) trans 8589936973 rc 0/0 00000100:00100000:1.0:1746065210.840873:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5409 00000100:00100000:0.0:1746065210.856510:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065210.857326:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265200640 00000100:00100000:2.0:1746065210.857334:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265200640 00000100:00100000:2.0:1746065210.857388:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14491 00000100:00100000:2.0:1746065210.857395:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2234:x1830881265200640:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065210.857424:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065210.857440:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60000/0xad6b7ddc147873d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c61 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.857500:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc1478744 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857510:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc1478744 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857518:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc1478744 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857529:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc147874b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857533:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc147874b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857537:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc147874b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857614:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc1478752 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857622:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc1478752 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857628:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc1478752 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065210.857635:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065210.857689:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc1478744 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857694:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc1478744 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857698:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc1478744 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857703:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc1478744 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857708:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b60400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065210.857711:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc1478744 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857716:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc1478744 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857724:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065210.857726:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065210.857729:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc1478744 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.857736:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc1478744 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.858825:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc147874b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.858834:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc147874b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.858838:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc147874b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.858843:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b61400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065210.858845:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc147874b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.858849:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc147874b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.858857:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a9973700) 00010000:00010000:2.0:1746065210.858859:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065210.858861:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc147874b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.858865:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc147874b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065210.858902:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60000/0xad6b7ddc147873d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c61 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.858911:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc1478752 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c61 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.858921:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065210.858923:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065210.858925:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b200, rc 0) 00000100:00100000:2.0:1746065210.859195:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2234:x1830881265200640:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1799us (2691us total) trans 8589936974 rc 0/0 00000100:00100000:2.0:1746065210.859201:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14491 00000100:00100000:0.0:1746065210.864280:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.864333:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.864352:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065210.864421:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265200896 00000100:00100000:3.0:1746065210.864429:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265200896 00000100:00100000:3.0:1746065210.864468:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14492 00000100:00100000:3.0:1746065210.864474:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2235:x1830881265200896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065210.864491:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065210.864507:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478760 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c68 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.864565:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478767 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864576:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478767 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864585:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478767 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864596:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147876e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864605:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147876e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864610:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147876e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864692:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478775 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864700:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478775 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864706:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478775 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065210.864714:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065210.864799:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478767 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864805:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478767 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864809:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478767 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864815:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478767 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864820:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065210.864823:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478767 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864829:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478767 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864841:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065210.864843:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065210.864847:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478767 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864851:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72400/0xad6b7ddc1478767 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864864:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147876e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864869:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147876e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864872:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147876e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864876:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065210.864878:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147876e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864883:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147876e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864888:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5300) 00010000:00010000:3.0:1746065210.864890:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065210.864892:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147876e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864896:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147876e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065210.864926:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478760 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c68 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.864937:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478775 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c68 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.864943:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065210.864945:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065210.864947:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73e00, rc 0) 00000100:00100000:3.0:1746065210.864983:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2235:x1830881265200896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 508us (710us total) trans 8589936975 rc 0/0 00000100:00100000:3.0:1746065210.864988:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14492 00000100:00100000:0.0:1746065210.866675:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065210.867638:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265201024 00000100:00100000:2.0:1746065210.867647:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265201024 00000100:00100000:1.0:1746065210.867650:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265201152 00000100:00100000:1.0:1746065210.867655:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265201152 00000100:00100000:1.0:1746065210.867679:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265201280 00000100:00100000:1.0:1746065210.867681:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265201280 00000100:00100000:2.0:1746065210.867726:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17112 00000100:00100000:2.0:1746065210.867733:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2006:x1830881265201152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065210.867743:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065210.867755:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1478783 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c76 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.867770:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.867785:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.867792:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1478783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c76 expref: 25 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.867804:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1478783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c76 expref: 25 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.867812:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a200, rc 0) 00000100:00100000:2.0:1746065210.867841:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2006:x1830881265201152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 109us (3488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065210.867846:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17112 00000100:00100000:2.0:1746065210.867860:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17113 00000100:00100000:2.0:1746065210.867864:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265201024:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065210.867867:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17114 00010000:00010000:2.0:1746065210.867870:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065210.867874:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2007:x1830881265201280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065210.867877:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147878a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c6f expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.867881:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065210.867886:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.867887:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.867888:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc1478791 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c7d expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.867891:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147878a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c6f expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.867898:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.867899:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147878a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c6f expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.867900:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.867904:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc1478791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c7d expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.867905:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b000, rc 0) 00010000:00010000:1.0:1746065210.867913:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc1478791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c7d expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065210.867918:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265201024:12345-192.168.202.27@tcp:101:cat.0 Request processed in 53us (3585us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065210.867920:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c000, rc 0) 00000100:00100000:2.0:1746065210.867922:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17113 00000100:00100000:1.0:1746065210.867936:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265201280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 64us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065210.867941:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17114 00000100:00100000:2.0:1746065210.871797:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.871811:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065210.871826:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065210.871837:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.871842:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265201920 00000100:00100000:1.0:1746065210.871848:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265201408 00000100:00100000:0.0:1746065210.871848:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265201920 00000100:00100000:1.0:1746065210.871852:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265201408 00000100:00100000:2.0:1746065210.871858:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.871862:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265201536 00000100:00100000:1.0:1746065210.871864:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265201536 00000100:00100000:2.0:1746065210.871867:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065210.871879:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.871880:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14493 00000100:00100000:1.0:1746065210.871882:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265201664 00000100:00100000:1.0:1746065210.871884:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265201664 00000100:00100000:0.0:1746065210.871886:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2231:x1830881265201920:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:2.0:1746065210.871890:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.871895:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265202048 00000100:00100000:1.0:1746065210.871897:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265202048 00000100:00100000:2.0:1746065210.871902:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065210.871905:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065210.871906:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265202176 00000100:00100000:1.0:1746065210.871908:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265202176 00000100:00100000:1.0:1746065210.871917:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265202304 00010000:00010000:0.0:1746065210.871917:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1478798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c99 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065210.871918:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265202304 00000100:00100000:2.0:1746065210.871921:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.871926:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265202432 00000100:00100000:1.0:1746065210.871928:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265202432 00000100:00100000:1.0:1746065210.871933:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265202560 00000100:00100000:2.0:1746065210.871934:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265202688 00000100:00100000:1.0:1746065210.871935:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265202560 00000100:00100000:2.0:1746065210.871937:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265202688 00000100:00100000:1.0:1746065210.871943:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17115 00000100:00100000:1.0:1746065210.871949:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265201536:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065210.871954:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17116 00010000:00010000:1.0:1746065210.871956:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065210.871958:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2006:x1830881265201664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065210.871965:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065210.871966:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b6400/0xad6b7ddc147879f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c8b expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.871974:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc14787a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c92 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.871987:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.871987:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.871989:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.871989:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.871995:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc14787a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c92 expref: 26 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.871995:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b6400/0xad6b7ddc147879f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c8b expref: 24 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.872006:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc14787a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c92 expref: 26 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.872015:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b600, rc 0) 00000100:00100000:2.0:1746065210.872049:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2006:x1830881265201664:12345-192.168.202.27@tcp:101:cat.0 Request processed in 89us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065210.872054:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17116 00000100:00100000:2.0:1746065210.872068:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17117 00000100:00100000:2.0:1746065210.872073:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265202048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065210.872078:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065210.872085:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc14787ad lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ca0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.872095:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.872097:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.872100:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc14787ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca0 expref: 47 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.872109:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc14787ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca0 expref: 47 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.872115:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a600, rc 0) 00000100:00100000:2.0:1746065210.872131:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265202048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 58us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065210.872135:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17117 00000100:00100000:2.0:1746065210.872145:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17118 00000100:00100000:2.0:1746065210.872150:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265202176:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065210.872156:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065210.872162:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d800/0xad6b7ddc14787b4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ca7 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.872171:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.872172:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.872176:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d800/0xad6b7ddc14787b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca7 expref: 37 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.872184:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d800/0xad6b7ddc14787b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca7 expref: 37 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.872190:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d800, rc 0) 00000100:00100000:2.0:1746065210.872204:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265202176:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065210.872209:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17118 00000100:00100000:2.0:1746065210.872219:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17119 00000100:00100000:2.0:1746065210.872223:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265202304:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065210.872228:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065210.872233:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14787bb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938cae expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.872240:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.872241:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.872245:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14787bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cae expref: 37 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.872251:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14787bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cae expref: 37 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.872257:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d000, rc 0) 00000100:00100000:2.0:1746065210.872271:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265202304:12345-192.168.202.27@tcp:101:cat.0 Request processed in 48us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065210.872275:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17119 00000100:00100000:2.0:1746065210.872283:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17120 00000100:00100000:2.0:1746065210.872293:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265202432:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065210.872298:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065210.872304:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938cb5 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.872311:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.872312:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.872315:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cb5 expref: 47 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.872323:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cb5 expref: 47 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.872325:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b6400/0xad6b7ddc147879f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c8b expref: 24 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065210.872328:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6dc00, rc 0) 00010000:00010000:1.0:1746065210.872334:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6400, rc 0) 00000100:00100000:2.0:1746065210.872341:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265202432:12345-192.168.202.27@tcp:101:cat.0 Request processed in 54us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065210.872345:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17120 00000100:00100000:1.0:1746065210.872353:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2007:x1830881265201536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 404us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065210.872354:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17121 00000100:00100000:2.0:1746065210.872357:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265202560:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065210.872362:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065210.872362:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17115 00010000:00010000:2.0:1746065210.872366:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc14787c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938cbc expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.872368:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00000100:00100000:1.0:1746065210.872373:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17122 00010000:00010000:2.0:1746065210.872374:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.872375:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065210.872378:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc14787c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cbc expref: 47 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065210.872378:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265202688:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065210.872378:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c30 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.872384:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065210.872385:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc14787c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cbc expref: 47 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065210.872385:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc1478752 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c61 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.872390:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b7400/0xad6b7ddc14787d7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938cc3 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.872391:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2d600, rc 0) 00010000:00010000:0.0:1746065210.872392:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478775 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c68 expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.872396:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065210.872399:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.872409:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.872414:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b7400/0xad6b7ddc14787d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cc3 expref: 37 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065210.872417:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265202560:12345-192.168.202.27@tcp:101:cat.0 Request processed in 59us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065210.872421:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17121 00010000:00010000:1.0:1746065210.872423:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b7400/0xad6b7ddc14787d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cc3 expref: 37 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065210.872426:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478775 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c68 expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.872429:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7400, rc 0) 00010000:00010000:0.0:1746065210.872436:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478775 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c68 expref: 27 pid: 7231 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746065210.872444:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265202688:12345-192.168.202.27@tcp:101:cat.0 Request processed in 66us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065210.872446:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263918592:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065210.872449:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17122 00000100:00100000:1.0:1746065210.872480:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17123 00000100:00100000:1.0:1746065210.872484:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265201408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065210.872490:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065210.872495:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938c84 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.872495:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc1478752 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c61 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.872502:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc1478752 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c61 expref: 10 pid: 7231 timeout: 906 lvb_type: 0 00010000:00010000:1.0:1746065210.872505:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.872507:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065210.872509:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263918720:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065210.872511:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c84 expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.872519:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c84 expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.872524:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7e00, rc 0) 00010000:00010000:0.0:1746065210.872530:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c30 expref: 9 pid: 13395 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065210.872538:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2006:x1830881265201408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 54us (766us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065210.872538:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c30 expref: 9 pid: 13395 timeout: 906 lvb_type: 0 00000100:00100000:1.0:1746065210.872543:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17123 00000100:00100000:0.0:1746065210.872545:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263918848:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065210.872563:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065210.874467:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.874590:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265202944 00000100:00100000:0.0:1746065210.874596:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265202944 00000100:00100000:2.0:1746065210.874796:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14494 00000100:00100000:2.0:1746065210.874804:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2232:x1830881265202944:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065210.874820:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065210.874832:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc14787e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938cca expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.874954:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065210.874965:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065210.874973:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065210.875039:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263918592:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065210.875046:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.875047:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263918720:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065210.875064:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265203072 00000100:00100000:2.0:1746065210.875067:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265203072 00000100:00100000:0.0:1746065210.875072:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263918848:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065210.875080:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478775 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c68 expref: 30 pid: 7231 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746065210.875086:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065210.875103:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7921 00000100:00100000:2.0:1746065210.875108:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265203072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065210.875115:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065210.875119:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478775 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c68 expref: 30 pid: 7231 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746065210.875127:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478775 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c68 expref: 30 pid: 7231 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746065210.875146:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478775 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c68 expref: 30 pid: 7231 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746065210.875170:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065210.875174:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065210.875179:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065210.875183:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065210.875210:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265203072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 102us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065210.875216:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7921 00000100:00100000:1.0:1746065210.875324:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065210.875336:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265203328 00000100:00100000:2.0:1746065210.875339:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265203328 00010000:00010000:2.0:1746065210.875352:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c30 expref: 10 pid: 13395 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746065210.875366:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7922 00000100:00100000:2.0:1746065210.875370:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265203328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065210.875377:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065210.875380:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c30 expref: 10 pid: 13395 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746065210.875387:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c30 expref: 10 pid: 13395 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746065210.875416:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc14786d4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c30 expref: 10 pid: 13395 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746065210.875424:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065210.875427:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065210.875432:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065210.875436:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065210.875451:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265203328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065210.875456:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7922 00000100:00100000:3.0:1746065210.876161:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.876198:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265203200 00000100:00100000:0.0:1746065210.876202:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265203200 00000100:00100000:3.0:1746065210.876205:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065210.876215:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc1478752 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c61 expref: 11 pid: 7231 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746065210.876244:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7923 00000100:00100000:0.0:1746065210.876250:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5357c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265203200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065210.876256:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065210.876260:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc1478752 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c61 expref: 11 pid: 7231 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746065210.876316:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc1478752 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c61 expref: 11 pid: 7231 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746065210.876328:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc1478752 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c61 expref: 11 pid: 7231 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746065210.876329:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.876395:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265203456 00000100:00100000:1.0:1746065210.876399:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265203456 00000100:00100000:1.0:1746065210.876437:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265203584 00000100:00100000:1.0:1746065210.876440:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265203584 00010000:00010000:0.0:1746065210.876448:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065210.876452:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:1.0:1746065210.876455:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14495 00010000:00010000:0.0:1746065210.876459:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00000100:00100000:1.0:1746065210.876460:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2234:x1830881265203456:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065210.876464:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065210.876470:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065210.876475:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065210.876483:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065210.876498:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065210.876501:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14496 00000100:00100000:2.0:1746065210.876506:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2235:x1830881265203584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065210.876512:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065210.876518:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5357c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265203200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 268us (358us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065210.876520:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc14787f3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938cd8 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065210.876525:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7923 00010000:00010000:2.0:1746065210.876552:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc14787f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd8 expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.876561:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc14787f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd8 expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.876561:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065210.876567:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065210.876573:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065210.876575:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065210.876577:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61400, rc 0) 00000004:00200000:0.0:1746065210.876578:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065210.876660:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc1478798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c99 expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.876669:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c99 expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.876679:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065210.876681:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065210.876683:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67800, rc 0) 00010000:00010000:3.0:1746065210.876688:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065210.876695:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065210.876703:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2231:x1830881265201920:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4817us (4892us total) trans 8589936976 rc 0/0 00000004:00200000:3.0:1746065210.876704:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000100:00100000:0.0:1746065210.876708:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14493 00010000:00010000:3.0:1746065210.876746:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc14787e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cca expref: 32 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.876883:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cca expref: 31 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.876889:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065210.876891:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065210.876893:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61800, rc 0) 00010000:00010000:1.0:1746065210.876969:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065210.876977:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6600/0xad6b7ddc1478808 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938cd1 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.876997:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6600/0xad6b7ddc1478808 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd1 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.877005:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6600/0xad6b7ddc1478808 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd1 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.877018:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065210.877020:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065210.877021:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6600, rc 0) 00000100:00100000:1.0:1746065210.877035:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2234:x1830881265203456:12345-192.168.202.27@tcp:101:cat.0 Request processed in 575us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065210.877040:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14495 00000100:00100000:2.0:1746065210.877094:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2235:x1830881265203584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 588us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065210.877099:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14496 00000100:00100000:3.0:1746065210.877236:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2232:x1830881265202944:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2433us (2774us total) trans 8589936977 rc 0/0 00000100:00100000:3.0:1746065210.877242:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14494 00000100:00100000:0.0:1746065210.889840:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.889889:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.889968:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265203968 00000100:00100000:1.0:1746065210.889977:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265203968 00002000:00100000:1.0:1746065210.890017:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff8800a4e51500 x1830881265203968/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065210.890026:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51500 with x1830881265203968 ext(0->1048575) 00002000:00010000:1.0:1746065210.890030:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e51500 00000100:00100000:1.0:1746065210.890062:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265204096 00000100:00100000:1.0:1746065210.890064:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265204096 00002000:00100000:1.0:1746065210.890077:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800a4e50000 x1830881265204096/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065210.890083:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50000 with x1830881265204096 ext(1048576->2097151) 00002000:00010000:1.0:1746065210.890086:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e50000 00000100:00100000:3.0:1746065210.890229:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6006 00000100:00100000:3.0:1746065210.890238:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265203968:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065210.890585:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6007 00000100:00100000:2.0:1746065210.890593:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265204096:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065210.891454:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.891474:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.891486:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265204352 00000100:00100000:0.0:1746065210.891489:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265204352 00002000:00100000:0.0:1746065210.891507:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a4e53800 x1830881265204352/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065210.891514:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53800 with x1830881265204352 ext(1048576->2097151) 00002000:00010000:0.0:1746065210.891517:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e53800 00000100:00100000:0.0:1746065210.891542:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265204608 00000100:00100000:0.0:1746065210.891544:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265204608 00002000:00100000:0.0:1746065210.891554:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800a4e51880 x1830881265204608/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065210.891561:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51880 with x1830881265204608 ext(1048576->2097151) 00002000:00010000:0.0:1746065210.891563:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e51880 00000100:00100000:2.0:1746065210.891568:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6008 00000100:00100000:2.0:1746065210.891576:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2004:x1830881265204352:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065210.891580:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6009 00000100:00100000:0.0:1746065210.891585:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265204608:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065210.899705:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.899744:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065210.899813:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265204864 00000100:00100000:0.0:1746065210.899816:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065210.899826:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265204864 00000100:00100000:1.0:1746065210.899833:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265205120 00000100:00100000:1.0:1746065210.899839:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265205120 00002000:00100000:2.0:1746065210.899860:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff8800a4e53480 x1830881265204864/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065210.899870:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53480 with x1830881265204864 ext(0->1048575) 00002000:00100000:1.0:1746065210.899874:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800a4e52a00 x1830881265205120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:2.0:1746065210.899876:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e53480 00002000:00100000:1.0:1746065210.899883:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52a00 with x1830881265205120 ext(1048576->2097151) 00002000:00010000:1.0:1746065210.899886:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e52a00 00000100:00100000:2.0:1746065210.899903:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265205376 00000100:00100000:2.0:1746065210.899940:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265205376 00002000:00100000:2.0:1746065210.899954:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a4e51c00 x1830881265205376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065210.899965:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51c00 with x1830881265205376 ext(1048576->2097151) 00002000:00010000:2.0:1746065210.899968:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e51c00 00000100:00100000:2.0:1746065210.900024:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6010 00000100:00100000:2.0:1746065210.900031:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265204864:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065210.900093:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6011 00000100:00100000:0.0:1746065210.900100:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6012 00000100:00100000:1.0:1746065210.900103:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881265205120:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065210.900110:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881265205376:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065210.907019:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065210.907161:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265203968:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16922us (17327us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065210.907171:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6006 00002000:00100000:3.0:1746065210.907181:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff8800a4e51500 x1830881265203968/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065210.907191:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51500 with x1830881265203968 ext(0->1048575) 00002000:00010000:3.0:1746065210.907196:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e51500 00000100:00100000:3.0:1746065210.907215:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265205632 00000100:00100000:3.0:1746065210.907221:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265205632 00002000:00100000:3.0:1746065210.907246:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800984d9880 x1830881265205632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065210.907253:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d9880 with x1830881265205632 ext(1048576->2097151) 00002000:00010000:3.0:1746065210.907256:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d9880 00000100:00100000:3.0:1746065210.907276:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6013 00000100:00100000:3.0:1746065210.907281:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+49:2006:x1830881265205632:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065210.907665:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2004:x1830881265204096:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17072us (17774us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065210.907674:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6007 00002000:00100000:0.0:1746065210.907680:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800a4e50000 x1830881265204096/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065210.907688:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50000 with x1830881265204096 ext(1048576->2097151) 00002000:00010000:0.0:1746065210.907694:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e50000 00000100:00100000:0.0:1746065210.915557:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065210.915623:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265204608:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24035us (24146us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065210.915633:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6009 00000100:00100000:3.0:1746065210.915643:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265205888 00002000:00100000:2.0:1746065210.915643:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800a4e51880 x1830881265204608/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065210.915649:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265205888 00002000:00100000:2.0:1746065210.915651:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51880 with x1830881265204608 ext(1048576->2097151) 00002000:00010000:2.0:1746065210.915655:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e51880 00000100:00100000:3.0:1746065210.915682:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14497 00000100:00100000:3.0:1746065210.915688:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2231:x1830881265205888:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065210.915730:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065210.915733:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065210.915754:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6600/0xad6b7ddc1478808 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd1 expref: 11 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.915935:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065210.915940:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065210.915950:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147880f lrc: 2/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938cdf expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.915988:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065210.915999:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc14786c6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c29 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.916005:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc14787f3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd8 expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.916011:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065210.916033:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc14787f3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd8 expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.916043:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc14787f3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd8 expref: 29 pid: 7204 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746065210.916053:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263918976:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065210.916474:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc14786c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c29 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065210.916483:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc14786c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c29 expref: 8 pid: 13395 timeout: 906 lvb_type: 0 00000100:00100000:3.0:1746065210.916491:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263919104:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065210.916511:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065210.916647:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065210.916747:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265206016 00000100:00100000:3.0:1746065210.916750:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265206016 00000100:00100000:1.0:1746065210.916903:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14498 00000100:00100000:1.0:1746065210.916911:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2234:x1830881265206016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065210.916920:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065210.916927:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ce6 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.916955:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065210.916962:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 4/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.916971:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065210.916980:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.916989:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065210.916991:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065210.916993:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065210.916998:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b7200, rc 0) 00000100:00100000:1.0:1746065210.917019:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2234:x1830881265206016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 109us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065210.917024:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14498 00000100:00100000:0.0:1746065210.921051:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.921090:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.921131:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265206272 00000100:00100000:0.0:1746065210.921138:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265206272 00010000:00010000:0.0:1746065210.921168:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc14786c6 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c29 expref: 9 pid: 13395 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746065210.921191:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265206144 00000100:00100000:0.0:1746065210.921192:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265206144 00010000:00010000:0.0:1746065210.921201:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc14787f3 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd8 expref: 30 pid: 7204 timeout: 906 lvb_type: 0 00000100:00100000:0.0:1746065210.921215:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7924 00000100:00100000:0.0:1746065210.921222:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265206272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065210.921232:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065210.921236:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc14786c6 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c29 expref: 9 pid: 13395 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746065210.921243:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc14786c6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c29 expref: 9 pid: 13395 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746065210.921261:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265204352:12345-192.168.202.27@tcp:3:cat.0 Request processed in 29685us (29808us total) trans 0 rc 1048576/1048576 00010000:00010000:0.0:1746065210.921262:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065210.921266:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00000100:00100000:2.0:1746065210.921269:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6008 00010000:00010000:0.0:1746065210.921273:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00002000:00100000:2.0:1746065210.921276:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a4e53800 x1830881265204352/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746065210.921277:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:2.0:1746065210.921284:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53800 with x1830881265204352 ext(1048576->2097151) 00002000:00010000:2.0:1746065210.921288:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e53800 00000100:00100000:0.0:1746065210.921288:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265206272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 68us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065210.921293:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7924 00000100:00100000:0.0:1746065210.921301:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7925 00000100:00100000:0.0:1746065210.921305:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265206144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065210.921310:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065210.921313:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc14787f3 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd8 expref: 30 pid: 7204 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746065210.921320:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc14787f3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd8 expref: 30 pid: 7204 timeout: 906 lvb_type: 0 00000100:00100000:2.0:1746065210.921329:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263918976:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065210.921329:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61400/0xad6b7ddc14787f3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cd8 expref: 30 pid: 7204 timeout: 906 lvb_type: 0 00010000:00010000:2.0:1746065210.921339:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc14786c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c29 expref: 8 pid: 13395 timeout: 906 lvb_type: 0 00010000:00010000:0.0:1746065210.921341:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065210.921344:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065210.921350:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 9571 initiator: MDT0 00000100:00100000:2.0:1746065210.921351:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263919104:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065210.921355:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065210.921361:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065210.922240:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065210.922242:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065210.922249:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065210.922254:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 9571 initiator: MDT0 00000040:00080000:2.0:1746065210.922458:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1038, 88 off99184 00000004:00080000:2.0:1746065210.922465:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 806940690655ns, next at 761143591313ns, rc = 0 00000100:00100000:0.0:1746065210.923037:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265206144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1728us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065210.923044:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7925 00000040:00080000:2.0:1746065210.923155:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1056, 88 off100768 00000004:00080000:2.0:1746065210.923162:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 806941387934ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065210.923174:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1057, 88 off100856 00000004:00080000:2.0:1746065210.923178:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 806941404031ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065210.923561:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1039, 88 off99272 00000004:00080000:2.0:1746065210.923566:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 806941792531ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065210.923583:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1040, 88 off99360 00000004:00080000:2.0:1746065210.923586:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 806941812178ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065210.923596:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1058, 88 off100944 00000004:00080000:2.0:1746065210.923599:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 806941825198ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065210.923617:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1059, 88 off101032 00000004:00080000:2.0:1746065210.923619:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 806941845787ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065210.923626:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1060, 88 off101120 00000004:00080000:2.0:1746065210.923629:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 806941855342ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065210.923638:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1041, 88 off99448 00000004:00080000:2.0:1746065210.923640:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 806941866669ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065210.923648:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1061, 88 off101208 00000004:00080000:2.0:1746065210.923650:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 806941876536ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065210.923658:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1042, 88 off99536 00000004:00080000:2.0:1746065210.923660:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 806941886747ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065210.923667:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1062, 88 off101296 00000004:00080000:2.0:1746065210.923669:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 806941895576ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065210.923677:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1043, 88 off99624 00000004:00080000:2.0:1746065210.923679:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 806941905611ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065210.923686:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1044, 88 off99712 00000004:00080000:2.0:1746065210.923688:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 806941914721ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065210.923694:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1045, 88 off99800 00000004:00080000:2.0:1746065210.923696:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 806941922338ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065210.923703:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1046, 88 off99888 00000004:00080000:2.0:1746065210.923705:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 806941931442ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065210.923717:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1063, 88 off101384 00000004:00080000:2.0:1746065210.923720:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 806941946398ns, next at 761143559853ns, rc = 0 00000001:00080000:3.0:1746065210.930939:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936978 is committed 00000004:00080000:3.0:1746065210.930950:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1042 committed 00000004:00080000:3.0:1746065210.930959:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1027 committed 00000004:00080000:3.0:1746065210.930964:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1026 committed 00000004:00080000:3.0:1746065210.930966:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1025 committed 00000004:00080000:3.0:1746065210.930968:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1024 committed 00000004:00080000:3.0:1746065210.930969:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1041 committed 00000004:00080000:3.0:1746065210.930970:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1023 committed 00000004:00080000:3.0:1746065210.930972:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1040 committed 00000004:00080000:3.0:1746065210.930973:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1022 committed 00000004:00080000:3.0:1746065210.930974:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1039 committed 00000004:00080000:3.0:1746065210.930976:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1038 committed 00000004:00080000:3.0:1746065210.930977:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1037 committed 00000004:00080000:3.0:1746065210.930979:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1021 committed 00000004:00080000:3.0:1746065210.930980:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1020 committed 00000004:00080000:3.0:1746065210.930981:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1036 committed 00000004:00080000:3.0:1746065210.930983:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1035 committed 00000004:00080000:3.0:1746065210.930984:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1019 committed 00000001:00080000:3.0:1746065210.930989:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936977 is committed 00000001:00080000:3.0:1746065210.930999:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589936973 is committed 00000100:00100000:3.0:1746065210.931116:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263919360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065210.931167:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065210.931346:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263919232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065210.931369:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065210.931388:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263919616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065210.931415:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065210.931443:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263919360 00000100:00100000:0.0:1746065210.931449:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263919360 00000100:00100000:0.0:1746065210.931479:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263919232 00000100:00100000:0.0:1746065210.931481:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263919232 00000100:00100000:0.0:1746065210.931491:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263919616 00000100:00100000:0.0:1746065210.931493:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263919616 00000100:00100000:0.0:1746065210.931505:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17124 00000100:00100000:0.0:1746065210.931511:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3760:x1830881263919360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065210.931611:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065210.931614:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065209 -> 1746065209 00002000:00010000:0.0:1746065210.931616:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065208 -> 1746065208 00002000:00010000:0.0:1746065210.931618:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065209 -> 1746065209 00002000:00010000:0.0:1746065210.931619:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065210.931641:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3760:x1830881263919360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (475us total) trans 21474841640 rc 0/0 00000100:00100000:0.0:1746065210.931647:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17124 00000100:00100000:0.0:1746065210.931660:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17125 00000100:00100000:0.0:1746065210.931664:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3759:x1830881263919232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065210.931701:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065210.931703:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065209 -> 1746065209 00002000:00010000:0.0:1746065210.931704:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065208 -> 1746065208 00002000:00010000:0.0:1746065210.931706:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065209 -> 1746065209 00002000:00010000:0.0:1746065210.931707:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065210.931724:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3759:x1830881263919232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (355us total) trans 21474841641 rc 0/0 00000100:00100000:0.0:1746065210.931729:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17125 00000100:00100000:0.0:1746065210.931736:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17126 00000100:00100000:0.0:1746065210.931740:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+63:3762:x1830881263919616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065210.931789:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065210.931792:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065210.931793:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065210.931794:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065210.931796:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:0.0:1746065210.931816:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+64:3762:x1830881263919616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (400us total) trans 21474841642 rc 0/0 00000100:00100000:0.0:1746065210.931821:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17126 00010000:00010000:0.0:1746065210.931999:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cdf expref: 11 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.932009:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065210.932011:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:0.0:1746065210.932015:0:9571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.932028:0:9571:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.932034:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.932056:0:9571:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065210.932065:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263921280:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065210.932196:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881265205376:12345-192.168.202.27@tcp:3:cat.0 Request processed in 32090us (32378us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065210.932202:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6012 00002000:00100000:0.0:1746065210.932210:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800a4e51c00 x1830881265205376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065210.932217:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51c00 with x1830881265205376 ext(1048576->2097151) 00002000:00010000:0.0:1746065210.932222:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e51c00 00000100:00100000:0.0:1746065210.932286:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263919488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065210.932304:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065210.932341:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263919488 00000100:00100000:2.0:1746065210.932345:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263919488 00000100:00100000:2.0:1746065210.932361:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17127 00000100:00100000:2.0:1746065210.932364:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+64:3761:x1830881263919488:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065210.932867:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d9180/2, rc 0, transno 21474841640 00000100:00100000:3.0:1746065210.932872:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263919360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065210.932878:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263919872:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065210.932899:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065210.933080:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263920384:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065210.933100:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065210.933112:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263920896:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065210.933123:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065210.933143:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263919872 00000100:00100000:3.0:1746065210.933146:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263919872 00000100:00100000:3.0:1746065210.933163:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263920384 00000100:00100000:3.0:1746065210.933164:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263920384 00000100:00100000:3.0:1746065210.933173:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263920896 00000100:00100000:3.0:1746065210.933175:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263920896 00000100:00100000:3.0:1746065210.933184:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17128 00000100:00100000:3.0:1746065210.933188:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+65:3760:x1830881263919872:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065210.933220:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17129 00000100:00100000:3.0:1746065210.933224:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+51:3760:x1830881263920384:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065210.933228:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d8000/2, rc 0, transno 21474841641 00000100:00100000:1.0:1746065210.933232:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263919232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065210.933236:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263919744:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065210.933254:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065210.933255:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17130 00000100:00100000:2.0:1746065210.933260:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+51:3760:x1830881263920896:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065210.933267:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263920256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065210.933279:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065210.933290:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263920768:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065210.933301:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065210.933324:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984db800/2, rc 0, transno 21474841642 00000100:00100000:1.0:1746065210.933327:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263919616:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065210.933332:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263920128:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065210.933339:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+52:3760:x1830881263920896:12345-0@lo:2:osp-syn-1-0.0 Request processed in 80us (215us total) trans 17179874236 rc 0/0 00000100:00100000:2.0:1746065210.933344:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17130 00000100:00100000:1.0:1746065210.933345:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065210.933352:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263920640:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065210.933353:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263919744 00000100:00100000:2.0:1746065210.933355:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263919744 00000100:00100000:2.0:1746065210.933363:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263920256 00000100:00100000:1.0:1746065210.933364:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065210.933365:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263920256 00000100:00100000:2.0:1746065210.933371:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263920768 00000100:00100000:1.0:1746065210.933371:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263921152:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065210.933372:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263920768 00000100:00100000:2.0:1746065210.933377:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263920128 00000100:00100000:2.0:1746065210.933379:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263920128 00000100:00100000:1.0:1746065210.933382:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065210.933383:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263920640 00000100:00100000:2.0:1746065210.933385:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263920640 00000100:00100000:2.0:1746065210.933390:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263921152 00000100:00100000:2.0:1746065210.933391:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263921152 00000100:00100000:2.0:1746065210.933398:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17131 00000100:00100000:1.0:1746065210.933414:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17132 00000100:00100000:2.0:1746065210.933418:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+67:3759:x1830881263919744:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065210.933418:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3759:x1830881263920256:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065210.933445:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17133 00000100:00100000:2.0:1746065210.933450:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3759:x1830881263920768:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065210.933458:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065210.933460:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065209 -> 1746065209 00002000:00010000:1.0:1746065210.933462:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065209 -> 1746065209 00002000:00010000:1.0:1746065210.933464:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065209 -> 1746065209 00002000:00010000:1.0:1746065210.933466:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 1864 -> 1864 00002000:00010000:2.0:1746065210.933480:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065210.933482:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065210.933484:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065210.933485:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:1.0:1746065210.933485:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+57:3759:x1830881263920256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (205us total) trans 17179874237 rc 0/0 00002000:00010000:2.0:1746065210.933487:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065210.933491:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17132 00000100:00100000:2.0:1746065210.933500:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3759:x1830881263920768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (199us total) trans 17179874238 rc 0/0 00000100:00100000:1.0:1746065210.933500:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17134 00000100:00100000:1.0:1746065210.933504:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+67:3762:x1830881263920128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065210.933505:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17133 00000100:00100000:2.0:1746065210.933512:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17135 00000100:00100000:2.0:1746065210.933515:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3762:x1830881263920640:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065210.933537:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b02a00/2, rc 0, transno 17179874237 00000100:00100000:1.0:1746065210.933544:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b02a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263920256:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065210.933550:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1a7100/2, rc 0, transno 17179874238 00000100:00100000:1.0:1746065210.933553:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263920768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065210.933556:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+56:3762:x1830881263920640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 40us (190us total) trans 17179874239 rc 0/0 00000100:00100000:2.0:1746065210.933560:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17135 00000100:00100000:2.0:1746065210.933568:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17136 00000100:00100000:2.0:1746065210.933571:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+55:3762:x1830881263921152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065210.933583:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263921408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065210.933597:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746065210.933601:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:2.0:1746065210.933603:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065210.933605:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065210.933607:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065210.933608:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:1.0:1746065210.933612:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263921408 00000100:00100000:1.0:1746065210.933614:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263921408 00000100:00100000:2.0:1746065210.933622:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3762:x1830881263921152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (239us total) trans 17179874240 rc 0/0 00000100:00100000:1.0:1746065210.933625:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17137 00000100:00100000:2.0:1746065210.933628:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17136 00000100:00100000:1.0:1746065210.933629:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3759:x1830881263921408:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065210.933643:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b03480/2, rc 0, transno 17179874239 00000100:00100000:2.0:1746065210.933646:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b03480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263920640:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065210.933652:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856df80/2, rc 0, transno 17179874240 00000100:00100000:2.0:1746065210.933655:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263921152:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065210.933675:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3759:x1830881263921408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (76us total) trans 17179874241 rc 0/0 00000004:00080000:2.0:1746065210.933677:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1a4e00/2, rc 0, transno 17179874236 00000100:00100000:2.0:1746065210.933679:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263920896:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065210.933680:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17137 00000004:00080000:1.0:1746065210.933695:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856ca80/2, rc 0, transno 17179874241 00000100:00100000:1.0:1746065210.933697:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263921408:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065210.933709:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd300 going to sleep for 11 seconds 00002000:00010000:3.0:1746065210.934077:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065210.934079:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065207 -> 1746065207 00002000:00010000:3.0:1746065210.934081:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065206 -> 1746065206 00002000:00010000:3.0:1746065210.934083:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065207 -> 1746065207 00002000:00010000:3.0:1746065210.934084:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065210.934104:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+57:3760:x1830881263920384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 879us (1003us total) trans 17179874242 rc 0/0 00000100:00100000:3.0:1746065210.934110:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17129 00000100:00100000:0.0:1746065210.935047:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263920000:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065210.935074:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065210.935091:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263920000 00000100:00100000:0.0:1746065210.935095:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263920000 00000100:00100000:0.0:1746065210.935112:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17138 00000100:00100000:0.0:1746065210.935117:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+68:3761:x1830881263920000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065210.935190:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+69:3761:x1830881263920000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (114us total) trans 21474841643 rc 0/0 00000100:00100000:0.0:1746065210.935195:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17138 00000004:00080000:0.0:1746065210.935220:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad7b80/2, rc 0, transno 21474841643 00000100:00100000:0.0:1746065210.935223:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263920000:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065210.935229:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b00000/2, rc 0, transno 17179874242 00000100:00100000:0.0:1746065210.935229:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263920512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065210.935233:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263920384:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065210.935275:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065210.935277:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065209 -> 1746065209 00002000:00010000:2.0:1746065210.935279:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065209 -> 1746065209 00002000:00010000:2.0:1746065210.935281:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065209 -> 1746065209 00002000:00010000:2.0:1746065210.935282:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746065210.935302:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+70:3761:x1830881263919488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2937us (2997us total) trans 21474841644 rc 0/0 00000100:00100000:2.0:1746065210.935307:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17127 00000100:00100000:1.0:1746065210.935307:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+70:3762:x1830881263920128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 1803us (1961us total) trans 21474841645 rc 0/0 00000100:00100000:1.0:1746065210.935312:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17134 00000004:00080000:1.0:1746065210.935335:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad6a00/2, rc 0, transno 21474841645 00000100:00100000:1.0:1746065210.935338:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263920128:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065210.935359:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:2.0:1746065210.935361:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:2.0:1746065210.935363:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065210.935365:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:2.0:1746065210.935367:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:2.0:1746065210.935387:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+69:3760:x1830881263919872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2199us (2487us total) trans 21474841646 rc 0/0 00000100:00100000:2.0:1746065210.935395:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17128 00000004:00080000:2.0:1746065210.935509:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad7800/2, rc 0, transno 21474841646 00000100:00100000:2.0:1746065210.935512:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263919872:0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065210.936497:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746065210.936501:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065210.936503:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065210.936505:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065210.936507:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:3.0:1746065210.936540:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+69:3759:x1830881263919744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 3121us (3285us total) trans 21474841647 rc 0/0 00000100:00100000:3.0:1746065210.936546:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17131 00000004:00080000:1.0:1746065210.936734:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984db480/2, rc 0, transno 21474841647 00000100:00100000:1.0:1746065210.936738:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263919744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065210.937184:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+49:2006:x1830881265204864:12345-192.168.202.27@tcp:3:cat.0 Request processed in 37152us (37485us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065210.937191:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6010 00002000:00100000:3.0:1746065210.937199:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff8800a4e53480 x1830881265204864/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065210.937207:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e53480 with x1830881265204864 ext(0->1048575) 00002000:00010000:3.0:1746065210.937211:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e53480 00000100:00100000:2.0:1746065210.937347:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065210.937410:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265206400 00000100:00100000:3.0:1746065210.937414:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265206400 00000100:00100000:3.0:1746065210.937441:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5410 00000100:00100000:3.0:1746065210.937446:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2234:x1830881265206400:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:3.0:1746065210.937510:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b26c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2234:x1830881265206400:12345-192.168.202.27@tcp:49:cat.0 Request processed in 64us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065210.937515:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5410 00000100:00100000:1.0:1746065210.937617:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263921280:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065210.937642:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147880f lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cdf expref: 11 pid: 9571 timeout: 0 lvb_type: 3 00010000:00010000:1.0:1746065210.937674:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cdf expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.937690:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a200, rc 0) 00000100:00100000:1.0:1746065210.937706:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2231:x1830881265205888:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 22018us (22157us total) trans 8589936978 rc 0/0 00000100:00100000:1.0:1746065210.937712:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14497 00000100:00100000:0.0:1746065210.938767:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065210.938830:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263921024:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065210.938858:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065210.938888:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d9f80/2, rc 0, transno 21474841644 00000100:00100000:0.0:1746065210.938892:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263919488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065210.938925:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263920512 00000100:00100000:0.0:1746065210.938928:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263920512 00000100:00100000:3.0:1746065210.938930:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263921024 00000100:00100000:3.0:1746065210.938933:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263921024 00000100:00100000:0.0:1746065210.939098:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17139 00000100:00100000:0.0:1746065210.939104:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+58:3761:x1830881263920512:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065210.939134:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17140 00000100:00100000:3.0:1746065210.939139:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+58:3761:x1830881263921024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065210.939198:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065210.939201:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065210.939203:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065210.939205:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065210.939205:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 4897248 -> 4897248 00002000:00010000:3.0:1746065210.939207:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00002000:00010000:0.0:1746065210.939208:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065209 -> 1746065209 00002000:00010000:0.0:1746065210.939209:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065209 -> 1746065209 00002000:00010000:0.0:1746065210.939211:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065209 -> 1746065209 00002000:00010000:0.0:1746065210.939212:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5480 -> 5480 00000100:00100000:3.0:1746065210.939229:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+60:3761:x1830881263921024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 90us (369us total) trans 17179874243 rc 0/0 00000100:00100000:0.0:1746065210.939232:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+60:3761:x1830881263920512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 129us (1939us total) trans 17179874244 rc 0/0 00000100:00100000:3.0:1746065210.939234:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17140 00000100:00100000:0.0:1746065210.939236:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17139 00000004:00080000:0.0:1746065210.939254:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b02d80/2, rc 0, transno 17179874244 00000100:00100000:0.0:1746065210.939258:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b02d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263920512:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065210.940030:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1a5880/2, rc 0, transno 17179874243 00000100:00100000:0.0:1746065210.940034:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263921024:0@lo:2:osp-syn-1-0.0 00000001:00080000:0.0:1746065210.943375:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841642 is committed 00000001:00080000:0.0:1746065210.943386:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841639 is committed 00000001:00080000:0.0:1746065210.943415:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841630 is committed 00000001:00080000:0.0:1746065210.943421:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841629 is committed 00000100:00100000:2.0:1746065210.943732:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265205120:12345-192.168.202.27@tcp:3:cat.0 Request processed in 43627us (43982us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065210.943741:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6011 00002000:00100000:2.0:1746065210.943750:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800a4e52a00 x1830881265205120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065210.943757:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52a00 with x1830881265205120 ext(1048576->2097151) 00002000:00010000:2.0:1746065210.943763:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e52a00 00000100:00100000:0.0:1746065210.945798:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.946113:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265206528 00000100:00100000:1.0:1746065210.946120:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265206528 00000100:00100000:3.0:1746065210.946178:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265205632:12345-192.168.202.27@tcp:3:cat.0 Request processed in 38895us (39166us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065210.946187:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6013 00002000:00100000:3.0:1746065210.946194:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800984d9880 x1830881265205632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065210.946272:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d9880 with x1830881265205632 ext(1048576->2097151) 00002000:00010000:3.0:1746065210.946276:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984d9880 00000100:00100000:1.0:1746065210.946379:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14499 00000100:00100000:1.0:1746065210.946385:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2235:x1830881265206528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065210.946411:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065210.946425:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc1478824 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ced expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.946466:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc1478824 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ced expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.946477:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc1478824 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ced expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.946493:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065210.946495:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065210.946498:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25800, rc 0) 00000100:00100000:1.0:1746065210.946527:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2235:x1830881265206528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 143us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065210.946532:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14499 00000100:00100000:0.0:1746065210.956588:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.956650:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265206656 00000100:00100000:1.0:1746065210.956659:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265206656 00000100:00100000:1.0:1746065210.959056:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17141 00000100:00100000:1.0:1746065210.959072:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2231:x1830881265206656:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065210.959090:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065210.959106:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938cf4 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.959132:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc14786e9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c53 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.959139:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc14787c9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cbc expref: 46 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.959145:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b6400/0xad6b7ddc147879f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c8b expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.959151:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.959153:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.959160:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3604480->4169727] (req 3604480->4169727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.959188:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b6400/0xad6b7ddc147879f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c8b expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.959199:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b6400/0xad6b7ddc147879f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c8b expref: 25 pid: 10219 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746065210.959209:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263921536:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065210.959310:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc14787c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cbc expref: 46 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.959317:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc14787c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cbc expref: 46 pid: 12258 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746065210.959324:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263921664:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065210.959604:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc14786e9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c53 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.959612:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc14786e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c53 expref: 11 pid: 12258 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746065210.959619:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263921792:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065210.959652:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065210.975053:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.975078:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.975091:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.975140:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.975162:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265207680 00000100:00100000:0.0:1746065210.975169:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265207680 00010000:00010000:0.0:1746065210.975197:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc14787c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cbc expref: 47 pid: 12258 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746065210.975221:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7926 00000100:00100000:0.0:1746065210.975229:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265207680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065210.975241:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065210.975260:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc14787c9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cbc expref: 47 pid: 12258 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746065210.975270:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc14787c9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cbc expref: 47 pid: 12258 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746065210.975292:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065210.975323:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265207680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065210.975328:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7926 00000100:00100000:0.0:1746065210.975354:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.975421:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065210.975434:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265207552 00000100:00100000:0.0:1746065210.975437:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265207552 00010000:00010000:0.0:1746065210.975448:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b6400/0xad6b7ddc147879f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c8b expref: 26 pid: 10219 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746065210.975462:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265207808 00000100:00100000:0.0:1746065210.975463:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265207808 00010000:00010000:0.0:1746065210.975470:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc14786e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c53 expref: 12 pid: 12258 timeout: 906 lvb_type: 1 00000100:00100000:0.0:1746065210.975480:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7927 00000100:00100000:0.0:1746065210.975483:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265207552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065210.975490:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065210.975497:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b6400/0xad6b7ddc147879f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c8b expref: 26 pid: 10219 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746065210.975504:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b6400/0xad6b7ddc147879f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c8b expref: 26 pid: 10219 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746065210.975513:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065210.975528:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265207552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 44us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065210.975533:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7927 00000100:00100000:0.0:1746065210.975541:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7928 00000100:00100000:0.0:1746065210.975545:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265207808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065210.975550:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065210.975555:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc14786e9 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c53 expref: 12 pid: 12258 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746065210.975562:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc14786e9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c53 expref: 12 pid: 12258 timeout: 906 lvb_type: 1 00010000:00010000:0.0:1746065210.975571:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065210.975572:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065210.975578:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.975584:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065210.975609:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065210.975619:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263921920:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065210.975654:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065210.975713:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265206912 00000100:00100000:0.0:1746065210.975715:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265206912 00002000:00100000:0.0:1746065210.975735:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099e13b80 x1830881265206912/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065210.975743:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13b80 with x1830881265206912 ext(1048576->2097151) 00002000:00010000:0.0:1746065210.975747:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e13b80 00000100:00100000:0.0:1746065210.975756:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265207040 00000100:00100000:0.0:1746065210.975757:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265207040 00002000:00100000:0.0:1746065210.975764:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099e11180 x1830881265207040/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065210.975770:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11180 with x1830881265207040 ext(1048576->2097151) 00002000:00010000:0.0:1746065210.975790:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e11180 00000100:00100000:0.0:1746065210.975797:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265207424 00000100:00100000:0.0:1746065210.975799:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265207424 00002000:00100000:0.0:1746065210.975807:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880099e10e00 x1830881265207424/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065210.975812:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e10e00 with x1830881265207424 ext(1048576->2097151) 00002000:00010000:0.0:1746065210.975815:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e10e00 00000100:00100000:0.0:1746065210.975822:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6014 00000100:00100000:0.0:1746065210.975825:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265206912:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065210.976381:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6015 00000100:00100000:0.0:1746065210.976386:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265207040:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065210.978142:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6016 00000100:00100000:0.0:1746065210.978150:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265207424:12345-192.168.202.27@tcp:3:multiop.0 00010000:00010000:1.0:1746065210.980313:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b6400/0xad6b7ddc147879f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c8b expref: 27 pid: 10219 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746065210.980348:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263921536:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065210.980361:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ab2d600/0xad6b7ddc14787c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cbc expref: 46 pid: 12258 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746065210.980368:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263921664:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065210.980377:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb800/0xad6b7ddc14786e9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c53 expref: 12 pid: 12258 timeout: 906 lvb_type: 1 00000100:00100000:1.0:1746065210.980385:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263921792:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065210.980416:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 26 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.980427:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25c00, rc 0) 00000100:00100000:1.0:1746065210.980469:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2231:x1830881265206656:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 21404us (23887us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065210.980477:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17141 00000100:00100000:0.0:1746065210.982895:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065210.984920:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265208064 00000100:00100000:2.0:1746065210.984931:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265208064 00002000:00100000:2.0:1746065210.984973:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88013513a680 x1830881265208064/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065210.984983:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513a680 with x1830881265208064 ext(1048576->2097151) 00002000:00010000:2.0:1746065210.984989:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513a680 00000100:00100000:2.0:1746065210.985010:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6017 00000100:00100000:2.0:1746065210.985017:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881265208064:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065210.986223:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.986264:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265208192 00000100:00100000:1.0:1746065210.986268:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265208192 00002000:00100000:1.0:1746065210.986288:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880135138380 x1830881265208192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065210.986306:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138380 with x1830881265208192 ext(1048576->2097151) 00002000:00010000:1.0:1746065210.986310:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135138380 00000100:00100000:1.0:1746065210.986323:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6018 00000100:00100000:1.0:1746065210.986329:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881265208192:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065210.990083:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065210.990752:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265208576 00000100:00100000:2.0:1746065210.990761:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265208576 00002000:00100000:2.0:1746065210.990828:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88013513aa00 x1830881265208576/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/0 e 0 to 0 dl 1746065221 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065210.990837:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513aa00 with x1830881265208576 ext(1048576->2097151) 00002000:00010000:2.0:1746065210.990843:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013513aa00 00000100:00100000:2.0:1746065210.990874:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6019 00000100:00100000:2.0:1746065210.990882:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+46:2006:x1830881265208576:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065210.998837:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265206912:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 23002us (23784us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065210.998848:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6014 00002000:00100000:2.0:1746065210.998857:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099e13b80 x1830881265206912/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065210.998865:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13b80 with x1830881265206912 ext(1048576->2097151) 00002000:00010000:2.0:1746065210.998870:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e13b80 00000100:00100000:2.0:1746065210.998921:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065210.998945:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265208704 00000100:00100000:1.0:1746065210.998952:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265208704 00000100:00100000:1.0:1746065210.998993:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17142 00000100:00100000:1.0:1746065210.999000:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+48:2232:x1830881265208704:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065210.999014:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065210.999028:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938cfb expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065210.999033:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265207040:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 22645us (23952us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065210.999041:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6015 00002000:00100000:0.0:1746065210.999046:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099e11180 x1830881265207040/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746065210.999052:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc14786f7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c4c expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00002000:00100000:0.0:1746065210.999054:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11180 with x1830881265207040 ext(1048576->2097151) 00002000:00010000:0.0:1746065210.999058:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e11180 00010000:00010000:1.0:1746065210.999060:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c84 expref: 25 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.999066:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cb5 expref: 49 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.999071:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.999073:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065210.999076:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 49 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065210.999101:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cb5 expref: 49 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.999110:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cb5 expref: 49 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746065210.999121:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263922048:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065210.999194:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c84 expref: 25 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.999201:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c84 expref: 25 pid: 3067 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746065210.999209:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263922176:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065210.999232:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc14786f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c4c expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065210.999239:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc14786f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c4c expref: 11 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746065210.999246:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263922304:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065210.999260:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.006725:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.006881:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881265207424:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 28730us (31787us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065211.006890:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6016 00002000:00100000:0.0:1746065211.006899:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880099e10e00 x1830881265207424/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.006908:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e10e00 with x1830881265207424 ext(1048576->2097151) 00010000:00010000:0.0:1746065211.006917:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c84 expref: 24 pid: 3067 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.006928:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c84 expref: 24 pid: 3067 timeout: 907 lvb_type: 1 00002000:00010000:0.0:1746065211.006935:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099e10e00 00000100:00100000:0.0:1746065211.006954:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265208960 00000100:00100000:0.0:1746065211.006959:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265208960 00002000:00100000:0.0:1746065211.006986:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (3604480->3608575) req@ffff88013513b800 x1830881265208960/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.006993:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b800 with x1830881265208960 ext(3604480->3608575) 00002000:00010000:0.0:1746065211.006995:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013513b800 00000100:00100000:0.0:1746065211.007020:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6020 00000100:00100000:0.0:1746065211.007026:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265208960:12345-192.168.202.27@tcp:3:multiop.0 00000100:00080000:3.0:1746065211.007064:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065211.007103:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265208960:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 77us (386us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065211.007108:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6020 00002000:00100000:0.0:1746065211.007113:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x78:0x0] (3604480->3608575) req@ffff88013513b800 x1830881265208960/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.007119:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b800 with x1830881265208960 ext(3604480->3608575) 00002000:00010000:0.0:1746065211.007122:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013513b800 00000100:00100000:2.0:1746065211.007933:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263921920:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065211.007949:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.007974:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265207808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 32428us (32553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.007981:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7928 00000100:00100000:1.0:1746065211.010095:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263922048:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.010106:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263922176:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065211.011959:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263922304:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065211.011987:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 49 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.012004:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047600, rc 0) 00000100:00100000:0.0:1746065211.012038:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+49:2232:x1830881265208704:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 13038us (13116us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.012049:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17142 00000100:00100000:3.0:1746065211.013926:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265208064:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28901us (31032us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065211.013936:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6017 00002000:00100000:3.0:1746065211.013947:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88013513a680 x1830881265208064/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.013956:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513a680 with x1830881265208064 ext(1048576->2097151) 00002000:00010000:3.0:1746065211.013961:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513a680 00000100:00100000:0.0:1746065211.027184:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.027252:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.027295:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.027323:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265209344 00000100:00100000:0.0:1746065211.027331:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265209344 00000100:00100000:2.0:1746065211.027419:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265209216 00000100:00100000:2.0:1746065211.027422:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265209216 00010000:00010000:2.0:1746065211.027443:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c84 expref: 25 pid: 3067 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.027467:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265209088 00000100:00100000:2.0:1746065211.027469:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265209088 00000100:00100000:1.0:1746065211.027536:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7929 00000100:00100000:1.0:1746065211.027546:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265209216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065211.027559:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065211.027575:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c84 expref: 25 pid: 3067 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746065211.027586:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c84 expref: 25 pid: 3067 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746065211.027606:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b7e00/0xad6b7ddc14787de lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c84 expref: 25 pid: 3067 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.027662:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17143 00000100:00100000:3.0:1746065211.027669:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2234:x1830881265209344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065211.027683:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.027693:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d02 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.027707:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.027712:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 48 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.027718:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065211.027721:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.027752:0:9549:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [2031616->2097151] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 48 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.027762:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.027771:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993e200, rc 0) 00010000:00010000:1.0:1746065211.027861:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065211.027862:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc14786f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c4c expref: 11 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746065211.027893:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265209216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 349us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.027894:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7930 00000100:00100000:2.0:1746065211.027899:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265209088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065211.027899:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7929 00010000:00010000:2.0:1746065211.027905:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.027911:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc14786f7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c4c expref: 11 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.027918:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc14786f7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c4c expref: 11 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.027929:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc14786f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c4c expref: 11 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.027940:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.027956:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265209088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.027961:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7930 00000100:00080000:2.0:1746065211.028018:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065211.028363:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2234:x1830881265209344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 693us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.028369:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17143 00000100:00100000:1.0:1746065211.030486:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265208192:12345-192.168.202.27@tcp:3:cat.0 Request processed in 44150us (44259us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065211.030495:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6018 00002000:00100000:1.0:1746065211.030504:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880135138380 x1830881265208192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.030512:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138380 with x1830881265208192 ext(1048576->2097151) 00002000:00010000:1.0:1746065211.030517:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135138380 00000100:00100000:3.0:1746065211.031487:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265208576:12345-192.168.202.27@tcp:3:cat.0 Request processed in 40603us (41409us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065211.031494:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6019 00002000:00100000:3.0:1746065211.031501:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88013513aa00 x1830881265208576/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:126/0 lens 488/440 e 0 to 0 dl 1746065221 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.031508:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513aa00 with x1830881265208576 ext(1048576->2097151) 00010000:00010000:3.0:1746065211.031515:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cb5 expref: 47 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.031526:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cb5 expref: 47 pid: 12258 timeout: 907 lvb_type: 1 00002000:00010000:3.0:1746065211.031532:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013513aa00 00000100:00100000:0.0:1746065211.035991:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.036312:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265209600 00000100:00100000:0.0:1746065211.036327:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.036381:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265209600 00000100:00100000:3.0:1746065211.036425:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265209728 00000100:00100000:3.0:1746065211.036429:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265209728 00010000:00010000:2.0:1746065211.036431:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cb5 expref: 47 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.036451:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7931 00002000:00100000:3.0:1746065211.036452:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4165632->4169727) req@ffff88013513bb80 x1830881265209728/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746065211.036457:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265209600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00002000:00100000:3.0:1746065211.036460:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513bb80 with x1830881265209728 ext(4165632->4169727) 00002000:00010000:3.0:1746065211.036463:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013513bb80 00010000:00010000:2.0:1746065211.036469:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.036485:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cb5 expref: 47 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.036495:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cb5 expref: 47 pid: 12258 timeout: 907 lvb_type: 1 00000100:00080000:0.0:1746065211.036523:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1746065211.036617:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14787c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cb5 expref: 47 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.036655:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.036657:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.036663:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 46 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.036672:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 46 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.036697:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 46 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.036707:0:7192:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 46 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.036716:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263922560:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065211.036906:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065211.037138:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6021 00000100:00100000:1.0:1746065211.037145:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265209728:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065211.037433:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265209728:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 288us (1105us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065211.037439:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6021 00002000:00100000:1.0:1746065211.037445:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4165632->4169727) req@ffff88013513bb80 x1830881265209728/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.037453:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513bb80 with x1830881265209728 ext(4165632->4169727) 00002000:00010000:1.0:1746065211.037456:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013513bb80 00000100:00100000:0.0:1746065211.039882:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.040117:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265209856 00000100:00100000:2.0:1746065211.040124:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265209856 00000100:00100000:2.0:1746065211.040156:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17144 00000100:00100000:2.0:1746065211.040163:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2235:x1830881265209856:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065211.040179:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.040191:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d09 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.040211:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065211.040215:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 48 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.040224:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 48 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.040231:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44400, rc 0) 00000100:00100000:2.0:1746065211.040261:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+48:2235:x1830881265209856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 99us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.040266:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17144 00000100:00100000:3.0:1746065211.040661:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263922560:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065211.040677:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.040699:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265209600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4242us (4717us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.040706:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7931 00000100:00100000:1.0:1746065211.040899:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.041431:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265210112 00000100:00100000:0.0:1746065211.041435:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265210112 00002000:00100000:0.0:1746065211.041460:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (2031616->2035711) req@ffff88009856f800 x1830881265210112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.041468:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f800 with x1830881265210112 ext(2031616->2035711) 00010000:00010000:0.0:1746065211.041474:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 47 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.041485:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 47 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:0.0:1746065211.041491:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856f800 00000100:00100000:0.0:1746065211.041505:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1979 00000100:00100000:0.0:1746065211.041514:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265210112:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065211.041995:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265210112:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 479us (1096us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065211.042005:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1979 00002000:00100000:0.0:1746065211.042009:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (2031616->2035711) req@ffff88009856f800 x1830881265210112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.042016:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f800 with x1830881265210112 ext(2031616->2035711) 00010000:00010000:0.0:1746065211.042021:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 47 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.042030:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 47 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:0.0:1746065211.042036:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856f800 00000100:00100000:0.0:1746065211.048067:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.048118:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265210496 00000100:00100000:0.0:1746065211.048119:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.048125:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265210496 00000100:00100000:2.0:1746065211.048268:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17145 00000100:00100000:2.0:1746065211.048275:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2232:x1830881265210496:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065211.048290:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.048420:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d10 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.048446:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.048567:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065211.048569:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065211.048573:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->2822143] (req 2097152->2822143) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.048597:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.048606:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 23 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.048616:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263922688:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.050228:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265210368 00000100:00100000:2.0:1746065211.050234:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265210368 00002000:00100000:2.0:1746065211.050264:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (2031616->2097151) req@ffff880135139880 x1830881265210368/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.050273:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139880 with x1830881265210368 ext(2031616->2097151) 00010000:00010000:2.0:1746065211.050280:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 49 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.050290:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 49 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746065211.050295:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135139880 00000100:00100000:2.0:1746065211.050308:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1980 00000100:00100000:2.0:1746065211.050315:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881265210368:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065211.050434:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065211.052913:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.052916:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263922688:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.052943:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265210624 00010000:00010000:3.0:1746065211.052945:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->2822143] (req 2097152->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 50 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.052947:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265210624 00010000:00010000:3.0:1746065211.052962:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44000, rc 0) 00002000:00100000:2.0:1746065211.052975:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3604480->4169727) req@ffff88008f7ffb80 x1830881265210624/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.052984:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ffb80 with x1830881265210624 ext(3604480->4169727) 00010000:00010000:2.0:1746065211.052989:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 24 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.052994:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+50:2232:x1830881265210496:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4720us (4936us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065211.052998:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 24 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.053001:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17145 00002000:00010000:2.0:1746065211.053003:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7ffb80 00000100:00100000:2.0:1746065211.053018:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1981 00000100:00100000:2.0:1746065211.053023:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265210624:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065211.053706:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881265210368:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 3388us (5584us total) trans 17179874245 rc 0/0 00000100:00100000:0.0:1746065211.053713:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1980 00002000:00100000:0.0:1746065211.053719:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (2031616->2097151) req@ffff880135139880 x1830881265210368/t17179874245(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/448 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.053728:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139880 with x1830881265210368 ext(2031616->2097151) 00010000:00010000:0.0:1746065211.053735:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 50 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.053745:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 50 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:0.0:1746065211.053755:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135139880 00000100:00100000:2.0:1746065211.058105:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.058143:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265210752 00000100:00100000:2.0:1746065211.058150:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265210752 00010000:00010000:2.0:1746065211.058179:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 50 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.058216:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7932 00000100:00100000:2.0:1746065211.058222:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+50:2006:x1830881265210752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.058235:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065211.058248:0:7192:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065207 -> 1746065211 00002000:00010000:2.0:1746065211.058251:0:7192:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065207 -> 1746065211 00010000:00010000:2.0:1746065211.058256:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 50 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.058264:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 50 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.058603:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047600/0xad6b7ddc1478832 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2031616->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cfb expref: 50 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.059194:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.059196:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.059204:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.059212:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.059220:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.059221:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.059223:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 49 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.059228:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 49 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.059257:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 49 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.059268:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263922816:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065211.059343:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.059351:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263922944:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065211.059369:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065211.060172:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265210624:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 7144us (7260us total) trans 17179874246 rc 0/0 00000100:00100000:3.0:1746065211.060181:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1981 00002000:00100000:3.0:1746065211.060190:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3604480->4169727) req@ffff88008f7ffb80 x1830881265210624/t17179874246(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/448 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.060199:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ffb80 with x1830881265210624 ext(3604480->4169727) 00010000:00010000:3.0:1746065211.060206:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 26 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.060218:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 26 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746065211.060225:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f7ffb80 00000100:00100000:0.0:1746065211.061871:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.062258:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263922944:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065211.062961:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263922816:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065211.062981:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.063014:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+49:2006:x1830881265210752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4792us (4917us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.063023:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7932 00000100:00100000:2.0:1746065211.063043:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265210880 00000100:00100000:2.0:1746065211.063048:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265210880 00010000:00010000:2.0:1746065211.063065:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 26 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.063097:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7933 00000100:00100000:2.0:1746065211.063103:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265210880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.063114:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065211.063128:0:7192:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065209 -> 1746065211 00002000:00010000:2.0:1746065211.063131:0:7192:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065209 -> 1746065211 00010000:00010000:2.0:1746065211.064598:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 26 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.064612:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 26 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.064631:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc147882b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3604480->4169727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cf4 expref: 26 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.064642:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.064643:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.064650:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.064657:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.064685:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 48 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.064695:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263923072:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065211.064788:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.066071:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.066120:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265211136 00000100:00100000:3.0:1746065211.066127:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265211136 00002000:00100000:3.0:1746065211.066159:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880135138e00 x1830881265211136/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.066167:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138e00 with x1830881265211136 ext(1048576->2097151) 00002000:00010000:3.0:1746065211.066170:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138e00 00000100:00100000:3.0:1746065211.066200:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6022 00000100:00100000:3.0:1746065211.066207:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265211136:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065211.067241:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.067295:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265211392 00000100:00100000:1.0:1746065211.067299:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265211392 00002000:00100000:1.0:1746065211.067319:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880135139180 x1830881265211392/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.067326:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139180 with x1830881265211392 ext(1048576->2097151) 00002000:00010000:1.0:1746065211.067330:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135139180 00000100:00100000:1.0:1746065211.067360:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6023 00000100:00100000:1.0:1746065211.067366:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+49:2007:x1830881265211392:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065211.068412:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263923072:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065211.068431:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.068458:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265210880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5355us (6590us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.068465:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7933 00000100:00100000:1.0:1746065211.081463:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+49:2007:x1830881265211392:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 14090us (14217us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065211.081473:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6023 00002000:00100000:1.0:1746065211.081483:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880135139180 x1830881265211392/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.081491:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139180 with x1830881265211392 ext(1048576->2097151) 00002000:00010000:1.0:1746065211.081496:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135139180 00000100:00100000:1.0:1746065211.081537:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.081549:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265211648 00000100:00100000:1.0:1746065211.081554:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265211648 00002000:00100000:1.0:1746065211.081573:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2818048->2822143) req@ffff88009856d180 x1830881265211648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.081584:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d180 with x1830881265211648 ext(2818048->2822143) 00002000:00010000:1.0:1746065211.081587:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856d180 00000100:00100000:1.0:1746065211.081596:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6024 00000100:00100000:1.0:1746065211.081600:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881265211648:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065211.082301:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+49:2005:x1830881265211648:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 642us (705us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065211.082308:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6024 00002000:00100000:1.0:1746065211.082314:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2818048->2822143) req@ffff88009856d180 x1830881265211648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.082321:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d180 with x1830881265211648 ext(2818048->2822143) 00002000:00010000:1.0:1746065211.082324:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856d180 00000100:00100000:3.0:1746065211.083027:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265211136:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 16817us (16956us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065211.083034:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6022 00002000:00100000:3.0:1746065211.083039:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880135138e00 x1830881265211136/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.083046:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138e00 with x1830881265211136 ext(1048576->2097151) 00002000:00010000:3.0:1746065211.083050:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138e00 00010000:00010000:1.0:1746065211.089723:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065211.100154:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.100193:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.100233:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.100269:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265212288 00000100:00100000:0.0:1746065211.100277:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265212288 00000100:00100000:0.0:1746065211.100312:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17146 00000100:00100000:0.0:1746065211.100318:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265212288:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065211.100333:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065211.100348:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc147884e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d17 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065211.100391:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263923200:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065211.100478:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065211.100557:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265212032 00000100:00100000:3.0:1746065211.100561:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265212032 00002000:00100000:3.0:1746065211.100589:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880135139c00 x1830881265212032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.100597:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139c00 with x1830881265212032 ext(2097152->4194303) 00002000:00010000:3.0:1746065211.100601:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135139c00 00000100:00100000:3.0:1746065211.100610:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265212160 00000100:00100000:3.0:1746065211.100612:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265212160 00002000:00100000:3.0:1746065211.100623:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2822144->4194303) req@ffff88013513b100 x1830881265212160/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.100629:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b100 with x1830881265212160 ext(2822144->4194303) 00002000:00010000:3.0:1746065211.100632:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013513b100 00000100:00100000:3.0:1746065211.100641:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6025 00000100:00100000:3.0:1746065211.100645:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265212032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065211.101687:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6026 00000100:00100000:3.0:1746065211.101694:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+49:2006:x1830881265212160:12345-192.168.202.27@tcp:3:cat.0 00000100:00080000:0.0:1746065211.105852:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:1.0:1746065211.109059:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065209 -> 1746065211 00000100:00100000:1.0:1746065211.109079:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263923200:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065211.109111:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc147884e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d17 expref: 26 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065211.109123:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012db9c000/0xad6b7ddc147884e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d17 expref: 26 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065211.109138:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c000, rc 0) 00000100:00100000:1.0:1746065211.109177:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265212288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8857us (8943us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065211.109189:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17146 00000100:00100000:0.0:1746065211.121867:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.121937:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265212416 00000100:00100000:1.0:1746065211.121944:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265212416 00000100:00100000:1.0:1746065211.121981:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17147 00000100:00100000:1.0:1746065211.121988:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2234:x1830881265212416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065211.122003:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.122017:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d1e expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.122041:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 50 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.122047:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065211.122049:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065211.122051:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.122075:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 50 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.122077:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265212032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21431us (21937us total) trans 0 rc 2097152/2097152 00010000:00010000:1.0:1746065211.122084:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 50 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.122085:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6025 00002000:00100000:3.0:1746065211.122092:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880135139c00 x1830881265212032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065211.122093:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263923328:192.168.202.27@tcp:104: 00002000:00100000:3.0:1746065211.122099:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139c00 with x1830881265212032 ext(2097152->4194303) 00002000:00010000:3.0:1746065211.122103:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135139c00 00000100:00100000:1.0:1746065211.122153:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065211.127679:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263923328:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065211.127707:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.127722:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779600, rc 0) 00000100:00100000:1.0:1746065211.127766:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2234:x1830881265212416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5776us (5905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.127767:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+49:2006:x1830881265212160:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26071us (27571us total) trans 0 rc 1372160/1372160 00000100:00100000:1.0:1746065211.127795:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17147 00000100:00100000:3.0:1746065211.127796:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6026 00002000:00100000:3.0:1746065211.127804:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2822144->4194303) req@ffff88013513b100 x1830881265212160/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1372160/1372160 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.127813:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b100 with x1830881265212160 ext(2822144->4194303) 00010000:00010000:3.0:1746065211.127820:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 49 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.127832:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 49 pid: 9549 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746065211.127841:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013513b100 00000100:00100000:0.0:1746065211.127989:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.128034:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265212544 00000100:00100000:3.0:1746065211.128040:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265212544 00002000:00100000:3.0:1746065211.128064:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2822143) req@ffff88009252b100 x1830881265212544/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.128071:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252b100 with x1830881265212544 ext(2097152->2822143) 00010000:00010000:3.0:1746065211.128076:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 49 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.128084:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 49 pid: 9549 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746065211.128090:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009252b100 00000100:00100000:3.0:1746065211.128103:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1982 00000100:00100000:3.0:1746065211.128109:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881265212544:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065211.135813:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.135845:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265212672 00000100:00100000:0.0:1746065211.135855:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265212672 00000100:00100000:0.0:1746065211.135904:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17148 00000100:00100000:0.0:1746065211.135913:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+51:2235:x1830881265212672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065211.135930:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065211.135946:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d25 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.135967:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065211.135969:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065211.135973:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 52 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.135982:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 52 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.135990:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538400, rc 0) 00000100:00100000:0.0:1746065211.136038:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+52:2235:x1830881265212672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 125us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.136044:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17148 00000100:00100000:3.0:1746065211.139769:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881265212544:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11651us (11772us total) trans 17179874247 rc 0/0 00000100:00100000:3.0:1746065211.139796:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1982 00002000:00100000:3.0:1746065211.139806:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2822143) req@ffff88009252b100 x1830881265212544/t17179874247(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/448 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.139814:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252b100 with x1830881265212544 ext(2097152->2822143) 00010000:00010000:3.0:1746065211.139823:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 52 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.139843:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 52 pid: 9549 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746065211.139849:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009252b100 00000100:00100000:0.0:1746065211.144639:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.144939:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265212800 00000100:00100000:3.0:1746065211.144948:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265212800 00010000:00010000:3.0:1746065211.144985:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 52 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.145024:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7934 00000100:00100000:3.0:1746065211.145031:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881265212800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.145043:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.145060:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 52 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.145072:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 52 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.145092:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478847 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2822143) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d10 expref: 52 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.145122:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.145124:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.145130:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.145141:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.145147:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.145148:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.145151:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 51 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.145156:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 51 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.145181:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 51 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.146129:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263923456:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065211.146214:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.146222:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263923584:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065211.146693:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065211.151379:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263923456:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065211.152327:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263923584:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065211.152346:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.152895:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881265212800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7861us (8260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.152905:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7934 00000100:00100000:0.0:1746065211.153112:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.153309:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265213056 00000100:00100000:3.0:1746065211.153316:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265213056 00002000:00100000:3.0:1746065211.153347:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009252bb80 x1830881265213056/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.153355:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252bb80 with x1830881265213056 ext(3145728->4194303) 00002000:00010000:3.0:1746065211.153359:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252bb80 00000100:00100000:3.0:1746065211.153380:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6027 00000100:00100000:3.0:1746065211.153386:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881265213056:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065211.161787:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.161820:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.161827:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265213312 00000100:00100000:2.0:1746065211.161835:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265213312 00000100:00100000:3.0:1746065211.161868:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265213568 00002000:00100000:2.0:1746065211.161870:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009252a300 x1830881265213312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065211.161872:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265213568 00002000:00100000:2.0:1746065211.161880:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252a300 with x1830881265213312 ext(2097152->4194303) 00002000:00010000:2.0:1746065211.161885:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252a300 00002000:00100000:3.0:1746065211.161895:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880092528000 x1830881265213568/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.161902:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092528000 with x1830881265213568 ext(2097152->4194303) 00000100:00100000:2.0:1746065211.161902:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6028 00002000:00010000:3.0:1746065211.161906:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092528000 00000100:00100000:2.0:1746065211.161908:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265213312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065211.161916:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6029 00000100:00100000:3.0:1746065211.161921:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265213568:12345-192.168.202.27@tcp:3:cat.0 00000100:00080000:0.0:1746065211.162357:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065211.164428:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881265213056:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11034us (11309us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065211.164438:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6027 00002000:00100000:3.0:1746065211.164447:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009252bb80 x1830881265213056/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.164455:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252bb80 with x1830881265213056 ext(3145728->4194303) 00002000:00010000:3.0:1746065211.164461:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252bb80 00000100:00100000:0.0:1746065211.170318:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.170380:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265213824 00000100:00100000:1.0:1746065211.171158:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265213824 00000100:00100000:1.0:1746065211.171214:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14500 00000100:00100000:1.0:1746065211.171222:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2240:x1830881265213824:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065211.171243:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.171258:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478863 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d2c expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.171384:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147886a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171395:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147886a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171416:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147886a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00080000:0.0:1746065211.171416:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746065211.171427:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478871 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171433:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171437:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171514:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1478878 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171523:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1478878 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171529:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1478878 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065211.171536:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065211.171590:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147886a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171596:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147886a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171601:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147886a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171606:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147886a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171611:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065211.171619:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147886a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171624:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147886a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171633:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065211.171635:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065211.171638:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147886a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171647:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147886a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171668:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478871 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171673:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478871 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171677:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478871 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171680:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065211.171682:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478871 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171687:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478871 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171692:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008c512800) 00010000:00010000:1.0:1746065211.171694:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065211.171695:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478871 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171699:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478871 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.171731:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1478863 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d2c expref: 13 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.171741:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1478878 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d2c expref: 12 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.171752:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065211.171754:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065211.171759:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a400, rc 0) 00000100:00100000:1.0:1746065211.171920:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2240:x1830881265213824:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 698us (1608us total) trans 8589936979 rc 0/0 00000100:00100000:1.0:1746065211.171927:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14500 00000100:00100000:2.0:1746065211.176105:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265213312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14188us (14327us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065211.176115:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6028 00002000:00100000:2.0:1746065211.176126:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009252a300 x1830881265213312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.176135:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252a300 with x1830881265213312 ext(2097152->4194303) 00002000:00010000:2.0:1746065211.176140:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252a300 00000100:00100000:0.0:1746065211.177412:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.177432:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265214080 00000100:00100000:2.0:1746065211.177439:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265214080 00002000:00100000:2.0:1746065211.177470:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff880092529880 x1830881265214080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.177477:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529880 with x1830881265214080 ext(4194304->4898815) 00002000:00010000:2.0:1746065211.177481:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092529880 00000100:00100000:2.0:1746065211.178364:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6030 00000100:00100000:2.0:1746065211.178375:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881265214080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065211.184993:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265213568:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23063us (23163us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065211.185003:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6029 00002000:00100000:3.0:1746065211.185013:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880092528000 x1830881265213568/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.185021:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092528000 with x1830881265213568 ext(2097152->4194303) 00002000:00010000:3.0:1746065211.185026:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092528000 00000100:00100000:2.0:1746065211.185936:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881265214080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7562us (8717us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746065211.185944:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6030 00002000:00100000:2.0:1746065211.185950:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff880092529880 x1830881265214080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.185958:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529880 with x1830881265214080 ext(4194304->4898815) 00002000:00010000:2.0:1746065211.185962:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092529880 00000100:00100000:0.0:1746065211.185996:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.186053:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265214336 00000100:00100000:0.0:1746065211.186059:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265214336 00000100:00100000:0.0:1746065211.186914:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5411 00000100:00100000:0.0:1746065211.186923:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2240:x1830881265214336:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065211.187105:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2240:x1830881265214336:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 184us (1110us total) trans 8589936980 rc 0/0 00000100:00100000:0.0:1746065211.187111:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5411 00000100:00100000:0.0:1746065211.196492:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.197191:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265214592 00000100:00100000:3.0:1746065211.197201:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265214592 00000100:00100000:3.0:1746065211.197249:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5412 00000100:00100000:3.0:1746065211.197256:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2235:x1830881265214592:12345-192.168.202.27@tcp:35:cat.0 00000100:00080000:0.0:1746065211.197458:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065211.197858:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2235:x1830881265214592:12345-192.168.202.27@tcp:35:cat.0 Request processed in 600us (1371us total) trans 8589936981 rc 0/0 00000100:00100000:3.0:1746065211.197865:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5412 00000100:00100000:1.0:1746065211.197943:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.198765:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265214848 00000100:00100000:2.0:1746065211.198770:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265214848 00002000:00100000:2.0:1746065211.198831:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88009856c700 x1830881265214848/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.198840:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c700 with x1830881265214848 ext(4194304->4898815) 00002000:00010000:2.0:1746065211.198845:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856c700 00000100:00100000:2.0:1746065211.199218:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6031 00000100:00100000:2.0:1746065211.199225:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881265214848:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065211.204665:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881265214848:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5432us (6713us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746065211.204676:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6031 00002000:00100000:2.0:1746065211.204686:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88009856c700 x1830881265214848/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.204694:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c700 with x1830881265214848 ext(4194304->4898815) 00002000:00010000:2.0:1746065211.204700:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856c700 00000100:00100000:0.0:1746065211.212633:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.212978:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265215104 00000100:00100000:3.0:1746065211.212986:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265215104 00000100:00100000:3.0:1746065211.213064:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5413 00000100:00100000:3.0:1746065211.213072:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2234:x1830881265215104:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065211.213358:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2234:x1830881265215104:12345-192.168.202.27@tcp:35:cat.0 Request processed in 285us (731us total) trans 8589936982 rc 0/0 00000100:00100000:3.0:1746065211.213364:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5413 00000100:00100000:0.0:1746065211.225583:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.225643:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265215232 00000100:00100000:2.0:1746065211.225651:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265215232 00000100:00100000:2.0:1746065211.225686:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17149 00000100:00100000:2.0:1746065211.225693:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2240:x1830881265215232:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065211.225706:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.225720:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d33 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.225744:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.225752:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 50 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.225757:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.225759:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.225762:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3407872->3903487] (req 3407872->3903487) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.226061:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 50 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.226072:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 50 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.226082:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263923712:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065211.226735:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.226744:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 27 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.226795:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263923840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.227226:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065211.229019:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263923712:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.229030:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263923840:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065211.229052:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3407872->3903487] (req 3407872->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.229065:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45000, rc 0) 00000100:00100000:2.0:1746065211.229096:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2240:x1830881265215232:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3403us (3521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.229103:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17149 00000100:00100000:0.0:1746065211.231560:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.231611:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265215360 00000100:00100000:3.0:1746065211.231619:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265215360 00010000:00010000:3.0:1746065211.231645:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 51 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.232054:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7935 00000100:00100000:3.0:1746065211.232065:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881265215360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.232077:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.232094:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 51 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.232104:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 51 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.232122:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147885c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d25 expref: 51 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.232142:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.232170:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881265215360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.232393:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7935 00000100:00100000:0.0:1746065211.234206:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.234256:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265215488 00000100:00100000:3.0:1746065211.234263:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265215488 00010000:00010000:3.0:1746065211.234285:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 27 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.234623:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7936 00000100:00100000:3.0:1746065211.234630:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265215488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.234642:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.234656:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 27 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.234666:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 27 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.234684:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095779600/0xad6b7ddc1478855 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d1e expref: 27 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.234697:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.234699:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.234705:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.234712:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.234736:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.234746:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263923968:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065211.235302:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065211.236330:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263923968:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065211.236345:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.236380:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265215488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1749us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.236388:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7936 00000100:00100000:0.0:1746065211.236945:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.236997:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265215744 00000100:00100000:3.0:1746065211.237001:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265215744 00002000:00100000:3.0:1746065211.237033:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3407872->3411967) req@ffff88012f09ca80 x1830881265215744/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.237041:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ca80 with x1830881265215744 ext(3407872->3411967) 00002000:00010000:3.0:1746065211.237044:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09ca80 00000100:00100000:3.0:1746065211.237064:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6032 00000100:00100000:3.0:1746065211.237070:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265215744:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065211.237162:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265215744:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 92us (218us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065211.237178:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6032 00002000:00100000:3.0:1746065211.237183:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3407872->3411967) req@ffff88012f09ca80 x1830881265215744/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.237449:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ca80 with x1830881265215744 ext(3407872->3411967) 00002000:00010000:3.0:1746065211.237453:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09ca80 00000100:00100000:0.0:1746065211.242957:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.243013:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265216000 00000100:00100000:3.0:1746065211.243021:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265216000 00002000:00100000:3.0:1746065211.243057:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3899392->3903487) req@ffff88012f09c380 x1830881265216000/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.243066:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c380 with x1830881265216000 ext(3899392->3903487) 00002000:00010000:3.0:1746065211.243070:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09c380 00000100:00100000:3.0:1746065211.243097:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6033 00000100:00100000:3.0:1746065211.243103:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265216000:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065211.243232:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265216000:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 128us (280us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065211.243238:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6033 00002000:00100000:3.0:1746065211.243243:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3899392->3903487) req@ffff88012f09c380 x1830881265216000/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.243250:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c380 with x1830881265216000 ext(3899392->3903487) 00002000:00010000:3.0:1746065211.243252:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09c380 00000100:00100000:0.0:1746065211.320638:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.321040:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265216256 00000100:00100000:1.0:1746065211.321048:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265216256 00000100:00100000:1.0:1746065211.321110:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14501 00000100:00100000:1.0:1746065211.321118:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2245:x1830881265216256:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065211.321138:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.321155:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147888d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d3a expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.321213:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478894 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321224:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478894 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321232:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478894 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321243:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147889b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321248:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147889b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321256:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147889b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321337:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc14788a2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321346:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc14788a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321352:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc14788a2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065211.321359:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065211.321430:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478894 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321436:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478894 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321440:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478894 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321446:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478894 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321450:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065211.321453:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478894 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321459:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478894 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321468:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065211.321470:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065211.321474:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478894 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321478:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478894 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321503:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147889b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321508:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147889b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321513:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147889b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321516:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577a200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065211.321518:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147889b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321522:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147889b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321527:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008c512800) 00010000:00010000:1.0:1746065211.321528:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065211.321530:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147889b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321534:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147889b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.321565:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147888d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d3a expref: 32 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.321575:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc14788a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d3a expref: 31 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.321581:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065211.321583:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065211.321585:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2400, rc 0) 00000100:00100000:1.0:1746065211.321635:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2245:x1830881265216256:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 517us (1005us total) trans 8589936983 rc 0/0 00000100:00100000:1.0:1746065211.321642:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14501 00000100:00100000:0.0:1746065211.324473:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.324522:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265216512 00000100:00100000:3.0:1746065211.324530:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265216512 00000100:00100000:3.0:1746065211.324574:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5414 00000100:00100000:3.0:1746065211.324581:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2245:x1830881265216512:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065211.324756:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2245:x1830881265216512:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 174us (290us total) trans 8589936984 rc 0/0 00000100:00100000:3.0:1746065211.324762:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5414 00000100:00100000:0.0:1746065211.329744:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.330226:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265216640 00000100:00100000:3.0:1746065211.330235:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265216640 00000100:00100000:3.0:1746065211.330278:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17150 00000100:00100000:3.0:1746065211.330285:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+50:2245:x1830881265216640:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065211.330310:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.330325:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d41 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.330350:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc14786db lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c37 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.330356:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc14787ad lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca0 expref: 51 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.330368:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147878a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c6f expref: 25 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.330374:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.330376:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.330379:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [73728->155647] (req 73728->155647) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 51 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.330413:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147878a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c6f expref: 25 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.330423:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147878a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c6f expref: 25 pid: 9550 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.330433:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263924096:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.330507:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc14787ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca0 expref: 51 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.330515:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc14787ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca0 expref: 51 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.330523:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263924224:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.330543:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc14786db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c37 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.330555:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc14786db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c37 expref: 9 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.330562:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263924352:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065211.330575:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.331276:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.331443:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265216896 00000100:00100000:2.0:1746065211.331448:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265216896 00000100:00100000:2.0:1746065211.331486:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14502 00000100:00100000:2.0:1746065211.331493:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2248:x1830881265216896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065211.331507:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.331517:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44000/0xad6b7ddc14788b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d48 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.331566:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14788be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331575:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14788be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331584:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14788be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331594:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14788c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331599:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14788c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331603:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14788c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331681:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc14788cc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331690:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc14788cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331696:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc14788cc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065211.331704:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065211.331758:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14788be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331763:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14788be lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331768:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14788be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331797:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14788be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331801:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065211.331804:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14788be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331809:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14788be lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331822:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065211.331824:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065211.331827:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14788be lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331832:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc14788be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331844:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14788c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331849:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14788c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331853:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14788c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331857:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065211.331859:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14788c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331863:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14788c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331868:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008ec47700) 00010000:00010000:2.0:1746065211.331870:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065211.331873:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14788c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331877:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc14788c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065211.331904:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44000/0xad6b7ddc14788b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d48 expref: 35 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.331914:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc14788cc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d48 expref: 34 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.331919:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065211.331921:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065211.331923:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44a00, rc 0) 00000100:00100000:2.0:1746065211.331962:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2248:x1830881265216896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 469us (687us total) trans 8589936985 rc 0/0 00000100:00100000:2.0:1746065211.331968:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14502 00000100:00100000:3.0:1746065211.334477:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263924224:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065211.334488:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263924352:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065211.334997:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.335023:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.335044:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.335058:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.335070:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.335087:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.335112:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265217536 00000100:00100000:0.0:1746065211.335117:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265217536 00000100:00100000:0.0:1746065211.335143:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265217664 00000100:00100000:0.0:1746065211.335145:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265217664 00000100:00100000:0.0:1746065211.335156:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17151 00000100:00100000:0.0:1746065211.335162:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881265217536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065211.335178:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065211.335191:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc14788da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d4f expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.335210:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.335218:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc14788da lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d4f expref: 54 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.335226:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc14788da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d4f expref: 54 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.335237:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3a00, rc 0) 00000100:00100000:0.0:1746065211.335267:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881265217536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 105us (208us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065211.335273:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17151 00000100:00100000:0.0:1746065211.335286:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17152 00000100:00100000:0.0:1746065211.335290:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881265217664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065211.335296:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065211.335301:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cd3400/0xad6b7ddc14788e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d56 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065211.335333:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263924480:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065211.335379:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929adb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.335394:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265217024 00000100:00100000:0.0:1746065211.335407:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265217024 00010000:00010000:0.0:1746065211.335421:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc14787ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca0 expref: 54 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746065211.335441:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265217280 00000100:00100000:0.0:1746065211.335442:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265217280 00010000:00010000:0.0:1746065211.335450:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147878a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c6f expref: 26 pid: 9550 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746065211.335459:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265217152 00000100:00100000:0.0:1746065211.335460:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265217152 00010000:00010000:0.0:1746065211.335467:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc14786db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c37 expref: 10 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746065211.335474:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265217408 00000100:00100000:0.0:1746065211.335476:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265217408 00000100:00100000:0.0:1746065211.335485:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7937 00000100:00100000:0.0:1746065211.335489:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881265217024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065211.335496:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065211.335509:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc14787ad lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca0 expref: 54 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.335517:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc14787ad lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca0 expref: 54 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.335529:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc14787ad lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca0 expref: 54 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.335536:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065211.335548:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+53:2007:x1830881265217024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.335553:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7937 00000100:00100000:0.0:1746065211.335582:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7938 00000100:00100000:0.0:1746065211.335586:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881265217280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065211.335591:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065211.335596:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147878a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c6f expref: 26 pid: 9550 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.335603:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147878a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c6f expref: 26 pid: 9550 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.335611:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065211.335620:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881265217280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.335624:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7938 00000100:00100000:0.0:1746065211.335630:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7939 00000100:00100000:0.0:1746065211.335633:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265217152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065211.335637:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065211.335641:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc14786db lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c37 expref: 10 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.335647:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc14786db lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c37 expref: 10 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.335656:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc14786db lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c37 expref: 10 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.335665:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.335667:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.335672:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 52 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.335678:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 52 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.335692:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 52 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065211.335699:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263924608:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065211.335712:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.335742:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 840 00000100:00100000:0.0:1746065211.335747:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265217408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065211.335752:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065211.335762:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc14788cc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d48 expref: 34 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.335792:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065211.335796:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065211.335807:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265217408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 60us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.335811:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 840 00010000:00010000:3.0:1746065211.336063:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147878a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c6f expref: 25 pid: 9550 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.336075:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263924096:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.336094:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 52 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.336101:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44200, rc 0) 00000100:00100000:3.0:1746065211.336126:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+52:2245:x1830881265216640:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5842us (6389us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.336132:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17150 00000100:00100000:2.0:1746065211.340923:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.340974:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263924608:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065211.340990:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.341019:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265217152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5384us (5974us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.341028:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7939 00000100:00100000:3.0:1746065211.341132:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265217920 00000100:00100000:3.0:1746065211.341139:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265217920 00002000:00100000:3.0:1746065211.341170:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (73728->77823) req@ffff88008f7fd500 x1830881265217920/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.341179:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd500 with x1830881265217920 ext(73728->77823) 00002000:00010000:3.0:1746065211.341183:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd500 00000100:00100000:3.0:1746065211.341202:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6034 00000100:00100000:3.0:1746065211.341208:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881265217920:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065211.341308:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881265217920:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 99us (390us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065211.341313:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6034 00002000:00100000:3.0:1746065211.341317:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (73728->77823) req@ffff88008f7fd500 x1830881265217920/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.341323:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd500 with x1830881265217920 ext(73728->77823) 00002000:00010000:3.0:1746065211.341327:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd500 00000100:00100000:1.0:1746065211.341414:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263924480:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065211.341438:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3400/0xad6b7ddc14788e1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d56 expref: 51 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065211.341448:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3400/0xad6b7ddc14788e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d56 expref: 51 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065211.341461:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3400, rc 0) 00000100:00100000:1.0:1746065211.341494:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881265217664:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6203us (6405us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065211.341500:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17152 00000100:00100000:0.0:1746065211.344095:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.344164:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265218432 00000100:00100000:1.0:1746065211.344172:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265218432 00002000:00100000:1.0:1746065211.344206:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x75:0x0] (0->73727) req@ffff880135138000 x1830881265218432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.344215:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138000 with x1830881265218432 ext(0->73727) 00002000:00010000:1.0:1746065211.344218:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138000 00000100:00100000:1.0:1746065211.344289:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6035 00000100:00100000:1.0:1746065211.344297:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881265218432:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065211.346382:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.346415:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265218688 00000100:00100000:3.0:1746065211.346421:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265218688 00002000:00100000:3.0:1746065211.346445:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (151552->155647) req@ffff88011dad5f80 x1830881265218688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.346453:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5f80 with x1830881265218688 ext(151552->155647) 00002000:00010000:3.0:1746065211.346457:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad5f80 00000100:00100000:3.0:1746065211.346475:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6036 00000100:00100000:3.0:1746065211.346480:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+52:2006:x1830881265218688:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065211.346565:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+52:2006:x1830881265218688:12345-192.168.202.27@tcp:3:cat.0 Request processed in 80us (183us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065211.346571:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6036 00002000:00100000:3.0:1746065211.346575:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x75:0x0] (151552->155647) req@ffff88011dad5f80 x1830881265218688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.346587:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5f80 with x1830881265218688 ext(151552->155647) 00002000:00010000:3.0:1746065211.346589:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad5f80 00000100:00100000:3.0:1746065211.346718:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.346769:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265218176 00000100:00100000:0.0:1746065211.346792:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265218176 00000100:00100000:0.0:1746065211.346819:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14503 00000100:00100000:0.0:1746065211.346823:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2251:x1830881265218176:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065211.346837:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065211.346851:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14788e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d5d expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.346905:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14788ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.346917:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14788ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.346926:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14788ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.346936:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc14788f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.346940:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc14788f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.346944:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc14788f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.347016:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc14788fd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.347030:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc14788fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.347037:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc14788fd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065211.347049:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065211.347116:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14788ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.347122:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14788ef lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.347126:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14788ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.347131:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14788ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.350891:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065211.350898:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14788ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.350905:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14788ef lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.350920:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065211.350922:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065211.350926:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14788ef lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.350931:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488400/0xad6b7ddc14788ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.350943:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc14788f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.350947:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc14788f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.350955:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc14788f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.350958:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065211.350960:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc14788f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.350963:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc14788f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.350968:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095561d00) 00010000:00010000:0.0:1746065211.350969:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065211.350971:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc14788f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.350974:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc14788f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065211.352369:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc14788e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d5d expref: 17 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.352385:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc14788fd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d5d expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.352391:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065211.352392:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065211.352395:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489200, rc 0) 00000100:00100000:0.0:1746065211.352462:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2251:x1830881265218176:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5635us (5742us total) trans 8589936986 rc 0/0 00000100:00100000:0.0:1746065211.352469:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14503 00000100:00100000:2.0:1746065211.352630:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+50:2004:x1830881265218432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8332us (8538us total) trans 0 rc 73728/73728 00000100:00100000:2.0:1746065211.352638:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6035 00002000:00100000:2.0:1746065211.352646:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x75:0x0] (0->73727) req@ffff880135138000 x1830881265218432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 73728/73728 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.352655:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138000 with x1830881265218432 ext(0->73727) 00002000:00010000:2.0:1746065211.352659:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138000 00000100:00100000:0.0:1746065211.369673:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.369769:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265218944 00000100:00100000:2.0:1746065211.369804:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265218944 00002000:00100000:2.0:1746065211.369843:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x75:0x0] (155648->1048575) req@ffff88013513b480 x1830881265218944/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.369852:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b480 with x1830881265218944 ext(155648->1048575) 00002000:00010000:2.0:1746065211.369856:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013513b480 00000100:00100000:2.0:1746065211.369887:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6037 00000100:00100000:2.0:1746065211.369893:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881265218944:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065211.377704:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.378236:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265219072 00000100:00100000:2.0:1746065211.378246:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265219072 00000100:00100000:2.0:1746065211.378309:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 841 00000100:00100000:2.0:1746065211.378317:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265219072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.378332:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.378359:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489200/0xad6b7ddc14788fd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d5d expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.379543:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065211.379550:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.379613:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265219072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1293us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.379622:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 841 00000100:00100000:1.0:1746065211.380007:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.380039:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265219328 00000100:00100000:0.0:1746065211.380044:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265219328 00000100:00100000:1.0:1746065211.380048:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.380065:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265219584 00000100:00100000:1.0:1746065211.380069:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265219584 00000100:00100000:0.0:1746065211.380071:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17153 00000100:00100000:0.0:1746065211.380076:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265219328:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065211.380087:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065211.380090:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065211.380101:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265219200 00000100:00100000:1.0:1746065211.380103:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265219200 00010000:00010000:0.0:1746065211.380103:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c488000/0xad6b7ddc147890b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d6b expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065211.380115:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14504 00000100:00100000:1.0:1746065211.380120:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2254:x1830881265219584:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065211.380132:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.380142:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3800/0xad6b7ddc1478912 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d72 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.380195:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+50:2005:x1830881265218944:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10301us (10528us total) trans 0 rc 892928/892928 00010000:00010000:1.0:1746065211.380198:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc1478919 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065211.380203:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6037 00010000:00010000:1.0:1746065211.380207:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc1478919 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00002000:00100000:3.0:1746065211.380211:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x75:0x0] (155648->1048575) req@ffff88013513b480 x1830881265218944/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 892928/892928 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746065211.380216:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc1478919 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00002000:00100000:3.0:1746065211.380220:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b480 with x1830881265218944 ext(155648->1048575) 00002000:00010000:3.0:1746065211.380224:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013513b480 00010000:00010000:1.0:1746065211.380227:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3600/0xad6b7ddc1478920 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.380231:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3600/0xad6b7ddc1478920 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.380236:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3600/0xad6b7ddc1478920 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065211.380293:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263924736:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065211.380356:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949600 going to sleep for 11 seconds 00010000:00010000:1.0:1746065211.381195:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc1478927 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381353:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc1478927 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381361:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc1478927 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065211.381370:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065211.381443:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc1478919 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381449:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc1478919 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381453:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc1478919 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381458:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc1478919 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381463:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065211.381466:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc1478919 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381472:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc1478919 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381480:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065211.381483:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065211.381485:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc1478919 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381490:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc1478919 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381983:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3600/0xad6b7ddc1478920 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381990:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3600/0xad6b7ddc1478920 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381994:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3600/0xad6b7ddc1478920 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.381998:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb3600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065211.382001:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3600/0xad6b7ddc1478920 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.382005:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3600/0xad6b7ddc1478920 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.382012:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008c512e00) 00010000:00010000:1.0:1746065211.382014:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065211.382016:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3600/0xad6b7ddc1478920 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.382020:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3600/0xad6b7ddc1478920 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065211.382054:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3800/0xad6b7ddc1478912 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d72 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.382064:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc1478927 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d72 expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.382069:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065211.382071:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065211.382073:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2e00, rc 0) 00000100:00100000:1.0:1746065211.387380:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2254:x1830881265219584:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7247us (7319us total) trans 8589936987 rc 0/0 00000100:00100000:1.0:1746065211.387391:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14504 00000100:00100000:1.0:1746065211.387489:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14505 00000100:00100000:1.0:1746065211.387560:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+6:2255:x1830881265219200:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065211.387581:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.387598:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1478935 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d64 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.387650:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147893c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.387660:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147893c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.387669:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147893c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.387682:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc1478943 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.387687:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc1478943 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.387692:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc1478943 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.387748:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.387759:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c99 expref: 16 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.387765:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cca expref: 32 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.387770:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 5/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.387815:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cca expref: 32 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.387826:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cca expref: 32 pid: 9571 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746065211.387835:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263924864:192.168.202.27@tcp:104: 00000100:00080000:0.0:1746065211.387853:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1746065211.387910:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c99 expref: 16 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.387918:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c99 expref: 16 pid: 7205 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746065211.387926:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263924992:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.387943:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23536c0 going to sleep for 11 seconds 00002000:00010000:0.0:1746065211.387947:0:13375:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime: 1746065209 -> 1746065211 00002000:00010000:0.0:1746065211.387950:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime: 1746065209 -> 1746065211 00002000:00010000:0.0:1746065211.387952:0:13375:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime: 1746065209 -> 1746065211 00000100:00100000:0.0:1746065211.387965:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263924736:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065211.387984:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c488000/0xad6b7ddc147890b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d6b expref: 26 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.387994:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c488000/0xad6b7ddc147890b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d6b expref: 26 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.388015:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488000, rc 0) 00000100:00100000:0.0:1746065211.388050:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265219328:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7973us (8044us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065211.388056:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17153 00000100:00100000:0.0:1746065211.392210:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.392295:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.392318:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265219968 00000100:00100000:0.0:1746065211.392325:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265219968 00000100:00100000:0.0:1746065211.392388:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5415 00000100:00100000:0.0:1746065211.392409:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+33:31231:x1830881265219968:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065211.392490:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f8700 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263924864:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.392501:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263924992:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065211.392528:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065211.392645:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+34:31231:x1830881265219968:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 247us (346us total) trans 8589936988 rc 0/0 00000100:00100000:0.0:1746065211.392652:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5415 00000100:00100000:2.0:1746065211.392801:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265219712 00000100:00100000:2.0:1746065211.392807:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265219712 00000100:00100000:2.0:1746065211.392835:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17154 00000100:00100000:2.0:1746065211.392842:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+50:2248:x1830881265219712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065211.392852:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.392866:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d79 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.392891:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 24 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.392898:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065211.392900:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065211.392903:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 51 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.392928:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 24 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.392938:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 24 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.392948:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263925120:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.393012:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.399209:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.399502:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.400444:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265220224 00000100:00100000:3.0:1746065211.400453:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265220224 00000100:00100000:3.0:1746065211.400708:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5416 00000100:00100000:3.0:1746065211.400785:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:30399:x1830881265220224:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065211.401135:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b26850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:30399:x1830881265220224:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 418us (1931us total) trans 8589936989 rc 0/0 00000100:00100000:3.0:1746065211.401143:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5416 00000100:00100000:0.0:1746065211.401366:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.401388:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.401439:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.401461:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265220352 00000100:00100000:0.0:1746065211.401465:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265220352 00000100:00100000:1.0:1746065211.401543:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265220480 00000100:00100000:1.0:1746065211.401547:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265220480 00000100:00100000:1.0:1746065211.401571:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17155 00000100:00100000:1.0:1746065211.401576:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2251:x1830881265220480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065211.401585:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.401599:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d80 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.401621:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 51 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.401628:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065211.401629:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065211.401632:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.401712:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263925120:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.401732:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 51 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.401742:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44000, rc 0) 00000100:00100000:3.0:1746065211.401786:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+51:2248:x1830881265219712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8931us (9569us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.401790:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265220608 00000100:00100000:3.0:1746065211.401792:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17154 00000100:00100000:0.0:1746065211.401794:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265220608 00010000:00010000:0.0:1746065211.401807:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cca expref: 34 pid: 9571 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.401850:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7940 00000100:00100000:2.0:1746065211.401857:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265220608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.401865:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.401870:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cca expref: 34 pid: 9571 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.401878:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cca expref: 34 pid: 9571 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.401893:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b61800/0xad6b7ddc14787ec lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cca expref: 34 pid: 9571 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746065211.401903:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 50 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.401905:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065211.401909:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.401912:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 50 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.401915:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065211.401919:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065211.401923:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065211.401927:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263925248:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.401939:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265220608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.401944:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7940 00000100:00100000:2.0:1746065211.401956:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 842 00000100:00100000:2.0:1746065211.401960:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265220352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.401965:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065211.401965:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23536c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065211.401979:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2e00/0xad6b7ddc1478927 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d72 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.401986:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065211.401989:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065211.401993:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065211.401997:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065211.402001:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.402013:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265220352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (2512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.402017:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 842 00000100:00100000:3.0:1746065211.402018:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265220736 00000100:00100000:3.0:1746065211.402022:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265220736 00002000:00100000:3.0:1746065211.402043:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3407872->3903487) req@ffff880099bd5f80 x1830881265220736/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.402051:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5f80 with x1830881265220736 ext(3407872->3903487) 00010000:00010000:3.0:1746065211.402056:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 27 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.402064:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 27 pid: 9549 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746065211.402069:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd5f80 00000100:00100000:3.0:1746065211.402082:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1983 00000100:00100000:3.0:1746065211.402088:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2004:x1830881265220736:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065211.405573:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.406277:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.406335:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265220992 00000100:00100000:3.0:1746065211.406343:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265220992 00010000:00010000:3.0:1746065211.406370:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c99 expref: 17 pid: 7205 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.406392:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7941 00000100:00100000:3.0:1746065211.406409:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265220992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.406420:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.406424:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c99 expref: 17 pid: 7205 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.406433:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c99 expref: 17 pid: 7205 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.406452:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc14787d0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c99 expref: 17 pid: 7205 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.406477:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065211.406481:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065211.406488:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065211.406495:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065211.406510:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.406538:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265220864 00000100:00100000:3.0:1746065211.406540:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265220992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 142us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.406542:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265220864 00000100:00100000:3.0:1746065211.406545:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7941 00000100:00100000:2.0:1746065211.406563:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17156 00000100:00100000:2.0:1746065211.406567:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2254:x1830881265220864:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065211.406578:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.406588:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d87 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.406606:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc14786f0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c3e expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.406613:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d800/0xad6b7ddc14787b4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca7 expref: 20 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.406619:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1478783 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c76 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.406624:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.406625:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.406628:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 6/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1093632->1433599] (req 1093632->1433599) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.406648:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1478783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c76 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.406658:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1478783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c76 expref: 9 pid: 9550 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.406668:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263925376:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065211.406813:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406822:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065211.406864:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:1.0:1746065211.406867:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065211.406887:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406896:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406904:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147893c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406909:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147893c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406914:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147893c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406919:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147893c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406923:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065211.406926:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147893c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406931:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147893c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406939:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065211.406941:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065211.406945:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147893c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406949:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147893c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406994:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc1478943 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.406999:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc1478943 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.407003:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc1478943 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.407007:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099cd3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065211.407009:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc1478943 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.407013:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc1478943 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.407019:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008c512500) 00010000:00010000:1.0:1746065211.407021:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065211.407022:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc1478943 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.407025:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc1478943 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065211.407049:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1478935 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d64 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.407058:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d64 expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.407068:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065211.407069:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065211.407071:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3a00, rc 0) 00010000:00010000:2.0:1746065211.407147:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6d800/0xad6b7ddc14787b4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca7 expref: 20 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.407155:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d800/0xad6b7ddc14787b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca7 expref: 20 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.407163:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263925504:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.407468:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+7:2255:x1830881265219200:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 19968us (27378us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065211.407475:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14505 00010000:00010000:2.0:1746065211.407905:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc14786f0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c3e expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.407914:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc14786f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c3e expref: 10 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.407923:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263925632:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.407942:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.410849:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.410974:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265221120 00000100:00100000:3.0:1746065211.410981:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265221120 00002000:00100000:3.0:1746065211.411020:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (73728->155647) req@ffff880099bd7480 x1830881265221120/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.411028:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7480 with x1830881265221120 ext(73728->155647) 00010000:00010000:3.0:1746065211.411036:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 51 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.411051:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 51 pid: 9549 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746065211.411056:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd7480 00000100:00100000:3.0:1746065211.411074:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1984 00000100:00100000:3.0:1746065211.411080:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881265221120:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065211.411302:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263925376:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.411627:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263925248:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065211.411649:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 28 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.411661:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a200, rc 0) 00000100:00100000:1.0:1746065211.411748:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2251:x1830881265220480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10171us (10381us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065211.411756:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17155 00000100:00100000:2.0:1746065211.421986:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.422003:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.422025:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.422045:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265221376 00000100:00100000:2.0:1746065211.422052:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265221376 00010000:00010000:2.0:1746065211.422087:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc14786f0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c3e expref: 11 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.422115:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265221248 00000100:00100000:2.0:1746065211.422118:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265221248 00010000:00010000:2.0:1746065211.422127:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1478783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c76 expref: 10 pid: 9550 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.422136:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265221504 00000100:00100000:2.0:1746065211.422138:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265221504 00010000:00010000:2.0:1746065211.422146:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d800/0xad6b7ddc14787b4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca7 expref: 21 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.422158:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7942 00000100:00100000:2.0:1746065211.422164:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265221376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.422179:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.422196:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc14786f0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c3e expref: 11 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.422205:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc14786f0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c3e expref: 11 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.422225:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.422254:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265221376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.422260:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7942 00000100:00100000:2.0:1746065211.422271:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7943 00000100:00100000:2.0:1746065211.422275:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265221248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.422279:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.422284:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1478783 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c76 expref: 10 pid: 9550 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.422291:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1478783 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c76 expref: 10 pid: 9550 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.422312:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc1478783 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c76 expref: 10 pid: 9550 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.422322:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.422332:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265221248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.422337:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7943 00000100:00100000:2.0:1746065211.422344:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7944 00000100:00100000:2.0:1746065211.422347:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265221504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.422351:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.422356:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6d800/0xad6b7ddc14787b4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca7 expref: 21 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.422362:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6d800/0xad6b7ddc14787b4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca7 expref: 21 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.422370:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.422372:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.422377:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.422383:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.422416:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.422424:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263925760:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065211.422488:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.422535:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.422547:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265221632 00000100:00100000:2.0:1746065211.422550:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265221632 00000100:00100000:2.0:1746065211.422563:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265221760 00000100:00100000:2.0:1746065211.422564:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265221760 00000100:00100000:2.0:1746065211.422573:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17157 00000100:00100000:2.0:1746065211.422577:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265221632:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065211.422588:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.422598:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb3800/0xad6b7ddc1478966 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d8e expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.422623:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263925888:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065211.422650:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17158 00000100:00100000:2.0:1746065211.422655:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265221760:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065211.422660:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.422666:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc147896d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d95 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.422685:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263926016:192.168.202.27@tcp:106: 00000100:00080000:0.0:1746065211.422973:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746065211.423231:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d800/0xad6b7ddc14787b4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ca7 expref: 21 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.423244:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263925504:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.423254:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdac00/0xad6b7ddc14786f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c3e expref: 12 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.423260:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263925632:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.423280:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 7/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.423287:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44800, rc 0) 00000100:00100000:3.0:1746065211.423307:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2254:x1830881265220864:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 16739us (17741us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.423313:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17156 00000100:00100000:3.0:1746065211.424215:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2004:x1830881265220736:12345-192.168.202.27@tcp:4:cat.0 Request processed in 22122us (22770us total) trans 17179874248 rc 0/0 00000100:00100000:3.0:1746065211.424227:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1983 00002000:00100000:3.0:1746065211.424235:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3407872->3903487) req@ffff880099bd5f80 x1830881265220736/t17179874248(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/448 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.424243:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5f80 with x1830881265220736 ext(3407872->3903487) 00010000:00010000:3.0:1746065211.424250:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 28 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.424260:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 28 pid: 9549 timeout: 907 lvb_type: 0 00002000:00010000:3.0:1746065211.424266:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd5f80 00000100:00100000:3.0:1746065211.424729:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065211.425591:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881265221120:12345-192.168.202.27@tcp:4:cat.0 Request processed in 14507us (14747us total) trans 17179874250 rc 0/0 00000100:00100000:2.0:1746065211.425655:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1984 00002000:00100000:2.0:1746065211.425663:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (73728->155647) req@ffff880099bd7480 x1830881265221120/t17179874250(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/448 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.425670:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7480 with x1830881265221120 ext(73728->155647) 00010000:00010000:2.0:1746065211.425677:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 54 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.425686:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 54 pid: 9549 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746065211.425691:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd7480 00000100:00100000:1.0:1746065211.425718:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.425814:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065211.425876:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065211.426014:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.426112:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265221888 00000100:00100000:0.0:1746065211.426118:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265221888 00000100:00100000:2.0:1746065211.426141:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263925760:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065211.426145:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265222016 00000100:00100000:0.0:1746065211.426147:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265222016 00010000:00010000:2.0:1746065211.426154:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065211.426160:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17159 00000100:00100000:0.0:1746065211.426166:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265221888:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:2.0:1746065211.426176:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881265221504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3828us (4150us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065211.426176:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065211.426183:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7944 00010000:00010000:0.0:1746065211.426187:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1478974 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938d9c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.426203:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065211.426204:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17160 00010000:00010000:0.0:1746065211.426204:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065211.426209:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265222016:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065211.426211:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1478974 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d9c expref: 13 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.426216:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.426223:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147897b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938da3 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.426223:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1478974 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d9c expref: 13 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.426231:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489e00, rc 0) 00000100:00100000:0.0:1746065211.426247:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265221888:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 81us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.426252:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263926144:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065211.426252:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17159 00002000:00010000:0.0:1746065211.426279:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 1864 -> 1912 00000100:00100000:0.0:1746065211.426283:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263925888:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065211.426297:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb3800/0xad6b7ddc1478966 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d8e expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.426305:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb3800/0xad6b7ddc1478966 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d8e expref: 13 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065211.426317:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9300 going to sleep for 11 seconds 00010000:00010000:0.0:1746065211.426319:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3800, rc 0) 00000100:00100000:0.0:1746065211.426334:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265221632:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3756us (3846us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065211.426339:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17157 00002000:00010000:3.0:1746065211.426391:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065209 -> 1746065211 00002000:00010000:3.0:1746065211.426393:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065208 -> 1746065211 00002000:00010000:3.0:1746065211.426395:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065209 -> 1746065211 00000100:00100000:3.0:1746065211.426413:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263926016:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065211.426430:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc147896d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d95 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.426438:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc147896d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d95 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.426444:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51ac00, rc 0) 00000100:00100000:3.0:1746065211.426477:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265221760:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3822us (3941us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065211.426483:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17158 00000100:00100000:0.0:1746065211.427865:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.428029:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.428148:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263926144:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065211.428165:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147897b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938da3 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.428175:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147897b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938da3 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.428182:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72a00, rc 0) 00000100:00100000:2.0:1746065211.428242:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265222144 00000100:00100000:2.0:1746065211.428247:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265222144 00000100:00100000:2.0:1746065211.428276:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 237 00000100:00100000:2.0:1746065211.428281:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2007:x1830881265222144:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:1.0:1746065211.428349:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265222400 00000100:00100000:1.0:1746065211.428353:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265222400 00000100:00100000:1.0:1746065211.428415:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1126 00000100:00100000:1.0:1746065211.428421:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2007:x1830881265222400:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065211.428904:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265222016:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 2693us (2888us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065211.428911:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17160 00000100:00100000:2.0:1746065211.428921:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2007:x1830881265222144:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 638us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.428928:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 237 00000100:00080000:0.0:1746065211.429047:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065211.429069:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.429083:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.429110:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.429456:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265222272 00000100:00100000:3.0:1746065211.429460:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265222272 00000100:00100000:3.0:1746065211.429489:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265222528 00000100:00100000:3.0:1746065211.429492:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265222528 00000100:00100000:3.0:1746065211.429505:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1127 00000100:00100000:3.0:1746065211.429509:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:2007:x1830881265222272:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1746065211.429657:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265222656 00000100:00100000:2.0:1746065211.429661:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265222656 00010000:00010000:2.0:1746065211.429675:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 28 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.429692:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7945 00000100:00100000:2.0:1746065211.429696:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265222656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.429704:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.429713:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 28 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.429722:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 28 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.429736:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45000/0xad6b7ddc1478886 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->3903487) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d33 expref: 28 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.429748:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.429750:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.429755:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 53 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065211.429814:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2007:x1830881265222400:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 1393us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.429815:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+294:2007:x1830881265222272:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 304us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065211.429820:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1126 00000100:00100000:3.0:1746065211.429823:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1127 00000100:00100000:1.0:1746065211.429833:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1128 00000100:00100000:1.0:1746065211.429837:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+5:2007:x1830881265222528:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:1.0:1746065211.429859:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+5:2007:x1830881265222528:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 22us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065211.429864:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1128 00000100:00080000:0.0:1746065211.429915:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1746065211.430010:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 53 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.430036:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 53 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.430048:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263926272:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065211.430096:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.433491:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.433596:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.433707:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265222784 00000100:00100000:3.0:1746065211.433717:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265222784 00010000:00010000:3.0:1746065211.433747:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 54 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.433802:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7946 00000100:00100000:3.0:1746065211.433813:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881265222784:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.433824:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.433900:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 54 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746065211.433922:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265223040 00000100:00100000:1.0:1746065211.433925:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265223040 00000100:00100000:1.0:1746065211.433948:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14506 00000100:00100000:1.0:1746065211.433953:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+7:2255:x1830881265223040:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065211.433967:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.433981:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478982 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938daa expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.434060:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1478989 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.434074:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d64 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.434081:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1478989 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.434106:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d64 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.434115:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d64 expref: 8 pid: 9571 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746065211.434125:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263926400:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.434557:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 54 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.434575:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44200/0xad6b7ddc14788b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 73728->155647) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d41 expref: 54 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.434587:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.434588:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.434594:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.434600:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.434620:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.434627:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263926528:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065211.435158:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d649c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065211.435357:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23536c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.435809:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.436185:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265223296 00000100:00100000:2.0:1746065211.436191:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265223296 00002000:00100000:2.0:1746065211.436226:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1093632->1097727) req@ffff880099bd6d80 x1830881265223296/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.436236:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd6d80 with x1830881265223296 ext(1093632->1097727) 00002000:00010000:2.0:1746065211.436240:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd6d80 00000100:00100000:2.0:1746065211.436269:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6038 00000100:00100000:2.0:1746065211.436276:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265223296:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065211.436388:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265223296:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 111us (579us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065211.436412:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6038 00002000:00100000:2.0:1746065211.436418:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1093632->1097727) req@ffff880099bd6d80 x1830881265223296/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.436424:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd6d80 with x1830881265223296 ext(1093632->1097727) 00002000:00010000:2.0:1746065211.436427:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd6d80 00000100:00100000:2.0:1746065211.437333:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edace00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263926272:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065211.437347:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.437372:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265222656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7674us (8260us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.437380:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7945 00000100:00100000:3.0:1746065211.437725:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263926528:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065211.437735:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.437752:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881265222784:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3945us (4269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.437758:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7946 00000100:00100000:1.0:1746065211.438593:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263926400:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065211.438608:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1478989 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065211.446147:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.446186:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.446254:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.446284:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265223680 00000100:00100000:2.0:1746065211.446292:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265223680 00002000:00100000:2.0:1746065211.446328:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880099bd4000 x1830881265223680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.446337:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4000 with x1830881265223680 ext(2097152->4194303) 00002000:00010000:2.0:1746065211.446342:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd4000 00000100:00100000:2.0:1746065211.446357:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265223936 00000100:00100000:2.0:1746065211.446360:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265223936 00002000:00100000:2.0:1746065211.446371:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1429504->1433599) req@ffff880099bd7b80 x1830881265223936/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.446377:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7b80 with x1830881265223936 ext(1429504->1433599) 00002000:00010000:2.0:1746065211.446380:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd7b80 00000100:00100000:2.0:1746065211.446413:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6039 00000100:00100000:2.0:1746065211.446420:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881265223680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065211.446448:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265223424 00000100:00100000:3.0:1746065211.446453:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265223424 00010000:00010000:3.0:1746065211.446472:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d64 expref: 9 pid: 9571 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.446490:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7947 00000100:00100000:3.0:1746065211.446494:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265223424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.446503:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.446508:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d64 expref: 9 pid: 9571 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.446518:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d64 expref: 9 pid: 9571 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.446534:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147894a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d64 expref: 9 pid: 9571 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.446561:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065211.446566:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1478989 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.446574:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1478989 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.446583:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1478989 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.446600:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.446632:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265223424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 136us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.446638:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7947 00000100:00100000:3.0:1746065211.446657:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6040 00000100:00100000:3.0:1746065211.446662:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265223936:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065211.446725:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265223936:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 62us (470us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065211.446731:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6040 00002000:00100000:3.0:1746065211.446736:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1429504->1433599) req@ffff880099bd7b80 x1830881265223936/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.446743:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7b80 with x1830881265223936 ext(1429504->1433599) 00002000:00010000:3.0:1746065211.446745:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd7b80 00010000:00010000:1.0:1746065211.447246:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1478989 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.447254:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1478989 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065211.447270:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065211.447368:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1478982 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938daa expref: 9 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.447383:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1478989 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938daa expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.447390:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065211.447392:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065211.447394:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b600, rc 0) 00000100:00100000:1.0:1746065211.447431:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2255:x1830881265223040:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 13477us (13835us total) trans 8589936990 rc 0/0 00000100:00100000:1.0:1746065211.447437:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14506 00000100:00100000:3.0:1746065211.451541:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.451587:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.451900:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.452185:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265224320 00000100:00100000:1.0:1746065211.452193:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265224320 00002000:00100000:1.0:1746065211.452224:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1093631) req@ffff88011dad6d80 x1830881265224320/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.452238:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6d80 with x1830881265224320 ext(1048576->1093631) 00002000:00010000:1.0:1746065211.452243:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad6d80 00000100:00100000:1.0:1746065211.452257:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265224448 00000100:00100000:1.0:1746065211.452259:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265224448 00002000:00100000:1.0:1746065211.452270:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88011dad6300 x1830881265224448/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.452276:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6300 with x1830881265224448 ext(0->1048575) 00002000:00010000:1.0:1746065211.452278:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad6300 00000100:00100000:1.0:1746065211.452289:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6041 00000100:00100000:1.0:1746065211.452295:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265224320:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065211.452417:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6042 00000100:00100000:1.0:1746065211.452421:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265224448:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065211.455194:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265224704 00000100:00100000:0.0:1746065211.455203:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265224704 00000100:00100000:0.0:1746065211.455248:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5417 00000100:00100000:0.0:1746065211.455254:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2254:x1830881265224704:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065211.455497:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2254:x1830881265224704:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 242us (3596us total) trans 8589936991 rc 0/0 00000100:00100000:0.0:1746065211.455503:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5417 00000100:00100000:0.0:1746065211.461338:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.461909:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265224960 00000100:00100000:1.0:1746065211.461917:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265224960 00000100:00100000:1.0:1746065211.461958:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14507 00000100:00100000:1.0:1746065211.461964:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2255:x1830881265224960:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065211.461984:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.461987:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065211.462009:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc1478989 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938daa expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.462021:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065211.462024:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065211.462033:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478997 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938db1 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.462109:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147899e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.462119:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147899e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.462126:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147899e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065211.462134:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065211.462210:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478997 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db1 expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.462221:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147899e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db1 expref: 9 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.462226:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065211.462228:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065211.462230:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3a00, rc 0) 00000100:00100000:1.0:1746065211.462287:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2255:x1830881265224960:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 318us (950us total) trans 8589936992 rc 0/0 00000100:00100000:1.0:1746065211.462293:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14507 00000100:00100000:1.0:1746065211.470087:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265224320:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 17785us (18545us total) trans 0 rc 45056/45056 00000100:00100000:1.0:1746065211.470097:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6041 00002000:00100000:1.0:1746065211.470106:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1093631) req@ffff88011dad6d80 x1830881265224320/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 45056/45056 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.470121:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6d80 with x1830881265224320 ext(1048576->1093631) 00002000:00010000:1.0:1746065211.470125:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad6d80 00000100:00100000:2.0:1746065211.470197:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881265223680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23776us (24009us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065211.470204:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6039 00002000:00100000:2.0:1746065211.470209:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880099bd4000 x1830881265223680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.470216:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4000 with x1830881265223680 ext(2097152->4194303) 00002000:00010000:2.0:1746065211.470219:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd4000 00000100:00100000:1.0:1746065211.473147:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.473543:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265225088 00000100:00100000:0.0:1746065211.473552:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265225088 00000100:00100000:0.0:1746065211.473588:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14508 00000100:00100000:0.0:1746065211.473595:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2255:x1830881265225088:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065211.473613:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065211.473627:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14789ac lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938db8 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.473669:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14789ac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db8 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.473679:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14789ac lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db8 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.473692:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065211.473694:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065211.473697:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488800, rc 0) 00000100:00100000:0.0:1746065211.473731:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2255:x1830881265225088:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 136us (592us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.473736:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14508 00000100:00100000:2.0:1746065211.473952:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265224448:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 21529us (22362us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065211.473959:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6042 00002000:00100000:2.0:1746065211.473966:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88011dad6300 x1830881265224448/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.473975:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6300 with x1830881265224448 ext(0->1048575) 00002000:00010000:2.0:1746065211.473978:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad6300 00000100:00100000:0.0:1746065211.479859:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.479899:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.479925:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.479951:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.479961:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265225344 00000100:00100000:0.0:1746065211.479965:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.479969:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265225344 00000100:00100000:0.0:1746065211.479986:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265225600 00000100:00100000:3.0:1746065211.479990:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265225856 00000100:00100000:0.0:1746065211.479990:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265225600 00000100:00100000:3.0:1746065211.479993:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265225856 00000100:00100000:1.0:1746065211.480007:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265225216 00000100:00100000:0.0:1746065211.480010:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265225472 00000100:00100000:1.0:1746065211.480012:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265225216 00000100:00100000:0.0:1746065211.480013:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265225472 00000100:00100000:3.0:1746065211.480022:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17161 00000100:00100000:3.0:1746065211.480029:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265225344:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065211.480065:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065211.480075:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17162 00000100:00100000:1.0:1746065211.480081:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17163 00000100:00100000:0.0:1746065211.480082:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265225600:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065211.480085:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065211.480086:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265225856:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065211.480092:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065211.480093:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065211.480096:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.480100:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.480100:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.480109:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc14786fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c5a expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.480109:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.480115:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b7400/0xad6b7ddc14787d7 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cc3 expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.480116:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1478974 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d9c expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.480120:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.480121:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc14787a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c92 expref: 7 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.480122:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 52 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.480126:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.480127:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.480127:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.480128:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.480128:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.480130:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 7 pid: 3068 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.480131:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.480142:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263926656:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065211.480142:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc14787a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c92 expref: 7 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.480146:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 52 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.480148:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc14787a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c92 expref: 7 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.480154:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 52 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746065211.480155:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263926784:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065211.480162:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263926912:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.480193:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17164 00000100:00100000:3.0:1746065211.480197:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d649c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065211.480200:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265225472:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:3.0:1746065211.480212:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17165 00010000:00010000:2.0:1746065211.480213:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.480216:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265225216:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065211.480222:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc14786e2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c45 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.480227:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14787bb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cae expref: 19 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.480228:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.480236:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.480239:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc1478791 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c7d expref: 7 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.480241:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.480242:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.480243:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.480244:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.480244:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.480246:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.480257:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.480263:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc1478791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c7d expref: 7 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.480265:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 26 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.480270:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc1478791 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c7d expref: 7 pid: 10219 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.480272:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263927040:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.480276:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263927168:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065211.480311:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64600 going to sleep for 11 seconds 00010000:00010000:1.0:1746065211.480319:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b7400/0xad6b7ddc14787d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cc3 expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.480324:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1478974 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d9c expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065211.480327:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b7400/0xad6b7ddc14787d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cc3 expref: 19 pid: 10219 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746065211.480333:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263927296:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065211.480335:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1478974 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d9c expref: 11 pid: 9549 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746065211.480343:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263927424:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065211.480362:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc14786fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c5a expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.480367:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.480373:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 26 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746065211.480380:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263927680:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065211.480394:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.480444:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.480584:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265225728 00000100:00100000:0.0:1746065211.480587:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265225728 00000100:00100000:0.0:1746065211.480602:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17166 00000100:00100000:0.0:1746065211.480606:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265225728:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:0.0:1746065211.480622:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.480631:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 52 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.480636:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.480638:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.480640:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.480652:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 52 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.480656:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14787bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cae expref: 19 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.480659:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 52 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.480665:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14787bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cae expref: 19 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746065211.480667:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263927808:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.480672:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263927936:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065211.480689:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949480 going to sleep for 11 seconds 00010000:00010000:2.0:1746065211.480697:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc14786e2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c45 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065211.480715:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc14786fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c5a expref: 12 pid: 12260 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746065211.480723:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263927552:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.480745:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353f00 going to sleep for 11 seconds 00010000:00010000:2.0:1746065211.480813:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc14786e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c45 expref: 12 pid: 12260 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.480820:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263928064:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.480942:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.484758:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.484827:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.484947:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263926784:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.485063:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265225984 00000100:00100000:2.0:1746065211.485068:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265225984 00000100:00100000:2.0:1746065211.485097:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265226112 00000100:00100000:2.0:1746065211.485099:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265226112 00000100:00100000:2.0:1746065211.485111:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17167 00000100:00100000:2.0:1746065211.485116:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881265225984:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065211.485118:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263926656:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065211.485130:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.485135:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.485141:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72400/0xad6b7ddc14789dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938dbf expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.485156:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065211.485204:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17168 00000100:00100000:1.0:1746065211.485209:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881265226112:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065211.485215:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.485223:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc14789e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938dc6 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065211.485251:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263928192:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065211.485443:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72400/0xad6b7ddc14789dd lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dbf expref: 54 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.485454:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72400/0xad6b7ddc14789dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dbf expref: 54 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.485477:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72400, rc 0) 00000100:00100000:2.0:1746065211.485500:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881265225984:12345-192.168.202.27@tcp:101:cat.0 Request processed in 384us (749us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065211.485505:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17167 00000100:00100000:1.0:1746065211.485544:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.490013:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263926912:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.490692:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edace00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263927168:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.490748:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263927424:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.490756:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263927680:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065211.490790:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065211.490851:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263927296:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.491159:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263927936:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.491180:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.491196:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265226368 00000100:00100000:2.0:1746065211.491201:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265226368 00010000:00010000:2.0:1746065211.491224:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b7400/0xad6b7ddc14787d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cc3 expref: 22 pid: 10219 timeout: 907 lvb_type: 1 00000100:00100000:0.0:1746065211.491302:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263927808:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065211.491311:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.491650:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263927040:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.491662:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.491833:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7948 00000100:00100000:2.0:1746065211.491840:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881265226368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.491851:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.491865:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b7400/0xad6b7ddc14787d7 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cc3 expref: 22 pid: 10219 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.491874:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b7400/0xad6b7ddc14787d7 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cc3 expref: 22 pid: 10219 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.491893:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b7400/0xad6b7ddc14787d7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cc3 expref: 22 pid: 10219 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.491906:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.493796:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881265226368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1948us (2608us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.493807:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7948 00000100:00100000:3.0:1746065211.494028:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.494114:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.494127:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.494141:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265226496 00000100:00100000:3.0:1746065211.494146:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265226496 00010000:00010000:3.0:1746065211.494170:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1478974 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d9c expref: 13 pid: 9549 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.494192:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265226752 00000100:00100000:3.0:1746065211.494194:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265226752 00010000:00010000:3.0:1746065211.494202:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 53 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.494214:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7949 00000100:00100000:3.0:1746065211.494219:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265226496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.494229:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.494243:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1478974 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d9c expref: 13 pid: 9549 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.494250:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1478974 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d9c expref: 13 pid: 9549 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.494268:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1478974 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d9c expref: 13 pid: 9549 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.494282:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.494306:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265226496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.494311:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7949 00000100:00100000:3.0:1746065211.494320:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7950 00000100:00100000:3.0:1746065211.494324:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881265226752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.494329:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.494335:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 53 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.494342:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 53 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.494351:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44400/0xad6b7ddc1478840 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d09 expref: 53 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.494357:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.494369:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881265226752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.494373:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7950 00000100:00100000:3.0:1746065211.494408:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.494420:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265227008 00000100:00100000:3.0:1746065211.494422:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265227008 00010000:00010000:3.0:1746065211.494432:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14787bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cae expref: 21 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.494444:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7951 00000100:00100000:3.0:1746065211.494448:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881265227008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.494454:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.494465:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14787bb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cae expref: 21 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.494472:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14787bb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cae expref: 21 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.494486:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc14787bb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cae expref: 21 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.494493:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.494507:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881265227008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.494511:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7951 00000100:00100000:3.0:1746065211.494541:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.494550:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265227264 00000100:00100000:3.0:1746065211.494552:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265227264 00010000:00010000:3.0:1746065211.494560:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc14786e2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c45 expref: 13 pid: 12260 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.494577:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7952 00000100:00100000:3.0:1746065211.494581:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265227264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.494588:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.494595:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc14786e2 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c45 expref: 13 pid: 12260 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.494602:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc14786e2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c45 expref: 13 pid: 12260 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.494611:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.494623:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265227264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.494630:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7952 00000100:00100000:1.0:1746065211.494633:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263928192:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065211.494656:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065211.494657:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc14789e4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dc6 expref: 19 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065211.494665:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265226624 00010000:00010000:1.0:1746065211.494666:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095779200/0xad6b7ddc14789e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dc6 expref: 19 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065211.494667:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265226624 00010000:00010000:3.0:1746065211.494676:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc14787a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c92 expref: 8 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746065211.494677:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779200, rc 0) 00000100:00100000:3.0:1746065211.494687:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7953 00000100:00100000:3.0:1746065211.494691:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265226624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.494696:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065211.494698:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+18:2004:x1830881265226112:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9488us (9870us total) trans 0 rc 301/301 00010000:00010000:3.0:1746065211.494702:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc14787a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c92 expref: 8 pid: 12258 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746065211.494704:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17168 00010000:00010000:3.0:1746065211.494709:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc14787a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c92 expref: 8 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.494718:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b600/0xad6b7ddc14787a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c92 expref: 8 pid: 12258 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.494726:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065211.494738:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.494739:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2004:x1830881265226624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (82us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.494743:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7953 00000100:00100000:3.0:1746065211.494752:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265226880 00000100:00100000:3.0:1746065211.494754:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265226880 00010000:00010000:3.0:1746065211.494761:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 27 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746065211.494766:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.494790:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265227136 00000100:00100000:1.0:1746065211.494793:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265227136 00000100:00100000:3.0:1746065211.494798:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7954 00000100:00100000:3.0:1746065211.494803:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2004:x1830881265226880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065211.494807:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 52 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.494808:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.494814:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 27 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.494820:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 27 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746065211.494826:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263927552:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.494827:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7955 00010000:00010000:3.0:1746065211.494829:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993e200/0xad6b7ddc1478839 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d02 expref: 27 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746065211.494832:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881265227136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.494836:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.494838:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.494838:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.494842:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.494845:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 52 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.494848:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.494851:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.494852:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 52 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746065211.494862:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1478951 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d79 expref: 52 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.494866:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065211.494870:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.494871:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.494873:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.494879:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.494880:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265226880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (142us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065211.494899:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065211.494915:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+51:2004:x1830881265227136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065211.494921:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7955 00010000:00010000:0.0:1746065211.494923:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.494930:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.494945:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.494951:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.494956:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.494961:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f04b600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065211.494964:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.494970:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.494978:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.494989:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.495000:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.495011:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.495016:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.495020:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.495025:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065211.495027:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.495032:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.495039:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.495044:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489200/0xad6b7ddc14789ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.495047:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265226240 00000100:00100000:2.0:1746065211.495050:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265226240 00002000:00100000:2.0:1746065211.495073:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1093632->1433599) req@ffff88008f7fea00 x1830881265226240/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746065211.495073:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc14789d6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065211.495077:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265225600:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 14996us (15177us total) trans 0 rc 0/0 00002000:00100000:2.0:1746065211.495081:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fea00 with x1830881265226240 ext(1093632->1433599) 00000100:00100000:1.0:1746065211.495083:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17162 00010000:00010000:2.0:1746065211.495086:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 7 pid: 3068 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.495094:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 7 pid: 3068 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746065211.495099:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f7fea00 00000100:00100000:0.0:1746065211.495108:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265225728:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 14501us (14664us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.495110:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1985 00000100:00100000:1.0:1746065211.495112:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.495114:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17166 00000100:00100000:2.0:1746065211.495115:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2004:x1830881265226240:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065211.495142:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.495158:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265228032 00000100:00100000:0.0:1746065211.495161:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265228032 00000100:00100000:1.0:1746065211.495162:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.495173:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265227648 00000100:00100000:1.0:1746065211.495176:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265227648 00000100:00100000:0.0:1746065211.495182:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14509 00002000:00100000:1.0:1746065211.495191:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1433600->2097151) req@ffff8800996f9500 x1830881265227648/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746065211.495191:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2258:x1830881265228032:12345-192.168.202.27@tcp:101:multiop.0 00002000:00100000:1.0:1746065211.495197:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f9500 with x1830881265227648 ext(1433600->2097151) 00010000:00010000:1.0:1746065211.495201:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 9 pid: 3068 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.495203:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265227392 00010000:00010000:0.0:1746065211.495204:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065211.495206:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265227392 00010000:00010000:1.0:1746065211.495208:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 9 pid: 3068 timeout: 907 lvb_type: 0 00002000:00010000:1.0:1746065211.495212:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800996f9500 00010000:00010000:2.0:1746065211.495215:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc14786fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c5a expref: 13 pid: 12260 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.495215:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e600/0xad6b7ddc14789eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938dcd expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065211.495224:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1986 00000100:00100000:2.0:1746065211.495228:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7956 00000100:00100000:1.0:1746065211.495229:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265227648:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065211.495232:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265227392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.495237:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.495243:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc14786fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c5a expref: 13 pid: 12260 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.495249:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc14786fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c5a expref: 13 pid: 12260 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.495262:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc14786fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c5a expref: 13 pid: 12260 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.495266:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc14789f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.495269:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.495270:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.495273:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.495274:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc14789f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.495278:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.495281:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc14789f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.495289:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065211.495290:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc14789f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.495295:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc14789f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065211.495299:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265227392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 67us (188us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065211.495299:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc14789f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065211.495304:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7956 00010000:00010000:2.0:1746065211.495326:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc14786e2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c45 expref: 11 pid: 12260 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.495334:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263928064:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065211.495347:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.495371:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.495382:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147899e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db1 expref: 9 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.495387:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.495424:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147899e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db1 expref: 9 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.495433:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147899e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db1 expref: 9 pid: 7205 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746065211.495443:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263928320:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.495451:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.495466:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265227776 00000100:00100000:2.0:1746065211.495469:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265227776 00000100:00100000:0.0:1746065211.495477:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949480 going to sleep for 11 seconds 00010000:00010000:2.0:1746065211.495478:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc1478791 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c7d expref: 11 pid: 10219 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.495487:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.495492:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7957 00010000:00010000:0.0:1746065211.495492:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.495495:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265227776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.495500:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065211.495504:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495506:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc1478791 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c7d expref: 11 pid: 10219 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.495509:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495513:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc1478791 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c7d expref: 11 pid: 10219 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.495515:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495522:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c000/0xad6b7ddc1478791 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938c7d expref: 11 pid: 10219 timeout: 907 lvb_type: 1 00010000:00010000:0.0:1746065211.495523:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a852a200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065211.495526:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495528:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.495530:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.495532:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.495532:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495537:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.495540:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.495545:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc14789c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495547:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.495557:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265227776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 61us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.495562:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7957 00010000:00010000:2.0:1746065211.495574:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065211.495574:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265225856:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 15488us (15648us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.495579:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17163 00010000:00010000:2.0:1746065211.495583:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495592:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495597:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495602:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495606:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065211.495613:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495712:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495721:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.495726:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc14789c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.495751:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265225472:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 15552us (15785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.495757:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17164 00000100:00100000:3.0:1746065211.496038:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7954 00000100:00100000:1.0:1746065211.496589:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.496634:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265228160 00000100:00100000:3.0:1746065211.496638:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265228160 00000100:00100000:1.0:1746065211.496641:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.496662:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17169 00000100:00100000:3.0:1746065211.496667:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2251:x1830881265228160:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065211.496675:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.496681:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938dd4 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.496693:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065211.496695:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.496700:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00000100:00100000:2.0:1746065211.497182:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265228288 00000100:00100000:2.0:1746065211.497185:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265228288 00010000:00010000:2.0:1746065211.497198:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 26 pid: 9549 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.497211:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7958 00000100:00100000:2.0:1746065211.497215:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2006:x1830881265228288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.497221:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.497230:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 26 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.497238:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 26 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.497249:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1478958 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d80 expref: 26 pid: 9549 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.497256:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.497257:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.497260:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.497265:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.497277:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.497308:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2006:x1830881265228288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 91us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.497313:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7958 00010000:00010000:2.0:1746065211.497326:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.497332:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.497341:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.497346:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.497352:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.497356:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065211.497358:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.497364:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.497371:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.497380:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14789cf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.497437:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265225216:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 17220us (17485us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.497442:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17165 00010000:00010000:3.0:1746065211.497500:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.497511:0:11461:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.497520:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.497528:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01c00, rc 0) 00000100:00100000:3.0:1746065211.497546:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2251:x1830881265228160:12345-192.168.202.27@tcp:101:cat.0 Request processed in 879us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.497551:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17169 00000100:00100000:2.0:1746065211.500730:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.500740:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263928320:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065211.500758:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:1.0:1746065211.500766:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265227648:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 5535us (5602us total) trans 0 rc 663552/663552 00000100:00100000:1.0:1746065211.500792:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1986 00002000:00100000:1.0:1746065211.500800:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1433600->2097151) req@ffff8800996f9500 x1830881265227648/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 663552/663552 job:'multiop.0' uid:0 gid:0 00000100:00100000:2.0:1746065211.500801:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:1.0:1746065211.500813:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f9500 with x1830881265227648 ext(1433600->2097151) 00010000:00010000:1.0:1746065211.500819:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 9 pid: 3068 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746065211.500829:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 9 pid: 3068 timeout: 907 lvb_type: 0 00002000:00010000:1.0:1746065211.500834:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800996f9500 00000100:00100000:2.0:1746065211.500851:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265228416 00000100:00100000:2.0:1746065211.500856:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265228416 00000100:00100000:2.0:1746065211.500892:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17170 00000100:00100000:2.0:1746065211.500899:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+51:2248:x1830881265228416:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065211.500902:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265228544 00000100:00100000:3.0:1746065211.500905:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265228544 00010000:00010000:2.0:1746065211.500909:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.500918:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147899e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db1 expref: 10 pid: 7205 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.500922:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1478a0e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ddb expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.500938:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7959 00002000:00010000:2.0:1746065211.500938:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 4897248, mtime: 0x6812d73b, atime: 0x6812d73b, ctime: 0x6812d73b, blocks: 0x1568 00000100:00100000:3.0:1746065211.500943:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265228544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.500949:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.500951:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.500953:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147899e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db1 expref: 10 pid: 7205 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.500953:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.500959:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1478a0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ddb expref: 52 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.500960:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147899e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db1 expref: 10 pid: 7205 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.500969:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1478a0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ddb expref: 52 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.500972:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147899e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db1 expref: 10 pid: 7205 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.500976:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a200, rc 0) 00010000:00010000:3.0:1746065211.500981:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065211.500985:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.500993:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065211.500994:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+52:2248:x1830881265228416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 96us (193us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065211.500999:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065211.500999:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17170 00010000:00010000:3.0:1746065211.501078:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065211.501093:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501099:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:3.0:1746065211.501110:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265228544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 166us (387us total) trans 0 rc 0/0 00000004:00200000:1.0:1746065211.501111:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000100:00100000:3.0:1746065211.501116:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7959 00010000:00010000:1.0:1746065211.501231:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501238:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501243:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501247:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880130104600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065211.501250:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501255:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501266:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065211.501268:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065211.501271:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501275:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130104600/0xad6b7ddc1478a00 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501290:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc14789f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501295:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc14789f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501299:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc14789f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501303:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc14789f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501307:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7fa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065211.501309:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc14789f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501313:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc14789f2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501319:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065211.501321:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065211.501323:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc14789f2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501328:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7fa00/0xad6b7ddc14789f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501335:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc14789f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501340:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc14789f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501344:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc14789f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501347:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd7e000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065211.501350:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc14789f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501354:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc14789f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501358:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012d56c000) 00010000:00010000:1.0:1746065211.501360:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065211.501362:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc14789f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501366:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc14789f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065211.501394:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e600/0xad6b7ddc14789eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dcd expref: 35 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.501411:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e600/0xad6b7ddc14789eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dcd expref: 35 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.501417:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7e600, rc 0) 00000100:00100000:1.0:1746065211.501443:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2258:x1830881265228032:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6255us (6300us total) trans 8589936993 rc 301/301 00000100:00100000:1.0:1746065211.501450:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14509 00000100:00100000:0.0:1746065211.505624:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265226240:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 10501us (11502us total) trans 21474841648 rc 0/0 00000100:00100000:0.0:1746065211.505634:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1985 00002000:00100000:0.0:1746065211.505644:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1093632->1433599) req@ffff88008f7fea00 x1830881265226240/t21474841648(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/448 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.505657:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fea00 with x1830881265226240 ext(1093632->1433599) 00010000:00010000:0.0:1746065211.505665:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 9 pid: 3068 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.505677:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 9 pid: 3068 timeout: 907 lvb_type: 0 00002000:00010000:0.0:1746065211.505683:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f7fea00 00000100:00100000:2.0:1746065211.506194:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.506331:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265228800 00000100:00100000:1.0:1746065211.506337:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265228800 00002000:00100000:1.0:1746065211.506363:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88012edaea00 x1830881265228800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.506370:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaea00 with x1830881265228800 ext(4194304->4898815) 00002000:00010000:1.0:1746065211.506373:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaea00 00000100:00100000:1.0:1746065211.506387:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6043 00000100:00100000:1.0:1746065211.506393:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881265228800:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065211.511327:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.511473:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265228928 00000100:00100000:2.0:1746065211.511482:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265228928 00010000:00010000:2.0:1746065211.511513:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 9 pid: 3068 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.511540:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7960 00000100:00100000:2.0:1746065211.511547:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2006:x1830881265228928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.511557:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.511573:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 9 pid: 3068 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.511584:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 9 pid: 3068 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.511604:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44800/0xad6b7ddc147895f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1093632->1433599) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d87 expref: 9 pid: 3068 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.511620:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.511622:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.511625:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.511632:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.511914:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.511953:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2006:x1830881265228928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 406us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.511959:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7960 00010000:00010000:2.0:1746065211.512025:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.512032:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.512047:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.512053:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.512059:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.512065:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065211.512068:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.512075:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.512087:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.512088:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.512093:0:3067:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 7 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.512099:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 7 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.512122:0:3067:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 7 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.512133:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263928448:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065211.512177:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065211.513808:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+52:2004:x1830881265228800:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7410us (7611us total) trans 0 rc 704512/704512 00000100:00100000:1.0:1746065211.513816:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6043 00002000:00100000:1.0:1746065211.513824:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88012edaea00 x1830881265228800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.513831:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaea00 with x1830881265228800 ext(4194304->4898815) 00002000:00010000:1.0:1746065211.513835:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaea00 00000100:00100000:3.0:1746065211.514254:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263928448:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065211.514271:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.514280:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc14789b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.514323:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265225344:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 34294us (34472us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.514329:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17161 00000100:00100000:0.0:1746065211.515769:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.515911:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265229184 00000100:00100000:1.0:1746065211.515917:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265229184 00000100:00100000:1.0:1746065211.515957:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14510 00000100:00100000:1.0:1746065211.515963:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2255:x1830881265229184:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:1.0:1746065211.515999:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065211.516018:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488800/0xad6b7ddc14789ac lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938db8 expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.516236:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065211.516241:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065211.516293:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2255:x1830881265229184:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 329us (527us total) trans 0 rc -116/-116 00000100:00100000:1.0:1746065211.516299:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14510 00000100:00100000:0.0:1746065211.517117:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.517142:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.517262:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.517367:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.517432:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265229312 00000100:00100000:3.0:1746065211.517437:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265229312 00000100:00100000:3.0:1746065211.517464:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265229568 00000100:00100000:3.0:1746065211.517466:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265229568 00000100:00100000:3.0:1746065211.517483:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265229440 00000100:00100000:3.0:1746065211.517485:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265229440 00000100:00100000:3.0:1746065211.517496:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17171 00000100:00100000:3.0:1746065211.517501:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881265229312:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065211.517511:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.517524:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1478a1c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938de2 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065211.517541:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d73b, atime: 0x6812d73b, ctime: 0x6812d73b, blocks: 0x778 00010000:00010000:3.0:1746065211.517553:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.517555:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.517562:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1478a1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de2 expref: 53 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.517573:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1478a1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de2 expref: 53 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.517586:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61200, rc 0) 00000100:00100000:3.0:1746065211.517614:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881265229312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 113us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.517619:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17171 00000100:00100000:3.0:1746065211.517630:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17172 00000100:00100000:3.0:1746065211.517634:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+19:2005:x1830881265229568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065211.517641:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.517650:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc1478a23 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938df0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065211.517661:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d739, atime: 0x6812d738, ctime: 0x6812d739, blocks: 0x808 00010000:00010000:3.0:1746065211.517668:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.517670:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.517673:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc1478a23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df0 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.517682:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc1478a23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df0 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.517689:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61c00, rc 0) 00000100:00100000:3.0:1746065211.517704:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881265229568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 69us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.517708:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17172 00000100:00100000:3.0:1746065211.517717:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17173 00000100:00100000:3.0:1746065211.517722:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+19:2005:x1830881265229440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065211.517728:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.517733:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478a2a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938de9 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.517742:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.517743:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.517746:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478a2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de9 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.517753:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478a2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de9 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.517758:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60e00, rc 0) 00000100:00100000:3.0:1746065211.517795:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881265229440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.517800:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17173 00000100:00100000:0.0:1746065211.518142:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265229696 00000100:00100000:0.0:1746065211.518145:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265229696 00000100:00100000:0.0:1746065211.518162:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17174 00000100:00100000:0.0:1746065211.518166:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881265229696:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065211.518172:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065211.518179:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc1478a31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938df7 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065211.518189:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d73b, atime: 0x6812d736, ctime: 0x6812d73b, blocks: 0x808 00010000:00010000:0.0:1746065211.518196:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.518198:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.518202:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc1478a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df7 expref: 54 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.518210:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc1478a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df7 expref: 54 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.518216:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72200, rc 0) 00000100:00100000:0.0:1746065211.518234:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881265229696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 67us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.518239:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17174 00000100:00100000:0.0:1746065211.518266:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.518335:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.518345:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265229824 00000100:00100000:0.0:1746065211.518348:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265229824 00000100:00100000:0.0:1746065211.518360:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17175 00000100:00100000:0.0:1746065211.518364:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881265229824:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065211.518370:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065211.518377:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478a38 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938dfe expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065211.518387:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d739, atime: 0x6812d739, ctime: 0x6812d739, blocks: 0x1008 00010000:00010000:0.0:1746065211.518394:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.518408:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.518412:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478a38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dfe expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.518420:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478a38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dfe expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.518431:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73e00, rc 0) 00000100:00100000:0.0:1746065211.518447:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265229824:12345-192.168.202.27@tcp:101:cat.0 Request processed in 83us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.518451:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17175 00000100:00100000:1.0:1746065211.518628:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265230080 00000100:00100000:1.0:1746065211.518631:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265230080 00000100:00100000:1.0:1746065211.518650:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5418 00000100:00100000:1.0:1746065211.518654:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2255:x1830881265230080:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065211.518768:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2255:x1830881265230080:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 112us (501us total) trans 8589936994 rc 0/0 00000100:00100000:1.0:1746065211.518791:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5418 00000100:00100000:0.0:1746065211.519346:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.519615:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265230336 00000100:00100000:1.0:1746065211.519620:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265230336 00002000:00100000:1.0:1746065211.519641:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800907bdf80 x1830881265230336/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.519649:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdf80 with x1830881265230336 ext(1048576->2097151) 00002000:00010000:1.0:1746065211.519654:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bdf80 00000100:00100000:1.0:1746065211.520287:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6044 00000100:00100000:1.0:1746065211.520294:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265230336:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065211.526593:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.526619:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265230592 00000100:00100000:0.0:1746065211.526627:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265230592 00000100:00100000:0.0:1746065211.526665:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5419 00000100:00100000:0.0:1746065211.526671:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2248:x1830881265230592:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:0.0:1746065211.526867:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2248:x1830881265230592:12345-192.168.202.27@tcp:35:cat.0 Request processed in 195us (281us total) trans 8589936995 rc 0/0 00000100:00100000:0.0:1746065211.526873:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5419 00000100:00100000:0.0:1746065211.527724:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.527760:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265230848 00000100:00100000:1.0:1746065211.527766:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265230848 00000100:00100000:1.0:1746065211.527906:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5420 00000100:00100000:1.0:1746065211.527912:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2255:x1830881265230848:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065211.528009:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2255:x1830881265230848:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 96us (286us total) trans 8589936996 rc 0/0 00000100:00100000:1.0:1746065211.528015:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5420 00000100:00100000:1.0:1746065211.528872:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265230336:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8577us (9525us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065211.528880:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6044 00002000:00100000:1.0:1746065211.528888:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800907bdf80 x1830881265230336/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.528896:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdf80 with x1830881265230336 ext(1048576->2097151) 00002000:00010000:1.0:1746065211.528901:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bdf80 00000100:00100000:0.0:1746065211.537177:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.537953:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265230976 00000100:00100000:3.0:1746065211.537962:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265230976 00000100:00100000:3.0:1746065211.538014:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17176 00000100:00100000:3.0:1746065211.538022:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2251:x1830881265230976:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065211.538040:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.538057:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478a3f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e05 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.538086:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.538088:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.538096:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478a3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e05 expref: 9 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.538115:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478a3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e05 expref: 9 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.538126:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e400, rc 0) 00000100:00100000:3.0:1746065211.538201:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2251:x1830881265230976:12345-192.168.202.27@tcp:101:cat.0 Request processed in 178us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.538207:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17176 00000100:00100000:0.0:1746065211.542910:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.542987:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265231232 00000100:00100000:1.0:1746065211.542996:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265231232 00002000:00100000:1.0:1746065211.543033:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800907bd500 x1830881265231232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.543042:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd500 with x1830881265231232 ext(1048576->2097151) 00002000:00010000:1.0:1746065211.543047:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bd500 00000100:00100000:1.0:1746065211.543079:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6045 00000100:00100000:1.0:1746065211.543086:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265231232:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065211.552465:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265231232:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9368us (9554us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065211.552477:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6045 00002000:00100000:1.0:1746065211.552488:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800907bd500 x1830881265231232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.552503:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd500 with x1830881265231232 ext(1048576->2097151) 00002000:00010000:1.0:1746065211.552509:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bd500 00000100:00100000:0.0:1746065211.556289:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.556349:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265231360 00000100:00100000:2.0:1746065211.556358:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265231360 00000100:00100000:2.0:1746065211.556413:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17177 00000100:00100000:2.0:1746065211.556421:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2251:x1830881265231360:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065211.556436:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.556450:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478a46 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e0c expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.556471:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.556472:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.556479:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478a46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e0c expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.556492:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478a46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e0c expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.556502:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3e00, rc 0) 00000100:00100000:2.0:1746065211.556553:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2251:x1830881265231360:12345-192.168.202.27@tcp:101:cat.0 Request processed in 133us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.556559:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17177 00000100:00100000:0.0:1746065211.562453:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.563428:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265231616 00000100:00100000:1.0:1746065211.563437:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265231616 00002000:00100000:1.0:1746065211.563474:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800907bc700 x1830881265231616/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.563483:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bc700 with x1830881265231616 ext(1048576->2097151) 00002000:00010000:1.0:1746065211.563487:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bc700 00000100:00100000:1.0:1746065211.563513:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6046 00000100:00100000:1.0:1746065211.563519:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265231616:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065211.572467:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265231616:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8934us (10013us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065211.572479:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6046 00002000:00100000:2.0:1746065211.572491:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800907bc700 x1830881265231616/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.572500:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bc700 with x1830881265231616 ext(1048576->2097151) 00002000:00010000:2.0:1746065211.572506:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bc700 00000100:00100000:0.0:1746065211.586305:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.586349:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.586648:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265231872 00000100:00100000:2.0:1746065211.586656:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265231872 00000100:00100000:1.0:1746065211.587102:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.587316:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265231744 00000100:00100000:2.0:1746065211.587319:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265231744 00000100:00100000:2.0:1746065211.587338:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265232000 00000100:00100000:2.0:1746065211.587339:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265232000 00000100:00100000:2.0:1746065211.587353:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17178 00000100:00100000:2.0:1746065211.587359:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265231872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065211.587374:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.587387:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e1a expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.587417:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.587419:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.587427:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 28 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.587440:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 28 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.587448:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71aa00, rc 0) 00000100:00100000:2.0:1746065211.587487:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265231872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 128us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.587492:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17178 00000100:00100000:2.0:1746065211.587506:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17179 00000100:00100000:2.0:1746065211.587510:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265231744:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065211.587515:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.587521:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc1478a54 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e13 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.587529:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.587531:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.587535:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc1478a54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e13 expref: 28 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065211.587940:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17180 00000100:00100000:3.0:1746065211.587948:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265232000:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065211.587955:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.587965:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478a5b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e21 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.587975:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.587976:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.587981:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478a5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e21 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.587989:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478a5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e21 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.587996:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e600, rc 0) 00000100:00100000:3.0:1746065211.588013:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265232000:12345-192.168.202.27@tcp:101:cat.0 Request processed in 67us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.588017:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17180 00010000:00010000:2.0:1746065211.588574:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc1478a54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e13 expref: 28 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065211.588582:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3a00, rc 0) 00000100:00100000:2.0:1746065211.588614:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265231744:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1102us (2264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.588622:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17179 00000100:00100000:3.0:1746065211.588846:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.588921:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265232256 00000100:00100000:0.0:1746065211.588927:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265232256 00000100:00100000:0.0:1746065211.588969:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14511 00000100:00100000:0.0:1746065211.588976:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2262:x1830881265232256:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065211.588992:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065211.589003:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc1478a62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e28 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.589059:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc1478a69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589069:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc1478a69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589077:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc1478a69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589087:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478a70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589092:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589097:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589173:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478a77 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589182:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478a77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589187:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478a77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065211.589195:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065211.589256:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc1478a69 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589265:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc1478a69 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589270:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc1478a69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589275:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc1478a69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589279:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065211.589282:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc1478a69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589287:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc1478a69 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589296:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065211.589298:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065211.589301:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc1478a69 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.589306:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc1478a69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.591737:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478a70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.591747:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478a70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.591752:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478a70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.591755:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f73800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065211.591759:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478a70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.591763:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478a70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.591784:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095561d00) 00010000:00010000:0.0:1746065211.591787:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065211.591789:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478a70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.591793:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73800/0xad6b7ddc1478a70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.591838:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc1478a62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e28 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.591848:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478a77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e28 expref: 19 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.591854:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065211.591855:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065211.591857:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72a00, rc 0) 00000100:00100000:0.0:1746065211.591908:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2262:x1830881265232256:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2933us (3064us total) trans 8589936997 rc 0/0 00000100:00100000:0.0:1746065211.591915:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14511 00000100:00100000:2.0:1746065211.595182:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.595301:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265232384 00000100:00100000:1.0:1746065211.595309:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265232384 00000100:00100000:1.0:1746065211.595353:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17181 00000100:00100000:1.0:1746065211.595362:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+54:2258:x1830881265232384:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065211.595378:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.595408:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e2f expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.595435:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1478a0e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ddb expref: 55 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.595443:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 27 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065211.595454:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.595456:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.595460:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 55 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.595491:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 27 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065211.595503:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 27 pid: 3067 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746065211.595515:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263928576:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065211.595613:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1478a0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ddb expref: 55 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.595622:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1478a0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ddb expref: 55 pid: 11461 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746065211.595631:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263928704:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.595658:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23536c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065211.597216:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263928576:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.597231:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263928704:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065211.597257:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 55 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.597277:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130104600, rc 0) 00000100:00100000:1.0:1746065211.597489:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+55:2258:x1830881265232384:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2127us (2313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065211.597497:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17181 00000100:00100000:0.0:1746065211.601931:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.602018:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265232512 00000100:00100000:2.0:1746065211.602024:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265232512 00010000:00010000:2.0:1746065211.602052:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1478a0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ddb expref: 55 pid: 11461 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.602075:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7961 00000100:00100000:2.0:1746065211.602081:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881265232512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.602091:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.602106:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1478a0e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ddb expref: 55 pid: 11461 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.602115:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1478a0e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ddb expref: 55 pid: 11461 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.602133:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a200/0xad6b7ddc1478a0e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->4898815) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ddb expref: 55 pid: 11461 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.602163:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.602196:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+54:2005:x1830881265232512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 114us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.602202:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7961 00000100:00100000:0.0:1746065211.603456:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.603523:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.603615:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265232896 00000100:00100000:2.0:1746065211.603620:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265232896 00000100:00100000:3.0:1746065211.603638:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265233024 00000100:00100000:3.0:1746065211.603641:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265233024 00002000:00100000:2.0:1746065211.603649:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880097a6c380 x1830881265232896/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.603655:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097a6df80 x1830881265233024/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.603658:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6c380 with x1830881265232896 ext(2097152->4194303) 00002000:00100000:3.0:1746065211.603661:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6df80 with x1830881265233024 ext(2097152->4194303) 00002000:00010000:3.0:1746065211.603664:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6df80 00010000:00010000:2.0:1746065211.603664:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 28 pid: 3067 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.603674:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 28 pid: 3067 timeout: 907 lvb_type: 1 00002000:00010000:2.0:1746065211.603680:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a6c380 00000100:00100000:3.0:1746065211.603758:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1987 00000100:00100000:3.0:1746065211.603765:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881265232896:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065211.603765:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6047 00000100:00100000:2.0:1746065211.603769:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265233024:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065211.624731:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265233024:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20951us (21199us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065211.624743:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6047 00002000:00100000:2.0:1746065211.624755:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097a6df80 x1830881265233024/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.624764:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6df80 with x1830881265233024 ext(2097152->4194303) 00002000:00010000:2.0:1746065211.624770:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6df80 00000100:00100000:3.0:1746065211.629008:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881265232896:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25231us (25545us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065211.629020:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1987 00002000:00100000:3.0:1746065211.629032:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880097a6c380 x1830881265232896/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065211.629041:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6c380 with x1830881265232896 ext(2097152->4194303) 00010000:00010000:3.0:1746065211.629051:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 28 pid: 3067 timeout: 907 lvb_type: 1 00010000:00010000:3.0:1746065211.629066:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 28 pid: 3067 timeout: 907 lvb_type: 1 00002000:00010000:3.0:1746065211.629072:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a6c380 00000100:00100000:0.0:1746065211.637745:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.637858:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265233152 00000100:00100000:1.0:1746065211.637866:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265233152 00000100:00100000:1.0:1746065211.637918:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17182 00000100:00100000:1.0:1746065211.637926:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2251:x1830881265233152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065211.637941:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.637956:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e36 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.637976:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.637982:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 53 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.637987:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065211.637990:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.638032:0:13375:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4165632->4194303] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 53 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.638044:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.638060:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7f000, rc 0) 00000100:00100000:1.0:1746065211.638136:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2251:x1830881265233152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 207us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065211.638142:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17182 00000100:00100000:0.0:1746065211.639737:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.639918:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265233280 00000100:00100000:2.0:1746065211.639924:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265233280 00010000:00010000:2.0:1746065211.639953:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 29 pid: 3067 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.640005:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7962 00000100:00100000:2.0:1746065211.640014:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2006:x1830881265233280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.640026:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.640045:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 29 pid: 3067 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.640055:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 29 pid: 3067 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.640074:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478a4d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e1a expref: 29 pid: 3067 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.640112:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.640114:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.640121:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 53 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.640129:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 53 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.640158:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 53 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.640169:0:7192:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 53 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.640180:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263928960:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065211.640956:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065211.645572:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263928960:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065211.645594:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065211.646912:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.647013:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265233536 00000100:00100000:2.0:1746065211.647022:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265233536 00002000:00100000:2.0:1746065211.647063:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (4165632->4169727) req@ffff88013615d500 x1830881265233536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.647072:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615d500 with x1830881265233536 ext(4165632->4169727) 00010000:00010000:2.0:1746065211.647080:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 54 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.647093:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 54 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746065211.647099:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013615d500 00000100:00100000:2.0:1746065211.647124:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1988 00000100:00100000:2.0:1746065211.647132:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881265233536:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065211.647524:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881265233280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7507us (7786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.647532:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7962 00000100:00100000:2.0:1746065211.648189:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881265233536:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 1056us (1279us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065211.648196:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1988 00002000:00100000:2.0:1746065211.648203:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (4165632->4169727) req@ffff88013615d500 x1830881265233536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.648210:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615d500 with x1830881265233536 ext(4165632->4169727) 00010000:00010000:2.0:1746065211.648216:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 54 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.648227:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 54 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746065211.648233:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013615d500 00000100:00100000:2.0:1746065211.674627:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.674687:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.674714:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265233920 00000100:00100000:2.0:1746065211.674721:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265233920 00002000:00100000:2.0:1746065211.674757:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (4165632->4194303) req@ffff88012edae680 x1830881265233920/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.674765:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edae680 with x1830881265233920 ext(4165632->4194303) 00010000:00010000:2.0:1746065211.674789:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 54 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.674802:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 54 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746065211.674809:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012edae680 00000100:00100000:2.0:1746065211.674828:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1989 00000100:00100000:2.0:1746065211.674835:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881265233920:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065211.675076:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265233792 00000100:00100000:3.0:1746065211.675080:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265233792 00000100:00100000:3.0:1746065211.675113:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17183 00000100:00100000:3.0:1746065211.675119:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+21:2258:x1830881265233792:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065211.675128:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.675142:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e3d expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.675161:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478a38 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dfe expref: 22 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.675168:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478a5b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e21 expref: 9 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.675173:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.675175:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.675178:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->3899391] (req 3145728->3899391) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.675200:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478a5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e21 expref: 9 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.675209:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478a5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e21 expref: 9 pid: 11461 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.675218:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263929088:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.677086:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478a38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dfe expref: 22 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.677097:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478a38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dfe expref: 22 pid: 9549 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.677105:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263929216:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065211.677152:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065211.679145:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+56:2007:x1830881265233920:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 4305us (4452us total) trans 17179874251 rc 0/0 00000100:00100000:2.0:1746065211.679154:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1989 00002000:00100000:2.0:1746065211.679162:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (4165632->4194303) req@ffff88012edae680 x1830881265233920/t17179874251(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/448 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.679171:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edae680 with x1830881265233920 ext(4165632->4194303) 00010000:00010000:2.0:1746065211.679178:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 56 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.679194:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 56 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746065211.679200:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012edae680 00000001:00080000:0.0:1746065211.680018:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874251 is committed 00000001:00080000:0.0:1746065211.680030:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874248 is committed 00000001:00080000:0.0:1746065211.680046:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874243 is committed 00000001:00080000:0.0:1746065211.680048:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874244 is committed 00000001:00080000:0.0:1746065211.680058:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874235 is committed 00000100:00100000:3.0:1746065211.681464:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263929088:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065211.681475:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263929216:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.681500:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->3899391] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.681514:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fc00, rc 0) 00000100:00100000:3.0:1746065211.681546:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+22:2258:x1830881265233792:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6427us (6926us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.681553:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17183 00000100:00100000:0.0:1746065211.682208:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.682244:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.682317:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265234048 00000100:00100000:2.0:1746065211.682323:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265234048 00010000:00010000:2.0:1746065211.682345:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478a5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e21 expref: 10 pid: 11461 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.682376:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265234176 00000100:00100000:2.0:1746065211.682379:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265234176 00010000:00010000:2.0:1746065211.682387:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478a38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dfe expref: 22 pid: 9549 timeout: 907 lvb_type: 1 00000100:00100000:2.0:1746065211.682414:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7963 00000100:00100000:2.0:1746065211.682421:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265234048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.682431:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.682446:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478a5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e21 expref: 10 pid: 11461 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.682455:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478a5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e21 expref: 10 pid: 11461 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.682471:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478a5b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e21 expref: 10 pid: 11461 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.682488:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.682510:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265234048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.682515:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7963 00000100:00100000:2.0:1746065211.682525:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7964 00000100:00100000:2.0:1746065211.682529:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881265234176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.682535:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.682541:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478a38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dfe expref: 22 pid: 9549 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.682548:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478a38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dfe expref: 22 pid: 9549 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.682557:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc1478a38 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dfe expref: 22 pid: 9549 timeout: 907 lvb_type: 1 00010000:00010000:2.0:1746065211.682564:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.682565:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.682570:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.682577:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.682596:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 21 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.682606:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263929344:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065211.682651:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065211.684961:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.685000:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265234304 00000100:00100000:2.0:1746065211.685003:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263929344:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065211.685005:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265234304 00010000:00010000:2.0:1746065211.685017:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065211.685025:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 27 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.685041:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881265234176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2511us (2796us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.685044:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7965 00000100:00100000:2.0:1746065211.685048:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7964 00000100:00100000:0.0:1746065211.685049:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881265234304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065211.685057:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065211.685070:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 27 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.685077:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 27 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.685092:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478a85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4165632->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e2f expref: 27 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.685104:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.685106:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065211.685110:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 7 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.685117:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 7 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065211.685138:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 7 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065211.685147:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263929472:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065211.685187:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065211.689999:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.690092:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265234432 00000100:00100000:0.0:1746065211.690100:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265234432 00000100:00100000:3.0:1746065211.690729:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17184 00000100:00100000:3.0:1746065211.690737:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2262:x1830881265234432:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:0.0:1746065211.690843:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263929472:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065211.690859:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.690889:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.690893:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881265234304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5843us (5937us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065211.690901:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7965 00000100:00100000:2.0:1746065211.690930:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265234688 00000100:00100000:2.0:1746065211.690933:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265234688 00002000:00100000:2.0:1746065211.690958:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3895296->3899391) req@ffff88012edad500 x1830881265234688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.690967:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edad500 with x1830881265234688 ext(3895296->3899391) 00002000:00010000:2.0:1746065211.690971:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edad500 00000100:00100000:2.0:1746065211.690981:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6048 00000100:00100000:2.0:1746065211.690986:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265234688:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065211.691082:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265234688:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 94us (192us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065211.691087:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6048 00002000:00100000:2.0:1746065211.691091:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3895296->3899391) req@ffff88012edad500 x1830881265234688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.691097:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edad500 with x1830881265234688 ext(3895296->3899391) 00002000:00010000:2.0:1746065211.691101:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edad500 00010000:00010000:3.0:1746065211.691315:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.691329:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e44 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.691349:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc1478a31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df7 expref: 25 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.691357:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478a46 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e0c expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.691362:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.691364:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.691367:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [2019328->2097151] (req 2019328->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.691387:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478a46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e0c expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.691408:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478a46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e0c expref: 9 pid: 3067 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.691418:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263929600:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.693044:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.693061:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265234944 00000100:00100000:2.0:1746065211.693065:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265234944 00002000:00100000:2.0:1746065211.693086:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012edac700 x1830881265234944/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.693094:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac700 with x1830881265234944 ext(3145728->4194303) 00002000:00010000:2.0:1746065211.693097:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac700 00000100:00100000:2.0:1746065211.693121:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6049 00000100:00100000:2.0:1746065211.693126:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265234944:12345-192.168.202.27@tcp:3:multiop.0 00010000:00010000:3.0:1746065211.693191:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc1478a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df7 expref: 25 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.693203:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc1478a31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df7 expref: 25 pid: 9549 timeout: 907 lvb_type: 1 00000100:00100000:3.0:1746065211.693213:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263929728:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065211.695416:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.699337:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.699369:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.699448:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263929600:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065211.699458:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263929728:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065211.699467:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265235072 00000100:00100000:1.0:1746065211.699472:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265235072 00010000:00010000:3.0:1746065211.699481:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [2019328->2097151] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 12 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.699494:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e800, rc 0) 00010000:00010000:1.0:1746065211.699494:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478a46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e0c expref: 12 pid: 3067 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746065211.699514:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7966 00000100:00100000:1.0:1746065211.699520:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265235072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065211.699525:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2262:x1830881265234432:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8790us (9540us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065211.699529:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065211.699531:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17184 00010000:00010000:1.0:1746065211.699542:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478a46 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e0c expref: 11 pid: 3067 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746065211.699551:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478a46 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e0c expref: 11 pid: 3067 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746065211.699568:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478a46 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e0c expref: 11 pid: 3067 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.699605:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265235328 00000100:00100000:2.0:1746065211.699608:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265235328 00000100:00100000:2.0:1746065211.699633:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5421 00000100:00100000:2.0:1746065211.699637:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2258:x1830881265235328:12345-192.168.202.27@tcp:35:multiop.0 00010000:00010000:1.0:1746065211.699719:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065211.699739:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265235072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 219us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065211.699744:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7966 00000100:00100000:2.0:1746065211.699801:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2258:x1830881265235328:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 162us (430us total) trans 8589936998 rc 0/0 00000100:00100000:2.0:1746065211.699806:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5421 00000100:00100000:0.0:1746065211.701679:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.701727:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265235456 00000100:00100000:1.0:1746065211.701731:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265235456 00010000:00010000:1.0:1746065211.701748:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc1478a31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df7 expref: 26 pid: 9549 timeout: 907 lvb_type: 1 00000100:00100000:1.0:1746065211.701800:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7967 00000100:00100000:1.0:1746065211.701806:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265235456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065211.701815:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065211.701825:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc1478a31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df7 expref: 26 pid: 9549 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746065211.701835:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc1478a31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df7 expref: 26 pid: 9549 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746065211.701849:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72200/0xad6b7ddc1478a31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df7 expref: 26 pid: 9549 timeout: 907 lvb_type: 1 00010000:00010000:1.0:1746065211.701862:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.701864:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.701870:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 8 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.701874:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265234944:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8746us (8832us total) trans 0 rc 1048576/1048576 00010000:00010000:1.0:1746065211.701878:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 8 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.701883:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6049 00002000:00100000:2.0:1746065211.701890:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012edac700 x1830881265234944/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746065211.701902:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 8 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065211.701917:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263929856:192.168.202.27@tcp:105: 00002000:00100000:2.0:1746065211.701944:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac700 with x1830881265234944 ext(3145728->4194303) 00002000:00010000:2.0:1746065211.701948:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac700 00000100:00100000:1.0:1746065211.701964:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23536c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.707705:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.707807:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.707864:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265235840 00000100:00100000:3.0:1746065211.707872:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265235840 00000100:00100000:3.0:1746065211.707905:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17185 00000100:00100000:3.0:1746065211.707911:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2251:x1830881265235840:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065211.707911:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263929856:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065211.707926:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.707927:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065211.707938:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e4b expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065211.707958:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265235456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6152us (6283us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065211.707961:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 20 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065211.707966:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7967 00010000:00010000:3.0:1746065211.707967:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065211.707968:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065211.707971:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.707992:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 20 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.708002:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 20 pid: 3067 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.708013:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263929984:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.708033:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265235712 00000100:00100000:2.0:1746065211.708038:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265235712 00000100:00100000:3.0:1746065211.708048:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00002000:00100000:2.0:1746065211.708061:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x77:0x0] (2019328->2023423) req@ffff88013615d180 x1830881265235712/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.708070:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615d180 with x1830881265235712 ext(2019328->2023423) 00002000:00010000:2.0:1746065211.708074:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013615d180 00000100:00100000:2.0:1746065211.708088:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6050 00000100:00100000:2.0:1746065211.708093:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265235712:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065211.708201:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265235712:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 107us (503us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065211.708206:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6050 00002000:00100000:2.0:1746065211.708211:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x77:0x0] (2019328->2023423) req@ffff88013615d180 x1830881265235712/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.708218:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615d180 with x1830881265235712 ext(2019328->2023423) 00002000:00010000:2.0:1746065211.708220:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013615d180 00000100:00100000:3.0:1746065211.709420:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263929984:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.709436:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.709447:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e000, rc 0) 00000100:00100000:3.0:1746065211.709467:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2251:x1830881265235840:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1556us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.709473:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17185 00000100:00100000:0.0:1746065211.711770:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.711912:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.711986:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265236096 00000100:00100000:2.0:1746065211.711995:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265236096 00002000:00100000:2.0:1746065211.712031:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3899391) req@ffff88013615e300 x1830881265236096/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.712040:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615e300 with x1830881265236096 ext(3145728->3899391) 00010000:00010000:2.0:1746065211.712047:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 21 pid: 3067 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.712059:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 21 pid: 3067 timeout: 907 lvb_type: 0 00002000:00010000:2.0:1746065211.712069:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013615e300 00000100:00100000:2.0:1746065211.712088:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1990 00000100:00100000:2.0:1746065211.712095:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881265236096:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065211.712750:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265235968 00000100:00100000:3.0:1746065211.712756:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265235968 00000100:00100000:3.0:1746065211.712798:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17186 00000100:00100000:3.0:1746065211.712803:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2262:x1830881265235968:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065211.712813:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.712826:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e52 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.712846:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.712852:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.712854:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.712857:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->2801663] (req 2097152->2801663) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.712887:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.712896:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 9 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.712906:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263930112:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065211.712947:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065211.717489:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263930112:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065211.717516:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->2801663] (req 2097152->2801663) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.717531:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f000, rc 0) 00000100:00100000:3.0:1746065211.717563:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2262:x1830881265235968:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4758us (5799us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.717570:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17186 00000100:00100000:2.0:1746065211.719181:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.719543:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265236224 00000100:00100000:1.0:1746065211.719552:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265236224 00010000:00010000:1.0:1746065211.719583:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 9 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:1.0:1746065211.719606:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7968 00000100:00100000:1.0:1746065211.719612:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2006:x1830881265236224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065211.719622:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065211.719636:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 9 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746065211.719645:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 9 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746065211.719663:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012fd7f000/0xad6b7ddc1478a8c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e36 expref: 9 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746065211.719682:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.719685:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065211.719690:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 8 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.719698:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 8 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065211.719721:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 8 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065211.719731:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263930240:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065211.719792:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23536c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.724984:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265236096:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 12879us (13062us total) trans 21474841649 rc 0/0 00000100:00100000:0.0:1746065211.724995:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1990 00002000:00100000:0.0:1746065211.725006:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3899391) req@ffff88013615e300 x1830881265236096/t21474841649(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/448 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.725016:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615e300 with x1830881265236096 ext(3145728->3899391) 00010000:00010000:0.0:1746065211.725024:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 23 pid: 3067 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.725038:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 23 pid: 3067 timeout: 907 lvb_type: 0 00002000:00010000:0.0:1746065211.725044:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013615e300 00000100:00100000:1.0:1746065211.725595:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263930240:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065211.725613:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065211.726598:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2006:x1830881265236224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6982us (7418us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065211.726608:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7968 00000100:00100000:1.0:1746065211.728888:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.728965:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265236352 00000100:00100000:2.0:1746065211.728973:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265236352 00010000:00010000:2.0:1746065211.729001:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 23 pid: 3067 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.729034:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7969 00000100:00100000:2.0:1746065211.729041:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265236352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.729052:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065211.729065:0:7190:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065209 -> 1746065211 00002000:00010000:2.0:1746065211.729068:0:7190:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065209 -> 1746065211 00010000:00010000:2.0:1746065211.729073:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 23 pid: 3067 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.729083:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 23 pid: 3067 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.729103:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1478a93 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3899391) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e3d expref: 23 pid: 3067 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.729131:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.729134:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065211.729140:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.729147:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.729177:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065211.729188:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263930368:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065211.729259:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065211.729383:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.729482:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265236608 00000100:00100000:0.0:1746065211.729487:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265236608 00002000:00100000:0.0:1746065211.729510:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2797568->2801663) req@ffff880099e11500 x1830881265236608/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.729517:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11500 with x1830881265236608 ext(2797568->2801663) 00002000:00010000:0.0:1746065211.729521:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e11500 00000100:00100000:0.0:1746065211.729535:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6051 00000100:00100000:0.0:1746065211.729540:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265236608:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065211.729789:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265236608:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 233us (391us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065211.729795:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6051 00002000:00100000:0.0:1746065211.729801:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2797568->2801663) req@ffff880099e11500 x1830881265236608/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/4536 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.729808:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11500 with x1830881265236608 ext(2797568->2801663) 00002000:00010000:0.0:1746065211.729811:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e11500 00000100:00100000:2.0:1746065211.731098:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263930368:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065211.731110:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.732170:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881265236352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3127us (3285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.732179:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7969 00000100:00100000:0.0:1746065211.732838:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.733014:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265236864 00000100:00100000:2.0:1746065211.733019:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265236864 00002000:00100000:2.0:1746065211.733046:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88013615dc00 x1830881265236864/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.733054:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615dc00 with x1830881265236864 ext(3145728->4194303) 00002000:00010000:2.0:1746065211.733058:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615dc00 00000100:00100000:2.0:1746065211.733623:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6052 00000100:00100000:2.0:1746065211.733629:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265236864:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065211.735146:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.735244:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265237120 00000100:00100000:3.0:1746065211.735249:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265237120 00000100:00100000:3.0:1746065211.735279:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5422 00000100:00100000:3.0:1746065211.735283:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2262:x1830881265237120:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065211.735451:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b26450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2262:x1830881265237120:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 167us (308us total) trans 8589936999 rc 0/0 00000100:00100000:3.0:1746065211.735458:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5422 00000100:00100000:2.0:1746065211.743434:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265236864:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9796us (10588us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065211.743446:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6052 00002000:00100000:2.0:1746065211.743455:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88013615dc00 x1830881265236864/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.743464:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615dc00 with x1830881265236864 ext(3145728->4194303) 00002000:00010000:2.0:1746065211.743469:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615dc00 00000100:00100000:0.0:1746065211.743585:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.743642:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265237376 00000100:00100000:2.0:1746065211.743648:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265237376 00000100:00100000:2.0:1746065211.743680:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14512 00000100:00100000:2.0:1746065211.743686:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2267:x1830881265237376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065211.743704:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.743719:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc1478aaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e59 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.743798:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1478ab6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.743810:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1478ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.743818:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1478ab6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.743828:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4200/0xad6b7ddc1478abd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.743833:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4200/0xad6b7ddc1478abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.743838:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4200/0xad6b7ddc1478abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744248:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc1478ac4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744259:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc1478ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744265:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc1478ac4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065211.744274:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065211.744339:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1478ab6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744344:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1478ab6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744349:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1478ab6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744354:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1478ab6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744359:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065211.744363:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1478ab6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744368:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1478ab6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744377:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065211.744380:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065211.744383:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1478ab6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744390:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1478ab6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744426:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4200/0xad6b7ddc1478abd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744431:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4200/0xad6b7ddc1478abd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744435:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4200/0xad6b7ddc1478abd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744440:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065211.744442:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4200/0xad6b7ddc1478abd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744446:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4200/0xad6b7ddc1478abd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744453:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097b72a00) 00010000:00010000:2.0:1746065211.744455:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065211.744456:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4200/0xad6b7ddc1478abd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744460:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4200/0xad6b7ddc1478abd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.744490:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4a00/0xad6b7ddc1478aaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e59 expref: 39 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.744500:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc1478ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e59 expref: 38 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.744510:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065211.744512:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065211.744514:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5800, rc 0) 00000100:00100000:2.0:1746065211.745089:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2267:x1830881265237376:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1399us (1501us total) trans 8589937000 rc 0/0 00000100:00100000:2.0:1746065211.745097:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14512 00000100:00100000:0.0:1746065211.750207:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.750248:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.750388:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265237632 00000100:00100000:2.0:1746065211.750405:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265237632 00002000:00100000:2.0:1746065211.750442:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88013615c700 x1830881265237632/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.750452:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615c700 with x1830881265237632 ext(4194304->4898815) 00002000:00010000:2.0:1746065211.750457:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013615c700 00000100:00100000:2.0:1746065211.750486:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6053 00000100:00100000:2.0:1746065211.750493:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265237632:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065211.751818:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265237760 00000100:00100000:3.0:1746065211.751825:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265237760 00000100:00100000:3.0:1746065211.751859:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17187 00000100:00100000:3.0:1746065211.751865:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265237760:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065211.751880:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.751893:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552f600/0xad6b7ddc1478ad2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e60 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.751933:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263930496:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065211.752317:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065211.752365:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.753423:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.754378:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265237888 00000100:00100000:1.0:1746065211.754384:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265237888 00000100:00100000:1.0:1746065211.754440:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265238016 00000100:00100000:1.0:1746065211.754443:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265238016 00000100:00100000:1.0:1746065211.754470:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17188 00000100:00100000:1.0:1746065211.754477:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881265237888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065211.754491:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065211.754503:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c488600/0xad6b7ddc1478ad9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e67 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065211.754545:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263930624:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065211.754961:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17189 00000100:00100000:3.0:1746065211.754972:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881265238016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065211.754979:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.754987:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478ae0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e6e expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.754999:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.755000:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.755006:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478ae0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e6e expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.755018:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478ae0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e6e expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.755026:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e600, rc 0) 00000100:00100000:3.0:1746065211.755044:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265238016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 77us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.755050:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17189 00000100:00100000:1.0:1746065211.758449:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23536c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746065211.760647:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065206 -> 1746065211 00000100:00100000:3.0:1746065211.760673:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263930496:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065211.760700:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552f600/0xad6b7ddc1478ad2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e60 expref: 28 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.760713:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552f600/0xad6b7ddc1478ad2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e60 expref: 28 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065211.760729:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f600, rc 0) 00000100:00100000:3.0:1746065211.760790:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881265237760:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8924us (10540us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065211.760798:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17187 00000100:00100000:0.0:1746065211.762174:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265237632:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11678us (11971us total) trans 0 rc 704512/704512 00000100:00100000:0.0:1746065211.762182:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6053 00002000:00100000:0.0:1746065211.762190:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff88013615c700 x1830881265237632/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.762199:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615c700 with x1830881265237632 ext(4194304->4898815) 00002000:00010000:0.0:1746065211.762203:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013615c700 00000100:00100000:0.0:1746065211.764815:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263930624:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065211.764844:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c488600/0xad6b7ddc1478ad9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e67 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.764857:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c488600/0xad6b7ddc1478ad9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e67 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065211.764875:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488600, rc 0) 00000100:00100000:0.0:1746065211.764923:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265237888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10445us (12556us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065211.765002:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17188 00000100:00100000:1.0:1746065211.780815:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.780852:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.780866:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.780884:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265238528 00000100:00100000:1.0:1746065211.780890:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265238528 00002000:00100000:1.0:1746065211.780927:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff8800996faa00 x1830881265238528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.780935:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996faa00 with x1830881265238528 ext(0->1048575) 00002000:00010000:1.0:1746065211.780940:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996faa00 00000100:00100000:1.0:1746065211.780953:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265238784 00000100:00100000:1.0:1746065211.780955:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265238784 00002000:00100000:1.0:1746065211.780966:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800996f8a80 x1830881265238784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.780973:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f8a80 with x1830881265238784 ext(1048576->2097151) 00002000:00010000:1.0:1746065211.780975:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f8a80 00000100:00100000:1.0:1746065211.780996:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6054 00000100:00100000:1.0:1746065211.781002:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265238528:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065211.781750:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6055 00000100:00100000:0.0:1746065211.781757:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265238784:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065211.782327:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.782636:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265238272 00000100:00100000:3.0:1746065211.782642:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265238272 00000100:00100000:3.0:1746065211.782670:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5423 00000100:00100000:3.0:1746065211.782675:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2251:x1830881265238272:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065211.782839:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2251:x1830881265238272:12345-192.168.202.27@tcp:35:cat.0 Request processed in 162us (2029us total) trans 8589937001 rc 0/0 00000100:00100000:3.0:1746065211.782845:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5423 00000100:00100000:0.0:1746065211.783289:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265239040 00000100:00100000:0.0:1746065211.783293:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265239040 00002000:00100000:0.0:1746065211.783312:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88013615e680 x1830881265239040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.783320:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615e680 with x1830881265239040 ext(1048576->2097151) 00002000:00010000:0.0:1746065211.783325:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615e680 00000100:00100000:0.0:1746065211.783336:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6056 00000100:00100000:0.0:1746065211.783352:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265239040:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065211.804002:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265238784:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22238us (23126us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065211.804011:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6055 00002000:00100000:2.0:1746065211.804020:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800996f8a80 x1830881265238784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.804028:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f8a80 with x1830881265238784 ext(1048576->2097151) 00002000:00010000:2.0:1746065211.804034:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f8a80 00000100:00100000:2.0:1746065211.809898:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265239040:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26547us (27562us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065211.809911:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6056 00002000:00100000:2.0:1746065211.809921:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88013615e680 x1830881265239040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.809930:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615e680 with x1830881265239040 ext(1048576->2097151) 00002000:00010000:2.0:1746065211.809935:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615e680 00000100:00100000:1.0:1746065211.814054:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265238528:12345-192.168.202.27@tcp:3:cat.0 Request processed in 33044us (33193us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065211.814065:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6054 00002000:00100000:1.0:1746065211.814075:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff8800996faa00 x1830881265238528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.814084:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996faa00 with x1830881265238528 ext(0->1048575) 00002000:00010000:1.0:1746065211.814088:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996faa00 00000100:00100000:0.0:1746065211.824593:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.824690:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265239168 00000100:00100000:2.0:1746065211.824697:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265239168 00000100:00100000:2.0:1746065211.824749:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17190 00000100:00100000:2.0:1746065211.824756:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+25:2267:x1830881265239168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065211.824839:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.824855:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e75 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.824880:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 7 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.824886:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065211.824888:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065211.824890:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.824914:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 7 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.824923:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 7 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.824938:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263930752:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.825244:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065211.827057:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263930752:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065211.827083:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.827102:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d9200, rc 0) 00000100:00100000:2.0:1746065211.827142:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2267:x1830881265239168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2385us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.827149:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17190 00000100:00100000:0.0:1746065211.827332:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.827430:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265239296 00000100:00100000:1.0:1746065211.827436:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265239296 00002000:00100000:1.0:1746065211.827467:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (2019328->2097151) req@ffff880091aa4e00 x1830881265239296/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.827475:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa4e00 with x1830881265239296 ext(2019328->2097151) 00010000:00010000:1.0:1746065211.827482:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 8 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746065211.827492:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 8 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:1.0:1746065211.827498:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091aa4e00 00000100:00100000:1.0:1746065211.827739:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1991 00000100:00100000:1.0:1746065211.827746:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265239296:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065211.829575:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265239296:12345-192.168.202.27@tcp:4:cat.0 Request processed in 1823us (2238us total) trans 17179874252 rc 0/0 00000100:00100000:1.0:1746065211.829583:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1991 00002000:00100000:1.0:1746065211.829590:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (2019328->2097151) req@ffff880091aa4e00 x1830881265239296/t17179874252(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/448 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.829604:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa4e00 with x1830881265239296 ext(2019328->2097151) 00010000:00010000:1.0:1746065211.829616:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 10 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746065211.829627:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 10 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:1.0:1746065211.829632:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091aa4e00 00000100:00100000:0.0:1746065211.830631:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.830678:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265239424 00000100:00100000:2.0:1746065211.830683:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265239424 00010000:00010000:2.0:1746065211.830703:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 10 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.830755:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7970 00000100:00100000:3.0:1746065211.830764:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265239424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.830800:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.830814:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 10 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.830851:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 10 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.830869:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552e800/0xad6b7ddc1478a9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2019328->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e44 expref: 10 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.830884:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.830886:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.830891:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 25 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.830898:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 25 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.830963:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 25 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.830974:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263930880:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065211.831088:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065211.833361:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263930880:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065211.833377:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.833424:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2006:x1830881265239424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2660us (2792us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.833432:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7970 00000100:00100000:0.0:1746065211.834567:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.834800:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265239680 00000100:00100000:1.0:1746065211.834806:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265239680 00002000:00100000:1.0:1746065211.834836:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880091aa4700 x1830881265239680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.834844:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa4700 with x1830881265239680 ext(1048576->2097151) 00002000:00010000:1.0:1746065211.834848:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa4700 00000100:00100000:1.0:1746065211.834875:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6057 00000100:00100000:1.0:1746065211.834881:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265239680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065211.842567:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265239680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7677us (7993us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065211.842578:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6057 00002000:00100000:1.0:1746065211.842589:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880091aa4700 x1830881265239680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.842598:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa4700 with x1830881265239680 ext(1048576->2097151) 00002000:00010000:1.0:1746065211.842604:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa4700 00000100:00100000:0.0:1746065211.849282:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.849378:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265239808 00000100:00100000:2.0:1746065211.849386:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265239808 00000100:00100000:2.0:1746065211.849443:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17191 00000100:00100000:2.0:1746065211.849450:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2267:x1830881265239808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065211.849465:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.849479:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e7c expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.849502:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 8 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.849513:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065211.849515:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065211.849518:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.849540:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 8 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.849549:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 8 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.849560:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263931008:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.849982:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065211.851980:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263931008:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065211.852003:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.852016:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167800, rc 0) 00000100:00100000:2.0:1746065211.852055:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+27:2267:x1830881265239808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2605us (2782us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.852063:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17191 00000100:00100000:0.0:1746065211.852940:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065211.852989:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265239936 00000100:00100000:1.0:1746065211.852996:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265239936 00002000:00100000:1.0:1746065211.853025:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2801663) req@ffff880091aa7480 x1830881265239936/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065211.853035:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa7480 with x1830881265239936 ext(2097152->2801663) 00010000:00010000:1.0:1746065211.853041:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 9 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:1.0:1746065211.853053:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 9 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:1.0:1746065211.853059:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091aa7480 00000100:00100000:1.0:1746065211.853575:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1992 00000100:00100000:1.0:1746065211.853582:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265239936:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065211.866439:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265239936:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12850us (13493us total) trans 17179874253 rc 0/0 00000100:00100000:0.0:1746065211.866450:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1992 00002000:00100000:0.0:1746065211.866461:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2801663) req@ffff880091aa7480 x1830881265239936/t17179874253(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:127/0 lens 488/448 e 0 to 0 dl 1746065222 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.866470:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa7480 with x1830881265239936 ext(2097152->2801663) 00010000:00010000:0.0:1746065211.866480:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 11 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.866494:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 11 pid: 13375 timeout: 907 lvb_type: 0 00002000:00010000:0.0:1746065211.866505:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091aa7480 00000100:00100000:0.0:1746065211.872294:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.872498:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265240064 00000100:00100000:3.0:1746065211.872507:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265240064 00010000:00010000:3.0:1746065211.872537:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 11 pid: 13375 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.872576:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7971 00000100:00100000:3.0:1746065211.872583:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265240064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065211.872595:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065211.872614:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 11 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.872626:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 11 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.872646:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552f000/0xad6b7ddc1478aa8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2801663) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e52 expref: 11 pid: 13375 timeout: 907 lvb_type: 0 00010000:00010000:3.0:1746065211.872671:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.872674:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065211.872680:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.872687:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.872716:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 26 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065211.872728:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263931136:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065211.872836:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065211.875645:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263931136:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065211.875666:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065211.875700:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265240064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3117us (3414us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.875710:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7971 00000100:00100000:0.0:1746065211.880962:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.881589:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.881657:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265240320 00000100:00100000:2.0:1746065211.881664:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265240320 00002000:00100000:2.0:1746065211.881880:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880091aa6d80 x1830881265240320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.881893:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6d80 with x1830881265240320 ext(2097152->4194303) 00002000:00010000:2.0:1746065211.881898:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa6d80 00000100:00100000:2.0:1746065211.881916:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265240576 00000100:00100000:2.0:1746065211.881918:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265240576 00000100:00100000:0.0:1746065211.881963:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6058 00000100:00100000:0.0:1746065211.881971:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265240320:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:2.0:1746065211.882266:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091aa7800 x1830881265240576/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.882273:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa7800 with x1830881265240576 ext(2097152->4194303) 00002000:00010000:2.0:1746065211.882277:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091aa7800 00000100:00100000:2.0:1746065211.882291:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6059 00000100:00100000:2.0:1746065211.882297:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265240576:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065211.898966:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265240320:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16987us (18001us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065211.898977:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6058 00002000:00100000:2.0:1746065211.898987:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880091aa6d80 x1830881265240320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.898996:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6d80 with x1830881265240320 ext(2097152->4194303) 00002000:00010000:2.0:1746065211.899001:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa6d80 00000100:00100000:0.0:1746065211.905248:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265240576:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22943us (23651us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065211.905260:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6059 00002000:00100000:0.0:1746065211.905271:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091aa7800 x1830881265240576/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065211.905280:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa7800 with x1830881265240576 ext(2097152->4194303) 00002000:00010000:0.0:1746065211.905285:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091aa7800 00000100:00100000:0.0:1746065211.913166:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.913259:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265240832 00000100:00100000:2.0:1746065211.913267:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265240832 00002000:00100000:2.0:1746065211.913307:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff880091aa6300 x1830881265240832/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/0 e 0 to 0 dl 1746065222 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.913316:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6300 with x1830881265240832 ext(4194304->4898815) 00002000:00010000:2.0:1746065211.913321:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa6300 00000100:00100000:2.0:1746065211.913340:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6060 00000100:00100000:2.0:1746065211.913346:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881265240832:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065211.922683:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881265240832:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9328us (9517us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746065211.922694:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6060 00002000:00100000:2.0:1746065211.922704:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff880091aa6300 x1830881265240832/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:127/0 lens 488/440 e 0 to 0 dl 1746065222 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065211.922714:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6300 with x1830881265240832 ext(4194304->4898815) 00002000:00010000:2.0:1746065211.922719:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa6300 00000100:00100000:0.0:1746065211.928236:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.928350:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265241088 00000100:00100000:3.0:1746065211.928359:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265241088 00000100:00100000:3.0:1746065211.928443:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5424 00000100:00100000:3.0:1746065211.928451:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2267:x1830881265241088:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065211.929153:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2267:x1830881265241088:12345-192.168.202.27@tcp:35:cat.0 Request processed in 701us (922us total) trans 8589937002 rc 0/0 00000100:00100000:3.0:1746065211.929159:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5424 00000100:00100000:0.0:1746065211.930658:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.930753:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265241344 00000100:00100000:2.0:1746065211.930759:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265241344 00000100:00100000:2.0:1746065211.930813:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14513 00000100:00100000:2.0:1746065211.930820:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2270:x1830881265241344:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065211.930833:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065211.930847:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478af5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e83 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.931472:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.931486:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478a77 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e28 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.931492:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc1478ac4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e59 expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.931497:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 5/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.931523:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc1478ac4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e59 expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.931533:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc1478ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e59 expref: 40 pid: 7205 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.931543:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263931264:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065211.931712:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478a77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e28 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.931719:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478a77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e28 expref: 20 pid: 7205 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.931725:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263931392:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.932010:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065211.933294:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.933359:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065211.933401:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265241472 00000100:00100000:0.0:1746065211.933407:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265241472 00010000:00010000:0.0:1746065211.933430:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc1478ac4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e59 expref: 41 pid: 7205 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746065211.933449:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265241600 00000100:00100000:0.0:1746065211.933451:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265241600 00010000:00010000:0.0:1746065211.933459:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478a77 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e28 expref: 21 pid: 7205 timeout: 907 lvb_type: 0 00000100:00100000:0.0:1746065211.933471:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7972 00000100:00100000:0.0:1746065211.933482:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265241472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065211.933489:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065211.933493:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc1478ac4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e59 expref: 41 pid: 7205 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.933500:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc1478ac4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e59 expref: 41 pid: 7205 timeout: 907 lvb_type: 0 00000100:00100000:2.0:1746065211.933506:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7973 00000100:00100000:2.0:1746065211.933512:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265241600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.933520:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065211.933521:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065211.933525:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478a77 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e28 expref: 21 pid: 7205 timeout: 907 lvb_type: 0 00010000:00010000:0.0:1746065211.933525:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.933532:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065211.933537:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065211.933540:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478a77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e28 expref: 21 pid: 7205 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.933551:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065211.933554:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065211.933560:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.933563:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc1478ac4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e59 expref: 41 pid: 7205 timeout: 907 lvb_type: 0 00010000:00010000:2.0:1746065211.933565:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065211.933571:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265241472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065211.933574:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263931264:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065211.933577:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065211.933582:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc1478a77 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e28 expref: 21 pid: 7205 timeout: 907 lvb_type: 0 00000100:00100000:3.0:1746065211.933590:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263931392:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065211.933597:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265241600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.933602:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7973 00010000:00010000:3.0:1746065211.933603:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.933609:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.933617:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065211.933629:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065211.933900:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478af5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e83 expref: 42 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.933910:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e83 expref: 41 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.933916:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065211.933918:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065211.933920:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167c00, rc 0) 00000100:00100000:3.0:1746065211.933944:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2270:x1830881265241344:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3125us (3290us total) trans 8589937003 rc 0/0 00000100:00100000:3.0:1746065211.933949:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14513 00000100:00100000:0.0:1746065211.934198:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7972 00000100:00100000:0.0:1746065211.977570:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065211.977752:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265241856 00000100:00100000:3.0:1746065211.977760:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265241856 00000100:00100000:3.0:1746065211.977825:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14514 00000100:00100000:3.0:1746065211.977832:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2273:x1830881265241856:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065211.977852:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065211.977868:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e8a expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.977929:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.977938:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.977948:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.977960:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.977965:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.977976:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978052:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc1478b1f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978061:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc1478b1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978067:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc1478b1f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065211.978075:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065211.978132:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b11 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978138:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b11 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978143:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978147:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978152:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065211.978155:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978160:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b11 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978168:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065211.978170:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065211.978173:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b11 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978177:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978206:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978210:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978214:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978217:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065211.978219:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978223:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978228:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ef2aa00) 00010000:00010000:3.0:1746065211.978230:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065211.978232:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978240:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065211.978275:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e8a expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.978286:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc1478b1f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e8a expref: 22 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065211.978292:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065211.978294:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065211.978296:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167e00, rc 0) 00000100:00100000:3.0:1746065211.979130:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2273:x1830881265241856:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1296us (1566us total) trans 8589937004 rc 0/0 00000100:00100000:3.0:1746065211.979137:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14514 00000100:00100000:0.0:1746065211.992211:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065211.992305:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265241984 00000100:00100000:2.0:1746065211.992313:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265241984 00000100:00100000:2.0:1746065211.992356:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 843 00000100:00100000:2.0:1746065211.992363:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265241984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065211.992374:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065211.992423:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc1478b1f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e8a expref: 22 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065211.993300:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065211.993306:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065211.993349:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265241984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 985us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065211.993356:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 843 00000100:00100000:0.0:1746065212.018653:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.018745:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265242112 00000100:00100000:2.0:1746065212.018753:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265242112 00000100:00100000:2.0:1746065212.018818:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17192 00000100:00100000:2.0:1746065212.018826:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2273:x1830881265242112:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065212.018845:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.018860:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e91 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.018886:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.018893:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478a2a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de9 expref: 22 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.018898:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.018900:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.018903:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 5/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1953792->2097151] (req 1953792->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.019118:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478a2a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de9 expref: 22 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.019129:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478a2a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de9 expref: 22 pid: 3067 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.019140:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263931520:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.019435:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.019443:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 11 pid: 11461 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.019455:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263931648:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.019474:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.028860:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.028956:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265242368 00000100:00100000:3.0:1746065212.028963:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265242368 00000100:00100000:3.0:1746065212.029017:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14515 00000100:00100000:3.0:1746065212.029025:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2276:x1830881265242368:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065212.029045:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.029060:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e98 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.029128:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b3b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029138:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029151:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b3b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029162:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b42 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029167:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029172:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029251:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc1478b49 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029260:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc1478b49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029266:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc1478b49 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065212.029275:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065212.029335:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b3b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029341:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b3b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029345:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b3b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029350:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029355:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.029359:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b3b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029364:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b3b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029373:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065212.029376:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.029379:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b3b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.029383:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1478b3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065212.029544:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.029616:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.029645:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265242496 00000100:00100000:0.0:1746065212.029648:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265242496 00010000:00010000:0.0:1746065212.029666:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478a2a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de9 expref: 23 pid: 3067 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746065212.029691:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265242624 00000100:00100000:0.0:1746065212.029693:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265242624 00010000:00010000:0.0:1746065212.029703:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 12 pid: 11461 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746065212.029717:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7974 00000100:00100000:0.0:1746065212.029721:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265242496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.029730:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065212.029747:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478a2a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de9 expref: 23 pid: 3067 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.029757:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478a2a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de9 expref: 23 pid: 3067 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.029794:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065212.029829:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265242496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065212.029835:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7974 00000100:00100000:0.0:1746065212.029848:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7975 00000100:00100000:0.0:1746065212.029853:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265242624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.029860:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065212.029867:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 12 pid: 11461 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.029876:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 12 pid: 11461 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.029886:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.029888:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.029893:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.029900:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.029922:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065212.029933:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263931776:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065212.029978:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00010000:00010000:2.0:1746065212.030094:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478a2a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de9 expref: 22 pid: 3067 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.030107:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263931520:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.030116:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc1478a07 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938dd4 expref: 12 pid: 11461 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.030123:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263931648:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.030143:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.030151:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25400, rc 0) 00000100:00100000:2.0:1746065212.030172:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2273:x1830881265242112:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11348us (11527us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.030179:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17192 00010000:00010000:3.0:1746065212.031006:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b42 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.031014:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b42 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.031018:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.031022:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.031025:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b42 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.031029:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b42 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.031038:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ef2a400) 00010000:00010000:3.0:1746065212.031040:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.031042:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b42 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.031049:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b42 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.031083:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1478b34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e98 expref: 24 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.031091:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc1478b49 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e98 expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.031096:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065212.031097:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065212.031099:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71be00, rc 0) 00000100:00100000:3.0:1746065212.031123:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2276:x1830881265242368:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2100us (2270us total) trans 8589937005 rc 0/0 00000100:00100000:3.0:1746065212.031128:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14515 00000100:00100000:2.0:1746065212.039209:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263931776:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065212.039229:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065212.039275:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265242624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9420us (9657us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.039285:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7975 00000100:00100000:0.0:1746065212.039410:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.039485:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265242752 00000100:00100000:2.0:1746065212.039491:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265242752 00000100:00100000:2.0:1746065212.039523:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 844 00000100:00100000:2.0:1746065212.039528:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265242752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065212.039538:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065212.039558:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc1478b49 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e98 expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.039573:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065212.039577:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065212.039592:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265242752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 64us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.039597:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 844 00000100:00100000:2.0:1746065212.042859:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.042933:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265243008 00000100:00100000:3.0:1746065212.042941:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265243008 00002000:00100000:3.0:1746065212.042975:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1953792->1957887) req@ffff880099bd7800 x1830881265243008/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.042984:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7800 with x1830881265243008 ext(1953792->1957887) 00002000:00010000:3.0:1746065212.042989:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd7800 00000100:00100000:3.0:1746065212.043006:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6061 00000100:00100000:3.0:1746065212.043012:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265243008:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065212.043117:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265243008:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 104us (265us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065212.043122:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6061 00002000:00100000:3.0:1746065212.043128:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1953792->1957887) req@ffff880099bd7800 x1830881265243008/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/4536 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.043134:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7800 with x1830881265243008 ext(1953792->1957887) 00002000:00010000:3.0:1746065212.043137:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd7800 00000100:00100000:1.0:1746065212.047922:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.048048:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.048368:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265243136 00000100:00100000:2.0:1746065212.048376:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265243136 00000100:00100000:2.0:1746065212.048520:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265243264 00000100:00100000:2.0:1746065212.048523:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265243264 00000100:00100000:3.0:1746065212.048559:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17193 00000100:00100000:3.0:1746065212.048568:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265243136:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065212.048582:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.048598:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b57 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938e9f expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.048616:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.048618:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.048625:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e9f expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.048639:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e9f expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.048648:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71aa00, rc 0) 00000100:00100000:3.0:1746065212.048685:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265243136:12345-192.168.202.27@tcp:101:cat.0 Request processed in 119us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.048690:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17193 00000100:00100000:3.0:1746065212.048705:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17194 00000100:00100000:3.0:1746065212.048710:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265243264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065212.048715:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.048720:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1478b5e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ea6 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.048730:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.048731:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.048735:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1478b5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ea6 expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.048743:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1478b5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ea6 expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.048749:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71be00, rc 0) 00000100:00100000:3.0:1746065212.048761:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265243264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.048765:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17194 00000100:00100000:0.0:1746065212.049625:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.049697:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265243392 00000100:00100000:3.0:1746065212.049700:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265243392 00000100:00100000:3.0:1746065212.049735:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14516 00000100:00100000:3.0:1746065212.049740:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2277:x1830881265243392:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065212.049752:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.049762:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc1478b65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ead expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.049924:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478b6c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.049935:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478b6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.049944:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478b6c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.049958:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478b73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.049963:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478b73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.049967:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478b73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.050022:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.050032:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e83 expref: 39 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.050036:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.050058:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e83 expref: 39 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.050068:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e83 expref: 39 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.050078:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263931904:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.050592:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.053538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.054363:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265243520 00000100:00100000:2.0:1746065212.054375:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265243520 00000100:00100000:2.0:1746065212.054423:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17195 00000100:00100000:2.0:1746065212.054429:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2273:x1830881265243520:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065212.054448:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.054461:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938eb4 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.054485:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc1478a23 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df0 expref: 21 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065212.054496:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263931904:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.054499:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478a3f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e05 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.054505:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.054507:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.054511:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->1265663] (req 1048576->1265663) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.054514:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.054536:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478a3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e05 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.054546:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478a3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e05 expref: 11 pid: 11461 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.054556:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263932032:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065212.054591:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065212.054634:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc1478a23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df0 expref: 21 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.054642:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc1478a23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df0 expref: 21 pid: 3067 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.054650:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263932160:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.054669:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.054917:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265243648 00000100:00100000:0.0:1746065212.054921:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265243648 00010000:00010000:0.0:1746065212.054938:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e83 expref: 40 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746065212.054967:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7976 00000100:00100000:0.0:1746065212.054972:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881265243648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.054981:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065212.054985:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e83 expref: 40 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.054993:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e83 expref: 40 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.055008:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167c00/0xad6b7ddc1478afc lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e83 expref: 40 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.055030:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065212.055034:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.055042:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.055048:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.055060:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065212.055079:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881265243648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065212.055084:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7976 00010000:00010000:3.0:1746065212.055231:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055237:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065212.055278:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065212.055281:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065212.055296:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055303:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055312:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478b6c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055493:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478b6c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055498:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478b6c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055503:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478b6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055509:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.055512:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478b6c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055517:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478b6c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055525:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065212.055528:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.055530:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478b6c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055534:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5800/0xad6b7ddc1478b6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055547:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478b73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055550:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478b73 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055554:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478b73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055558:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090de5200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.055560:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478b73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055564:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478b73 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.055570:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ef2a000) 00010000:00010000:3.0:1746065212.057067:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.057073:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478b73 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.057078:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc1478b73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.057111:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167e00/0xad6b7ddc1478b65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ead expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.057121:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ead expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.057127:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065212.057129:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065212.057131:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4200, rc 0) 00000100:00100000:3.0:1746065212.057492:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2277:x1830881265243392:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7750us (7868us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.057498:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14516 00000100:00100000:0.0:1746065212.057815:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.057828:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.057861:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.057894:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265244160 00000100:00100000:3.0:1746065212.057899:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265244160 00002000:00100000:3.0:1746065212.057924:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1953791) req@ffff880091b67800 x1830881265244160/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.057932:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67800 with x1830881265244160 ext(1048576->1953791) 00002000:00010000:3.0:1746065212.057935:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b67800 00000100:00100000:3.0:1746065212.057951:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265244032 00000100:00100000:3.0:1746065212.057953:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265244032 00002000:00100000:3.0:1746065212.057962:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880091b64700 x1830881265244032/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.057968:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64700 with x1830881265244032 ext(0->1048575) 00002000:00010000:3.0:1746065212.057970:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b64700 00000100:00100000:3.0:1746065212.057979:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6062 00000100:00100000:3.0:1746065212.057984:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265244160:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065212.058504:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6063 00000100:00100000:1.0:1746065212.058512:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265244032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065212.058586:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263932032:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.058594:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263932160:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.058618:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->1265663] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 13 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.058629:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af08000, rc 0) 00000100:00100000:2.0:1746065212.058655:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2273:x1830881265243520:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4226us (5124us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.058661:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17195 00000100:00100000:0.0:1746065212.058849:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.058863:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265244288 00000100:00100000:0.0:1746065212.058866:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265244288 00010000:00010000:0.0:1746065212.058880:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478a3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e05 expref: 13 pid: 11461 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746065212.058894:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265244416 00000100:00100000:0.0:1746065212.058895:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265244416 00010000:00010000:0.0:1746065212.058903:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc1478a23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df0 expref: 22 pid: 3067 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746065212.058912:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7977 00000100:00100000:0.0:1746065212.058916:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265244288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.058924:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065212.058936:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478a3f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e05 expref: 13 pid: 11461 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.058944:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478a3f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e05 expref: 13 pid: 11461 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.058960:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552e400/0xad6b7ddc1478a3f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e05 expref: 13 pid: 11461 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.058970:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065212.058988:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265244288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065212.058993:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7977 00000100:00100000:0.0:1746065212.059004:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7978 00000100:00100000:0.0:1746065212.059008:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881265244416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.059014:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065212.059020:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc1478a23 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df0 expref: 22 pid: 3067 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.059028:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc1478a23 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df0 expref: 22 pid: 3067 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.059038:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61c00/0xad6b7ddc1478a23 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938df0 expref: 22 pid: 3067 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.059046:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.059048:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.059053:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.059059:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.059078:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065212.059088:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263932288:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065212.059121:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.065237:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.065730:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.066065:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.068446:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263932288:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065212.068465:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065212.068508:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265244416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9499us (9659us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065212.068516:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7978 00000100:00100000:1.0:1746065212.068634:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.068954:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265244544 00000100:00100000:2.0:1746065212.068961:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265244544 00000100:00100000:3.0:1746065212.069006:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265244672 00000100:00100000:3.0:1746065212.069010:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265244672 00000100:00100000:3.0:1746065212.069026:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265244800 00000100:00100000:3.0:1746065212.069028:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265244800 00000100:00100000:3.0:1746065212.069044:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17196 00000100:00100000:3.0:1746065212.069050:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265244544:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065212.069105:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265244928 00000100:00100000:2.0:1746065212.069108:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265244928 00000100:00100000:2.0:1746065212.069131:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17197 00000100:00100000:2.0:1746065212.069135:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265244800:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065212.069144:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065212.069154:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17198 00010000:00010000:2.0:1746065212.069159:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9000/0xad6b7ddc1478b88 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ec9 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.069161:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265244928:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065212.069169:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065212.069178:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac30800/0xad6b7ddc1478b8f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ed0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.069193:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.069195:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065212.069197:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263932416:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065212.069203:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30800/0xad6b7ddc1478b8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed0 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.069214:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30800/0xad6b7ddc1478b8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed0 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.069221:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30800, rc 0) 00000100:00100000:1.0:1746065212.069241:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265244928:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 82us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.069246:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17198 00010000:00010000:3.0:1746065212.069265:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.069272:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478b96 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ebb expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.069282:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.069284:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.069288:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478b96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ebb expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.069296:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478b96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ebb expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.069303:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5200, rc 0) 00000100:00100000:3.0:1746065212.069326:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265244544:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 276us (4098us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.069331:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17196 00000100:00100000:3.0:1746065212.069359:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17199 00000100:00100000:3.0:1746065212.069362:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265244672:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065212.069367:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.069374:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1478b9d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ec2 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065212.069403:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263932544:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065212.069438:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.069491:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065212.071236:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.071269:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.071310:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265245056 00000100:00100000:3.0:1746065212.071315:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265245056 00000100:00100000:3.0:1746065212.071341:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17200 00000100:00100000:3.0:1746065212.071346:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265245056:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065212.071356:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.071366:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1478ba4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ed7 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.071380:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.071382:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.071387:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1478ba4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed7 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.071404:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1478ba4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed7 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.071411:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:3.0:1746065212.071434:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265245056:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 88us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.071439:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17200 00000100:00100000:1.0:1746065212.072118:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.072252:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265245312 00000100:00100000:2.0:1746065212.072256:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265245312 00002000:00100000:2.0:1746065212.072276:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1261568->1265663) req@ffff8800996f8700 x1830881265245312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.072284:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f8700 with x1830881265245312 ext(1261568->1265663) 00002000:00010000:2.0:1746065212.072288:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f8700 00000100:00100000:2.0:1746065212.072302:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6064 00000100:00100000:2.0:1746065212.072307:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265245312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065212.072386:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265245312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 78us (1116us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065212.072400:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6064 00002000:00100000:2.0:1746065212.072404:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1261568->1265663) req@ffff8800996f8700 x1830881265245312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/4536 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.072410:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f8700 with x1830881265245312 ext(1261568->1265663) 00002000:00010000:2.0:1746065212.072412:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f8700 00002000:00010000:2.0:1746065212.072447:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065211 -> 1746065212 00002000:00010000:2.0:1746065212.072450:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065211 -> 1746065212 00002000:00010000:2.0:1746065212.072451:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065211 -> 1746065212 00000100:00100000:2.0:1746065212.072458:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263932544:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065212.072477:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1478b9d lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ec2 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.072486:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136167e00/0xad6b7ddc1478b9d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ec2 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.072496:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167e00, rc 0) 00000100:00100000:2.0:1746065212.072515:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265244672:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3151us (6785us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065212.072520:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17199 00000100:00100000:2.0:1746065212.072531:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265245440 00000100:00100000:2.0:1746065212.072534:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265245440 00000100:00100000:2.0:1746065212.072546:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17201 00000100:00100000:2.0:1746065212.072550:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265245440:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065212.072556:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.072564:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1478bab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ede expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.072573:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.072575:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.072579:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1478bab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ede expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.072586:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1478bab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ede expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.072592:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f600, rc 0) 00000100:00100000:2.0:1746065212.072605:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265245440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 54us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.072609:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17201 00000100:00100000:0.0:1746065212.072803:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265244032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14291us (14972us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065212.072808:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6063 00002000:00100000:0.0:1746065212.072813:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880091b64700 x1830881265244032/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065212.072819:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64700 with x1830881265244032 ext(0->1048575) 00002000:00010000:0.0:1746065212.072822:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b64700 00000100:00100000:3.0:1746065212.073016:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265244160:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15029us (15200us total) trans 0 rc 905216/905216 00000100:00100000:3.0:1746065212.073023:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6062 00002000:00100000:3.0:1746065212.073028:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1953791) req@ffff880091b67800 x1830881265244160/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 905216/905216 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.073035:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67800 with x1830881265244160 ext(1048576->1953791) 00002000:00010000:3.0:1746065212.073038:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b67800 00002000:00010000:2.0:1746065212.073563:0:12260:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065209 -> 1746065212 00002000:00010000:2.0:1746065212.073566:0:12260:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065208 -> 1746065212 00002000:00010000:2.0:1746065212.073567:0:12260:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065209 -> 1746065212 00000100:00100000:2.0:1746065212.073575:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263932416:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065212.073589:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9000/0xad6b7ddc1478b88 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ec9 expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.073598:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f4d9000/0xad6b7ddc1478b88 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ec9 expref: 10 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.073609:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d9000, rc 0) 00000100:00100000:2.0:1746065212.073869:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265244800:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4732us (7803us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065212.073875:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17197 00000100:00100000:0.0:1746065212.075984:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.076080:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265245696 00000100:00100000:3.0:1746065212.076088:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265245696 00000100:00100000:3.0:1746065212.076130:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5425 00000100:00100000:3.0:1746065212.076137:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2273:x1830881265245696:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065212.076336:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2273:x1830881265245696:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 198us (357us total) trans 8589937006 rc 0/0 00000100:00100000:3.0:1746065212.076342:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5425 00000100:00100000:0.0:1746065212.077750:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.078009:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265245952 00000100:00100000:3.0:1746065212.078015:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265245952 00002000:00100000:3.0:1746065212.078045:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1265664->2097151) req@ffff880099ec7800 x1830881265245952/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.078053:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7800 with x1830881265245952 ext(1265664->2097151) 00002000:00010000:3.0:1746065212.078058:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec7800 00000100:00100000:3.0:1746065212.078439:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6065 00000100:00100000:3.0:1746065212.078447:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265245952:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065212.082281:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.082336:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.082510:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265246208 00000100:00100000:3.0:1746065212.082518:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265246208 00000100:00100000:1.0:1746065212.082537:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265246464 00000100:00100000:1.0:1746065212.082541:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265246464 00000100:00100000:3.0:1746065212.082555:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14517 00000100:00100000:3.0:1746065212.082567:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2277:x1830881265246208:12345-192.168.202.27@tcp:101:lfs.0 00002000:00100000:1.0:1746065212.082567:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880135222a00 x1830881265246464/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.082577:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222a00 with x1830881265246464 ext(1048576->2097151) 00010000:00010000:3.0:1746065212.082580:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00010000:1.0:1746065212.082582:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135222a00 00010000:00010000:3.0:1746065212.082594:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc1478bb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ee5 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.082595:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6066 00000100:00100000:1.0:1746065212.082600:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265246464:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:3.0:1746065212.082675:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.082688:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ead expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.082699:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.082723:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ead expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.082732:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ead expref: 12 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.082742:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263932672:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.082817:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065212.087520:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263932672:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065212.087541:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065212.089046:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.089112:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265246592 00000100:00100000:2.0:1746065212.089118:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265246592 00010000:00010000:2.0:1746065212.089151:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ead expref: 13 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.089174:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7979 00000100:00100000:2.0:1746065212.089180:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265246592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065212.089189:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065212.089194:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ead expref: 13 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.089202:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ead expref: 13 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.089219:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc1478b7a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ead expref: 13 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.089247:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065212.089251:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.089259:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.089268:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.089286:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065212.089319:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265246592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 139us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.089326:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7979 00010000:00010000:2.0:1746065212.089353:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.089360:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065212.089379:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065212.089492:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc1478bb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ee5 expref: 13 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.089503:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ee5 expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.089509:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065212.089511:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065212.089513:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30000, rc 0) 00000100:00100000:2.0:1746065212.089537:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2277:x1830881265246208:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6975us (7265us total) trans 8589937007 rc 0/0 00000100:00100000:2.0:1746065212.089543:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14517 00000100:00100000:3.0:1746065212.089733:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265245952:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11287us (11986us total) trans 0 rc 831488/831488 00000100:00100000:3.0:1746065212.089740:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6065 00002000:00100000:3.0:1746065212.089748:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1265664->2097151) req@ffff880099ec7800 x1830881265245952/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 831488/831488 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.089756:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7800 with x1830881265245952 ext(1265664->2097151) 00002000:00010000:3.0:1746065212.089760:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec7800 00010000:00010000:2.0:1746065212.091551:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065212.092173:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.092219:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265246720 00000100:00100000:2.0:1746065212.092225:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265246720 00000100:00100000:2.0:1746065212.092266:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17202 00000100:00100000:2.0:1746065212.092272:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+21:2270:x1830881265246720:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065212.092285:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.092300:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938eec expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.092324:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.092331:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1478bab lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ede expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.092336:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478ae0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e6e expref: 22 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.092342:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.092343:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.092346:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3682304->4194303] (req 3682304->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 22 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.092368:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478ae0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e6e expref: 22 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.092378:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478ae0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e6e expref: 22 pid: 9549 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.092387:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263932800:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.092464:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1478bab lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ede expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.092471:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1478bab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ede expref: 8 pid: 11461 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.092477:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263932928:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.092499:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 9 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.092506:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 9 pid: 13375 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.092512:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263933056:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.092526:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065212.092742:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265246464:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10139us (10404us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065212.092754:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6066 00002000:00100000:1.0:1746065212.092763:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880135222a00 x1830881265246464/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.092800:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135222a00 with x1830881265246464 ext(1048576->2097151) 00002000:00010000:1.0:1746065212.092804:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135222a00 00000100:00100000:0.0:1746065212.093795:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.093867:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265246848 00000100:00100000:2.0:1746065212.093872:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265246848 00000100:00100000:2.0:1746065212.093900:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14518 00000100:00100000:2.0:1746065212.093906:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2277:x1830881265246848:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065212.093919:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.093931:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc1478bce lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ef3 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.093994:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.094007:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ee5 expref: 13 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.094013:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.094031:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ee5 expref: 13 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.094039:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ee5 expref: 13 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.094046:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263933184:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.094100:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.098360:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.098499:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265246976 00000100:00100000:1.0:1746065212.098507:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265246976 00010000:00010000:1.0:1746065212.098539:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1478bab lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ede expref: 9 pid: 11461 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746065212.098577:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7980 00000100:00100000:1.0:1746065212.098584:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265246976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.098596:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.098612:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1478bab lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ede expref: 9 pid: 11461 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746065212.098621:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1478bab lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ede expref: 9 pid: 11461 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746065212.098641:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.098676:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265246976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.098682:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7980 00000100:00100000:2.0:1746065212.098691:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263932800:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.098702:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009580f600/0xad6b7ddc1478bab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ede expref: 8 pid: 11461 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.098716:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263932928:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.098724:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263933056:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.098748:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3682304->4194303] (req 3682304->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 22 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.098758:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f800, rc 0) 00000100:00100000:2.0:1746065212.098815:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2270:x1830881265246720:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6542us (6645us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.098822:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17202 00000100:00100000:2.0:1746065212.098849:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263933184:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.098862:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065212.099477:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.099511:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.099991:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265247104 00000100:00100000:1.0:1746065212.099991:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265247232 00000100:00100000:1.0:1746065212.099995:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265247232 00000100:00100000:3.0:1746065212.099996:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265247104 00010000:00010000:1.0:1746065212.100010:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478ae0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e6e expref: 22 pid: 9549 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746065212.100011:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 10 pid: 13375 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.100026:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7981 00000100:00100000:1.0:1746065212.100030:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265247232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065212.100035:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7982 00010000:00010000:1.0:1746065212.100036:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065212.100040:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265247104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.100045:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478ae0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e6e expref: 22 pid: 9549 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746065212.100046:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.100053:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478ae0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e6e expref: 22 pid: 9549 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746065212.100064:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 10 pid: 13375 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.100072:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 10 pid: 13375 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.100086:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc1478aa1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e4b expref: 10 pid: 13375 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.100091:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc1478ae0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e6e expref: 22 pid: 9549 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746065212.100100:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.100103:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.100109:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.100137:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.100144:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065212.100162:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.100168:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881265247232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 137us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.100172:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263933312:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065212.100173:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7981 00000100:00100000:3.0:1746065212.100305:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.101408:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.101477:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265247360 00000100:00100000:1.0:1746065212.101482:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265247360 00010000:00010000:1.0:1746065212.101501:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ee5 expref: 14 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.101520:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7983 00000100:00100000:1.0:1746065212.101526:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265247360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.101535:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.101540:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ee5 expref: 14 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.101548:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ee5 expref: 14 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.101562:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478bb9 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ee5 expref: 14 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.101578:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065212.101582:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.101591:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.101597:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.101748:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065212.101906:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.101913:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065212.101958:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:2.0:1746065212.101962:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065212.101977:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.102001:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc1478bce lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ef3 expref: 14 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.102013:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ef3 expref: 13 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.102019:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065212.102021:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065212.102023:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e600, rc 0) 00000100:00100000:1.0:1746065212.102071:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265247360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 544us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.102077:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7983 00000100:00100000:2.0:1746065212.102340:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2277:x1830881265246848:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8433us (8546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.102346:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14518 00000100:00100000:0.0:1746065212.107680:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.107709:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263933312:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065212.107710:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065212.107726:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065212.107743:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.107758:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.107769:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2006:x1830881265247104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7727us (8291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.107803:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7982 00000100:00100000:0.0:1746065212.107853:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.107872:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265248000 00000100:00100000:3.0:1746065212.107877:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265248000 00000100:00100000:3.0:1746065212.107905:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265248128 00000100:00100000:3.0:1746065212.107906:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265248128 00000100:00100000:3.0:1746065212.107915:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265248256 00000100:00100000:3.0:1746065212.107917:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265248256 00000100:00100000:3.0:1746065212.107927:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17203 00000100:00100000:3.0:1746065212.107932:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265248000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065212.107953:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.107967:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc1478bdc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938efa expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.107972:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265247616 00000100:00100000:1.0:1746065212.107976:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265247616 00002000:00100000:1.0:1746065212.108000:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3682304->3686399) req@ffff88012dc3d180 x1830881265247616/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065212.108007:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263933440:192.168.202.27@tcp:106: 00002000:00100000:1.0:1746065212.108008:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d180 with x1830881265247616 ext(3682304->3686399) 00002000:00010000:1.0:1746065212.108012:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3d180 00000100:00100000:1.0:1746065212.108022:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265247872 00000100:00100000:1.0:1746065212.108025:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265247872 00002000:00100000:1.0:1746065212.108034:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012dc3dc00 x1830881265247872/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.108041:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3dc00 with x1830881265247872 ext(2097152->3145727) 00002000:00010000:1.0:1746065212.108043:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3dc00 00000100:00100000:3.0:1746065212.108051:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.108054:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17204 00000100:00100000:1.0:1746065212.108057:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6067 00000100:00100000:2.0:1746065212.108061:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265248128:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:1.0:1746065212.108061:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265247616:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065212.108067:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17205 00010000:00010000:2.0:1746065212.108068:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065212.108072:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265248256:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065212.108075:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1478be3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f01 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.108079:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.108086:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1478bea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f08 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065212.108097:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263933568:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065212.108107:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263933696:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065212.108119:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065212.108127:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.108137:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6068 00000100:00100000:2.0:1746065212.108142:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265247872:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065212.108146:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265247616:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 85us (474us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065212.108152:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6067 00002000:00100000:1.0:1746065212.108156:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3682304->3686399) req@ffff88012dc3d180 x1830881265247616/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/4536 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.108162:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d180 with x1830881265247616 ext(3682304->3686399) 00002000:00010000:1.0:1746065212.108164:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3d180 00002000:00010000:0.0:1746065212.118604:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746065211 -> 1746065212 00002000:00010000:0.0:1746065212.118612:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065209 -> 1746065212 00002000:00010000:0.0:1746065212.118614:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746065211 -> 1746065212 00000100:00100000:0.0:1746065212.118633:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263933696:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065212.118660:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1478bea lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f08 expref: 13 pid: 9549 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065212.118813:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263933440:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065212.118828:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc1478bdc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938efa expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.118839:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30400/0xad6b7ddc1478bdc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938efa expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.118864:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30400, rc 0) 00000100:00100000:3.0:1746065212.118903:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265248000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 10969us (11159us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065212.118911:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17203 00010000:00010000:0.0:1746065212.118976:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1478bea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f08 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065212.118987:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090684400, rc 0) 00000100:00100000:0.0:1746065212.119005:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265248256:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 10932us (11151us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065212.119010:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17205 00000100:00100000:2.0:1746065212.119277:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263933568:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065212.119293:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1478be3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f01 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.119300:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538400/0xad6b7ddc1478be3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f01 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.119423:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538400, rc 0) 00000100:00100000:2.0:1746065212.119445:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265248128:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11385us (11685us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065212.119450:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17204 00000100:00100000:3.0:1746065212.122681:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265247872:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14528us (14959us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065212.122691:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6068 00002000:00100000:3.0:1746065212.122700:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012dc3dc00 x1830881265247872/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.122707:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3dc00 with x1830881265247872 ext(2097152->3145727) 00002000:00010000:3.0:1746065212.122712:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3dc00 00000100:00100000:2.0:1746065212.125500:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.125539:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.125543:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265248384 00000100:00100000:0.0:1746065212.125550:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265248384 00000100:00100000:2.0:1746065212.125559:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265248640 00000100:00100000:2.0:1746065212.125562:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265248640 00000100:00100000:2.0:1746065212.125598:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14519 00000100:00100000:2.0:1746065212.125604:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2277:x1830881265248640:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065212.125609:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17206 00000100:00100000:0.0:1746065212.125615:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+27:2270:x1830881265248384:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065212.125619:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065212.125622:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065212.125634:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f0f expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.125635:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478bf8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f16 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.125659:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.125666:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1478ba4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed7 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065212.125676:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1478b5e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ea6 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065212.125681:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.125682:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.125685:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->4554751] (req 4194304->4554751) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.125707:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1478b5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ea6 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.125715:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1478bff lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.125717:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1478b5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ea6 expref: 11 pid: 13375 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746065212.125727:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1478bff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065212.125728:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263933824:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.125736:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1478bff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.125745:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1478bff lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.125750:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1478bff lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.125755:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1478bff lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.125760:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065212.125763:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1478bff lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.125767:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1478bff lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.125793:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065212.125795:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065212.125798:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1478bff lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.125802:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc1478bff lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.125812:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1478ba4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed7 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065212.125820:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1478ba4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed7 expref: 10 pid: 10219 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746065212.125827:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263933952:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.125828:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478bf8 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f16 expref: 13 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.125833:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478bf8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f16 expref: 13 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.125839:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539e00, rc 0) 00010000:00010000:0.0:1746065212.125851:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065212.125859:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2277:x1830881265248640:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 256us (320us total) trans 0 rc 301/301 00010000:00010000:0.0:1746065212.125860:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 28 pid: 3067 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.125864:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14519 00000100:00100000:0.0:1746065212.125865:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263934080:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065212.125876:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.131529:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.131576:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.131580:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265248768 00000100:00100000:1.0:1746065212.131587:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265248768 00000100:00100000:0.0:1746065212.131596:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.131618:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.131626:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17207 00000100:00100000:0.0:1746065212.131631:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265249280 00000100:00100000:1.0:1746065212.131633:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2276:x1830881265248768:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065212.131634:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265249280 00010000:00010000:1.0:1746065212.131647:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065212.131651:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5426 00000100:00100000:0.0:1746065212.131654:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2277:x1830881265249280:12345-192.168.202.27@tcp:35:lfs.0 00010000:00010000:1.0:1746065212.131661:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f1d expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.131683:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 20 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.131694:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065212.131696:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065212.131699:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.131724:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 20 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.131733:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 20 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.131744:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263934208:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065212.131797:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2277:x1830881265249280:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 141us (177us total) trans 8589937008 rc 0/0 00000100:00100000:0.0:1746065212.131801:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5426 00000100:00100000:3.0:1746065212.131804:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265248896 00000100:00100000:3.0:1746065212.131808:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265248896 00010000:00010000:3.0:1746065212.131826:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1478ba4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed7 expref: 11 pid: 10219 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746065212.131848:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265249024 00000100:00100000:3.0:1746065212.131851:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265249024 00010000:00010000:3.0:1746065212.131859:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1478b5e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ea6 expref: 12 pid: 13375 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746065212.131880:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7984 00000100:00100000:3.0:1746065212.131885:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265248896:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065212.131893:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065212.131907:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1478ba4 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed7 expref: 11 pid: 10219 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746065212.131915:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1478ba4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed7 expref: 11 pid: 10219 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746065212.131929:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065212.131992:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3fb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263933824:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.132003:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1478ba4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed7 expref: 11 pid: 10219 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.132012:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263933952:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.132019:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263934080:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.132038:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->4554751] (req 4194304->4554751) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.132046:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3000, rc 0) 00000100:00100000:1.0:1746065212.132101:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065212.132119:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7985 00000100:00100000:1.0:1746065212.132124:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265249024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.132130:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.132137:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1478b5e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ea6 expref: 12 pid: 13375 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746065212.132143:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1478b5e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ea6 expref: 12 pid: 13375 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746065212.132152:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1478b5e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ea6 expref: 12 pid: 13375 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746065212.132171:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.132183:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265249024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 60us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.132188:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7985 00000100:00100000:3.0:1746065212.132297:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265248896:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 411us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.132302:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7984 00000100:00100000:2.0:1746065212.132352:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2270:x1830881265248384:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6737us (6858us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.132357:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17206 00000100:00100000:1.0:1746065212.134667:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263934208:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065212.134690:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.134703:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4200, rc 0) 00000100:00100000:1.0:1746065212.134744:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2276:x1830881265248768:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3112us (3221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.134752:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17207 00000100:00100000:0.0:1746065212.134834:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.134868:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265249536 00000100:00100000:3.0:1746065212.134873:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265249536 00002000:00100000:3.0:1746065212.134901:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3682304->4194303) req@ffff880136a7b100 x1830881265249536/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746065212.134903:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:3.0:1746065212.134908:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b100 with x1830881265249536 ext(3682304->4194303) 00010000:00010000:3.0:1746065212.134920:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 21 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746065212.134927:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265249408 00010000:00010000:3.0:1746065212.134929:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 21 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746065212.134930:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265249408 00002000:00010000:3.0:1746065212.134934:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136a7b100 00010000:00010000:0.0:1746065212.134947:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 28 pid: 3067 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.134951:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1993 00000100:00100000:3.0:1746065212.134956:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881265249536:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065212.134965:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7986 00000100:00100000:0.0:1746065212.134969:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265249408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.134978:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065212.134991:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 28 pid: 3067 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.135000:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 28 pid: 3067 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.135015:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136167800/0xad6b7ddc1478aee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e7c expref: 28 pid: 3067 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.135025:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.135027:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.135032:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 27 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.135039:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 27 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.135063:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 27 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065212.135073:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263934336:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065212.135126:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065212.138638:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263934336:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065212.138656:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.138686:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881265249408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3715us (3781us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.138695:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7986 00000100:00100000:2.0:1746065212.141476:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.141734:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265249792 00000100:00100000:1.0:1746065212.141741:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265249792 00002000:00100000:1.0:1746065212.141805:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4550656->4554751) req@ffff880099bd5880 x1830881265249792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.141814:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5880 with x1830881265249792 ext(4550656->4554751) 00002000:00010000:1.0:1746065212.141819:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd5880 00000100:00100000:3.0:1746065212.141833:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265249536:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 6874us (6997us total) trans 21474841650 rc 0/0 00000100:00100000:1.0:1746065212.141837:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6069 00000100:00100000:3.0:1746065212.141842:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1993 00000100:00100000:1.0:1746065212.141844:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265249792:12345-192.168.202.27@tcp:3:multiop.0 00002000:00100000:3.0:1746065212.141849:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3682304->4194303) req@ffff880136a7b100 x1830881265249536/t21474841650(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/448 e 0 to 0 dl 1746065223 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.141856:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b100 with x1830881265249536 ext(3682304->4194303) 00010000:00010000:3.0:1746065212.141864:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 23 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.141877:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 23 pid: 12260 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746065212.141882:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880136a7b100 00000100:00100000:1.0:1746065212.141919:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265249792:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 75us (449us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065212.141925:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6069 00002000:00100000:1.0:1746065212.141930:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4550656->4554751) req@ffff880099bd5880 x1830881265249792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/4536 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.141938:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5880 with x1830881265249792 ext(4550656->4554751) 00002000:00010000:1.0:1746065212.141941:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099bd5880 00000100:00100000:0.0:1746065212.146434:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.146811:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265249920 00000100:00100000:1.0:1746065212.146819:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265249920 00010000:00010000:1.0:1746065212.146848:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 23 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.146870:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7987 00000100:00100000:1.0:1746065212.146876:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265249920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.146887:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.146902:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 23 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.146912:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 23 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.146930:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009580f800/0xad6b7ddc1478bc7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eec expref: 23 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.146955:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.146957:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.146962:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 9 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.146969:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 9 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.146994:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 9 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.147004:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263934464:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065212.147791:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.148649:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.148699:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265250176 00000100:00100000:3.0:1746065212.148705:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265250176 00000100:00100000:3.0:1746065212.148743:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5427 00000100:00100000:3.0:1746065212.148750:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2270:x1830881265250176:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065212.148932:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2270:x1830881265250176:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 181us (284us total) trans 8589937009 rc 0/0 00000100:00100000:3.0:1746065212.148938:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5427 00000100:00100000:1.0:1746065212.150845:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263934464:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065212.150862:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.150887:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265249920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4010us (4460us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.150895:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7987 00000100:00100000:2.0:1746065212.156148:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.156216:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265250432 00000100:00100000:1.0:1746065212.156223:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265250432 00002000:00100000:1.0:1746065212.156256:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880099bd6680 x1830881265250432/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.156265:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd6680 with x1830881265250432 ext(2097152->3145727) 00002000:00010000:1.0:1746065212.156270:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd6680 00000100:00100000:1.0:1746065212.156297:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6070 00000100:00100000:1.0:1746065212.156303:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265250432:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065212.157090:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.157120:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265250688 00000100:00100000:3.0:1746065212.157124:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265250688 00000100:00100000:3.0:1746065212.157151:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14520 00000100:00100000:3.0:1746065212.157155:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2282:x1830881265250688:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065212.157165:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.157176:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1478c0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f24 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.157228:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1478c14 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157239:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1478c14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157249:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1478c14 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157264:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc1478c1b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157270:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc1478c1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157275:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc1478c1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157351:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1478c22 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157359:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1478c22 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157365:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1478c22 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065212.157372:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065212.157449:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1478c14 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157456:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1478c14 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157461:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1478c14 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157467:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1478c14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157472:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.157475:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1478c14 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157480:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1478c14 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157491:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065212.157494:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.157497:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1478c14 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157502:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c400/0xad6b7ddc1478c14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157511:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc1478c1b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157515:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc1478c1b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157519:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc1478c1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157522:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2d600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.157524:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc1478c1b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157528:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc1478c1b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157533:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b2154800) 00010000:00010000:3.0:1746065212.157535:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.157536:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc1478c1b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157540:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d600/0xad6b7ddc1478c1b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.157576:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d200/0xad6b7ddc1478c0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f24 expref: 43 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.157586:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1478c22 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f24 expref: 42 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.157590:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065212.157592:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065212.157594:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c800, rc 0) 00000100:00100000:3.0:1746065212.157801:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2282:x1830881265250688:12345-192.168.202.27@tcp:101:cat.0 Request processed in 644us (712us total) trans 8589937010 rc 0/0 00000100:00100000:3.0:1746065212.157807:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14520 00000100:00100000:1.0:1746065212.163002:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265250432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6690us (6852us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065212.163013:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6070 00002000:00100000:1.0:1746065212.163023:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880099bd6680 x1830881265250432/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.163031:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd6680 with x1830881265250432 ext(2097152->3145727) 00002000:00010000:1.0:1746065212.163036:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd6680 00000100:00100000:0.0:1746065212.166570:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.166603:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.166633:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265250816 00000100:00100000:1.0:1746065212.166641:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265250816 00000100:00100000:1.0:1746065212.166681:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265250944 00000100:00100000:1.0:1746065212.166682:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265250944 00000100:00100000:0.0:1746065212.166685:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.166703:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265251072 00000100:00100000:1.0:1746065212.166705:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265251072 00000100:00100000:1.0:1746065212.166719:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17208 00000100:00100000:1.0:1746065212.166725:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265250816:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065212.166740:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065212.166755:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de5c00/0xad6b7ddc1478c30 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f2b expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.166829:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263934592:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065212.166897:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065212.166899:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17209 00000100:00100000:3.0:1746065212.166907:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265250944:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065212.166913:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.166920:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c37 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f32 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.166920:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17210 00000100:00100000:1.0:1746065212.166925:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881265251072:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065212.166930:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065212.166938:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc1478c3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f39 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065212.166946:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263934720:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065212.166948:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.166950:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.166956:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc1478c3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f39 expref: 27 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.166969:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc1478c3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f39 expref: 27 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065212.166973:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00010000:00010000:1.0:1746065212.166977:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2800, rc 0) 00000100:00100000:1.0:1746065212.166997:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881265251072:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.167003:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17210 00000100:00100000:0.0:1746065212.167558:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.167602:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265251200 00000100:00100000:2.0:1746065212.167606:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265251200 00000100:00100000:2.0:1746065212.167624:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17211 00000100:00100000:2.0:1746065212.167629:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2276:x1830881265251200:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065212.167635:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.167643:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f40 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.167657:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.167663:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065212.167664:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065212.167667:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.167681:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.167689:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 26 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.167696:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263934848:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.167727:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065212.170151:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263934592:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065212.170157:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263934720:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065212.170178:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c37 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f32 expref: 26 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.170178:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de5c00/0xad6b7ddc1478c30 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f2b expref: 26 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.170189:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c37 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f32 expref: 26 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.170189:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de5c00/0xad6b7ddc1478c30 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f2b expref: 26 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.170203:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2d800, rc 0) 00010000:00010000:1.0:1746065212.170217:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5c00, rc 0) 00000100:00100000:3.0:1746065212.170233:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881265250944:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3327us (3629us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065212.170237:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265250816:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3511us (3673us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065212.170240:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17209 00000100:00100000:1.0:1746065212.170243:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17208 00000100:00100000:2.0:1746065212.170379:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263934848:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.170404:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.170415:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538800, rc 0) 00000100:00100000:2.0:1746065212.170432:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2276:x1830881265251200:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2802us (2875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.170437:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17211 00000100:00100000:0.0:1746065212.171101:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.171181:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265251328 00000100:00100000:1.0:1746065212.171188:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265251328 00002000:00100000:1.0:1746065212.171221:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4554751) req@ffff880091a93800 x1830881265251328/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.171230:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93800 with x1830881265251328 ext(4194304->4554751) 00010000:00010000:1.0:1746065212.171235:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 27 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.171246:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 27 pid: 12260 timeout: 908 lvb_type: 0 00002000:00010000:1.0:1746065212.171252:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091a93800 00000100:00100000:1.0:1746065212.171276:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1994 00000100:00100000:1.0:1746065212.171283:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265251328:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065212.174301:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.174521:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265251456 00000100:00100000:2.0:1746065212.174529:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265251456 00000100:00100000:2.0:1746065212.174572:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17212 00000100:00100000:2.0:1746065212.174579:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2282:x1830881265251456:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065212.174592:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.174605:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f47 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.174628:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.174635:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065212.174636:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065212.174639:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.174663:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.174672:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 9 pid: 3067 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.174687:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263934976:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.174764:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.177160:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.177182:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265251584 00000100:00100000:0.0:1746065212.177187:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265251584 00002000:00100000:0.0:1746065212.177218:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1953792->2097151) req@ffff880091a93b80 x1830881265251584/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065212.177226:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93b80 with x1830881265251584 ext(1953792->2097151) 00010000:00010000:0.0:1746065212.177234:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 10 pid: 3067 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.177244:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 10 pid: 3067 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746065212.177250:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091a93b80 00000100:00100000:0.0:1746065212.177277:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1995 00000100:00100000:0.0:1746065212.177285:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265251584:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065212.177288:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263934976:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.177308:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.177320:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539e00, rc 0) 00000100:00100000:2.0:1746065212.177357:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2282:x1830881265251456:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2777us (3061us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.177364:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17212 00000100:00100000:1.0:1746065212.178979:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265251328:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 7692us (7874us total) trans 17179874254 rc 0/0 00000100:00100000:1.0:1746065212.178987:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1994 00002000:00100000:1.0:1746065212.178993:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4554751) req@ffff880091a93800 x1830881265251328/t17179874254(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/448 e 0 to 0 dl 1746065223 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.179000:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93800 with x1830881265251328 ext(4194304->4554751) 00010000:00010000:1.0:1746065212.179007:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 29 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.179016:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 29 pid: 12260 timeout: 908 lvb_type: 0 00002000:00010000:1.0:1746065212.179026:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091a93800 00000100:00100000:2.0:1746065212.180359:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265251584:12345-192.168.202.27@tcp:4:cat.0 Request processed in 3070us (3199us total) trans 21474841651 rc 0/0 00000100:00100000:2.0:1746065212.180367:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1995 00002000:00100000:2.0:1746065212.180374:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1953792->2097151) req@ffff880091a93b80 x1830881265251584/t21474841651(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/448 e 0 to 0 dl 1746065223 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.180381:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93b80 with x1830881265251584 ext(1953792->2097151) 00010000:00010000:2.0:1746065212.180387:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 12 pid: 3067 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.180408:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 12 pid: 3067 timeout: 908 lvb_type: 0 00002000:00010000:2.0:1746065212.180413:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091a93b80 00000100:00100000:2.0:1746065212.180717:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.180764:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265251712 00000100:00100000:1.0:1746065212.180786:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265251712 00010000:00010000:1.0:1746065212.180806:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 29 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.180835:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7988 00000100:00100000:1.0:1746065212.180841:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265251712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.180850:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065212.180861:0:9565:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065211 -> 1746065212 00002000:00010000:1.0:1746065212.180864:0:9565:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065211 -> 1746065212 00010000:00010000:1.0:1746065212.180867:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 29 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.180875:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 29 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.180892:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478bf1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4554751) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f0f expref: 29 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.180915:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.180917:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.180923:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 11 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.180930:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 11 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.180954:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 11 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.180964:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263935104:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065212.181015:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.183065:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.183256:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265251840 00000100:00100000:2.0:1746065212.183262:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265251840 00010000:00010000:2.0:1746065212.183285:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 12 pid: 3067 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.183315:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7989 00000100:00100000:2.0:1746065212.183322:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265251840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065212.183332:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065212.183346:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 12 pid: 3067 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.183355:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 12 pid: 3067 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.183372:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b4a25400/0xad6b7ddc1478b2d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1953792->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e91 expref: 12 pid: 3067 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.183405:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.183408:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.183413:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 23 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.183421:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 23 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.183444:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 23 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065212.183458:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263935232:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065212.183509:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065212.183934:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263935104:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065212.183948:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.183976:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265251712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3134us (3258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.183982:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7988 00000100:00100000:2.0:1746065212.184892:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263935232:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065212.184903:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065212.184924:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265251840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1602us (1865us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.184930:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7989 00000100:00100000:0.0:1746065212.192852:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.192899:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.192989:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265252096 00000100:00100000:1.0:1746065212.192997:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265252096 00000100:00100000:2.0:1746065212.193095:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265252352 00000100:00100000:2.0:1746065212.193100:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265252352 00002000:00100000:2.0:1746065212.193121:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880091a93100 x1830881265252352/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.193130:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93100 with x1830881265252352 ext(3145728->4194303) 00002000:00010000:2.0:1746065212.193135:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a93100 00000100:00100000:2.0:1746065212.193165:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6071 00000100:00100000:2.0:1746065212.193172:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265252352:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:1.0:1746065212.194101:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091a90700 x1830881265252096/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.194111:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90700 with x1830881265252096 ext(3145728->4194303) 00002000:00010000:1.0:1746065212.194115:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90700 00000100:00100000:1.0:1746065212.194129:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6072 00000100:00100000:1.0:1746065212.194136:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265252096:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065212.194222:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.194244:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265252608 00000100:00100000:1.0:1746065212.194247:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265252608 00002000:00100000:1.0:1746065212.194261:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880091a93480 x1830881265252608/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.194268:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93480 with x1830881265252608 ext(1048576->2097151) 00002000:00010000:1.0:1746065212.194272:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a93480 00000100:00100000:1.0:1746065212.194289:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6073 00000100:00100000:1.0:1746065212.194294:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265252608:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065212.207078:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265252352:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13899us (14171us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065212.207088:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6071 00002000:00100000:2.0:1746065212.207097:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880091a93100 x1830881265252352/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.207105:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93100 with x1830881265252352 ext(3145728->4194303) 00002000:00010000:2.0:1746065212.207111:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a93100 00000100:00100000:1.0:1746065212.210204:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265252608:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15900us (15974us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065212.210216:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6073 00002000:00100000:1.0:1746065212.210225:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880091a93480 x1830881265252608/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.210233:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93480 with x1830881265252608 ext(1048576->2097151) 00002000:00010000:1.0:1746065212.210239:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a93480 00000100:00100000:1.0:1746065212.213802:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265252096:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19637us (20929us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065212.213812:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6072 00002000:00100000:1.0:1746065212.213822:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091a90700 x1830881265252096/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.213831:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90700 with x1830881265252096 ext(3145728->4194303) 00002000:00010000:1.0:1746065212.213836:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90700 00000100:00100000:0.0:1746065212.222183:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.222222:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.222528:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265252736 00000100:00100000:2.0:1746065212.222536:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265252736 00000100:00100000:2.0:1746065212.222578:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265252864 00000100:00100000:2.0:1746065212.222580:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265252864 00000100:00100000:2.0:1746065212.222594:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17213 00000100:00100000:2.0:1746065212.222600:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265252736:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065212.222616:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.222630:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc1478c53 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f4e expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.222649:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.222650:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.222657:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc1478c53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f4e expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.222671:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc1478c53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f4e expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.222680:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538c00, rc 0) 00000100:00100000:1.0:1746065212.222841:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17214 00000100:00100000:1.0:1746065212.222849:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2282:x1830881265252864:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065212.222856:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065212.222863:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f55 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.222880:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 12 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.222886:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065212.222887:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065212.222890:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.222913:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 12 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.222922:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 12 pid: 10219 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.222932:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263935360:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.223718:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265252736:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1115us (1538us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.223725:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17213 00000100:00100000:1.0:1746065212.224105:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.229188:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.229295:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265252992 00000100:00100000:2.0:1746065212.229303:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265252992 00002000:00100000:2.0:1746065212.229340:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1265663) req@ffff8800957d9500 x1830881265252992/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.229349:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9500 with x1830881265252992 ext(1048576->1265663) 00010000:00010000:2.0:1746065212.229357:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 12 pid: 10219 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.229370:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 12 pid: 10219 timeout: 908 lvb_type: 0 00002000:00010000:2.0:1746065212.229376:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800957d9500 00000100:00100000:1.0:1746065212.229614:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263935360:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065212.229637:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.229649:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44e00, rc 0) 00000100:00100000:2.0:1746065212.229820:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1996 00000100:00100000:2.0:1746065212.229828:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265252992:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065212.229973:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2282:x1830881265252864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7124us (7749us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.229979:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17214 00000100:00100000:0.0:1746065212.232013:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.232162:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265253248 00000100:00100000:2.0:1746065212.232169:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265253248 00002000:00100000:2.0:1746065212.232202:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff8800957da680 x1830881265253248/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.232210:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da680 with x1830881265253248 ext(4194304->4898815) 00002000:00010000:2.0:1746065212.232214:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957da680 00000100:00100000:2.0:1746065212.232241:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6074 00000100:00100000:2.0:1746065212.232248:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265253248:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065212.240765:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265252992:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10929us (11577us total) trans 21474841652 rc 0/0 00000100:00100000:3.0:1746065212.240796:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1996 00002000:00100000:3.0:1746065212.240807:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1265663) req@ffff8800957d9500 x1830881265252992/t21474841652(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/448 e 0 to 0 dl 1746065223 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.240816:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9500 with x1830881265252992 ext(1048576->1265663) 00010000:00010000:3.0:1746065212.240825:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 14 pid: 10219 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.240843:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 14 pid: 10219 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746065212.240850:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800957d9500 00000100:00100000:2.0:1746065212.245168:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265253248:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12912us (13151us total) trans 0 rc 704512/704512 00000100:00100000:2.0:1746065212.245179:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6074 00002000:00100000:2.0:1746065212.245188:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff8800957da680 x1830881265253248/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.245197:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da680 with x1830881265253248 ext(4194304->4898815) 00002000:00010000:2.0:1746065212.245202:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957da680 00000100:00100000:0.0:1746065212.248339:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.248825:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265253504 00000100:00100000:3.0:1746065212.248833:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265253504 00000100:00100000:3.0:1746065212.248870:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14521 00000100:00100000:3.0:1746065212.248876:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2285:x1830881265253504:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065212.248895:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.248910:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2cc00/0xad6b7ddc1478c61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f5c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.248965:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.248975:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.248983:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.248993:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1478c6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.248997:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1478c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249002:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1478c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249071:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc1478c76 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249077:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc1478c76 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249083:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc1478c76 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065212.249090:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065212.249141:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c68 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249146:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c68 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249151:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249156:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249161:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2d800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.249163:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249169:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c68 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249177:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065212.249179:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.249182:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c68 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249187:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478c68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249212:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1478c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249220:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1478c6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249224:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1478c6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249228:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.249230:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1478c6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249234:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1478c6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249239:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a9bcc400) 00010000:00010000:3.0:1746065212.249241:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.249243:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1478c6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249246:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc1478c6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065212.249273:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2cc00/0xad6b7ddc1478c61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f5c expref: 26 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.249282:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc1478c76 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f5c expref: 25 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.249288:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065212.249289:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065212.249292:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539a00, rc 0) 00000100:00100000:3.0:1746065212.249338:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2285:x1830881265253504:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 462us (1004us total) trans 8589937011 rc 0/0 00000100:00100000:3.0:1746065212.249345:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14521 00000100:00100000:1.0:1746065212.249766:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.250630:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265253632 00000100:00100000:3.0:1746065212.250638:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265253632 00010000:00010000:3.0:1746065212.250670:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 14 pid: 10219 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.251733:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7990 00000100:00100000:3.0:1746065212.251744:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265253632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065212.251759:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065212.251793:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 14 pid: 10219 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.251804:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 14 pid: 10219 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.251824:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc1478b81 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1265663) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938eb4 expref: 14 pid: 10219 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.251838:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.251839:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.251846:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 24 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.251853:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 24 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.251881:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 24 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065212.251892:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263935488:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065212.251977:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.252657:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.253148:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265253760 00000100:00100000:1.0:1746065212.253153:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265253760 00000100:00100000:1.0:1746065212.253188:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17215 00000100:00100000:1.0:1746065212.253193:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265253760:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065212.253205:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065212.253214:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1478c84 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f63 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.253227:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.253229:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.253233:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1478c84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f63 expref: 15 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.253243:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1478c84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f63 expref: 15 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.253250:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44600, rc 0) 00000100:00100000:1.0:1746065212.253282:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265253760:12345-192.168.202.27@tcp:101:cat.0 Request processed in 88us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.253286:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17215 00000100:00100000:0.0:1746065212.257827:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.257946:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263935488:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065212.257965:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065212.258015:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265253632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6273us (8249us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.258025:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7990 00000100:00100000:2.0:1746065212.258303:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265254016 00000100:00100000:2.0:1746065212.258309:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265254016 00000100:00100000:2.0:1746065212.258336:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5428 00000100:00100000:2.0:1746065212.258341:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b1b26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2276:x1830881265254016:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065212.258496:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b1b26050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2276:x1830881265254016:12345-192.168.202.27@tcp:35:cat.0 Request processed in 154us (676us total) trans 8589937012 rc 0/0 00000100:00100000:2.0:1746065212.258501:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5428 00000100:00100000:0.0:1746065212.276572:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.276806:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265254272 00000100:00100000:2.0:1746065212.276814:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265254272 00002000:00100000:2.0:1746065212.276854:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800957d9c00 x1830881265254272/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.276864:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9c00 with x1830881265254272 ext(1048576->2097151) 00002000:00010000:2.0:1746065212.276869:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d9c00 00000100:00100000:2.0:1746065212.276898:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6075 00000100:00100000:2.0:1746065212.276905:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265254272:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065212.290649:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265254272:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13735us (14076us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065212.290660:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6075 00002000:00100000:2.0:1746065212.290671:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800957d9c00 x1830881265254272/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.290679:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9c00 with x1830881265254272 ext(1048576->2097151) 00002000:00010000:2.0:1746065212.290684:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d9c00 00000100:00100000:0.0:1746065212.301139:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.301215:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265254400 00000100:00100000:2.0:1746065212.301223:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265254400 00000100:00100000:2.0:1746065212.301275:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17216 00000100:00100000:2.0:1746065212.301282:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2282:x1830881265254400:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065212.301298:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.301312:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1478c8b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f6a expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.301332:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.301334:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.301340:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1478c8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f6a expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.301352:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1478c8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f6a expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.301360:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d800, rc 0) 00000100:00100000:2.0:1746065212.301409:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2282:x1830881265254400:12345-192.168.202.27@tcp:101:cat.0 Request processed in 127us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.301415:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17216 00000100:00100000:0.0:1746065212.310266:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.310314:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.310441:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265254784 00000100:00100000:3.0:1746065212.310450:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265254784 00002000:00100000:3.0:1746065212.310487:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff8800957d9f80 x1830881265254784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.310497:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9f80 with x1830881265254784 ext(2097152->4194303) 00002000:00010000:3.0:1746065212.310501:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d9f80 00000100:00100000:3.0:1746065212.311081:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265254912 00000100:00100000:3.0:1746065212.311085:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265254912 00002000:00100000:3.0:1746065212.311102:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8800957da300 x1830881265254912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.311109:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da300 with x1830881265254912 ext(2097152->4194303) 00002000:00010000:3.0:1746065212.311113:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957da300 00000100:00100000:3.0:1746065212.311134:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6076 00000100:00100000:3.0:1746065212.311141:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265254784:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065212.312460:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6077 00000100:00100000:2.0:1746065212.312469:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265254912:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065212.345022:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265254912:12345-192.168.202.27@tcp:3:cat.0 Request processed in 32546us (34699us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065212.345032:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6077 00002000:00100000:2.0:1746065212.345042:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8800957da300 x1830881265254912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.345051:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da300 with x1830881265254912 ext(2097152->4194303) 00002000:00010000:2.0:1746065212.345055:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957da300 00000100:00100000:3.0:1746065212.361787:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265254784:12345-192.168.202.27@tcp:3:cat.0 Request processed in 50624us (51508us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065212.361801:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6076 00002000:00100000:3.0:1746065212.361810:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff8800957d9f80 x1830881265254784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.361820:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9f80 with x1830881265254784 ext(2097152->4194303) 00002000:00010000:3.0:1746065212.361825:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d9f80 00000100:00100000:0.0:1746065212.378561:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.379647:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265255168 00000100:00100000:2.0:1746065212.379654:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265255168 00000100:00100000:2.0:1746065212.379702:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14522 00000100:00100000:2.0:1746065212.379708:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2288:x1830881265255168:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065212.379725:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.379739:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc1478c92 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f71 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.379844:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.379857:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ef3 expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.379864:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1478c22 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f24 expref: 43 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.379870:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc1478c76 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f5c expref: 25 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.379875:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.379900:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc1478c76 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f5c expref: 25 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.379908:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc1478c76 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f5c expref: 25 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.379919:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263935616:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.382688:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1478c22 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f24 expref: 43 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.382701:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1478c22 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f24 expref: 43 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.382711:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263935744:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.384461:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ef3 expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.384475:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ef3 expref: 12 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.384486:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263935872:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.384899:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.386323:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.386451:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265255424 00000100:00100000:3.0:1746065212.386458:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265255424 00002000:00100000:3.0:1746065212.386493:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff8800957dad80 x1830881265255424/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.386502:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957dad80 with x1830881265255424 ext(4194304->4898815) 00002000:00010000:3.0:1746065212.386506:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957dad80 00000100:00100000:3.0:1746065212.386532:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6078 00000100:00100000:3.0:1746065212.386538:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265255424:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065212.393771:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.393849:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.394032:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263935616:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.394048:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263935744:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065212.394077:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265255680 00000100:00100000:1.0:1746065212.394083:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265255680 00010000:00010000:1.0:1746065212.394115:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1478c22 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f24 expref: 44 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.394147:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265255552 00000100:00100000:1.0:1746065212.394149:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265255552 00010000:00010000:1.0:1746065212.394157:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc1478c76 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f5c expref: 26 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.394171:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7991 00000100:00100000:1.0:1746065212.394177:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265255680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.394188:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.394192:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1478c22 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f24 expref: 44 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.394199:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1478c22 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f24 expref: 44 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.394215:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c800/0xad6b7ddc1478c22 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f24 expref: 44 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.394228:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065212.394231:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065212.394239:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065212.394244:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.394271:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265255680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.394277:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7991 00000100:00100000:1.0:1746065212.394292:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7992 00000100:00100000:1.0:1746065212.394296:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2006:x1830881265255552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.394302:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.394305:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc1478c76 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f5c expref: 26 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.394311:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc1478c76 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f5c expref: 26 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.394321:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc1478c76 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f5c expref: 26 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.394329:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065212.394331:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065212.394336:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065212.394340:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.394354:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2006:x1830881265255552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.394359:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7992 00000100:00100000:0.0:1746065212.400131:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.401049:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265255808 00000100:00100000:2.0:1746065212.401053:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615c380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263935872:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.401055:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265255808 00010000:00010000:2.0:1746065212.401079:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.401080:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ef3 expref: 13 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.401107:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7993 00000100:00100000:3.0:1746065212.401113:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265255808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065212.401124:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065212.401129:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ef3 expref: 13 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.401142:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ef3 expref: 13 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.401160:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc1478bd5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ef3 expref: 13 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.401184:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065212.401188:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.401197:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.401203:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.401218:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065212.401265:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265255808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 151us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.401270:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7993 00010000:00010000:3.0:1746065212.401297:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.401302:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065212.401316:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065212.401428:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc1478c92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f71 expref: 44 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.401443:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f71 expref: 43 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.401449:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065212.401451:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065212.401453:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835de00, rc 0) 00000100:00100000:3.0:1746065212.401475:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2288:x1830881265255168:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 21767us (22921us total) trans 8589937013 rc 0/0 00000100:00100000:3.0:1746065212.401480:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14522 00000100:00100000:3.0:1746065212.405236:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265255424:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18689us (18909us total) trans 0 rc 704512/704512 00000100:00100000:3.0:1746065212.405246:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6078 00002000:00100000:3.0:1746065212.405254:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4898815) req@ffff8800957dad80 x1830881265255424/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 704512/704512 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.405263:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957dad80 with x1830881265255424 ext(4194304->4898815) 00002000:00010000:3.0:1746065212.405267:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957dad80 00000100:00100000:0.0:1746065212.412165:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.412240:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265255936 00000100:00100000:2.0:1746065212.412247:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265255936 00000100:00100000:2.0:1746065212.412301:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17217 00000100:00100000:2.0:1746065212.412308:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2288:x1830881265255936:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065212.412324:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.412338:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f78 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.412364:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.412371:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc1478c3e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f39 expref: 26 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.412376:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.412378:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.412381:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3944448->4153343] (req 3944448->4153343) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.412414:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc1478c3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f39 expref: 26 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.412424:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc1478c3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f39 expref: 26 pid: 13375 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.412434:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263936000:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.412531:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.413112:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 13 pid: 9549 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.413123:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263936128:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.413163:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.419797:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263936000:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.419812:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263936128:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.419839:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3944448->4153343] (req 3944448->4153343) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.419854:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d600, rc 0) 00000100:00100000:2.0:1746065212.419898:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2288:x1830881265255936:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7590us (7744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.419906:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17217 00000100:00100000:0.0:1746065212.422712:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.422827:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.422884:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.422939:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265256448 00000100:00100000:1.0:1746065212.422947:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265256448 00000100:00100000:1.0:1746065212.422984:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5429 00000100:00100000:1.0:1746065212.422991:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2282:x1830881265256448:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065212.423124:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265256064 00000100:00100000:3.0:1746065212.423128:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265256064 00010000:00010000:3.0:1746065212.423146:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc1478c3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f39 expref: 26 pid: 13375 timeout: 908 lvb_type: 1 00000100:00100000:1.0:1746065212.423160:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+44:2282:x1830881265256448:12345-192.168.202.27@tcp:35:cat.0 Request processed in 170us (275us total) trans 8589937014 rc 0/0 00000100:00100000:3.0:1746065212.423163:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265256192 00000100:00100000:3.0:1746065212.423165:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265256192 00000100:00100000:1.0:1746065212.423167:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5429 00010000:00010000:3.0:1746065212.423171:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 14 pid: 9549 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.423185:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7994 00000100:00100000:3.0:1746065212.423188:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7995 00000100:00100000:1.0:1746065212.423190:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265256064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065212.423192:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265256192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065212.423197:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.423197:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065212.423211:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 14 pid: 9549 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.423211:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc1478c3e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f39 expref: 26 pid: 13375 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746065212.423219:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 14 pid: 9549 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.423823:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc1478c3e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f39 expref: 26 pid: 13375 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746065212.424017:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090de4200/0xad6b7ddc1478c06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f1d expref: 14 pid: 9549 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.424034:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065212.424067:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265256192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 873us (1239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.424072:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7995 00010000:00010000:1.0:1746065212.424533:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc1478c3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f39 expref: 26 pid: 13375 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746065212.424542:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.424544:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.424549:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.424556:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.424585:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.424594:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263936256:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065212.424652:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b23536c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065212.430346:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263936256:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065212.430366:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.430425:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265256064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7233us (7719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.430435:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7994 00000100:00100000:2.0:1746065212.431816:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.431911:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265256704 00000100:00100000:3.0:1746065212.431917:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265256704 00002000:00100000:3.0:1746065212.431949:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3944448->3948543) req@ffff88013615ed80 x1830881265256704/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.431958:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615ed80 with x1830881265256704 ext(3944448->3948543) 00002000:00010000:3.0:1746065212.431963:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615ed80 00000100:00100000:3.0:1746065212.431991:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6079 00000100:00100000:3.0:1746065212.431997:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265256704:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065212.432107:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265256704:12345-192.168.202.27@tcp:3:cat.0 Request processed in 110us (294us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065212.432112:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6079 00002000:00100000:3.0:1746065212.432117:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3944448->3948543) req@ffff88013615ed80 x1830881265256704/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/4536 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.432123:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615ed80 with x1830881265256704 ext(3944448->3948543) 00002000:00010000:3.0:1746065212.432126:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013615ed80 00000100:00100000:0.0:1746065212.442895:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.442956:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265256960 00000100:00100000:2.0:1746065212.442964:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265256960 00002000:00100000:2.0:1746065212.443005:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (4149248->4153343) req@ffff88008c528000 x1830881265256960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.443014:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528000 with x1830881265256960 ext(4149248->4153343) 00002000:00010000:2.0:1746065212.443019:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c528000 00000100:00100000:2.0:1746065212.443058:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6080 00000100:00100000:2.0:1746065212.443067:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881265256960:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065212.443212:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881265256960:12345-192.168.202.27@tcp:3:cat.0 Request processed in 145us (327us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065212.443218:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6080 00002000:00100000:2.0:1746065212.443224:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (4149248->4153343) req@ffff88008c528000 x1830881265256960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/4536 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.443235:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528000 with x1830881265256960 ext(4149248->4153343) 00002000:00010000:2.0:1746065212.443238:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c528000 00000100:00100000:0.0:1746065212.447699:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.448669:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265257088 00000100:00100000:2.0:1746065212.448679:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265257088 00000100:00100000:2.0:1746065212.448739:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17218 00000100:00100000:2.0:1746065212.448746:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2285:x1830881265257088:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065212.448763:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.448814:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f7f expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.448842:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.448850:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065212.448852:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065212.448855:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [4128768->4194303] (req 4128768->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 14 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.448879:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.448889:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 24 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.448898:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263936384:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.448982:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.453692:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263936384:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.453728:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [4128768->4194303] (req 4128768->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 14 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.453746:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c200, rc 0) 00000100:00100000:2.0:1746065212.454117:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2285:x1830881265257088:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5369us (6424us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.454125:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17218 00000100:00100000:0.0:1746065212.459116:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.459181:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265257216 00000100:00100000:3.0:1746065212.459190:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265257216 00002000:00100000:3.0:1746065212.459233:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3944448->4153343) req@ffff88008c529c00 x1830881265257216/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.459243:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c529c00 with x1830881265257216 ext(3944448->4153343) 00010000:00010000:3.0:1746065212.459252:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 25 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.459267:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 25 pid: 12260 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746065212.459274:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c529c00 00000100:00100000:3.0:1746065212.459306:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1997 00000100:00100000:3.0:1746065212.459314:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265257216:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065212.475905:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265257216:12345-192.168.202.27@tcp:4:cat.0 Request processed in 16584us (17381us total) trans 21474841653 rc 0/0 00000100:00100000:3.0:1746065212.475915:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1997 00002000:00100000:3.0:1746065212.475926:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3944448->4153343) req@ffff88008c529c00 x1830881265257216/t21474841653(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/448 e 0 to 0 dl 1746065223 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.475935:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c529c00 with x1830881265257216 ext(3944448->4153343) 00010000:00010000:3.0:1746065212.479455:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 27 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.479482:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 27 pid: 12260 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746065212.479490:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c529c00 00000100:00100000:0.0:1746065212.487322:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.487428:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265257344 00000100:00100000:1.0:1746065212.487437:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265257344 00010000:00010000:1.0:1746065212.487470:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 27 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.487510:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7996 00000100:00100000:1.0:1746065212.487517:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265257344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.487529:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.487548:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 27 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.487558:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 27 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.487578:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835d600/0xad6b7ddc1478ca7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3944448->4153343) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f78 expref: 27 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.487876:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.487878:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.487886:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.487894:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.487923:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.487934:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263936512:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065212.488641:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.488841:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065212.489175:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265257600 00000100:00100000:3.0:1746065212.489181:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265257600 00000100:00100000:3.0:1746065212.489226:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14523 00000100:00100000:3.0:1746065212.489232:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2294:x1830881265257600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065212.489248:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.489259:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc1478cb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f86 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.489313:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1478cbc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489324:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1478cbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489332:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1478cbc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489342:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478cc3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489351:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489356:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489453:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc1478cca lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489462:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc1478cca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489468:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc1478cca lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065212.489475:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065212.489537:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1478cbc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489544:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1478cbc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489549:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1478cbc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489555:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1478cbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489561:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c31a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.489565:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1478cbc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489570:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1478cbc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489582:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065212.489586:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.489589:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1478cbc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489594:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31a00/0xad6b7ddc1478cbc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489618:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489623:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478cc3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489627:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489632:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099c30000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.489633:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489637:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489643:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a9bcc500) 00010000:00010000:3.0:1746065212.489645:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.489647:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478cc3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489651:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30000/0xad6b7ddc1478cc3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.489680:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30200/0xad6b7ddc1478cb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f86 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.489690:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc1478cca lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f86 expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.489695:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065212.489697:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065212.489699:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:3.0:1746065212.489727:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2294:x1830881265257600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 496us (1087us total) trans 8589937015 rc 0/0 00000100:00100000:3.0:1746065212.489733:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14523 00000100:00100000:0.0:1746065212.490351:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263936512:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065212.490367:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065212.490401:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265257344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2884us (3085us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065212.490408:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7996 00000100:00100000:0.0:1746065212.492437:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.492523:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265257856 00000100:00100000:3.0:1746065212.492530:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265257856 00002000:00100000:3.0:1746065212.492569:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4128768->4132863) req@ffff88008c52ad80 x1830881265257856/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.492577:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52ad80 with x1830881265257856 ext(4128768->4132863) 00002000:00010000:3.0:1746065212.492582:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c52ad80 00000100:00100000:0.0:1746065212.493557:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.493884:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6081 00000100:00100000:3.0:1746065212.493895:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265257856:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065212.494023:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265257856:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 130us (1592us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065212.494029:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6081 00002000:00100000:3.0:1746065212.494035:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4128768->4132863) req@ffff88008c52ad80 x1830881265257856/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/4536 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.494043:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52ad80 with x1830881265257856 ext(4128768->4132863) 00002000:00010000:3.0:1746065212.494047:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c52ad80 00000100:00100000:1.0:1746065212.494246:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265257984 00000100:00100000:1.0:1746065212.494251:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265257984 00000100:00100000:1.0:1746065212.494285:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 845 00000100:00100000:1.0:1746065212.494290:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2004:x1830881265257984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.494298:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.494317:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c30600/0xad6b7ddc1478cca lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f86 expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.494331:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065212.494336:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.494354:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265257984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.494359:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 845 00000100:00100000:0.0:1746065212.510327:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.510442:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265258112 00000100:00100000:3.0:1746065212.510450:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265258112 00000100:00100000:3.0:1746065212.510487:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17219 00000100:00100000:3.0:1746065212.510494:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2285:x1830881265258112:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065212.510508:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.510524:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f8d expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.510548:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.510556:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1478c8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f6a expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.510562:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.510564:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.510567:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->5038079] (req 4194304->5038079) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.510593:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1478c8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f6a expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.510602:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1478c8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f6a expref: 28 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.510613:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263936640:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065212.512599:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.512612:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 13 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.512623:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263936768:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.513624:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.519099:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.519131:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.519164:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265258368 00000100:00100000:2.0:1746065212.519172:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265258368 00002000:00100000:2.0:1746065212.519221:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008c52bb80 x1830881265258368/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065212.519226:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263936640:192.168.202.27@tcp:104: 00002000:00100000:2.0:1746065212.519231:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52bb80 with x1830881265258368 ext(1048576->2097151) 00002000:00010000:2.0:1746065212.519236:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c52bb80 00000100:00100000:2.0:1746065212.519259:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265258624 00000100:00100000:2.0:1746065212.519261:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265258624 00000100:00100000:0.0:1746065212.519266:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6082 00002000:00100000:2.0:1746065212.519270:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88008c528700 x1830881265258624/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065212.519273:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265258368:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:2.0:1746065212.519276:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528700 with x1830881265258624 ext(1048576->2097151) 00002000:00010000:2.0:1746065212.519279:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c528700 00000100:00100000:2.0:1746065212.519300:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6083 00000100:00100000:2.0:1746065212.519305:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265258624:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065212.527585:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.530714:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263936768:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065212.530742:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->5038079] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.530755:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30200, rc 0) 00000100:00100000:1.0:1746065212.530842:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2285:x1830881265258112:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 20348us (20521us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.530850:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17219 00000100:00100000:2.0:1746065212.531167:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265258752 00000100:00100000:2.0:1746065212.531174:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265258752 00010000:00010000:2.0:1746065212.531199:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1478c8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f6a expref: 29 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746065212.531207:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.531231:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265258880 00000100:00100000:2.0:1746065212.531233:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265258880 00010000:00010000:2.0:1746065212.531243:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 13 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.531258:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7997 00000100:00100000:2.0:1746065212.531264:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265258752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065212.531273:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7998 00010000:00010000:2.0:1746065212.531274:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065212.531280:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265258880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.531287:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065212.531293:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1478c8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f6a expref: 29 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.531297:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 13 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.531304:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1478c8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f6a expref: 29 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.531444:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 13 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.531466:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835d800/0xad6b7ddc1478c8b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f6a expref: 29 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.531484:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1478c45 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f40 expref: 13 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.533782:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.533787:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.533798:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.533808:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.533846:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065212.533863:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263936896:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065212.534683:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065212.535081:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265258880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3798us (3873us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.535091:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7998 00000100:00100000:2.0:1746065212.535175:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.538366:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265258624:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19053us (19226us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065212.538375:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6083 00002000:00100000:2.0:1746065212.538384:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88008c528700 x1830881265258624/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.538400:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c528700 with x1830881265258624 ext(1048576->2097151) 00002000:00010000:2.0:1746065212.538405:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c528700 00000100:00100000:2.0:1746065212.541403:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265258368:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22113us (22294us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065212.541413:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6082 00002000:00100000:2.0:1746065212.541423:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008c52bb80 x1830881265258368/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.541431:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52bb80 with x1830881265258368 ext(1048576->2097151) 00002000:00010000:2.0:1746065212.541436:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c52bb80 00000100:00100000:1.0:1746065212.553309:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.553411:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263936896:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065212.553429:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065212.553462:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265258752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 22198us (25885us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.553472:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7997 00000100:00100000:0.0:1746065212.555558:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265259136 00000100:00100000:0.0:1746065212.555566:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265259136 00000100:00100000:0.0:1746065212.555616:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14524 00000100:00100000:0.0:1746065212.555622:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+44:2297:x1830881265259136:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065212.555642:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065212.555655:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abace00/0xad6b7ddc1478cdf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f94 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.555707:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1478ce6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555717:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1478ce6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555725:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1478ce6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555735:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1478ced lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555739:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1478ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555744:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1478ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555844:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478cf4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555852:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555858:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478cf4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065212.555865:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065212.555913:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1478ce6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555922:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1478ce6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555927:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1478ce6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555931:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1478ce6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555935:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abade00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065212.555938:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1478ce6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555943:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1478ce6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555950:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065212.555952:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065212.555955:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1478ce6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555959:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1478ce6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555984:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1478ced lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555988:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1478ced lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555992:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1478ced lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.555996:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abadc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065212.555998:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1478ced lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.556002:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1478ced lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.556007:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800924c5500) 00010000:00010000:0.0:1746065212.556009:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065212.556011:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1478ced lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.556015:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1478ced lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065212.556041:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abace00/0xad6b7ddc1478cdf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f94 expref: 47 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.556051:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478cf4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f94 expref: 46 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.556056:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065212.556058:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065212.556059:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:0.0:1746065212.556098:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2297:x1830881265259136:12345-192.168.202.27@tcp:101:cat.0 Request processed in 476us (2798us total) trans 8589937016 rc 0/0 00000100:00100000:0.0:1746065212.556103:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14524 00000100:00100000:0.0:1746065212.563233:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.563274:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.563315:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.563406:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265259520 00000100:00100000:3.0:1746065212.563415:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265259520 00000100:00100000:3.0:1746065212.563463:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 846 00000100:00100000:3.0:1746065212.563470:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881265259520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065212.563483:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065212.563506:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad200/0xad6b7ddc1478cf4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f94 expref: 46 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.563526:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065212.563529:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065212.563566:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881265259520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.563572:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 846 00000100:00100000:1.0:1746065212.563684:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265259648 00000100:00100000:1.0:1746065212.563687:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265259648 00000100:00100000:1.0:1746065212.563708:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17220 00000100:00100000:1.0:1746065212.563712:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265259648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065212.563724:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065212.563734:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc1478d02 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938f9b expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.563768:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263937024:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065212.563836:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.563908:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265259392 00000100:00100000:2.0:1746065212.563912:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265259392 00000100:00100000:2.0:1746065212.563932:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5430 00000100:00100000:2.0:1746065212.563936:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2285:x1830881265259392:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065212.564059:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2285:x1830881265259392:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 121us (833us total) trans 8589937017 rc 0/0 00000100:00100000:2.0:1746065212.564064:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5430 00000100:00100000:0.0:1746065212.565103:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:1.0:1746065212.565194:0:12260:0:(ofd_lvb.c:258:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size: 4897248 -> 5034592 00002000:00010000:1.0:1746065212.565197:0:12260:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065211 -> 1746065212 00000100:00100000:1.0:1746065212.565209:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263937024:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065212.565227:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc1478d02 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f9b expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.565238:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857800/0xad6b7ddc1478d02 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f9b expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.565250:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857800, rc 0) 00000100:00100000:1.0:1746065212.565275:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265259648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1561us (1959us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065212.565281:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17220 00000100:00100000:1.0:1746065212.565292:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265259776 00000100:00100000:1.0:1746065212.565294:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265259776 00000100:00100000:1.0:1746065212.565319:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17221 00000100:00100000:1.0:1746065212.565324:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265259776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065212.565332:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065212.565341:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc1478d09 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fa2 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.565370:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263937152:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065212.565408:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065212.567557:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263937152:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065212.567579:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc1478d09 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fa2 expref: 27 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.567589:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856a00/0xad6b7ddc1478d09 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fa2 expref: 27 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.567596:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856a00, rc 0) 00000100:00100000:1.0:1746065212.567623:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265259776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2298us (2521us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065212.567629:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17221 00000100:00100000:1.0:1746065212.582629:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.582683:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.582722:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265260032 00000100:00100000:1.0:1746065212.582729:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265260032 00002000:00100000:1.0:1746065212.582765:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff8800996fb800 x1830881265260032/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.582792:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fb800 with x1830881265260032 ext(2097152->4194303) 00002000:00010000:1.0:1746065212.582797:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996fb800 00000100:00100000:1.0:1746065212.582811:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265260288 00000100:00100000:1.0:1746065212.582813:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265260288 00002000:00100000:1.0:1746065212.582825:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4128767) req@ffff8800996fb100 x1830881265260288/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.582831:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fb100 with x1830881265260288 ext(2097152->4128767) 00002000:00010000:1.0:1746065212.582834:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996fb100 00000100:00100000:1.0:1746065212.582849:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6084 00000100:00100000:1.0:1746065212.582856:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265260032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065212.583103:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6085 00000100:00100000:3.0:1746065212.583112:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265260288:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065212.592195:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.592316:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.592427:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265260416 00000100:00100000:2.0:1746065212.592435:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265260416 00000100:00100000:2.0:1746065212.592481:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265260544 00000100:00100000:2.0:1746065212.592484:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265260544 00000100:00100000:2.0:1746065212.592501:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17222 00000100:00100000:2.0:1746065212.592508:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265260416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065212.592522:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.592536:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f60200/0xad6b7ddc1478d10 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fa9 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065212.592580:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263937280:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065212.592680:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17223 00000100:00100000:3.0:1746065212.592688:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265260544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065212.592696:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.592705:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d17 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fb0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065212.592729:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263937408:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065212.592846:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065212.592874:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.600744:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263937280:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065212.600793:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f60200/0xad6b7ddc1478d10 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fa9 expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.600808:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60200/0xad6b7ddc1478d10 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fa9 expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.600832:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60200, rc 0) 00000100:00100000:2.0:1746065212.600873:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265260416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8363us (8822us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065212.600881:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17222 00000100:00100000:2.0:1746065212.601081:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263937408:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065212.601096:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d17 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb0 expref: 27 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.601108:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d17 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb0 expref: 27 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.601118:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2d800, rc 0) 00000100:00100000:2.0:1746065212.601136:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265260544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8450us (8886us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065212.601141:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17223 00000100:00100000:0.0:1746065212.620638:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.620703:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265260672 00000100:00100000:3.0:1746065212.620711:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265260672 00000100:00100000:3.0:1746065212.620753:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17224 00000100:00100000:3.0:1746065212.620760:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2297:x1830881265260672:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065212.620787:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265260032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 37915us (38148us total) trans 0 rc 2097152/2097152 00010000:00010000:3.0:1746065212.620789:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065212.620796:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6084 00002000:00100000:0.0:1746065212.620803:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff8800996fb800 x1830881265260032/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746065212.620804:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fb7 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065212.620812:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fb800 with x1830881265260032 ext(2097152->4194303) 00002000:00010000:0.0:1746065212.620816:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800996fb800 00010000:00010000:3.0:1746065212.620828:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 11 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.620835:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065212.620836:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065212.620840:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.620864:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 11 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.620874:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 11 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.620885:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263937536:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065212.629195:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.629223:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265260800 00000100:00100000:0.0:1746065212.629230:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265260800 00002000:00100000:0.0:1746065212.629261:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5034591) req@ffff88012f3c2680 x1830881265260800/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065212.629736:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c2680 with x1830881265260800 ext(4194304->5034591) 00010000:00010000:0.0:1746065212.629746:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 12 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.629759:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 12 pid: 12260 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746065212.629766:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3c2680 00000100:00100000:0.0:1746065212.629807:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1998 00000100:00100000:0.0:1746065212.629814:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265260800:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065212.631764:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065212.631820:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263937536:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065212.631840:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.631857:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2d200, rc 0) 00000100:00100000:3.0:1746065212.631905:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2297:x1830881265260672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11144us (11273us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.631912:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17224 00000100:00100000:3.0:1746065212.636168:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265260288:12345-192.168.202.27@tcp:3:cat.0 Request processed in 53048us (53475us total) trans 0 rc 2031616/2031616 00000100:00100000:3.0:1746065212.636180:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6085 00002000:00100000:3.0:1746065212.636190:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4128767) req@ffff8800996fb100 x1830881265260288/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 2031616/2031616 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.636198:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fb100 with x1830881265260288 ext(2097152->4128767) 00002000:00010000:3.0:1746065212.636203:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996fb100 00000100:00100000:0.0:1746065212.642481:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.642633:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265260928 00000100:00100000:3.0:1746065212.642641:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265260928 00000100:00100000:3.0:1746065212.642692:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17225 00000100:00100000:3.0:1746065212.642699:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2294:x1830881265260928:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065212.642714:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.642728:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fbe expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.642750:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065212.642752:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065212.642756:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.642765:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.642803:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2d800, rc 0) 00000100:00100000:3.0:1746065212.642852:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2294:x1830881265260928:12345-192.168.202.27@tcp:101:cat.0 Request processed in 154us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.642858:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17225 00000100:00100000:0.0:1746065212.646642:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265260800:12345-192.168.202.27@tcp:4:cat.0 Request processed in 16820us (17447us total) trans 17179874255 rc 0/0 00000100:00100000:0.0:1746065212.646653:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1998 00002000:00100000:0.0:1746065212.646664:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5034591) req@ffff88012f3c2680 x1830881265260800/t17179874255(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/448 e 0 to 0 dl 1746065223 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065212.646673:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c2680 with x1830881265260800 ext(4194304->5034591) 00010000:00010000:0.0:1746065212.646682:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 15 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.646697:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 15 pid: 12260 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746065212.646703:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f3c2680 00000100:00100000:0.0:1746065212.657217:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.657700:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265261056 00000100:00100000:3.0:1746065212.657708:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265261056 00010000:00010000:3.0:1746065212.657741:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 15 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746065212.658010:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 7999 00000100:00100000:0.0:1746065212.658018:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265261056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.658030:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065212.658045:0:7192:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5480 -> 5752 00010000:00010000:0.0:1746065212.658050:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 15 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.658061:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 15 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.659131:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30200/0xad6b7ddc1478cd8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f8d expref: 15 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.659161:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.659163:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.659168:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.659175:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.659181:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.659182:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.659184:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.659189:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.659252:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.659270:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263937664:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065212.659370:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.659379:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263937792:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065212.659407:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.674771:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.674872:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263937664:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065212.674880:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263937792:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065212.674900:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.674930:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265261056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 16914us (17721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.674940:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 7999 00000100:00100000:2.0:1746065212.675003:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265261312 00000100:00100000:2.0:1746065212.675008:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265261312 00002000:00100000:2.0:1746065212.675038:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012f3c0e00 x1830881265261312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.675046:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0e00 with x1830881265261312 ext(3145728->4194303) 00002000:00010000:2.0:1746065212.675050:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c0e00 00000100:00100000:2.0:1746065212.675071:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6086 00000100:00100000:2.0:1746065212.675076:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265261312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065212.688453:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.694919:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265261568 00000100:00100000:3.0:1746065212.694934:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265261568 00002000:00100000:3.0:1746065212.695062:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012f3c0a80 x1830881265261568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.695070:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0a80 with x1830881265261568 ext(2097152->3145727) 00002000:00010000:3.0:1746065212.695076:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c0a80 00000100:00100000:3.0:1746065212.695094:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6087 00000100:00100000:3.0:1746065212.695100:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265261568:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065212.696383:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265261312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21300us (21613us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065212.696401:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6086 00002000:00100000:3.0:1746065212.696409:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012f3c0e00 x1830881265261312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.696418:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0e00 with x1830881265261312 ext(3145728->4194303) 00002000:00010000:3.0:1746065212.696422:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c0e00 00000100:00100000:0.0:1746065212.713508:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.713680:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265261568:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18577us (25232us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065212.713690:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6087 00002000:00100000:2.0:1746065212.713703:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012f3c0a80 x1830881265261568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.713715:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0a80 with x1830881265261568 ext(2097152->3145727) 00002000:00010000:2.0:1746065212.713720:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c0a80 00000100:00100000:3.0:1746065212.714135:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265261824 00000100:00100000:3.0:1746065212.714142:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265261824 00000100:00100000:3.0:1746065212.714176:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14525 00000100:00100000:3.0:1746065212.714182:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2300:x1830881265261824:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065212.714198:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.714211:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2cc00/0xad6b7ddc1478d2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fc5 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.714266:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc1478d33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714277:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc1478d33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714285:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc1478d33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714296:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ae00/0xad6b7ddc1478d3a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714301:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ae00/0xad6b7ddc1478d3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714309:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ae00/0xad6b7ddc1478d3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714400:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d41 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714409:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714414:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d41 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065212.714422:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065212.714485:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc1478d33 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714491:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc1478d33 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714496:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc1478d33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714502:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc1478d33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714506:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008d926800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.714509:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc1478d33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714514:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc1478d33 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714522:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065212.714524:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.714528:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc1478d33 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714532:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008d926800/0xad6b7ddc1478d33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714545:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ae00/0xad6b7ddc1478d3a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714549:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ae00/0xad6b7ddc1478d3a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714554:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ae00/0xad6b7ddc1478d3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714557:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ae00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065212.714558:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ae00/0xad6b7ddc1478d3a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714562:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ae00/0xad6b7ddc1478d3a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714566:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a9bcc500) 00010000:00010000:3.0:1746065212.714568:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065212.714569:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ae00/0xad6b7ddc1478d3a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714572:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84ae00/0xad6b7ddc1478d3a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.714601:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2cc00/0xad6b7ddc1478d2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fc5 expref: 48 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.714610:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d41 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fc5 expref: 47 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.714616:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065212.714618:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065212.714619:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b400, rc 0) 00000100:00100000:3.0:1746065212.714640:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+47:2300:x1830881265261824:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 458us (1144us total) trans 8589937018 rc 0/0 00000100:00100000:3.0:1746065212.714645:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14525 00000100:00100000:0.0:1746065212.715931:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.718538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.718568:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.718598:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265262464 00000100:00100000:0.0:1746065212.718604:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265262464 00000100:00100000:0.0:1746065212.718636:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5431 00000100:00100000:0.0:1746065212.718642:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2300:x1830881265262464:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065212.718800:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+48:2300:x1830881265262464:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 157us (230us total) trans 8589937019 rc 0/0 00000100:00100000:0.0:1746065212.718806:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5431 00000100:00100000:1.0:1746065212.718904:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265262208 00000100:00100000:1.0:1746065212.718908:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265262208 00000100:00100000:1.0:1746065212.718932:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 847 00000100:00100000:1.0:1746065212.718937:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+48:2007:x1830881265262208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.718945:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.718963:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d41 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fc5 expref: 48 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.718978:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065212.718982:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.719011:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881265262208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.719016:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 847 00000100:00100000:2.0:1746065212.719536:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265262080 00000100:00100000:2.0:1746065212.719540:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265262080 00002000:00100000:2.0:1746065212.719561:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88012f3c0380 x1830881265262080/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.719569:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0380 with x1830881265262080 ext(4194304->5038079) 00002000:00010000:2.0:1746065212.719573:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c0380 00000100:00100000:2.0:1746065212.719589:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6088 00000100:00100000:2.0:1746065212.719594:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265262080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065212.729265:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.729725:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265262592 00000100:00100000:2.0:1746065212.729734:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265262592 00000100:00100000:2.0:1746065212.730822:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17226 00000100:00100000:2.0:1746065212.730834:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2297:x1830881265262592:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065212.730851:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.730869:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fcc expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.730895:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.730902:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065212.730904:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065212.730907:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.730936:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.730948:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 13 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.730959:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263937920:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.731620:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265262080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12021us (15686us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065212.731629:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6088 00002000:00100000:3.0:1746065212.731638:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88012f3c0380 x1830881265262080/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.731646:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0380 with x1830881265262080 ext(4194304->5038079) 00002000:00010000:3.0:1746065212.731650:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c0380 00000100:00100000:2.0:1746065212.731795:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.738881:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263937920:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.738917:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.738933:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60600, rc 0) 00000100:00100000:2.0:1746065212.741480:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2297:x1830881265262592:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10641us (12216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.741491:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17226 00000100:00100000:0.0:1746065212.741771:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.741848:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265262720 00000100:00100000:3.0:1746065212.741854:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265262720 00002000:00100000:3.0:1746065212.741889:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4128768->4194303) req@ffff88012f3c0000 x1830881265262720/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065212.741898:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0000 with x1830881265262720 ext(4128768->4194303) 00010000:00010000:3.0:1746065212.741905:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 14 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.741916:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 14 pid: 12260 timeout: 908 lvb_type: 0 00002000:00010000:3.0:1746065212.741927:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3c0000 00000100:00100000:3.0:1746065212.741951:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1999 00000100:00100000:3.0:1746065212.741956:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265262720:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065212.750231:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.750289:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.750505:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265262848 00000100:00100000:2.0:1746065212.750513:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265262848 00000100:00100000:2.0:1746065212.750572:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17227 00000100:00100000:2.0:1746065212.750579:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265262848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065212.750595:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.750608:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478d56 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fd3 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.750895:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265262976 00000100:00100000:1.0:1746065212.750900:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265262976 00000100:00100000:1.0:1746065212.750938:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14526 00000100:00100000:1.0:1746065212.750945:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2301:x1830881265262976:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065212.750959:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065212.750969:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1478d5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fda expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065212.750978:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263938048:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065212.751019:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1478d64 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.751034:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1478d64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.751044:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1478d64 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.751054:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1478d6b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065212.751056:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1746065212.751059:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1478d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.751065:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1478d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.751120:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.751128:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f71 expref: 46 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.751134:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.751152:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f71 expref: 46 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.751161:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f71 expref: 46 pid: 9571 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.751176:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263938176:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065212.751202:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.752107:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265262720:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10148us (10335us total) trans 21474841654 rc 0/0 00000100:00100000:0.0:1746065212.752116:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1999 00002000:00100000:0.0:1746065212.752124:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (4128768->4194303) req@ffff88012f3c0000 x1830881265262720/t21474841654(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/448 e 0 to 0 dl 1746065223 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065212.752133:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0000 with x1830881265262720 ext(4128768->4194303) 00010000:00010000:0.0:1746065212.752139:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 18 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.752150:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 18 pid: 12260 timeout: 908 lvb_type: 0 00002000:00010000:0.0:1746065212.752156:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3c0000 00000100:00100000:1.0:1746065212.753692:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263938176:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.753832:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263938048:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065212.753852:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478d56 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fd3 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.753863:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478d56 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fd3 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.753886:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60a00, rc 0) 00000100:00100000:2.0:1746065212.753909:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265262848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3331us (3685us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065212.753916:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17227 00010000:00010000:1.0:1746065212.754084:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065212.754087:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.754111:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265263104 00000100:00100000:2.0:1746065212.754115:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265263104 00010000:00010000:2.0:1746065212.754132:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f71 expref: 47 pid: 9571 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.754146:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8000 00000100:00100000:2.0:1746065212.754150:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265263104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065212.754158:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065212.754161:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f71 expref: 47 pid: 9571 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.754167:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f71 expref: 47 pid: 9571 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.754177:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc1478c99 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f71 expref: 47 pid: 9571 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.754184:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065212.754187:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.754192:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.754196:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065212.754205:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065212.754217:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881265263104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.754220:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8000 00010000:00010000:1.0:1746065212.754317:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754323:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065212.754364:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:1.0:1746065212.754369:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065212.754383:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754406:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754415:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1478d64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754421:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1478d64 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754426:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1478d64 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754431:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1478d64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754435:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bee600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065212.754439:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1478d64 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754444:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1478d64 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754452:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065212.754454:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065212.754457:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1478d64 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754461:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1478d64 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754486:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1478d6b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754490:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1478d6b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754495:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1478d6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754499:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bef400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065212.754501:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1478d6b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754506:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1478d6b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754511:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008ec47900) 00010000:00010000:1.0:1746065212.754513:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065212.754515:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1478d6b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754519:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1478d6b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065212.754546:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1478d5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fda expref: 14 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.754555:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fda expref: 13 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.754561:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065212.754563:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065212.754566:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bef600, rc 0) 00000100:00100000:1.0:1746065212.754597:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2301:x1830881265262976:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3653us (4307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.754603:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14526 00000100:00100000:0.0:1746065212.759227:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.759259:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.759287:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265263232 00000100:00100000:0.0:1746065212.759287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.759294:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265263232 00000100:00100000:0.0:1746065212.759300:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.759337:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.759367:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265263488 00000100:00100000:3.0:1746065212.759371:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265263488 00000100:00100000:3.0:1746065212.759414:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265263616 00000100:00100000:1.0:1746065212.759415:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265263744 00000100:00100000:3.0:1746065212.759416:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265263616 00000100:00100000:1.0:1746065212.759419:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265263744 00000100:00100000:3.0:1746065212.759430:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17228 00000100:00100000:3.0:1746065212.759436:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265263232:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065212.759449:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065212.759454:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17229 00000100:00100000:1.0:1746065212.759460:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265263488:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065212.759461:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d79 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fe1 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.759467:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065212.759473:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478d80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fe8 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.759478:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.759479:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.759484:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.759485:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.759486:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe1 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.759490:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478d80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe8 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.759497:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe1 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.759498:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478d80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe8 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.759505:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b400, rc 0) 00010000:00010000:1.0:1746065212.759505:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61400, rc 0) 00000100:00100000:1.0:1746065212.759539:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265263488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 79us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.759545:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17229 00000100:00100000:0.0:1746065212.759556:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17230 00000100:00100000:1.0:1746065212.759560:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17231 00000100:00100000:0.0:1746065212.759563:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265263616:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:1.0:1746065212.759564:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265263744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065212.759571:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065212.759571:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065212.759576:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478d87 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ff6 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.759580:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc1478d8e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938fef expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.759591:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.759592:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065212.759597:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc1478d8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fef expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065212.759602:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263938304:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065212.759607:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc1478d8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fef expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065212.759618:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:0.0:1746065212.759636:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265263616:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 74us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.759637:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.759641:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17230 00000100:00100000:2.0:1746065212.759696:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265263360 00000100:00100000:2.0:1746065212.759699:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265263360 00010000:00010000:2.0:1746065212.759712:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 16 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.759742:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8001 00000100:00100000:2.0:1746065212.759747:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265263360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065212.759754:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065212.759768:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 16 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.759802:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 16 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.759815:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.759817:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.759821:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.759827:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.759844:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065212.759853:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263938432:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065212.759951:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265263232:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 515us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.759956:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17228 00000100:00100000:2.0:1746065212.760140:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.762368:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.762808:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065212.762962:0:3068:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff8800996fad80 x1830881263938304) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 16 pid: 12260 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.762987:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc1478cae lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4128768->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f7f expref: 16 pid: 12260 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.762998:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263938304:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065212.763023:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478d87 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ff6 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.763033:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478d87 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ff6 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.763040:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b60000, rc 0) 00000100:00100000:1.0:1746065212.763072:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265263744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3507us (3770us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065212.763080:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17231 00000100:00100000:1.0:1746065212.763098:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265264000 00000100:00100000:1.0:1746065212.763102:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265264000 00000100:00100000:1.0:1746065212.764044:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265263872 00000100:00100000:1.0:1746065212.764049:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265263872 00000100:00100000:2.0:1746065212.764151:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17232 00000100:00100000:2.0:1746065212.764159:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+27:2300:x1830881265264000:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065212.764170:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.764179:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939004 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.764199:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 28 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.764212:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478d80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe8 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.764218:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1478c84 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f63 expref: 16 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.764223:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.764225:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.764228:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->1458175] (req 1048576->1458175) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.764247:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1478c84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f63 expref: 16 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.764256:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1478c84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f63 expref: 16 pid: 9549 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.764265:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263938560:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.764315:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478d80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe8 expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.764322:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478d80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe8 expref: 9 pid: 3068 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.764329:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263938688:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065212.764551:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17233 00000100:00100000:1.0:1746065212.764556:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265263872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065212.764563:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065212.764568:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478d9c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd938ffd expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.764578:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.764580:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.764585:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478d9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ffd expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.764596:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478d9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ffd expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065212.764602:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61800, rc 0) 00000100:00100000:1.0:1746065212.764616:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2006:x1830881265263872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 61us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.764621:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17233 00010000:00010000:2.0:1746065212.764936:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 28 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.764949:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 28 pid: 9549 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.764960:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263938816:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.765004:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.765027:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263938432:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065212.765040:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065212.765057:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265263360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5309us (5719us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.765064:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8001 00000100:00100000:2.0:1746065212.765661:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263938944:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1746065212.765690:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065212.765850:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263938944 00000100:00100000:3.0:1746065212.765855:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263938944 00000100:00100000:3.0:1746065212.765893:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1746065212.765898:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263938944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1746065212.765911:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1070455104 pending 2084864 free 3906805760 avail 3668295680 00000100:00100000:3.0:1746065212.765951:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881263938944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 53us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.765957:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:2.0:1746065212.766498:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263938944:0@lo:13:osp-pre-1-1.0 00000100:00080000:0.0:1746065212.767125:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065212.768220:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.768264:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265264512 00000100:00100000:1.0:1746065212.768270:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265264512 00000100:00100000:0.0:1746065212.768291:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.768308:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.768335:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265264128 00000100:00100000:2.0:1746065212.768339:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265264128 00010000:00010000:2.0:1746065212.768359:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478d80 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe8 expref: 10 pid: 3068 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.768399:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265264256 00000100:00100000:2.0:1746065212.768402:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265264256 00010000:00010000:2.0:1746065212.768412:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1478c84 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f63 expref: 16 pid: 9549 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746065212.768437:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14527 00000100:00100000:2.0:1746065212.768437:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8002 00000100:00100000:1.0:1746065212.768442:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8003 00000100:00100000:2.0:1746065212.768443:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265264128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065212.768445:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+13:2301:x1830881265264512:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:1.0:1746065212.768449:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265264256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065212.768452:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.768455:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065212.768457:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.768467:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478d80 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe8 expref: 10 pid: 3068 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746065212.768467:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1478c84 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f63 expref: 16 pid: 9549 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746065212.768470:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478da3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93900b expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.768475:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478d80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe8 expref: 10 pid: 3068 timeout: 908 lvb_type: 1 00010000:00010000:1.0:1746065212.768483:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1478c84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f63 expref: 16 pid: 9549 timeout: 908 lvb_type: 1 00010000:00010000:2.0:1746065212.768510:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065212.768510:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.768535:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265264256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 88us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.768536:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265264128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.768540:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8003 00000100:00100000:2.0:1746065212.768542:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8002 00010000:00010000:3.0:1746065212.768546:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.768557:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fda expref: 14 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.768563:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.768570:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44600/0xad6b7ddc1478c84 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f63 expref: 15 pid: 9549 timeout: 908 lvb_type: 1 00000100:00100000:2.0:1746065212.768580:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263938560:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065212.768584:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fda expref: 14 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.768589:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1478d80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe8 expref: 9 pid: 3068 timeout: 908 lvb_type: 1 00010000:00010000:3.0:1746065212.768593:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fda expref: 14 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.768596:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263938688:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.768604:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263938816:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.768607:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263939072:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.768622:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->1458175] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.768631:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61600, rc 0) 00000100:00100000:3.0:1746065212.768643:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.768647:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2300:x1830881265264000:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4491us (6285us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.768653:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17232 00000100:00100000:0.0:1746065212.768765:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.768897:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265264640 00000100:00100000:1.0:1746065212.768900:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265264640 00010000:00010000:1.0:1746065212.768911:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 28 pid: 9549 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.768929:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8004 00000100:00100000:1.0:1746065212.768933:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265264640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.768939:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.768945:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 28 pid: 9549 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.768952:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 28 pid: 9549 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.768962:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc1478c5a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f55 expref: 28 pid: 9549 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.768969:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.769365:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.769371:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.769378:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.769404:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.769411:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263939200:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065212.769687:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.770061:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.770135:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263939072:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065212.770148:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:1.0:1746065212.770194:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265264896 00000100:00100000:1.0:1746065212.770197:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265264896 00002000:00100000:1.0:1746065212.770218:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880099cf0380 x1830881265264896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.770226:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0380 with x1830881265264896 ext(2097152->4194303) 00002000:00010000:1.0:1746065212.770229:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0380 00000100:00100000:1.0:1746065212.770248:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6089 00000100:00100000:1.0:1746065212.770253:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265264896:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065212.771028:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.771069:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.771108:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265265280 00000100:00100000:3.0:1746065212.771111:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265265280 00010000:00010000:3.0:1746065212.771127:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fda expref: 15 pid: 7205 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.771144:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8005 00000100:00100000:3.0:1746065212.771149:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265265280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065212.771156:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065212.771160:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fda expref: 15 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.771169:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fda expref: 15 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.771182:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef600/0xad6b7ddc1478d72 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fda expref: 15 pid: 7205 timeout: 908 lvb_type: 0 00010000:00010000:3.0:1746065212.771196:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065212.771200:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.771212:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.771217:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.771229:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065212.771252:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265265280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 102us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.771257:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8005 00010000:00010000:3.0:1746065212.771276:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065212.771281:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065212.771293:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065212.771382:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478da3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93900b expref: 15 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.771406:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93900b expref: 14 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.771411:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065212.771413:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065212.771415:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a600, rc 0) 00000100:00100000:3.0:1746065212.771448:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+14:2301:x1830881265264512:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3004us (3232us total) trans 8589937020 rc 0/0 00000100:00100000:3.0:1746065212.771454:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14527 00000100:00100000:2.0:1746065212.771753:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265265152 00000100:00100000:2.0:1746065212.771757:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265265152 00002000:00100000:2.0:1746065212.771786:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880099cf0e00 x1830881265265152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.771794:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0e00 with x1830881265265152 ext(3145728->4194303) 00002000:00010000:2.0:1746065212.771797:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf0e00 00000100:00100000:2.0:1746065212.771807:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6090 00000100:00100000:2.0:1746065212.771812:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265265152:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065212.772877:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263939200:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065212.772890:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.772947:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265264640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4011us (4180us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.772954:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8004 00000100:00100000:3.0:1746065212.773213:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.773264:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.773277:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265265792 00000100:00100000:3.0:1746065212.773280:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265265792 00000100:00100000:3.0:1746065212.773313:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5432 00000100:00100000:3.0:1746065212.773319:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2294:x1830881265265792:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065212.773538:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265265536 00000100:00100000:1.0:1746065212.773542:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265265536 00002000:00100000:1.0:1746065212.773557:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1052671) req@ffff880099e10380 x1830881265265536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.773566:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e10380 with x1830881265265536 ext(1048576->1052671) 00002000:00010000:1.0:1746065212.773569:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e10380 00000100:00100000:1.0:1746065212.773585:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6091 00000100:00100000:1.0:1746065212.773590:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265265536:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065212.774158:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2294:x1830881265265792:12345-192.168.202.27@tcp:35:cat.0 Request processed in 837us (892us total) trans 8589937021 rc 0/0 00000100:00100000:3.0:1746065212.774164:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5432 00000100:00100000:1.0:1746065212.775276:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265265536:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 1682us (2060us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065212.775284:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6091 00002000:00100000:1.0:1746065212.775289:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1052671) req@ffff880099e10380 x1830881265265536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/4536 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.775488:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e10380 with x1830881265265536 ext(1048576->1052671) 00002000:00010000:1.0:1746065212.775493:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e10380 00000100:00100000:3.0:1746065212.775619:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.776116:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265265920 00000100:00100000:2.0:1746065212.776122:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265265920 00000100:00100000:2.0:1746065212.776164:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14528 00000100:00100000:2.0:1746065212.776170:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+14:2301:x1830881265265920:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065212.776185:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.776198:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60400/0xad6b7ddc1478db8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939012 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.776261:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.776274:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93900b expref: 15 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.776285:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.776310:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93900b expref: 15 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.776319:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93900b expref: 15 pid: 9571 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.776329:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263939328:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065212.776376:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065212.793487:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265265152:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 21665us (22451us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065212.793497:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6090 00002000:00100000:2.0:1746065212.793507:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880099cf0e00 x1830881265265152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.793516:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0e00 with x1830881265265152 ext(3145728->4194303) 00002000:00010000:2.0:1746065212.793521:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf0e00 00000100:00100000:0.0:1746065212.795434:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.795520:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263939328:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065212.795544:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:1.0:1746065212.795593:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265266048 00000100:00100000:1.0:1746065212.795599:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265266048 00010000:00010000:1.0:1746065212.795624:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93900b expref: 16 pid: 9571 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.795643:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8006 00000100:00100000:1.0:1746065212.795649:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265266048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.795660:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.795665:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93900b expref: 16 pid: 9571 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.795679:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93900b expref: 16 pid: 9571 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.795697:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a600/0xad6b7ddc1478daa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93900b expref: 16 pid: 9571 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.795710:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065212.795714:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065212.795722:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065212.795728:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065212.795740:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.795770:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265266048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 122us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.795789:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8006 00010000:00010000:2.0:1746065212.795858:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.795864:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065212.795910:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:2.0:1746065212.795914:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065212.795928:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.795951:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60400/0xad6b7ddc1478db8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939012 expref: 15 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.795966:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939012 expref: 14 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.795972:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065212.795974:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065212.795976:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60e00, rc 0) 00000100:00100000:2.0:1746065212.795995:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+14:2301:x1830881265265920:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 19825us (20376us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065212.796000:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14528 00000100:00100000:0.0:1746065212.810048:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.810366:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265264896:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 40110us (40303us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065212.810376:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6089 00002000:00100000:1.0:1746065212.810394:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880099cf0380 x1830881265264896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.810403:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0380 with x1830881265264896 ext(2097152->4194303) 00002000:00010000:1.0:1746065212.810409:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0380 00000100:00100000:0.0:1746065212.810643:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.810702:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265266176 00000100:00100000:2.0:1746065212.810709:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265266176 00000100:00100000:2.0:1746065212.810744:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265266304 00000100:00100000:2.0:1746065212.810746:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265266304 00000100:00100000:2.0:1746065212.810765:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17234 00000100:00100000:2.0:1746065212.810771:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265266176:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065212.810805:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065212.810824:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1478dc6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939019 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065212.810873:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263939456:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065212.810933:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065212.811030:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17235 00000100:00100000:3.0:1746065212.811038:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265266304:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065212.811044:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.811053:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478dcd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939020 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.811063:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.811065:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.811074:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478dcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939020 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.811088:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478dcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939020 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.811096:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b60000, rc 0) 00000100:00100000:3.0:1746065212.811116:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265266304:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 80us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.811120:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17235 00000100:00100000:0.0:1746065212.817290:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.818047:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.818072:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265266816 00000100:00100000:2.0:1746065212.818079:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265266816 00000100:00100000:2.0:1746065212.818120:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14529 00000100:00100000:2.0:1746065212.818126:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2304:x1830881265266816:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:3.0:1746065212.818131:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263939456:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065212.818149:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.818157:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1478dc6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939019 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065212.818162:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60400/0xad6b7ddc1478dd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939027 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.818167:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61000/0xad6b7ddc1478dc6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939019 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.818177:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61000, rc 0) 00000100:00100000:3.0:1746065212.818207:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265266176:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7437us (8171us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065212.818213:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17234 00010000:00010000:2.0:1746065212.818217:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478ddb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818228:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478ddb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818237:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478ddb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818247:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478de2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818252:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478de2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818257:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478de2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818325:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc1478de9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00000100:00100000:1.0:1746065212.818490:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265266560 00000100:00100000:1.0:1746065212.818494:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265266560 00002000:00100000:1.0:1746065212.818515:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1454080->1458175) req@ffff880099cf2a00 x1830881265266560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.818524:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2a00 with x1830881265266560 ext(1454080->1458175) 00002000:00010000:1.0:1746065212.818528:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf2a00 00000100:00100000:1.0:1746065212.818543:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6092 00000100:00100000:1.0:1746065212.818547:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265266560:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065212.818623:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265266560:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 75us (1341us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065212.818628:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6092 00002000:00100000:1.0:1746065212.818632:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1454080->1458175) req@ffff880099cf2a00 x1830881265266560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/4536 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.818639:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2a00 with x1830881265266560 ext(1454080->1458175) 00002000:00010000:1.0:1746065212.818641:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf2a00 00010000:00010000:2.0:1746065212.818748:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc1478de9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818757:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc1478de9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065212.818765:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065212.818845:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478ddb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818851:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478ddb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818856:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478ddb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818861:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478ddb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818866:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065212.818869:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478ddb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818874:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478ddb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818882:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065212.818885:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065212.818887:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478ddb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818892:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60a00/0xad6b7ddc1478ddb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818905:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478de2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818913:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478de2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818917:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478de2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818921:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065212.818923:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478de2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818927:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478de2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818932:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097b72a00) 00010000:00010000:2.0:1746065212.818934:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065212.818936:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478de2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818940:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478de2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065212.818965:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60400/0xad6b7ddc1478dd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939027 expref: 31 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.818973:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc1478de9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939027 expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.818978:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065212.818979:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065212.818981:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61800, rc 0) 00000100:00100000:2.0:1746065212.818998:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2304:x1830881265266816:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 873us (953us total) trans 8589937022 rc 0/0 00000100:00100000:2.0:1746065212.819004:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14529 00000100:00100000:0.0:1746065212.820846:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.821067:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265267072 00000100:00100000:2.0:1746065212.821072:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265267072 00002000:00100000:2.0:1746065212.821099:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880099cf0a80 x1830881265267072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.821108:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0a80 with x1830881265267072 ext(4194304->5038079) 00002000:00010000:2.0:1746065212.821112:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf0a80 00000100:00100000:2.0:1746065212.822291:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6093 00000100:00100000:2.0:1746065212.822300:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265267072:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065212.829462:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.829492:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.829517:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265267328 00000100:00100000:0.0:1746065212.829523:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265267328 00000100:00100000:0.0:1746065212.829555:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14530 00000100:00100000:0.0:1746065212.829561:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+14:2301:x1830881265267328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065212.829578:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065212.829592:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6200/0xad6b7ddc1478df7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93902e expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.829665:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1478dfe lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065212.829677:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1478dfe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065212.829686:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1478dfe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065212.829696:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1478dfe lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065212.829701:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1478dfe lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065212.829706:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1478dfe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065212.829712:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065212.829716:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1478dfe lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065212.829721:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1478dfe lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065212.829729:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065212.829731:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065212.829734:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1478dfe lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065212.829738:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1478dfe lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065212.829761:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6200/0xad6b7ddc1478df7 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93902e expref: 15 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.829767:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b6200/0xad6b7ddc1478df7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93902e expref: 15 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065212.829793:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b6200, rc 0) 00000100:00100000:0.0:1746065212.829824:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+14:2301:x1830881265267328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 263us (370us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065212.829830:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14530 00000100:00100000:0.0:1746065212.829883:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265267584 00000100:00100000:0.0:1746065212.829886:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265267584 00000100:00100000:0.0:1746065212.829903:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5433 00000100:00100000:0.0:1746065212.829907:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2300:x1830881265267584:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065212.830023:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2300:x1830881265267584:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 115us (530us total) trans 8589937023 rc 0/0 00000100:00100000:0.0:1746065212.830028:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5433 00000100:00100000:2.0:1746065212.836583:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.839081:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265267072:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 16773us (18232us total) trans 0 rc 843776/843776 00000100:00100000:0.0:1746065212.839092:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6093 00002000:00100000:0.0:1746065212.839102:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880099cf0a80 x1830881265267072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:128/0 lens 488/440 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 843776/843776 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065212.839111:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0a80 with x1830881265267072 ext(4194304->5038079) 00002000:00010000:0.0:1746065212.839117:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf0a80 00000100:00100000:1.0:1746065212.839828:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265267840 00000100:00100000:1.0:1746065212.839835:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265267840 00000100:00100000:1.0:1746065212.839868:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5434 00000100:00100000:1.0:1746065212.839874:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4111c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2301:x1830881265267840:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065212.840021:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4111c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+15:2301:x1830881265267840:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 147us (3445us total) trans 8589937024 rc 0/0 00000100:00100000:1.0:1746065212.840026:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5434 00000100:00100000:0.0:1746065212.850002:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.853643:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265268096 00000100:00100000:2.0:1746065212.853654:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265268096 00000100:00100000:2.0:1746065212.853700:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5435 00000100:00100000:2.0:1746065212.853707:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2297:x1830881265268096:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065212.853888:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+48:2297:x1830881265268096:12345-192.168.202.27@tcp:35:cat.0 Request processed in 181us (3895us total) trans 8589937025 rc 0/0 00000100:00100000:2.0:1746065212.853894:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5435 00000100:00100000:2.0:1746065212.925155:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263939584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746065212.925223:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065212.925653:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263939584 00000100:00100000:3.0:1746065212.925662:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263939584 00000100:00100000:3.0:1746065212.925711:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:3.0:1746065212.925721:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3761:x1830881263939584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1746065212.925743:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1068258752 pending 2412544 free 3910598656 avail 3679076352 00000100:00080000:0.0:1746065212.926231:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065212.926450:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3761:x1830881263939584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 729us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.926458:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:2.0:1746065212.926569:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881263939584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1746065212.957183:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.957261:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265268224 00000100:00100000:3.0:1746065212.957269:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265268224 00000100:00100000:3.0:1746065212.957312:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17236 00000100:00100000:3.0:1746065212.957318:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2304:x1830881265268224:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065212.957332:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.957347:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939035 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.957378:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.957395:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc1478d8e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fef expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.957402:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.957410:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.957411:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.957415:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.957439:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.957448:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 15 pid: 11461 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.957459:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263939712:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065212.957543:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc1478d8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fef expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.957555:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc1478d8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fef expref: 10 pid: 9550 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746065212.957568:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263939840:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065212.957593:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.957601:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 28 pid: 11461 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.957608:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263939968:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.957625:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.962596:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.962854:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263939712:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.962863:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263939968:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.963692:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263939840:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065212.963718:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3117056->3145727] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.963732:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a600, rc 0) 00000100:00100000:3.0:1746065212.963784:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2304:x1830881265268224:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6452us (6594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.963792:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17236 00000100:00100000:0.0:1746065212.965105:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.965140:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265268352 00000100:00100000:0.0:1746065212.965146:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265268352 00010000:00010000:0.0:1746065212.965177:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 15 pid: 11461 timeout: 908 lvb_type: 0 00000100:00100000:0.0:1746065212.965197:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265268480 00000100:00100000:0.0:1746065212.965199:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265268480 00010000:00010000:0.0:1746065212.965208:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc1478d8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fef expref: 11 pid: 9550 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746065212.965220:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8007 00000100:00100000:0.0:1746065212.965226:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265268352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.965238:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065212.965254:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 15 pid: 11461 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.965262:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 15 pid: 11461 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.965281:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d800/0xad6b7ddc1478d25 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fbe expref: 15 pid: 11461 timeout: 908 lvb_type: 0 00010000:00010000:0.0:1746065212.965294:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065212.965316:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265268352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (2728us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065212.965322:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8007 00000100:00100000:0.0:1746065212.965332:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8008 00000100:00100000:0.0:1746065212.965336:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265268480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.965341:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065212.965348:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc1478d8e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fef expref: 11 pid: 9550 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.965354:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc1478d8e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fef expref: 11 pid: 9550 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.965364:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc1478d8e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fef expref: 11 pid: 9550 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.965376:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065212.965399:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265268480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065212.965404:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8008 00000100:00100000:0.0:1746065212.966206:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.966572:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265268608 00000100:00100000:2.0:1746065212.966576:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265268608 00010000:00010000:2.0:1746065212.966592:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 29 pid: 11461 timeout: 908 lvb_type: 0 00000100:00100000:2.0:1746065212.966619:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8009 00000100:00100000:2.0:1746065212.966624:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265268608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065212.966630:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065212.966637:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 29 pid: 11461 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.966644:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 29 pid: 11461 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.966655:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2d200/0xad6b7ddc1478d1e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fb7 expref: 29 pid: 11461 timeout: 908 lvb_type: 0 00010000:00010000:2.0:1746065212.966671:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.966673:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065212.966678:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.966684:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065212.966707:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065212.966717:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263940096:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065212.966771:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065212.968881:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.969335:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263940096:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065212.969349:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065212.969380:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265268608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2755us (3175us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.969559:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265268864 00000100:00100000:1.0:1746065212.969568:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265268864 00002000:00100000:1.0:1746065212.969601:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3117056->3121151) req@ffff880092744000 x1830881265268864/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.969610:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744000 with x1830881265268864 ext(3117056->3121151) 00000100:00100000:2.0:1746065212.969683:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8009 00002000:00010000:1.0:1746065212.969719:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092744000 00000100:00100000:1.0:1746065212.969732:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6094 00000100:00100000:1.0:1746065212.969738:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265268864:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065212.969839:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265268864:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 101us (964us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065212.969844:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6094 00002000:00100000:1.0:1746065212.969848:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3117056->3121151) req@ffff880092744000 x1830881265268864/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/4536 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065212.969854:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744000 with x1830881265268864 ext(3117056->3121151) 00002000:00010000:1.0:1746065212.969857:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092744000 00000100:00100000:0.0:1746065212.972162:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065212.972218:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265268992 00000100:00100000:3.0:1746065212.972225:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265268992 00000100:00100000:3.0:1746065212.972264:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17237 00000100:00100000:3.0:1746065212.972270:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2304:x1830881265268992:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065212.972283:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065212.972295:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93903c expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.972317:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.972324:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478dcd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939020 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.972330:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478d9c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ffd expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.972336:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.972337:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065212.972340:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2973695] (req 2097152->2973695) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 16 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.972363:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478d9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ffd expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.972372:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478d9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ffd expref: 16 pid: 3068 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746065212.972392:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940224:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065212.972471:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478dcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939020 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065212.972483:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478dcd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939020 expref: 9 pid: 10219 timeout: 908 lvb_type: 1 00000100:00100000:3.0:1746065212.972490:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940352:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065212.972509:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.972516:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 26 pid: 9549 timeout: 908 lvb_type: 0 00000100:00100000:3.0:1746065212.972521:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940480:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.972533:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065212.976252:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940224:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.976264:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940352:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065212.976271:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940480:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065212.976296:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2973695] (req 2097152->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 16 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065212.976310:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae23c00, rc 0) 00000100:00100000:3.0:1746065212.976360:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2304:x1830881265268992:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4088us (4201us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065212.976368:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17237 00000100:00100000:0.0:1746065212.977023:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.977104:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065212.977132:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265269248 00000100:00100000:0.0:1746065212.977137:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265269248 00010000:00010000:0.0:1746065212.977158:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478d9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ffd expref: 16 pid: 3068 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746065212.977187:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265269120 00000100:00100000:0.0:1746065212.977190:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265269120 00010000:00010000:0.0:1746065212.977198:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478dcd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939020 expref: 10 pid: 10219 timeout: 908 lvb_type: 1 00000100:00100000:0.0:1746065212.977211:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8010 00000100:00100000:0.0:1746065212.977216:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265269248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.977226:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065212.977241:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478d9c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ffd expref: 16 pid: 3068 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.977249:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478d9c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ffd expref: 16 pid: 3068 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.977266:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1478d9c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ffd expref: 16 pid: 3068 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.977278:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065212.977296:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265269248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065212.977301:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8010 00000100:00100000:0.0:1746065212.977310:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8011 00000100:00100000:0.0:1746065212.977314:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265269120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065212.977320:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065212.977325:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478dcd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939020 expref: 10 pid: 10219 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.977332:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478dcd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939020 expref: 10 pid: 10219 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.977341:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b60000/0xad6b7ddc1478dcd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939020 expref: 10 pid: 10219 timeout: 908 lvb_type: 1 00010000:00010000:0.0:1746065212.977348:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065212.977359:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265269120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 44us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065212.977364:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8011 00000100:00100000:0.0:1746065212.981104:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.981736:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265269376 00000100:00100000:1.0:1746065212.981745:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265269376 00010000:00010000:1.0:1746065212.981975:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 27 pid: 9549 timeout: 908 lvb_type: 0 00000100:00100000:1.0:1746065212.982765:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8012 00000100:00100000:1.0:1746065212.982791:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265269376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065212.982804:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065212.982821:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 27 pid: 9549 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.982833:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 27 pid: 9549 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.982856:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60600/0xad6b7ddc1478d4f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fcc expref: 27 pid: 9549 timeout: 908 lvb_type: 0 00010000:00010000:1.0:1746065212.983256:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.983259:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065212.983266:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.983278:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065212.983310:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065212.983321:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263940608:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065212.983735:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065212.986522:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263940608:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065212.986541:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065212.986588:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265269376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3814us (5492us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065212.986597:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8012 00000100:00100000:0.0:1746065212.992859:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065212.992971:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265269632 00000100:00100000:2.0:1746065212.992980:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265269632 00002000:00100000:2.0:1746065212.993064:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2969600->2973695) req@ffff880092745180 x1830881265269632/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/0 e 0 to 0 dl 1746065223 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.993073:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745180 with x1830881265269632 ext(2969600->2973695) 00002000:00010000:2.0:1746065212.993078:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092745180 00000100:00100000:2.0:1746065212.993113:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6095 00000100:00100000:2.0:1746065212.993119:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265269632:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065212.993621:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265269632:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 501us (769us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065212.993627:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6095 00002000:00100000:2.0:1746065212.993632:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2969600->2973695) req@ffff880092745180 x1830881265269632/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:128/0 lens 488/4536 e 0 to 0 dl 1746065223 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065212.993639:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745180 with x1830881265269632 ext(2969600->2973695) 00002000:00010000:2.0:1746065212.993641:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092745180 00000100:00100000:0.0:1746065212.997192:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065212.997474:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265269888 00000100:00100000:1.0:1746065212.997483:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265269888 00000100:00100000:1.0:1746065212.997528:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5436 00000100:00100000:1.0:1746065212.997535:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2304:x1830881265269888:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065212.997688:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2304:x1830881265269888:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 153us (504us total) trans 8589937026 rc 0/0 00000100:00100000:1.0:1746065212.997694:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5436 00000100:00100000:0.0:1746065213.024161:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.024255:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265270144 00000100:00100000:2.0:1746065213.024265:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265270144 00000100:00100000:2.0:1746065213.025023:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14531 00000100:00100000:2.0:1746065213.025032:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2311:x1830881265270144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065213.025054:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.025071:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60400/0xad6b7ddc1478e13 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939043 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.025158:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478e1a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065213.025169:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478e1a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065213.025179:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478e1a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065213.025187:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065213.025257:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60400/0xad6b7ddc1478e13 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939043 expref: 34 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.025285:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478e1a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939043 expref: 33 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.025293:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065213.025295:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065213.025297:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60200, rc 0) 00000100:00080000:0.0:1746065213.025406:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065213.026093:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2311:x1830881265270144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1061us (1939us total) trans 8589937027 rc 0/0 00000100:00100000:2.0:1746065213.026099:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14531 00000100:00100000:0.0:1746065213.028692:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.028771:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265270272 00000100:00100000:3.0:1746065213.028793:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265270272 00000100:00100000:3.0:1746065213.028836:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17238 00000100:00100000:3.0:1746065213.028842:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265270272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065213.028854:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.028867:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc1478e28 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93904a expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065213.028905:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940736:192.168.202.27@tcp:106: 00000100:00080000:0.0:1746065213.029064:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065213.029448:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00002000:00010000:3.0:1746065213.030698:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065212 -> 1746065213 00002000:00010000:3.0:1746065213.030703:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065212 -> 1746065213 00002000:00010000:3.0:1746065213.030704:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065212 -> 1746065213 00000100:00100000:3.0:1746065213.030719:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940736:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065213.030740:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc1478e28 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93904a expref: 16 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.030752:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae22600/0xad6b7ddc1478e28 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93904a expref: 16 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.030764:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae22600, rc 0) 00000100:00100000:3.0:1746065213.030827:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265270272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1985us (2139us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065213.030834:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17238 00000100:00100000:0.0:1746065213.034965:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.035081:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265270400 00000100:00100000:3.0:1746065213.035090:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265270400 00000100:00100000:3.0:1746065213.035141:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17239 00000100:00100000:3.0:1746065213.035148:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2311:x1830881265270400:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065213.035166:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.035181:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939051 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.035207:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 25 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.035214:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065213.035216:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065213.035219:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 16 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.035243:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 25 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.035253:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 25 pid: 3067 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.035264:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940864:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065213.036680:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065213.049073:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940864:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065213.049097:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 16 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.049111:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96600, rc 0) 00000100:00100000:3.0:1746065213.049164:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2311:x1830881265270400:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14015us (14206us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.049171:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17239 00000100:00100000:0.0:1746065213.050622:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.053885:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265270528 00000100:00100000:2.0:1746065213.053896:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265270528 00002000:00100000:2.0:1746065213.053957:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1458175) req@ffff880092746300 x1830881265270528/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.053966:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746300 with x1830881265270528 ext(1048576->1458175) 00010000:00010000:2.0:1746065213.053975:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 26 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.053989:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 26 pid: 3067 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.053996:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092746300 00000100:00100000:2.0:1746065213.054024:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2000 00000100:00100000:2.0:1746065213.054031:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265270528:12345-192.168.202.27@tcp:4:cat.0 00000100:00080000:0.0:1746065213.054275:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065213.069623:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.072368:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265270784 00000100:00100000:3.0:1746065213.072378:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265270784 00000100:00080000:0.0:1746065213.072512:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065213.073325:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14532 00000100:00100000:3.0:1746065213.073335:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+48:2313:x1830881265270784:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065213.073355:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.073371:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96c00/0xad6b7ddc1478e36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939058 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.074074:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1478e3d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074087:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1478e3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074096:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1478e3d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074107:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1478e44 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074112:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1478e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074116:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1478e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074194:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478e4b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074202:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478e4b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074208:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478e4b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065213.074215:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065213.074270:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1478e3d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074276:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1478e3d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074281:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1478e3d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074287:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1478e3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074291:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065213.074304:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1478e3d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074311:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1478e3d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074319:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065213.074322:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065213.074326:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1478e3d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074330:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc1478e3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074347:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1478e44 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074355:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1478e44 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074360:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1478e44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074364:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f0a0800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065213.074366:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1478e44 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074370:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1478e44 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074375:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800a9bcc000) 00010000:00010000:3.0:1746065213.074377:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065213.074378:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1478e44 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074392:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f0a0800/0xad6b7ddc1478e44 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065213.074677:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96c00/0xad6b7ddc1478e36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939058 expref: 51 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.074689:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478e4b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939058 expref: 50 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.074694:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065213.074696:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065213.074698:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b000, rc 0) 00000100:00100000:3.0:1746065213.074751:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+50:2313:x1830881265270784:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1418us (5135us total) trans 8589937028 rc 0/0 00000100:00100000:3.0:1746065213.074758:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14532 00000100:00100000:2.0:1746065213.075225:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265270528:12345-192.168.202.27@tcp:4:cat.0 Request processed in 21193us (24605us total) trans 21474841655 rc 0/0 00000100:00100000:2.0:1746065213.075232:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2000 00002000:00100000:2.0:1746065213.075240:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1458175) req@ffff880092746300 x1830881265270528/t21474841655(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/448 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.075247:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746300 with x1830881265270528 ext(1048576->1458175) 00010000:00010000:2.0:1746065213.075254:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 28 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.075263:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 28 pid: 3067 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.075268:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092746300 00000100:00100000:0.0:1746065213.080172:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.080999:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265270912 00000100:00100000:3.0:1746065213.081007:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265270912 00000100:00100000:0.0:1746065213.081273:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.081299:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17240 00000100:00100000:3.0:1746065213.081305:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2313:x1830881265270912:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065213.081319:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.081332:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93905f expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.081656:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.081667:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d79 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe1 expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.081673:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc1478c53 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f4e expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.081679:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.081680:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.081683:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1990656->2023423] (req 1990656->2023423) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.081708:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc1478c53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f4e expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.081717:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc1478c53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f4e expref: 15 pid: 12260 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746065213.081728:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940992:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065213.082704:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265271040 00000100:00100000:0.0:1746065213.082710:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265271040 00010000:00010000:3.0:1746065213.082749:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe1 expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.082757:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe1 expref: 8 pid: 10219 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746065213.082765:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263941120:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065213.082807:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.082815:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 30 pid: 12260 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.082823:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263941248:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065213.082836:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00010000:00010000:0.0:1746065213.083146:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 30 pid: 3067 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746065213.083181:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8013 00000100:00100000:0.0:1746065213.083187:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265271040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065213.083194:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065213.083209:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 30 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.083218:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 30 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.083233:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc1478d95 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939004 expref: 30 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.083260:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.083262:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.083268:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.083275:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.083293:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065213.083301:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263941376:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065213.083344:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.090734:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263941376:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065213.090754:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065213.090839:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265271040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7651us (9565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065213.090849:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8013 00000100:00100000:3.0:1746065213.090970:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263940992:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065213.090980:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263941120:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065213.090987:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263941248:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065213.091006:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1990656->2023423] (req 1990656->2023423) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.091024:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488400, rc 0) 00000100:00100000:3.0:1746065213.091042:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2313:x1830881265270912:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9738us (10878us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.091049:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17240 00000100:00100000:0.0:1746065213.091496:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.091570:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.091647:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265271168 00000100:00100000:2.0:1746065213.091654:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265271168 00010000:00010000:2.0:1746065213.091677:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc1478c53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f4e expref: 16 pid: 12260 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746065213.091697:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265271296 00000100:00100000:2.0:1746065213.091699:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265271296 00010000:00010000:2.0:1746065213.091714:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe1 expref: 9 pid: 10219 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746065213.091734:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8014 00000100:00100000:2.0:1746065213.091739:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265271168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065213.091749:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065213.091763:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc1478c53 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f4e expref: 16 pid: 12260 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746065213.091790:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc1478c53 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f4e expref: 16 pid: 12260 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746065213.091807:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc1478c53 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f4e expref: 16 pid: 12260 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746065213.091819:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065213.091837:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265271168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.091842:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8014 00000100:00100000:2.0:1746065213.091852:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8015 00000100:00100000:2.0:1746065213.091856:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265271296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065213.091862:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065213.091869:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d79 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe1 expref: 9 pid: 10219 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746065213.091876:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d79 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe1 expref: 9 pid: 10219 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746065213.091885:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc1478d79 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938fe1 expref: 9 pid: 10219 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746065213.091892:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065213.091904:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2006:x1830881265271296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.091908:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8015 00000100:00080000:2.0:1746065213.091937:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746065213.095252:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065213.099086:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.099125:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.099144:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265271808 00000100:00100000:0.0:1746065213.099150:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265271808 00010000:00010000:0.0:1746065213.099177:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 28 pid: 12260 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746065213.099199:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8016 00000100:00100000:0.0:1746065213.099205:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265271808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065213.099213:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065213.099230:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 28 pid: 12260 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.099239:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 28 pid: 12260 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.099257:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1478c4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938f47 expref: 28 pid: 12260 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.099270:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.099272:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.099277:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.099285:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.099310:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 27 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065213.099321:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263941504:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065213.099452:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265271680 00000100:00100000:0.0:1746065213.099456:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265271680 00000100:00100000:0.0:1746065213.099479:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14533 00000100:00100000:0.0:1746065213.099485:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+50:2316:x1830881265271680:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065213.099500:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065213.099512:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc1478e60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939066 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.099583:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1478e67 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.099595:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1478e67 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.099603:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1478e67 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065213.099612:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065213.099685:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a400/0xad6b7ddc1478e60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939066 expref: 53 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.099695:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1478e67 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939066 expref: 52 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.099702:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065213.099704:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065213.099706:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ba00, rc 0) 00000100:00100000:0.0:1746065213.099728:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+52:2316:x1830881265271680:12345-192.168.202.27@tcp:101:cat.0 Request processed in 243us (649us total) trans 8589937029 rc 0/0 00000100:00100000:0.0:1746065213.099733:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14533 00000100:00100000:3.0:1746065213.104311:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.104333:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.104421:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263941504:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065213.104436:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065213.104444:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.104468:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881265271808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5263us (5343us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.104478:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8016 00000100:00100000:0.0:1746065213.104935:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265271936 00000100:00100000:0.0:1746065213.104940:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265271936 00002000:00100000:0.0:1746065213.104970:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800996f8000 x1830881265271936/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065213.104979:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f8000 with x1830881265271936 ext(1048576->2097151) 00002000:00010000:0.0:1746065213.104983:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f8000 00000100:00100000:0.0:1746065213.105000:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265272192 00000100:00100000:0.0:1746065213.105003:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265272192 00002000:00100000:0.0:1746065213.105012:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1990656->1994751) req@ffff8800996fa680 x1830881265272192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065213.105018:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fa680 with x1830881265272192 ext(1990656->1994751) 00002000:00010000:0.0:1746065213.105021:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996fa680 00000100:00100000:0.0:1746065213.105030:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6096 00000100:00100000:0.0:1746065213.105035:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265271936:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065213.105097:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6097 00000100:00100000:1.0:1746065213.105103:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265272192:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065213.105183:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265272192:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 81us (739us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065213.105189:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6097 00002000:00100000:1.0:1746065213.105194:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1990656->1994751) req@ffff8800996fa680 x1830881265272192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.105200:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fa680 with x1830881265272192 ext(1990656->1994751) 00002000:00010000:1.0:1746065213.105202:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996fa680 00000100:00100000:0.0:1746065213.110482:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.110568:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265272448 00000100:00100000:2.0:1746065213.110577:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265272448 00002000:00100000:2.0:1746065213.110612:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (2019328->2023423) req@ffff880092745f80 x1830881265272448/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.110621:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745f80 with x1830881265272448 ext(2019328->2023423) 00002000:00010000:2.0:1746065213.110626:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092745f80 00000100:00100000:2.0:1746065213.110649:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6098 00000100:00100000:2.0:1746065213.110657:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265272448:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065213.110793:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265272448:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 136us (319us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065213.110799:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6098 00002000:00100000:2.0:1746065213.110805:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (2019328->2023423) req@ffff880092745f80 x1830881265272448/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.110812:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745f80 with x1830881265272448 ext(2019328->2023423) 00002000:00010000:2.0:1746065213.110815:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092745f80 00000100:00100000:2.0:1746065213.115530:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265271936:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10485us (11191us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065213.115539:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6096 00002000:00100000:2.0:1746065213.115549:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800996f8000 x1830881265271936/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.115558:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f8000 with x1830881265271936 ext(1048576->2097151) 00002000:00010000:2.0:1746065213.115563:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f8000 00000100:00100000:0.0:1746065213.121487:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.121573:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265272704 00000100:00100000:2.0:1746065213.121581:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265272704 00000100:00100000:2.0:1746065213.121629:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5437 00000100:00100000:2.0:1746065213.121636:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+52:2313:x1830881265272704:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065213.122302:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.122350:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.122391:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.122406:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265272832 00000100:00100000:0.0:1746065213.122410:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265272832 00000100:00100000:0.0:1746065213.122428:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265273088 00000100:00100000:0.0:1746065213.122430:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265273088 00000100:00100000:0.0:1746065213.122437:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265272960 00000100:00100000:0.0:1746065213.122439:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265272960 00000100:00100000:0.0:1746065213.122456:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17241 00000100:00100000:0.0:1746065213.122461:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265272832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065213.122470:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065213.122481:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478e75 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93906d expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.122496:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.122498:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.122504:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478e75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93906d expref: 29 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065213.122516:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478e75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93906d expref: 29 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065213.122524:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b600, rc 0) 00000100:00100000:0.0:1746065213.122555:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265272832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 94us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065213.122560:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17241 00000100:00100000:0.0:1746065213.122572:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17242 00000100:00100000:0.0:1746065213.122576:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265273088:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065213.122580:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065213.122584:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1a800/0xad6b7ddc1478e7c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93907b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065213.122612:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263941632:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065213.122657:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809c00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.122674:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17243 00000100:00100000:0.0:1746065213.122678:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265272960:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065213.122684:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065213.122690:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1a000/0xad6b7ddc1478e83 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939074 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065213.122708:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263941760:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065213.122723:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00080000:3.0:1746065213.122842:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065213.122886:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+53:2313:x1830881265272704:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1250us (1407us total) trans 8589937030 rc 0/0 00000100:00100000:2.0:1746065213.122892:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5437 00002000:00010000:1.0:1746065213.129087:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746065212 -> 1746065213 00002000:00010000:1.0:1746065213.129094:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065212 -> 1746065213 00002000:00010000:1.0:1746065213.129096:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746065212 -> 1746065213 00000100:00100000:1.0:1746065213.129114:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263941760:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065213.129144:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a000/0xad6b7ddc1478e83 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939074 expref: 29 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065213.129155:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a000/0xad6b7ddc1478e83 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939074 expref: 29 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065213.129178:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a000, rc 0) 00000100:00100000:1.0:1746065213.129214:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265272960:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6534us (6831us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065213.129222:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17243 00002000:00010000:2.0:1746065213.129455:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746065212 -> 1746065213 00002000:00010000:2.0:1746065213.129458:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065212 -> 1746065213 00002000:00010000:2.0:1746065213.129459:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746065212 -> 1746065213 00000100:00100000:2.0:1746065213.129468:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263941632:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065213.129482:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1a800/0xad6b7ddc1478e7c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93907b expref: 29 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.129493:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1a800/0xad6b7ddc1478e7c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93907b expref: 29 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.129514:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a800, rc 0) 00000100:00100000:2.0:1746065213.129531:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265273088:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6954us (7181us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065213.129536:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17242 00000100:00100000:0.0:1746065213.155529:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.155561:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.155587:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.155588:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265273344 00000100:00100000:2.0:1746065213.155596:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265273344 00000100:00100000:0.0:1746065213.155629:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:2.0:1746065213.155632:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009aba7b80 x1830881265273344/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 504/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.155641:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba7b80 with x1830881265273344 ext(1048576->2097151) 00002000:00010000:2.0:1746065213.155646:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba7b80 00000100:00100000:0.0:1746065213.155656:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265273600 00000100:00100000:2.0:1746065213.155657:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265273856 00000100:00100000:2.0:1746065213.155659:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265273856 00000100:00100000:0.0:1746065213.155659:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265273600 00002000:00100000:2.0:1746065213.155669:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2973696->4194303) req@ffff88009aba7480 x1830881265273856/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.155674:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba7480 with x1830881265273856 ext(2973696->4194303) 00002000:00010000:2.0:1746065213.155677:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba7480 00002000:00100000:0.0:1746065213.155678:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009aba5f80 x1830881265273600/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 504/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065213.155684:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265274112 00002000:00100000:0.0:1746065213.155685:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba5f80 with x1830881265273600 ext(2097152->4194303) 00000100:00100000:2.0:1746065213.155686:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265274112 00002000:00010000:0.0:1746065213.155687:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aba5f80 00002000:00100000:2.0:1746065213.155693:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009aba4000 x1830881265274112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065213.155697:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6099 00002000:00100000:2.0:1746065213.155699:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba4000 with x1830881265274112 ext(1048576->2097151) 00002000:00010000:2.0:1746065213.155702:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba4000 00000100:00100000:0.0:1746065213.155703:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265273344:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.155715:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6100 00000100:00100000:2.0:1746065213.155719:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265273856:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065213.156289:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6101 00000100:00100000:0.0:1746065213.156295:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265273600:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.156342:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6102 00000100:00100000:2.0:1746065213.156346:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265274112:12345-192.168.202.27@tcp:3:cat.0 00000100:00080000:2.0:1746065213.156887:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065213.167195:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.167373:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265274240 00000100:00100000:1.0:1746065213.167390:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265274240 00000100:00100000:1.0:1746065213.167458:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14534 00000100:00100000:1.0:1746065213.167464:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+15:2318:x1830881265274240:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065213.167483:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065213.167500:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478e8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939082 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.167553:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1478e91 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167564:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1478e91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167573:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1478e91 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167585:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478e98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167594:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478e98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167598:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478e98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167654:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1478e9f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167663:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1478e9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167669:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1478e9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065213.167700:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:1.0:1746065213.167704:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065213.167717:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1478e9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167725:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1478e9f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167732:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1478e91 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167737:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1478e91 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167741:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1478e91 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167746:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1478e91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167754:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065213.167757:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1478e91 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167762:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1478e91 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167770:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065213.167787:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065213.167790:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1478e91 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167794:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1478e91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167807:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478e98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167811:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478e98 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167815:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478e98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167818:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065213.167820:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478e98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167823:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478e98 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167829:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008ec47500) 00010000:00010000:1.0:1746065213.167831:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065213.167833:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478e98 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167837:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478e98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.167856:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478e8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939082 expref: 17 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.167864:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1478e9f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939082 expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.167869:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065213.167871:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065213.167873:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6600, rc 0) 00000100:00100000:1.0:1746065213.167904:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+16:2318:x1830881265274240:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 440us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065213.167909:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14534 00000100:00080000:3.0:1746065213.168005:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065213.178150:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265273344:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22439us (22620us total) trans 0 rc 1015808/1015808 00000100:00100000:2.0:1746065213.178159:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6099 00002000:00100000:2.0:1746065213.178168:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009aba7b80 x1830881265273344/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 504/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.178177:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba7b80 with x1830881265273344 ext(1048576->2097151) 00002000:00010000:2.0:1746065213.178182:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba7b80 00000100:00100000:2.0:1746065213.194448:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265273856:12345-192.168.202.27@tcp:3:cat.0 Request processed in 38716us (38847us total) trans 0 rc 1220608/1220608 00000100:00100000:2.0:1746065213.194461:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6100 00002000:00100000:2.0:1746065213.194475:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2973696->4194303) req@ffff88009aba7480 x1830881265273856/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1220608/1220608 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.194484:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba7480 with x1830881265273856 ext(2973696->4194303) 00002000:00010000:2.0:1746065213.194491:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba7480 00000100:00100000:2.0:1746065213.195927:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265274112:12345-192.168.202.27@tcp:3:cat.0 Request processed in 39576us (40293us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065213.195936:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6102 00002000:00100000:2.0:1746065213.195943:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009aba4000 x1830881265274112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.195952:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba4000 with x1830881265274112 ext(1048576->2097151) 00002000:00010000:2.0:1746065213.195956:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba4000 00000100:00100000:0.0:1746065213.202967:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.203048:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.203121:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265274496 00000100:00100000:1.0:1746065213.203129:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265274496 00000100:00100000:1.0:1746065213.203173:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265274368 00000100:00100000:1.0:1746065213.203175:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265274368 00000100:00100000:1.0:1746065213.203192:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17244 00000100:00100000:1.0:1746065213.203198:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265274496:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065213.203213:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065213.203227:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ea6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939090 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065213.203266:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263941888:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065213.203341:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.203368:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17245 00000100:00100000:1.0:1746065213.203374:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265274368:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065213.203392:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065213.203402:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478ead lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939089 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065213.203424:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263942016:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065213.203444:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065213.209929:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263942016:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065213.209962:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478ead lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939089 expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.209976:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130104600/0xad6b7ddc1478ead lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939089 expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.209994:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130104600, rc 0) 00000100:00100000:2.0:1746065213.210036:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265274368:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6659us (6986us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065213.210044:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17245 00000100:00100000:1.0:1746065213.212473:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263941888:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065213.212503:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ea6 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939090 expref: 29 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065213.212515:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ea6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939090 expref: 29 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065213.212533:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8e00, rc 0) 00000100:00100000:1.0:1746065213.212570:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265274496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9371us (9610us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065213.212576:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17244 00000100:00100000:1.0:1746065213.214236:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265273600:12345-192.168.202.27@tcp:3:cat.0 Request processed in 57930us (58662us total) trans 0 rc 2068480/2068480 00000100:00100000:1.0:1746065213.214251:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6101 00002000:00100000:1.0:1746065213.214262:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009aba5f80 x1830881265273600/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 504/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 2068480/2068480 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.214272:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba5f80 with x1830881265273600 ext(2097152->4194303) 00002000:00010000:1.0:1746065213.214281:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aba5f80 00000100:00100000:0.0:1746065213.214587:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.214619:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.214647:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265274624 00000100:00100000:0.0:1746065213.214650:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.214655:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265274624 00000100:00100000:0.0:1746065213.214684:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.214691:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265274752 00000100:00100000:1.0:1746065213.214693:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265274752 00000100:00100000:1.0:1746065213.214705:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265274880 00000100:00100000:1.0:1746065213.214707:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265274880 00000100:00100000:0.0:1746065213.214712:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265275008 00000100:00100000:0.0:1746065213.214719:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265275008 00000100:00100000:1.0:1746065213.214730:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17246 00000100:00100000:1.0:1746065213.214736:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265274624:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065213.214751:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065213.214751:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17247 00000100:00100000:0.0:1746065213.214757:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265274752:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065213.214768:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc1478eb4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939097 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.214791:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065213.214805:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1be00/0xad6b7ddc1478ebb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93909e expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.214823:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.214825:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.214833:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1be00/0xad6b7ddc1478ebb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93909e expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065213.214845:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263942144:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065213.214845:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1be00/0xad6b7ddc1478ebb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93909e expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065213.214853:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1be00, rc 0) 00000100:00100000:0.0:1746065213.214882:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265274752:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 126us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065213.214887:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17247 00000100:00100000:0.0:1746065213.214903:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17248 00000100:00100000:0.0:1746065213.214908:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265274880:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:1.0:1746065213.214911:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00010000:00010000:0.0:1746065213.214915:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065213.214923:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1478ec2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390a5 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065213.214931:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17249 00000100:00100000:1.0:1746065213.214937:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265275008:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065213.214944:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065213.214952:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc1478ec9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390ac expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065213.214955:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263942272:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065213.214977:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263942400:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065213.214991:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.215001:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00080000:1.0:1746065213.215034:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065213.220698:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263942272:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065213.220728:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1478ec2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390a5 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065213.220746:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1478ec2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390a5 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065213.220760:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a400, rc 0) 00000100:00100000:0.0:1746065213.221564:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265274880:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 6652us (6910us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065213.221572:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17248 00000100:00100000:1.0:1746065213.222008:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263942400:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065213.222027:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc1478ec9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390ac expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065213.222042:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc1478ec9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390ac expref: 12 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065213.222053:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f400, rc 0) 00000100:00100000:1.0:1746065213.222073:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265275008:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 7136us (7389us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065213.222078:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17249 00002000:00010000:1.0:1746065213.222108:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065212 -> 1746065213 00002000:00010000:1.0:1746065213.222111:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065212 -> 1746065213 00002000:00010000:1.0:1746065213.222113:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065212 -> 1746065213 00000100:00100000:1.0:1746065213.222119:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263942144:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065213.222133:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc1478eb4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939097 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065213.222141:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc1478eb4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939097 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065213.222147:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f600, rc 0) 00000100:00100000:1.0:1746065213.222162:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265274624:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 7427us (7581us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065213.222166:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17246 00000100:00100000:1.0:1746065213.224055:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.224314:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.224389:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265275136 00000100:00100000:3.0:1746065213.224395:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265275136 00000100:00100000:3.0:1746065213.224442:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 848 00000100:00100000:3.0:1746065213.224449:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265275136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065213.224461:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065213.224479:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc1478e9f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939082 expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.224505:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065213.224508:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065213.224538:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265275136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.224545:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 848 00000100:00100000:1.0:1746065213.224649:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265275264 00000100:00100000:1.0:1746065213.224652:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265275264 00000100:00100000:1.0:1746065213.224671:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17250 00000100:00100000:1.0:1746065213.224676:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2316:x1830881265275264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065213.224686:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065213.224697:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390b3 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.224714:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.224721:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065213.224723:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065213.224725:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.224747:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.224757:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 13 pid: 3067 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746065213.224767:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263942528:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065213.224829:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.225837:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.226835:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265275520 00000100:00100000:1.0:1746065213.226841:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265275520 00000100:00100000:1.0:1746065213.226872:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14535 00000100:00100000:1.0:1746065213.226878:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2320:x1830881265275520:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065213.226896:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065213.226907:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc1478ed7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390ba expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.226981:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065213.226993:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939012 expref: 14 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.226999:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc1478de9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939027 expref: 34 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.227005:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478e4b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939058 expref: 52 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.227011:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 6/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065213.227029:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478e4b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939058 expref: 52 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.227037:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478e4b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939058 expref: 52 pid: 7205 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746065213.227046:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263942656:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065213.228783:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc1478de9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939027 expref: 34 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.228795:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc1478de9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939027 expref: 34 pid: 9571 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746065213.228806:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263942784:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065213.228840:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939012 expref: 14 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.228847:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939012 expref: 14 pid: 9571 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746065213.228854:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263942912:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065213.228867:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065213.229130:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.229572:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265275904 00000100:00100000:1.0:1746065213.229577:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265275904 00000100:00100000:1.0:1746065213.229606:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14536 00000100:00100000:1.0:1746065213.229612:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+15:2318:x1830881265275904:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065213.229623:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065213.229634:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc1478ee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390c8 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.229698:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc1478eec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.229708:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc1478eec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065213.229714:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc1478eec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065213.229864:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.229931:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.230454:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265276032 00000100:00100000:2.0:1746065213.230459:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265276032 00002000:00100000:2.0:1746065213.230483:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3117056->3145727) req@ffff88009834f100 x1830881265276032/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.230491:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f100 with x1830881265276032 ext(3117056->3145727) 00010000:00010000:2.0:1746065213.230499:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 14 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.230510:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 14 pid: 3067 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.230521:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009834f100 00000100:00100000:2.0:1746065213.230542:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2001 00000100:00100000:2.0:1746065213.230547:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265276032:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065213.230634:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263942528:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.230650:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.230661:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fa00, rc 0) 00000100:00100000:2.0:1746065213.230677:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2316:x1830881265275264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6001us (6364us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.230684:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17250 00000100:00100000:2.0:1746065213.230700:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265275648 00000100:00100000:2.0:1746065213.230702:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265275648 00000100:00100000:2.0:1746065213.230715:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17251 00000100:00100000:2.0:1746065213.230724:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265275648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065213.230730:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.230738:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d800/0xad6b7ddc1478ef3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390c1 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065213.230762:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263943040:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065213.230816:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.231692:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263942656:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065213.231704:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263942784:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065213.231710:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263942912:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065213.231728:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065213.232647:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.232676:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.232703:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.233094:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265276288 00000100:00100000:2.0:1746065213.233099:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265276288 00010000:00010000:2.0:1746065213.233124:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc1478de9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939027 expref: 35 pid: 9571 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.233144:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265276160 00000100:00100000:2.0:1746065213.233146:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265276160 00010000:00010000:2.0:1746065213.233153:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478e4b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939058 expref: 53 pid: 7205 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.233163:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265276416 00000100:00100000:2.0:1746065213.233165:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265276416 00010000:00010000:2.0:1746065213.233171:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939012 expref: 17 pid: 9571 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.233195:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8017 00000100:00100000:2.0:1746065213.233201:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+35:2004:x1830881265276288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065213.233210:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065213.233214:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc1478de9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939027 expref: 35 pid: 9571 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.233222:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc1478de9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939027 expref: 35 pid: 9571 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.233238:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc1478de9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939027 expref: 35 pid: 9571 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.233252:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065213.233256:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065213.233263:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 15 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065213.233271:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065213.233299:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:2004:x1830881265276288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.233305:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8017 00000100:00100000:2.0:1746065213.233317:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8018 00000100:00100000:2.0:1746065213.233321:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+53:2005:x1830881265276160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065213.233327:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065213.233331:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478e4b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939058 expref: 53 pid: 7205 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.233337:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478e4b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939058 expref: 53 pid: 7205 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.233347:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc1478e4b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939058 expref: 53 pid: 7205 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.233355:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065213.233357:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065213.233361:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065213.233366:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065213.233378:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881265276160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.233395:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8018 00000100:00100000:2.0:1746065213.233405:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8019 00000100:00100000:2.0:1746065213.233409:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265276416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065213.233415:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065213.233418:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939012 expref: 17 pid: 9571 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.233424:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939012 expref: 17 pid: 9571 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.233434:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60e00/0xad6b7ddc1478dbf lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939012 expref: 17 pid: 9571 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.233441:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065213.233444:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065213.233450:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065213.233455:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065213.233460:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc1478eec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065213.233465:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc1478eec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065213.233470:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc1478eec lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065213.233489:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065213.233504:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+16:2005:x1830881265276416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.233509:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8019 00010000:00010000:2.0:1746065213.233621:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc1478eec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065213.233627:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc1478eec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065213.233642:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065213.233730:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046200/0xad6b7ddc1478ee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390c8 expref: 17 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.233741:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc1478eec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390c8 expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.233747:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065213.233750:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065213.233752:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046c00, rc 0) 00000100:00100000:2.0:1746065213.233769:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+16:2318:x1830881265275904:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4158us (4640us total) trans 8589937031 rc 0/0 00000100:00100000:2.0:1746065213.233797:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14536 00010000:00010000:1.0:1746065213.234017:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065213.234023:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065213.234032:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065213.234072:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552ee00/0xad6b7ddc1478ed7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390ba expref: 35 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.234085:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390ba expref: 34 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.234091:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065213.234093:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065213.234095:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8e00, rc 0) 00000100:00100000:1.0:1746065213.234113:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:2320:x1830881265275520:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7235us (8278us total) trans 8589937032 rc 0/0 00000100:00100000:1.0:1746065213.234117:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14535 00000100:00100000:2.0:1746065213.237961:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263943040:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065213.237994:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d800/0xad6b7ddc1478ef3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390c1 expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.238007:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d800/0xad6b7ddc1478ef3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390c1 expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.238021:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d800, rc 0) 00000100:00100000:2.0:1746065213.238081:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265275648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7358us (8214us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065213.238089:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17251 00000100:00100000:0.0:1746065213.242968:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265276032:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12410us (13027us total) trans 17179874256 rc 0/0 00000100:00100000:0.0:1746065213.242978:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2001 00002000:00100000:0.0:1746065213.242989:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3117056->3145727) req@ffff88009834f100 x1830881265276032/t17179874256(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/448 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065213.242997:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f100 with x1830881265276032 ext(3117056->3145727) 00010000:00010000:0.0:1746065213.243006:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 16 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.243017:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 16 pid: 3067 timeout: 909 lvb_type: 0 00002000:00010000:0.0:1746065213.243027:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009834f100 00000100:00100000:3.0:1746065213.243043:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.243073:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.243899:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265276800 00000100:00100000:3.0:1746065213.243906:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265276800 00000100:00100000:3.0:1746065213.243939:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17252 00000100:00100000:3.0:1746065213.243945:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2311:x1830881265276800:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065213.243987:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.244000:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390d6 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.244022:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065213.244024:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065213.244028:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->5038079] (req 4194304->5038079) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.244038:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->5038079] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.244047:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b4a25c00, rc 0) 00000100:00100000:3.0:1746065213.244077:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2311:x1830881265276800:12345-192.168.202.27@tcp:101:cat.0 Request processed in 132us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.244083:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17252 00000100:00100000:2.0:1746065213.244567:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265276672 00000100:00100000:2.0:1746065213.244572:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265276672 00000100:00100000:2.0:1746065213.244605:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14537 00000100:00100000:2.0:1746065213.244611:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+16:2318:x1830881265276672:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065213.244623:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.244625:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065213.244643:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046c00/0xad6b7ddc1478eec lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390c8 expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.244656:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065213.244659:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065213.244666:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3cc00/0xad6b7ddc1478f0f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390cf expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.244739:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065213.244750:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390ba expref: 33 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.244756:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 4/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065213.244804:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390ba expref: 33 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.244814:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390ba expref: 33 pid: 7205 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.244824:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263943168:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.244879:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065213.251617:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.251827:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265276928 00000100:00100000:1.0:1746065213.251834:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265276928 00010000:00010000:1.0:1746065213.251864:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390ba expref: 34 pid: 7205 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746065213.251890:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8020 00000100:00100000:1.0:1746065213.251896:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:2005:x1830881265276928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065213.251906:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065213.251910:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390ba expref: 34 pid: 7205 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746065213.251919:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390ba expref: 34 pid: 7205 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746065213.251935:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065213.251939:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065213.251947:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065213.251952:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 4/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065213.251964:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065213.252057:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1478ede lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390ba expref: 34 pid: 7205 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746065213.252072:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263943168:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065213.252084:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.252089:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.252093:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.252105:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.252110:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.252114:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.252118:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3ca00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065213.252121:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.252125:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.252131:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065213.252134:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065213.252136:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.252140:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f16 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.252163:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3cc00/0xad6b7ddc1478f0f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390cf expref: 16 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.252168:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3cc00/0xad6b7ddc1478f0f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390cf expref: 16 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.252174:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3cc00, rc 0) 00000100:00100000:1.0:1746065213.252804:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2005:x1830881265276928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 906us (1192us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065213.252811:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8020 00000100:00100000:0.0:1746065213.252897:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+15:2318:x1830881265276672:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 8285us (9854us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065213.252903:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14537 00000100:00100000:1.0:1746065213.252993:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.253236:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265277056 00000100:00100000:0.0:1746065213.253240:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265277056 00010000:00010000:0.0:1746065213.253254:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 17 pid: 3067 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746065213.253280:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8021 00000100:00100000:0.0:1746065213.253286:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265277056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065213.253293:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065213.253308:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 17 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.253316:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 17 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.253328:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84a600/0xad6b7ddc1478e05 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3117056->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939035 expref: 17 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.253337:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.253339:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.253344:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 28 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.253350:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 28 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.253356:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.253357:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.253360:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.253366:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.253398:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065213.253408:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dda680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263943296:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065213.253459:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 28 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065213.253471:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263943424:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065213.253487:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065213.258727:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dda680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263943296:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065213.258910:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.259091:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265277312 00000100:00100000:2.0:1746065213.259097:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265277312 00000100:00100000:2.0:1746065213.259139:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5438 00000100:00100000:2.0:1746065213.259145:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+15:2318:x1830881265277312:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065213.259303:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+16:2318:x1830881265277312:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 156us (393us total) trans 8589937033 rc 0/0 00000100:00100000:2.0:1746065213.259309:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5438 00000100:00100000:2.0:1746065213.260742:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263943424:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065213.260758:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065213.262511:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265277056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9220us (9513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.262521:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8021 00000100:00100000:0.0:1746065213.264330:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.264537:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.264597:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265277568 00000100:00100000:2.0:1746065213.264605:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265277568 00002000:00100000:2.0:1746065213.264637:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880098ddb480 x1830881265277568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.264646:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098ddb480 with x1830881265277568 ext(2097152->3145727) 00002000:00010000:2.0:1746065213.264652:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098ddb480 00000100:00100000:2.0:1746065213.264675:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265277824 00000100:00100000:2.0:1746065213.264677:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265277824 00002000:00100000:2.0:1746065213.264689:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880098dda680 x1830881265277824/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.264696:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dda680 with x1830881265277824 ext(4194304->5038079) 00002000:00010000:2.0:1746065213.264699:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dda680 00000100:00100000:2.0:1746065213.264711:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6103 00000100:00100000:2.0:1746065213.264716:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265277568:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.265339:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6104 00000100:00100000:2.0:1746065213.265345:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265277824:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065213.275103:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265277568:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10377us (10769us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065213.275114:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6103 00002000:00100000:2.0:1746065213.275124:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880098ddb480 x1830881265277568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.275132:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098ddb480 with x1830881265277568 ext(2097152->3145727) 00002000:00010000:2.0:1746065213.275137:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098ddb480 00000100:00100000:0.0:1746065213.276940:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.276961:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265278080 00000100:00100000:0.0:1746065213.276968:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265278080 00000100:00100000:0.0:1746065213.277015:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14538 00000100:00100000:0.0:1746065213.277022:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+52:2322:x1830881265278080:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065213.277040:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065213.277054:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1478f1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390dd expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.277134:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b800/0xad6b7ddc1478f24 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.277146:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b800/0xad6b7ddc1478f24 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065213.277156:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b800/0xad6b7ddc1478f24 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065213.277166:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065213.277239:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1478f1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390dd expref: 55 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.277257:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b800/0xad6b7ddc1478f24 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390dd expref: 54 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.277265:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065213.277267:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065213.277269:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b800, rc 0) 00000100:00100000:0.0:1746065213.277300:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+54:2322:x1830881265278080:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 278us (364us total) trans 8589937034 rc 0/0 00000100:00100000:0.0:1746065213.277305:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14538 00000100:00100000:3.0:1746065213.277512:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265277824:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 12166us (12974us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065213.277519:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6104 00002000:00100000:3.0:1746065213.277526:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880098dda680 x1830881265277824/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 843776/843776 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.277539:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dda680 with x1830881265277824 ext(4194304->5038079) 00002000:00010000:3.0:1746065213.277542:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dda680 00000100:00100000:0.0:1746065213.278946:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.279270:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265278208 00000100:00100000:2.0:1746065213.279276:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265278208 00000100:00100000:2.0:1746065213.279650:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17253 00000100:00100000:2.0:1746065213.279657:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+28:2316:x1830881265278208:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065213.279669:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.279680:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390e4 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.279703:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.279710:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065213.279712:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065213.279715:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.279737:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.279746:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 14 pid: 3067 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.279756:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263943552:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.280531:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.290918:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.291550:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.291618:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263943552:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.291641:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.291657:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3ce00, rc 0) 00000100:00100000:2.0:1746065213.291704:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2316:x1830881265278208:12345-192.168.202.27@tcp:101:cat.0 Request processed in 12047us (12760us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.291712:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17253 00000100:00100000:2.0:1746065213.291733:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265278464 00000100:00100000:2.0:1746065213.291738:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265278464 00000100:00100000:2.0:1746065213.291762:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17254 00000100:00100000:2.0:1746065213.291768:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2320:x1830881265278464:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065213.291816:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.291828:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390f2 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.291848:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 28 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.291856:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.291862:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.291863:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.291866:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2600960->2965503] (req 2600960->2965503) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 17 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.291886:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.291894:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.291904:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263943680:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.291948:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 28 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.291958:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 28 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.291965:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263943808:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.291979:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065213.293161:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265278592 00000100:00100000:3.0:1746065213.293167:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265278592 00002000:00100000:3.0:1746065213.293200:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2973695) req@ffff88008f3e4a80 x1830881265278592/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:0.0:1746065213.293200:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:3.0:1746065213.293209:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4a80 with x1830881265278592 ext(2097152->2973695) 00010000:00010000:3.0:1746065213.293214:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 15 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.293223:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 15 pid: 3067 timeout: 909 lvb_type: 0 00002000:00010000:3.0:1746065213.293229:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3e4a80 00000100:00100000:3.0:1746065213.293243:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2002 00000100:00100000:3.0:1746065213.293249:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265278592:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065213.293259:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265278336 00000100:00100000:2.0:1746065213.293263:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265278336 00000100:00100000:2.0:1746065213.293279:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17255 00000100:00100000:2.0:1746065213.293284:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265278336:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065213.293290:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.293298:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390eb expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065213.293323:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263943936:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065213.293363:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.298277:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.298413:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265278720 00000100:00100000:2.0:1746065213.298421:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265278720 00000100:00100000:2.0:1746065213.298457:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17256 00000100:00100000:2.0:1746065213.298463:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2007:x1830881265278720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065213.298478:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.298495:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc1478f47 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9390f9 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065213.298536:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263944064:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065213.298822:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.300620:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.300737:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263943680:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.300751:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263943808:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.300807:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2600960->2965503] (req 2600960->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 17 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.300823:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c200, rc 0) 00000100:00100000:2.0:1746065213.300890:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2320:x1830881265278464:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9118us (9977us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.300899:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17254 00000100:00100000:0.0:1746065213.301099:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.301270:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265278976 00000100:00100000:3.0:1746065213.301275:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265278976 00010000:00010000:3.0:1746065213.301298:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 29 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.301319:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265278848 00000100:00100000:3.0:1746065213.301320:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265278848 00010000:00010000:3.0:1746065213.301329:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.301346:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8022 00000100:00100000:3.0:1746065213.301351:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265278976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065213.301359:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065213.301375:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 29 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746065213.301377:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8023 00010000:00010000:3.0:1746065213.301398:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 29 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746065213.301400:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2007:x1830881265278848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065213.301409:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065213.301414:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc1478ed0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390b3 expref: 29 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.301421:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.301431:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.301800:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065213.301817:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b4a25c00/0xad6b7ddc1478f08 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390d6 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.301823:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265278976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 471us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.301829:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8022 00010000:00010000:0.0:1746065213.301837:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.301841:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.301848:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 16 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.301855:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 16 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.301885:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 16 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065213.301898:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263944192:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065213.301969:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065213.304196:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263943936:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065213.304227:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f40 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390eb expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.304239:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc1478f40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390eb expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.304308:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3ca00, rc 0) 00000100:00100000:2.0:1746065213.304479:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2007:x1830881265278336:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11192us (11276us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065213.304486:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17255 00000100:00100000:0.0:1746065213.309996:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263944192:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065213.310015:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065213.310046:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265278848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8650us (8947us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065213.310054:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8023 00000100:00100000:2.0:1746065213.310176:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263944064:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065213.310198:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc1478f47 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f9 expref: 18 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.310216:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce800/0xad6b7ddc1478f47 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f9 expref: 18 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.310225:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5ce800, rc 0) 00000100:00100000:2.0:1746065213.310261:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2007:x1830881265278720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11798us (11992us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065213.310267:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17256 00000100:00100000:0.0:1746065213.312645:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.312670:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265279232 00000100:00100000:0.0:1746065213.312676:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265279232 00002000:00100000:0.0:1746065213.312709:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2600960->2605055) req@ffff88009077ce00 x1830881265279232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065213.312718:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ce00 with x1830881265279232 ext(2600960->2605055) 00002000:00010000:0.0:1746065213.312722:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ce00 00000100:00100000:0.0:1746065213.312751:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6105 00000100:00100000:0.0:1746065213.312758:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265279232:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065213.312878:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265279232:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 121us (237us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065213.312884:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6105 00002000:00100000:0.0:1746065213.312889:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2600960->2605055) req@ffff88009077ce00 x1830881265279232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065213.312896:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ce00 with x1830881265279232 ext(2600960->2605055) 00002000:00010000:0.0:1746065213.312898:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ce00 00000100:00100000:3.0:1746065213.327242:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265278592:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 33984us (35683us total) trans 21474841656 rc 0/0 00000100:00100000:3.0:1746065213.327254:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2002 00002000:00100000:3.0:1746065213.327264:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2973695) req@ffff88008f3e4a80 x1830881265278592/t21474841656(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/448 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.327273:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4a80 with x1830881265278592 ext(2097152->2973695) 00010000:00010000:3.0:1746065213.327281:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 17 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.327301:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 17 pid: 3067 timeout: 909 lvb_type: 0 00002000:00010000:3.0:1746065213.327308:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3e4a80 00000100:00100000:0.0:1746065213.329539:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.329583:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.329626:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.329639:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265279360 00000100:00100000:3.0:1746065213.329647:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265279360 00000100:00100000:0.0:1746065213.329663:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265279744 00000100:00100000:0.0:1746065213.329667:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265279744 00000100:00100000:3.0:1746065213.329681:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265279488 00000100:00100000:3.0:1746065213.329683:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265279488 00002000:00100000:0.0:1746065213.329697:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2961408->2965503) req@ffff880097faad80 x1830881265279744/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065213.329707:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faad80 with x1830881265279744 ext(2961408->2965503) 00000100:00100000:3.0:1746065213.329711:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17257 00002000:00010000:0.0:1746065213.329712:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097faad80 00000100:00100000:3.0:1746065213.329717:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265279360:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065213.329725:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6106 00010000:00010000:3.0:1746065213.329728:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065213.329730:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265279744:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:3.0:1746065213.329743:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc1478f4e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939100 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065213.329805:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263944320:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065213.329854:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265279744:12345-192.168.202.27@tcp:3:cat.0 Request processed in 123us (227us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065213.329861:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6106 00002000:00100000:0.0:1746065213.329866:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2961408->2965503) req@ffff880097faad80 x1830881265279744/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065213.329871:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00002000:00100000:0.0:1746065213.329874:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097faad80 with x1830881265279744 ext(2961408->2965503) 00002000:00010000:0.0:1746065213.329877:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097faad80 00000100:00100000:3.0:1746065213.329897:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17258 00000100:00100000:3.0:1746065213.329902:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881265279488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065213.329908:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.329914:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc1478f55 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939107 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065213.329935:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263944448:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065213.329957:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.336113:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.336256:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263944320:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065213.336285:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc1478f4e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939100 expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.336297:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc1478f4e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939100 expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.336324:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3200, rc 0) 00000100:00100000:3.0:1746065213.336368:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881265279360:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6647us (6833us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065213.336375:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17257 00000100:00100000:1.0:1746065213.336430:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265280000 00000100:00100000:1.0:1746065213.336438:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265280000 00000100:00100000:1.0:1746065213.338444:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5439 00000100:00100000:1.0:1746065213.338457:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2320:x1830881265280000:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065213.338566:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263944448:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065213.338591:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc1478f55 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939107 expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.338602:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2400/0xad6b7ddc1478f55 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939107 expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.338627:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2400, rc 0) 00000100:00100000:0.0:1746065213.338643:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.338661:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2006:x1830881265279488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8758us (9077us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065213.338662:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265280128 00000100:00100000:2.0:1746065213.338667:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17258 00000100:00100000:0.0:1746065213.338667:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265280128 00010000:00010000:0.0:1746065213.338685:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 17 pid: 3067 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746065213.338705:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8024 00000100:00100000:0.0:1746065213.338710:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265280128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065213.338721:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065213.338893:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:2320:x1830881265280000:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 438us (2787us total) trans 8589937035 rc 0/0 00000100:00100000:1.0:1746065213.338898:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5439 00010000:00010000:0.0:1746065213.339066:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 17 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.339077:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 17 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.339093:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae23c00/0xad6b7ddc1478e0c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2973695) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93903c expref: 17 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.339119:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.339122:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.339128:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 28 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.339140:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 28 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.339164:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 28 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065213.339174:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263944576:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065213.339227:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.345491:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.345626:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263944576:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065213.345643:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065213.345677:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265280128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6966us (7035us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065213.345686:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8024 00000100:00100000:2.0:1746065213.345868:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265280384 00000100:00100000:2.0:1746065213.345874:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265280384 00002000:00100000:2.0:1746065213.345905:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff880097fa8000 x1830881265280384/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.345914:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8000 with x1830881265280384 ext(5033984->5038079) 00002000:00010000:2.0:1746065213.345918:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa8000 00000100:00100000:2.0:1746065213.345944:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6107 00000100:00100000:2.0:1746065213.345950:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265280384:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.346051:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265280384:12345-192.168.202.27@tcp:3:cat.0 Request processed in 102us (567us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065213.346057:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6107 00002000:00100000:2.0:1746065213.346062:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff880097fa8000 x1830881265280384/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.346068:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8000 with x1830881265280384 ext(5033984->5038079) 00002000:00010000:2.0:1746065213.346071:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa8000 00000100:00100000:0.0:1746065213.347084:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.347124:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265280640 00000100:00100000:3.0:1746065213.347128:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265280640 00002000:00100000:3.0:1746065213.347147:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880097fab480 x1830881265280640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.347154:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab480 with x1830881265280640 ext(2097152->3145727) 00002000:00010000:3.0:1746065213.347157:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fab480 00000100:00100000:3.0:1746065213.347183:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6108 00000100:00100000:3.0:1746065213.347189:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265280640:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065213.356080:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.356436:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265280768 00000100:00100000:2.0:1746065213.356444:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265280768 00000100:00100000:2.0:1746065213.356496:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17259 00000100:00100000:2.0:1746065213.356503:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+28:2322:x1830881265280768:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065213.356519:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.356534:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93910e expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.356560:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 15 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.356568:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065213.356570:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065213.356573:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3338240->3944447] (req 3338240->3944447) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.356600:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 15 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.356611:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 15 pid: 13375 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.356623:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263944704:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.356702:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065213.366845:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263944704:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.366872:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3338240->3944447] (req 3338240->3944447) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.366886:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5cea00, rc 0) 00000100:00100000:3.0:1746065213.368294:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265280640:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21098us (21206us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065213.368305:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6108 00002000:00100000:3.0:1746065213.368314:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880097fab480 x1830881265280640/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.368323:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab480 with x1830881265280640 ext(2097152->3145727) 00002000:00010000:3.0:1746065213.368328:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fab480 00000100:00100000:2.0:1746065213.368822:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2322:x1830881265280768:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 12316us (12746us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.368829:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17259 00000100:00100000:1.0:1746065213.368964:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.371702:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265280896 00000100:00100000:3.0:1746065213.371713:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265280896 00002000:00100000:3.0:1746065213.371753:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2600960->2965503) req@ffff8800996fa300 x1830881265280896/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.371761:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fa300 with x1830881265280896 ext(2600960->2965503) 00010000:00010000:3.0:1746065213.371770:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 16 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.371820:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 16 pid: 13375 timeout: 909 lvb_type: 0 00002000:00010000:3.0:1746065213.371827:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800996fa300 00000100:00100000:3.0:1746065213.372863:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2003 00000100:00100000:3.0:1746065213.372874:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265280896:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065213.378154:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.379039:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265281024 00000100:00100000:3.0:1746065213.379048:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265281024 00000100:00100000:3.0:1746065213.379085:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17260 00000100:00100000:3.0:1746065213.379092:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2316:x1830881265281024:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065213.379105:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.379119:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939115 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.379140:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065213.379144:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3338240->3944447] (req 3338240->3944447) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.379154:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065213.379157:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 30 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.379188:0:13375:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3338240->3944447] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.379198:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 30 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.379208:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3000, rc 0) 00000100:00100000:3.0:1746065213.379935:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2316:x1830881265281024:12345-192.168.202.27@tcp:101:cat.0 Request processed in 841us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.379941:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17260 00000100:00100000:1.0:1746065213.380689:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265280896:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7817us (11725us total) trans 17179874257 rc 0/0 00000100:00100000:1.0:1746065213.380697:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2003 00002000:00100000:1.0:1746065213.380704:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2600960->2965503) req@ffff8800996fa300 x1830881265280896/t17179874257(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/448 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.380712:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fa300 with x1830881265280896 ext(2600960->2965503) 00010000:00010000:1.0:1746065213.380719:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 18 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746065213.380729:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 18 pid: 13375 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746065213.380735:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800996fa300 00000100:00100000:0.0:1746065213.384130:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.384249:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265281152 00000100:00100000:1.0:1746065213.384256:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265281152 00010000:00010000:1.0:1746065213.384283:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 18 pid: 13375 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746065213.385260:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8025 00000100:00100000:1.0:1746065213.385272:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2007:x1830881265281152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065213.385285:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065213.385304:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 18 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746065213.385314:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 18 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746065213.385332:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f39 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2600960->2965503) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390f2 expref: 18 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746065213.385350:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065213.385351:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065213.385357:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.385364:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.385407:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.385417:0:7191:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 29 pid: 13375 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746065213.385433:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263944960:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065213.385517:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.391056:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.392025:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263944960:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065213.392046:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065213.392086:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2007:x1830881265281152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6818us (7961us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065213.392097:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8025 00000100:00100000:2.0:1746065213.392273:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265281408 00000100:00100000:2.0:1746065213.392279:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265281408 00002000:00100000:2.0:1746065213.392316:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3338240->3342335) req@ffff880097fa8e00 x1830881265281408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.392324:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8e00 with x1830881265281408 ext(3338240->3342335) 00010000:00010000:2.0:1746065213.392332:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.392343:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.392353:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa8e00 00000100:00100000:2.0:1746065213.392376:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2004 00000100:00100000:2.0:1746065213.392390:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265281408:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065213.392486:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265281408:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 97us (1440us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065213.392491:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2004 00002000:00100000:2.0:1746065213.392495:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3338240->3342335) req@ffff880097fa8e00 x1830881265281408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.392501:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8e00 with x1830881265281408 ext(3338240->3342335) 00010000:00010000:2.0:1746065213.392505:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.392513:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.392518:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa8e00 00000100:00100000:0.0:1746065213.400143:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.400260:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265281664 00000100:00100000:2.0:1746065213.400268:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265281664 00002000:00100000:2.0:1746065213.400303:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3940352->3944447) req@ffff880097fa9c00 x1830881265281664/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.400312:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa9c00 with x1830881265281664 ext(3940352->3944447) 00010000:00010000:2.0:1746065213.400319:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.400336:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.400342:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa9c00 00000100:00100000:2.0:1746065213.400427:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2005 00000100:00100000:2.0:1746065213.400434:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265281664:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065213.400912:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265281664:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 477us (775us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065213.400918:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2005 00002000:00100000:2.0:1746065213.400923:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3940352->3944447) req@ffff880097fa9c00 x1830881265281664/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.400929:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa9c00 with x1830881265281664 ext(3940352->3944447) 00010000:00010000:2.0:1746065213.400933:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.400941:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.400946:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa9c00 00000100:00100000:0.0:1746065213.406198:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.406687:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265281920 00000100:00100000:2.0:1746065213.406695:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265281920 00002000:00100000:2.0:1746065213.406731:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3338240->3944447) req@ffff880097fa3480 x1830881265281920/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.406741:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3480 with x1830881265281920 ext(3338240->3944447) 00010000:00010000:2.0:1746065213.406750:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.406761:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 30 pid: 13375 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.406767:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa3480 00000100:00100000:2.0:1746065213.407638:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2006 00000100:00100000:2.0:1746065213.407647:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265281920:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065213.415498:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265281920:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 7843us (9298us total) trans 17179874258 rc 0/0 00000100:00100000:2.0:1746065213.415510:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2006 00002000:00100000:2.0:1746065213.415519:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3338240->3944447) req@ffff880097fa3480 x1830881265281920/t17179874258(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/448 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.415527:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3480 with x1830881265281920 ext(3338240->3944447) 00010000:00010000:2.0:1746065213.415536:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.415549:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.415556:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fa3480 00000100:00100000:0.0:1746065213.418006:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.418073:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265282048 00000100:00100000:1.0:1746065213.418082:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265282048 00010000:00010000:1.0:1746065213.418111:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00000100:00100000:1.0:1746065213.418147:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8026 00000100:00100000:1.0:1746065213.418153:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265282048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065213.418165:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065213.418181:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746065213.418192:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746065213.418212:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f5c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3338240->3944447) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93910e expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746065213.418434:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065213.418437:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065213.418443:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 31 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.418450:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 31 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.418476:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 31 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065213.418486:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263945088:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065213.418572:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.423828:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881263945088:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065213.423849:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065213.423892:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265282048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5737us (5891us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065213.423900:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8026 00000100:00100000:0.0:1746065213.424460:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.424498:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.424573:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265282432 00000100:00100000:2.0:1746065213.424578:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265282432 00002000:00100000:2.0:1746065213.424612:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097fa0e00 x1830881265282432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.424625:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0e00 with x1830881265282432 ext(3145728->4194303) 00002000:00010000:2.0:1746065213.424629:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0e00 00000100:00100000:2.0:1746065213.424652:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265282560 00000100:00100000:2.0:1746065213.424655:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265282560 00002000:00100000:2.0:1746065213.424669:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880097fa1880 x1830881265282560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065213.424671:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6109 00002000:00100000:2.0:1746065213.424675:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1880 with x1830881265282560 ext(3145728->4194303) 00000100:00100000:3.0:1746065213.424678:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265282432:12345-192.168.202.27@tcp:3:multiop.0 00002000:00010000:2.0:1746065213.424678:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa1880 00000100:00100000:2.0:1746065213.425140:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6110 00000100:00100000:2.0:1746065213.425146:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265282560:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065213.434602:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265282432:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9916us (10135us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065213.434613:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6109 00002000:00100000:2.0:1746065213.434623:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097fa0e00 x1830881265282432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.434632:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0e00 with x1830881265282432 ext(3145728->4194303) 00002000:00010000:2.0:1746065213.434637:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0e00 00000100:00100000:2.0:1746065213.439997:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265282560:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 14842us (15490us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065213.440007:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6110 00002000:00100000:2.0:1746065213.440016:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880097fa1880 x1830881265282560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.440030:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1880 with x1830881265282560 ext(3145728->4194303) 00002000:00010000:2.0:1746065213.440035:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa1880 00000100:00100000:0.0:1746065213.446553:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.447026:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265282816 00000100:00100000:2.0:1746065213.447034:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265282816 00002000:00100000:2.0:1746065213.447068:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097fa3800 x1830881265282816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.447077:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3800 with x1830881265282816 ext(4194304->5038079) 00002000:00010000:2.0:1746065213.447082:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa3800 00000100:00100000:2.0:1746065213.447096:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6111 00000100:00100000:2.0:1746065213.447102:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265282816:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.452811:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265282816:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5699us (6257us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065213.452822:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6111 00002000:00100000:2.0:1746065213.452831:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097fa3800 x1830881265282816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.452840:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3800 with x1830881265282816 ext(4194304->5038079) 00002000:00010000:2.0:1746065213.452845:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa3800 00000100:00100000:0.0:1746065213.473704:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.475413:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.475461:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.475495:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265282944 00000100:00100000:0.0:1746065213.475502:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265282944 00000100:00100000:0.0:1746065213.475539:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265283072 00000100:00100000:0.0:1746065213.475541:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265283072 00000100:00100000:0.0:1746065213.476343:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265283200 00000100:00100000:0.0:1746065213.476347:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265283200 00000100:00100000:2.0:1746065213.476471:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17261 00000100:00100000:2.0:1746065213.476483:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2007:x1830881265282944:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065213.476501:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.476516:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93911c expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065213.476572:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263945216:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065213.476641:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065213.476668:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17262 00000100:00100000:2.0:1746065213.476673:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2006:x1830881265283072:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065213.476679:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.476690:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478f71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939123 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.476701:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.476703:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.476712:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478f71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939123 expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.476724:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478f71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939123 expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.476734:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7c00, rc 0) 00000100:00100000:2.0:1746065213.476756:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265283072:12345-192.168.202.27@tcp:101:cat.0 Request processed in 80us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.476762:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17262 00000100:00100000:2.0:1746065213.476793:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17263 00000100:00100000:2.0:1746065213.476797:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2007:x1830881265283200:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065213.476803:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.476811:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f78 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93912a expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.476820:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.476821:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.476824:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93912a expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.476836:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93912a expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.476842:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c200, rc 0) 00000100:00100000:2.0:1746065213.476857:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2007:x1830881265283200:12345-192.168.202.27@tcp:101:cat.0 Request processed in 59us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.476862:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17263 00000100:00100000:3.0:1746065213.480057:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263945216:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065213.480084:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f6a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93911c expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.480095:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a5cea00/0xad6b7ddc1478f6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93911c expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.480108:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5cea00, rc 0) 00000100:00100000:3.0:1746065213.480141:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2007:x1830881265282944:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3659us (6444us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065213.480148:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17261 00000100:00100000:0.0:1746065213.480364:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.481412:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265283456 00000100:00100000:3.0:1746065213.481420:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265283456 00000100:00100000:3.0:1746065213.481459:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14539 00000100:00100000:3.0:1746065213.481465:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:2332:x1830881265283456:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065213.481480:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.481492:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc1478f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939131 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.481561:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc1478f86 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065213.481573:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc1478f86 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065213.481582:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc1478f86 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065213.481590:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065213.481657:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d000/0xad6b7ddc1478f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939131 expref: 37 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.481668:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc1478f86 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939131 expref: 36 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.481674:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065213.481677:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065213.481679:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d400, rc 0) 00000100:00100000:3.0:1746065213.483449:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+36:2332:x1830881265283456:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1979us (3080us total) trans 8589937036 rc 0/0 00000100:00100000:3.0:1746065213.483458:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14539 00000100:00100000:0.0:1746065213.485524:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.485618:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265283584 00000100:00100000:3.0:1746065213.485624:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265283584 00000100:00100000:3.0:1746065213.485668:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17264 00000100:00100000:3.0:1746065213.485674:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2331:x1830881265283584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065213.485689:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.485702:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939138 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.485725:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.485731:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065213.485733:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065213.485736:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.485759:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 28 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.485769:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 28 pid: 3067 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.485800:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263945344:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065213.487363:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.489086:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.489246:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263945344:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065213.489268:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.489622:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835da00, rc 0) 00000100:00100000:3.0:1746065213.490148:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2331:x1830881265283584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4471us (4625us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.490157:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17264 00000100:00100000:2.0:1746065213.490539:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265283712 00000100:00100000:2.0:1746065213.490545:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265283712 00002000:00100000:2.0:1746065213.490576:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1990656->2023423) req@ffff88008c459500 x1830881265283712/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.490584:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459500 with x1830881265283712 ext(1990656->2023423) 00010000:00010000:2.0:1746065213.490590:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 29 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.490601:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 29 pid: 3067 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.490607:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c459500 00000100:00100000:2.0:1746065213.490622:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2007 00000100:00100000:2.0:1746065213.490628:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265283712:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065213.490733:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.490938:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265283840 00000100:00100000:3.0:1746065213.490942:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265283840 00000100:00100000:3.0:1746065213.490958:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17265 00000100:00100000:3.0:1746065213.490962:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2332:x1830881265283840:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065213.490969:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.490980:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93913f expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.490996:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 30 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.491003:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f78 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93912a expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.491008:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.491010:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.491013:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3248128->3411967] (req 3248128->3411967) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 19 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.491038:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93912a expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.491046:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93912a expref: 19 pid: 13375 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746065213.491056:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263945472:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065213.491100:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 30 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.491107:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 30 pid: 13375 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.491114:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263945600:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065213.491128:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.494637:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.494658:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263945472:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065213.494665:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263945600:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065213.494683:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3248128->3411967] (req 3248128->3411967) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 19 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.494694:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c000, rc 0) 00000100:00100000:0.0:1746065213.494697:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265283968 00000100:00100000:0.0:1746065213.494702:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265283968 00000100:00100000:3.0:1746065213.494721:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2332:x1830881265283840:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3759us (3989us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065213.494724:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93912a expref: 20 pid: 13375 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746065213.494730:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17265 00000100:00100000:0.0:1746065213.494744:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8027 00000100:00100000:0.0:1746065213.494749:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265283968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065213.494758:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065213.494770:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f78 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93912a expref: 19 pid: 13375 timeout: 909 lvb_type: 1 00010000:00010000:0.0:1746065213.494792:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f78 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93912a expref: 19 pid: 13375 timeout: 909 lvb_type: 1 00010000:00010000:0.0:1746065213.494808:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc1478f78 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93912a expref: 19 pid: 13375 timeout: 909 lvb_type: 1 00010000:00010000:0.0:1746065213.494830:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065213.494845:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265283968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065213.494851:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8027 00000100:00100000:2.0:1746065213.495648:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265283712:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5017us (6563us total) trans 21474841657 rc 0/0 00000100:00100000:2.0:1746065213.495655:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2007 00002000:00100000:2.0:1746065213.495663:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1990656->2023423) req@ffff88008c459500 x1830881265283712/t21474841657(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/448 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.495670:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459500 with x1830881265283712 ext(1990656->2023423) 00010000:00010000:2.0:1746065213.495676:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 31 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.495684:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 31 pid: 3067 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.495690:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008c459500 00000100:00100000:0.0:1746065213.502208:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.502281:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265284096 00000100:00100000:2.0:1746065213.502288:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265284096 00010000:00010000:2.0:1746065213.502317:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 31 pid: 13375 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.502339:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8028 00000100:00100000:2.0:1746065213.502344:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265284096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065213.502355:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065213.502369:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 31 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.502391:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 31 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.502409:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1478f32 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390e4 expref: 31 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.502488:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.502490:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.502495:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.502502:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.502528:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065213.502537:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263945728:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065213.504426:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.505010:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.505068:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265284224 00000100:00100000:2.0:1746065213.505073:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265284224 00010000:00010000:2.0:1746065213.505095:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 31 pid: 3067 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.505114:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8029 00000100:00100000:2.0:1746065213.505119:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265284224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065213.505128:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065213.505142:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 31 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.505151:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 31 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.505165:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc1478e59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1990656->2023423) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93905f expref: 31 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.505174:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.505175:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.505180:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.505187:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.505207:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065213.505215:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263945856:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065213.505263:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065213.507141:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263945728:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065213.507157:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065213.507183:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265284096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4838us (4983us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.507192:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8028 00000100:00100000:3.0:1746065213.507274:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263945856:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065213.507283:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065213.507297:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265284224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2178us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.507303:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8029 00000100:00100000:0.0:1746065213.509602:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.509702:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265284480 00000100:00100000:2.0:1746065213.509709:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265284480 00002000:00100000:2.0:1746065213.509741:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3248128->3252223) req@ffff88008c459880 x1830881265284480/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.509749:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459880 with x1830881265284480 ext(3248128->3252223) 00002000:00010000:2.0:1746065213.509754:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459880 00000100:00100000:2.0:1746065213.509770:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6112 00000100:00100000:2.0:1746065213.509810:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265284480:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065213.509930:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265284480:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 120us (333us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065213.509935:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6112 00002000:00100000:2.0:1746065213.509940:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3248128->3252223) req@ffff88008c459880 x1830881265284480/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.509946:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459880 with x1830881265284480 ext(3248128->3252223) 00002000:00010000:2.0:1746065213.509948:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459880 00000100:00100000:0.0:1746065213.512808:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.512874:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265284736 00000100:00100000:2.0:1746065213.512881:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265284736 00002000:00100000:2.0:1746065213.512908:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008c459c00 x1830881265284736/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.512917:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459c00 with x1830881265284736 ext(1048576->2097151) 00002000:00010000:2.0:1746065213.512921:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459c00 00000100:00100000:2.0:1746065213.512935:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6113 00000100:00100000:2.0:1746065213.512940:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265284736:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065213.513491:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.513544:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265284992 00000100:00100000:1.0:1746065213.513548:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265284992 00002000:00100000:1.0:1746065213.513563:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3407872->3411967) req@ffff88008c458700 x1830881265284992/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.513570:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458700 with x1830881265284992 ext(3407872->3411967) 00002000:00010000:1.0:1746065213.513574:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c458700 00000100:00100000:1.0:1746065213.513585:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6114 00000100:00100000:1.0:1746065213.513589:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265284992:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065213.513655:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265284992:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 65us (165us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065213.513661:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6114 00002000:00100000:1.0:1746065213.513666:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3407872->3411967) req@ffff88008c458700 x1830881265284992/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.513672:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458700 with x1830881265284992 ext(3407872->3411967) 00002000:00010000:1.0:1746065213.513674:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c458700 00000100:00100000:0.0:1746065213.531369:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265284736:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 18420us (18595us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065213.531389:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6113 00002000:00100000:0.0:1746065213.531399:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008c459c00 x1830881265284736/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065213.531408:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459c00 with x1830881265284736 ext(1048576->2097151) 00002000:00010000:0.0:1746065213.531413:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c459c00 00000100:00100000:0.0:1746065213.552273:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.552319:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.552468:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265285376 00000100:00100000:2.0:1746065213.552476:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265285376 00002000:00100000:2.0:1746065213.552512:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88008c45b480 x1830881265285376/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.552521:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45b480 with x1830881265285376 ext(2097152->4194303) 00002000:00010000:2.0:1746065213.552526:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45b480 00000100:00100000:2.0:1746065213.552540:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265285504 00000100:00100000:2.0:1746065213.552541:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265285504 00002000:00100000:2.0:1746065213.552553:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88008c458a80 x1830881265285504/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 504/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.552559:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458a80 with x1830881265285504 ext(2097152->4194303) 00002000:00010000:2.0:1746065213.552562:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c458a80 00000100:00100000:2.0:1746065213.552572:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6115 00000100:00100000:2.0:1746065213.552577:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265285376:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065213.553209:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6116 00000100:00100000:0.0:1746065213.553217:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265285504:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065213.581093:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265285504:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27868us (28765us total) trans 0 rc 1933312/1933312 00000100:00100000:1.0:1746065213.581102:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6116 00002000:00100000:1.0:1746065213.581112:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88008c458a80 x1830881265285504/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 504/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1933312/1933312 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.581120:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c458a80 with x1830881265285504 ext(2097152->4194303) 00002000:00010000:1.0:1746065213.581126:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008c458a80 00000100:00100000:2.0:1746065213.587058:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265285376:12345-192.168.202.27@tcp:3:cat.0 Request processed in 34471us (34783us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065213.587069:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6115 00002000:00100000:2.0:1746065213.587079:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88008c45b480 x1830881265285376/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.587088:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45b480 with x1830881265285376 ext(2097152->4194303) 00002000:00010000:2.0:1746065213.587094:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45b480 00000100:00100000:0.0:1746065213.597409:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.597454:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.597535:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265285632 00000100:00100000:1.0:1746065213.597543:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265285632 00000100:00100000:1.0:1746065213.597897:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265285760 00000100:00100000:1.0:1746065213.597900:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265285760 00000100:00100000:3.0:1746065213.597945:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17266 00000100:00100000:3.0:1746065213.597953:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265285632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065213.597967:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.597983:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1478fa2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939146 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.598001:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.598003:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.598011:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1478fa2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939146 expref: 31 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.598023:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1478fa2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939146 expref: 31 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.598031:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46600, rc 0) 00000100:00100000:3.0:1746065213.598481:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265285632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 528us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.598487:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17266 00000100:00100000:3.0:1746065213.598504:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17267 00000100:00100000:3.0:1746065213.598509:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265285760:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065213.598515:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.598522:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1478fa9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93914d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065213.598551:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263945984:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065213.598692:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.598790:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265286016 00000100:00100000:2.0:1746065213.598794:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265286016 00002000:00100000:2.0:1746065213.598815:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097d2a300 x1830881265286016/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.598828:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2a300 with x1830881265286016 ext(4194304->5038079) 00002000:00010000:2.0:1746065213.598831:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d2a300 00000100:00100000:2.0:1746065213.598842:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6117 00000100:00100000:2.0:1746065213.598846:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2007:x1830881265286016:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065213.599733:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065213.604344:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263945984:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065213.604371:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1478fa9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93914d expref: 31 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.604397:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46a00/0xad6b7ddc1478fa9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93914d expref: 31 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.604419:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46a00, rc 0) 00000100:00100000:3.0:1746065213.604468:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265285760:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5957us (7012us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065213.604476:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17267 00000100:00100000:3.0:1746065213.612196:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2007:x1830881265286016:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13342us (13497us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065213.612206:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6117 00002000:00100000:3.0:1746065213.612215:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097d2a300 x1830881265286016/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.612223:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2a300 with x1830881265286016 ext(4194304->5038079) 00002000:00010000:3.0:1746065213.612228:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d2a300 00000100:00100000:1.0:1746065213.637900:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.638274:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.638930:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265286272 00000100:00100000:3.0:1746065213.638938:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265286272 00002000:00100000:3.0:1746065213.638971:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800996f9f80 x1830881265286272/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.638979:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f9f80 with x1830881265286272 ext(1048576->2097151) 00002000:00010000:3.0:1746065213.638984:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f9f80 00000100:00100000:3.0:1746065213.639007:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6118 00000100:00100000:3.0:1746065213.639013:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265286272:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.639193:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265286400 00000100:00100000:2.0:1746065213.639197:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265286400 00000100:00100000:2.0:1746065213.639224:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17268 00000100:00100000:2.0:1746065213.639228:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2338:x1830881265286400:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065213.639236:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.639248:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939154 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.639271:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.639282:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30800/0xad6b7ddc1478b8f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed0 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.639291:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b57 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e9f expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.639297:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.639299:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.639302:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [2072576->2097151] (req 2072576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.639329:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e9f expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.639340:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e9f expref: 17 pid: 13375 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746065213.639350:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263946112:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.639433:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac30800/0xad6b7ddc1478b8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed0 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.639441:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30800/0xad6b7ddc1478b8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed0 expref: 9 pid: 9550 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746065213.639448:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263946240:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.639469:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.639477:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 32 pid: 3067 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.639484:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263946368:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.639495:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.646385:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.646427:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.646444:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265286528 00000100:00100000:3.0:1746065213.646451:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265286528 00000100:00100000:0.0:1746065213.646457:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265286656 00000100:00100000:0.0:1746065213.646460:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265286656 00010000:00010000:3.0:1746065213.646478:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30800/0xad6b7ddc1478b8f lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed0 expref: 10 pid: 9550 timeout: 909 lvb_type: 1 00010000:00010000:0.0:1746065213.646478:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 33 pid: 3067 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.646865:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263946112:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.646877:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263946240:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.646883:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263946368:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.646905:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [2072576->2097151] (req 2072576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 33 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.646918:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd200, rc 0) 00000100:00100000:2.0:1746065213.646957:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2338:x1830881265286400:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7728us (8684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.646965:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17268 00000100:00100000:3.0:1746065213.647891:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8030 00000100:00100000:3.0:1746065213.647899:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265286528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065213.647911:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065213.647926:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac30800/0xad6b7ddc1478b8f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed0 expref: 10 pid: 9550 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746065213.647935:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac30800/0xad6b7ddc1478b8f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed0 expref: 10 pid: 9550 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746065213.647951:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30800/0xad6b7ddc1478b8f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ed0 expref: 10 pid: 9550 timeout: 909 lvb_type: 1 00010000:00010000:3.0:1746065213.647964:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065213.648493:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265286528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 594us (2123us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.648500:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8030 00000100:00100000:3.0:1746065213.648513:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8031 00000100:00100000:3.0:1746065213.648518:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265286656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065213.648524:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065213.648532:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 32 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.648539:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 32 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.648550:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc1478ae7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e75 expref: 32 pid: 3067 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.648559:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065213.648572:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265286656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.648577:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8031 00000100:00100000:1.0:1746065213.650615:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265286272:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11597us (12716us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065213.650624:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6118 00002000:00100000:1.0:1746065213.650633:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800996f9f80 x1830881265286272/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.650642:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f9f80 with x1830881265286272 ext(1048576->2097151) 00002000:00010000:1.0:1746065213.650646:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f9f80 00000100:00100000:2.0:1746065213.652592:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.652629:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265286784 00000100:00100000:0.0:1746065213.652636:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265286784 00010000:00010000:0.0:1746065213.652660:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e9f expref: 18 pid: 13375 timeout: 909 lvb_type: 1 00000100:00100000:0.0:1746065213.652695:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8032 00000100:00100000:0.0:1746065213.652701:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265286784:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065213.652712:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065213.652726:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b57 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e9f expref: 18 pid: 13375 timeout: 909 lvb_type: 1 00010000:00010000:0.0:1746065213.652737:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b57 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e9f expref: 18 pid: 13375 timeout: 909 lvb_type: 1 00010000:00010000:0.0:1746065213.652755:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1478b57 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e9f expref: 18 pid: 13375 timeout: 909 lvb_type: 1 00010000:00010000:0.0:1746065213.652796:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.652798:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.652813:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.652820:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.652848:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065213.652859:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d28a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263946496:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065213.653598:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065213.656330:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d28a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263946496:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065213.656349:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065213.656392:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265286784:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3689us (3803us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.656401:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8032 00000100:00100000:0.0:1746065213.658109:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.658153:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.658202:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265287040 00000100:00100000:1.0:1746065213.658208:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265287040 00002000:00100000:1.0:1746065213.658240:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (2072576->2076671) req@ffff880097d29880 x1830881265287040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.658248:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d29880 with x1830881265287040 ext(2072576->2076671) 00002000:00010000:1.0:1746065213.658252:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d29880 00000100:00100000:1.0:1746065213.658274:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265287168 00000100:00100000:1.0:1746065213.658276:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265287168 00002000:00100000:1.0:1746065213.658284:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880097d28380 x1830881265287168/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 504/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.658290:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d28380 with x1830881265287168 ext(1048576->2097151) 00002000:00010000:1.0:1746065213.658293:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d28380 00000100:00100000:1.0:1746065213.658311:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6119 00000100:00100000:1.0:1746065213.658316:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265287040:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065213.658343:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6120 00000100:00100000:0.0:1746065213.658350:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265287168:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065213.658430:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265287040:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 113us (325us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065213.658436:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6119 00002000:00100000:1.0:1746065213.658440:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (2072576->2076671) req@ffff880097d29880 x1830881265287040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.658447:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d29880 with x1830881265287040 ext(2072576->2076671) 00002000:00010000:1.0:1746065213.658450:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d29880 00000100:00100000:3.0:1746065213.669627:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265287168:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10730us (10926us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746065213.669638:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6120 00002000:00100000:3.0:1746065213.670239:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880097d28380 x1830881265287168/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 504/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.670250:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d28380 with x1830881265287168 ext(1048576->2097151) 00002000:00010000:3.0:1746065213.670255:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d28380 00000100:00100000:0.0:1746065213.677216:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.677864:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265287424 00000100:00100000:2.0:1746065213.677871:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265287424 00000100:00100000:2.0:1746065213.679993:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17269 00000100:00100000:2.0:1746065213.680006:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2338:x1830881265287424:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065213.680021:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.680035:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93915b expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.680057:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.680069:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478f71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939123 expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.680074:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.680075:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.680078:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2273279] (req 2097152->2273279) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.680100:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478f71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939123 expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.680109:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478f71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939123 expref: 16 pid: 13375 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746065213.680120:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263946624:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.680222:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.680230:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.680238:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263946752:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.680254:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065213.686172:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.686244:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265287680 00000100:00100000:3.0:1746065213.686252:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265287680 00002000:00100000:3.0:1746065213.686288:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880091a92a00 x1830881265287680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.686297:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92a00 with x1830881265287680 ext(2097152->3145727) 00010000:00010000:3.0:1746065213.686306:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 33 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.686318:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 33 pid: 13375 timeout: 909 lvb_type: 0 00002000:00010000:3.0:1746065213.686323:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091a92a00 00000100:00100000:0.0:1746065213.686435:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263946624:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065213.686444:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263946752:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065213.686466:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2273279] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 33 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.686477:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30800, rc 0) 00000100:00100000:0.0:1746065213.686523:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2338:x1830881265287424:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6521us (9313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065213.686530:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17269 00000100:00100000:3.0:1746065213.686942:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2008 00000100:00100000:3.0:1746065213.686949:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265287680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065213.687364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.687965:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265287808 00000100:00100000:2.0:1746065213.687970:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265287808 00010000:00010000:2.0:1746065213.687988:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478f71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939123 expref: 17 pid: 13375 timeout: 909 lvb_type: 1 00000100:00100000:2.0:1746065213.688023:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8033 00000100:00100000:2.0:1746065213.688030:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265287808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065213.688038:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065213.688055:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478f71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939123 expref: 17 pid: 13375 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746065213.688064:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478f71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939123 expref: 17 pid: 13375 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746065213.688084:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7c00/0xad6b7ddc1478f71 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939123 expref: 17 pid: 13375 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746065213.688107:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065213.688129:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265287808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.688135:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8033 00000100:00100000:3.0:1746065213.701401:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265287680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14445us (15228us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065213.701411:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2008 00002000:00100000:3.0:1746065213.701420:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880091a92a00 x1830881265287680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.701666:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92a00 with x1830881265287680 ext(2097152->3145727) 00010000:00010000:3.0:1746065213.701676:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.701689:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00002000:00010000:3.0:1746065213.701699:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091a92a00 00000100:00100000:0.0:1746065213.715447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.717869:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265287936 00000100:00100000:2.0:1746065213.717880:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265287936 00000100:00100000:2.0:1746065213.717930:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17270 00000100:00100000:2.0:1746065213.717937:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2336:x1830881265287936:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065213.717952:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.717968:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939162 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.717996:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.718003:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065213.718004:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065213.718008:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.718032:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.718041:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.718052:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263946880:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.718140:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.718175:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.720210:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265288064 00000100:00100000:2.0:1746065213.720217:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265288064 00010000:00010000:2.0:1746065213.720246:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.720283:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8034 00000100:00100000:2.0:1746065213.720289:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265288064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065213.720304:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065213.720322:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.720333:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.720349:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc1478f63 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939115 expref: 32 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.720383:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.720385:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.720390:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.720398:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.720422:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065213.720431:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263947008:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065213.720493:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.723964:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.724144:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263946880:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.724168:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.724182:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a852a200, rc 0) 00000100:00100000:2.0:1746065213.724229:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2336:x1830881265287936:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6292us (8789us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.724238:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17270 00000100:00100000:2.0:1746065213.724276:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265288192 00000100:00100000:2.0:1746065213.724280:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265288192 00002000:00100000:2.0:1746065213.724306:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3248128->3411967) req@ffff8800996f9c00 x1830881265288192/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.724314:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f9c00 with x1830881265288192 ext(3248128->3411967) 00010000:00010000:2.0:1746065213.724320:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 18 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.724330:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 18 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.724336:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800996f9c00 00000100:00100000:2.0:1746065213.724354:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2009 00000100:00100000:2.0:1746065213.724360:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265288192:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065213.725091:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263947008:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065213.725102:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065213.725122:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265288064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4833us (6948us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.725130:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8034 00000100:00100000:0.0:1746065213.726224:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.726284:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265288448 00000100:00100000:2.0:1746065213.726290:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265288448 00002000:00100000:2.0:1746065213.726315:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2269184->2273279) req@ffff880097d2aa00 x1830881265288448/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.726323:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2aa00 with x1830881265288448 ext(2269184->2273279) 00002000:00010000:2.0:1746065213.726327:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d2aa00 00000100:00100000:2.0:1746065213.726348:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6121 00000100:00100000:2.0:1746065213.726354:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265288448:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.726800:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265288448:12345-192.168.202.27@tcp:3:cat.0 Request processed in 444us (577us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065213.726807:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6121 00002000:00100000:2.0:1746065213.726812:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2269184->2273279) req@ffff880097d2aa00 x1830881265288448/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.726819:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2aa00 with x1830881265288448 ext(2269184->2273279) 00002000:00010000:2.0:1746065213.726822:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d2aa00 00000100:00100000:2.0:1746065213.733034:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265288192:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8668us (9070us total) trans 21474841658 rc 0/0 00000100:00100000:2.0:1746065213.733045:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2009 00002000:00100000:2.0:1746065213.733055:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3248128->3411967) req@ffff8800996f9c00 x1830881265288192/t21474841658(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/448 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.733064:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f9c00 with x1830881265288192 ext(3248128->3411967) 00010000:00010000:2.0:1746065213.733073:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 20 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.733085:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 20 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.733091:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800996f9c00 00000100:00100000:0.0:1746065213.740820:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.740899:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265288576 00000100:00100000:3.0:1746065213.740906:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265288576 00010000:00010000:3.0:1746065213.740934:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 20 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.740964:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8035 00000100:00100000:3.0:1746065213.740971:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265288576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065213.740981:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065213.740997:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 20 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.741007:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 20 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.741025:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835c000/0xad6b7ddc1478f9b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3248128->3411967) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93913f expref: 20 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.741053:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.741055:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.741062:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.741068:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.741095:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065213.741105:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263947136:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065213.741168:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065213.742474:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263947136:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065213.742485:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065213.742509:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265288576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1537us (1695us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.742516:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8035 00000100:00100000:0.0:1746065213.750873:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.750922:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.751243:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265288960 00000100:00100000:2.0:1746065213.751250:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265288960 00002000:00100000:2.0:1746065213.751283:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097d29180 x1830881265288960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.751291:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d29180 with x1830881265288960 ext(3145728->4194303) 00002000:00010000:2.0:1746065213.751295:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d29180 00000100:00100000:2.0:1746065213.752946:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265289088 00000100:00100000:2.0:1746065213.752951:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265289088 00002000:00100000:2.0:1746065213.752970:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097d2bb80 x1830881265289088/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.752977:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2bb80 with x1830881265289088 ext(2097152->4194303) 00002000:00010000:2.0:1746065213.752981:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d2bb80 00000100:00100000:3.0:1746065213.753414:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6122 00000100:00100000:1.0:1746065213.759471:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6123 00000100:00100000:1.0:1746065213.759487:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265289088:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.761573:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265288960:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.768759:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.769494:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265289216 00000100:00100000:0.0:1746065213.769502:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265289216 00000100:00100000:0.0:1746065213.769549:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17271 00000100:00100000:0.0:1746065213.769555:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2342:x1830881265289216:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065213.769569:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065213.769581:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939169 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.769603:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.769609:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065213.769611:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065213.769613:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3354624->3522559] (req 3354624->3522559) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.769636:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.769645:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 32 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746065213.769655:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263947264:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065213.769738:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.775556:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265289088:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16068us (24626us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065213.775566:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6123 00002000:00100000:1.0:1746065213.775579:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097d2bb80 x1830881265289088/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.775587:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2bb80 with x1830881265289088 ext(2097152->4194303) 00002000:00010000:1.0:1746065213.775593:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d2bb80 00000100:00100000:2.0:1746065213.775675:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263947264:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.775696:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3354624->3522559] (req 3354624->3522559) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.775711:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73e00, rc 0) 00000100:00100000:2.0:1746065213.775729:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2342:x1830881265289216:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6174us (6978us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.775735:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17271 00000100:00100000:0.0:1746065213.776965:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065213.779471:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265289344 00000100:00100000:1.0:1746065213.779481:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265289344 00002000:00100000:1.0:1746065213.779571:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2273279) req@ffff880097d2b800 x1830881265289344/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065213.779579:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2b800 with x1830881265289344 ext(2097152->2273279) 00010000:00010000:1.0:1746065213.779588:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 33 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:1.0:1746065213.779599:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 33 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:1.0:1746065213.779604:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d2b800 00000100:00100000:1.0:1746065213.779634:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2010 00000100:00100000:1.0:1746065213.779641:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265289344:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065213.779756:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265288960:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26334us (28889us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065213.779767:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6122 00002000:00100000:2.0:1746065213.779785:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097d29180 x1830881265288960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.779792:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d29180 with x1830881265288960 ext(3145728->4194303) 00010000:00010000:2.0:1746065213.779796:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 33 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.779808:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 33 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.779813:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d29180 00000100:00100000:0.0:1746065213.780261:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.780632:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265289472 00000100:00100000:2.0:1746065213.780636:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265289472 00000100:00100000:3.0:1746065213.781809:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17272 00000100:00100000:3.0:1746065213.781820:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2336:x1830881265289472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065213.781833:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.781846:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939170 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.781867:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065213.781872:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3354624->3522559] (req 3354624->3522559) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.781882:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065213.781886:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 34 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.781915:0:9550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3354624->3522559] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.781926:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 34 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.781934:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46000, rc 0) 00000100:00100000:3.0:1746065213.783099:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2336:x1830881265289472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1276us (2833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.783107:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17272 00000100:00100000:0.0:1746065213.785516:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265289344:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5868us (8547us total) trans 17179874259 rc 0/0 00000100:00100000:0.0:1746065213.785529:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2010 00002000:00100000:0.0:1746065213.785539:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2273279) req@ffff880097d2b800 x1830881265289344/t17179874259(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/448 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065213.785547:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2b800 with x1830881265289344 ext(2097152->2273279) 00010000:00010000:0.0:1746065213.785556:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 34 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.785568:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 34 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:0.0:1746065213.785574:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d2b800 00000100:00100000:0.0:1746065213.789152:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.789245:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265289600 00000100:00100000:3.0:1746065213.789252:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265289600 00010000:00010000:3.0:1746065213.789281:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 34 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.789317:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8036 00000100:00100000:3.0:1746065213.789323:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881265289600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065213.789334:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065213.789348:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 34 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.789363:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 34 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.789391:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1478fb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2273279) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93915b expref: 34 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.789406:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.789408:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.789414:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.789421:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.789447:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.789456:0:8352:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 16 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.789467:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263947520:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065213.789539:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065213.792234:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263947520:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065213.792252:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065213.792292:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265289600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2968us (3146us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.792301:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8036 00000100:00100000:0.0:1746065213.792981:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.793105:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265289856 00000100:00100000:2.0:1746065213.793110:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265289856 00002000:00100000:2.0:1746065213.793142:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3354624->3358719) req@ffff880097d28a80 x1830881265289856/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.793150:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d28a80 with x1830881265289856 ext(3354624->3358719) 00010000:00010000:2.0:1746065213.793158:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.793169:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.793174:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d28a80 00000100:00100000:2.0:1746065213.793291:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2011 00000100:00100000:2.0:1746065213.793297:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265289856:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065213.793415:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265289856:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 117us (434us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065213.793421:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2011 00002000:00100000:2.0:1746065213.793426:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3354624->3358719) req@ffff880097d28a80 x1830881265289856/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.793439:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d28a80 with x1830881265289856 ext(3354624->3358719) 00010000:00010000:2.0:1746065213.793443:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.793451:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.793457:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d28a80 00000100:00100000:0.0:1746065213.796576:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.797449:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265290112 00000100:00100000:2.0:1746065213.797457:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265290112 00002000:00100000:2.0:1746065213.797491:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3518464->3522559) req@ffff880097d05180 x1830881265290112/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.797500:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05180 with x1830881265290112 ext(3518464->3522559) 00010000:00010000:2.0:1746065213.797508:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.797520:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.797526:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d05180 00000100:00100000:2.0:1746065213.797609:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2012 00000100:00100000:2.0:1746065213.797616:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2006:x1830881265290112:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065213.797864:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2006:x1830881265290112:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 247us (1292us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065213.797870:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2012 00002000:00100000:2.0:1746065213.797876:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3518464->3522559) req@ffff880097d05180 x1830881265290112/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.797883:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05180 with x1830881265290112 ext(3518464->3522559) 00010000:00010000:2.0:1746065213.797888:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.797896:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.797902:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d05180 00000100:00100000:0.0:1746065213.800764:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.801992:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265290368 00000100:00100000:2.0:1746065213.802001:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265290368 00002000:00100000:2.0:1746065213.802051:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3354624->3522559) req@ffff880097d05500 x1830881265290368/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.802060:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05500 with x1830881265290368 ext(3354624->3522559) 00010000:00010000:2.0:1746065213.802068:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:2.0:1746065213.802081:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 17 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:2.0:1746065213.802087:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d05500 00000100:00100000:2.0:1746065213.802112:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2013 00000100:00100000:2.0:1746065213.802118:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2007:x1830881265290368:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065213.808616:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2007:x1830881265290368:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 6490us (7850us total) trans 17179874260 rc 0/0 00000100:00100000:0.0:1746065213.808628:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2013 00002000:00100000:0.0:1746065213.808637:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3354624->3522559) req@ffff880097d05500 x1830881265290368/t17179874260(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/448 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065213.808645:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05500 with x1830881265290368 ext(3354624->3522559) 00010000:00010000:0.0:1746065213.808655:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 19 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.808669:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 19 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:0.0:1746065213.808677:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d05500 00000100:00100000:0.0:1746065213.812165:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.812270:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265290496 00000100:00100000:3.0:1746065213.812277:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265290496 00010000:00010000:3.0:1746065213.812307:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 19 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.813306:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8037 00000100:00100000:3.0:1746065213.813316:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265290496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065213.813329:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065213.813343:0:8352:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065213 -> 1746065214 00002000:00010000:3.0:1746065213.813345:0:8352:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065213 -> 1746065214 00010000:00010000:3.0:1746065213.813351:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 19 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.813363:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 19 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.813396:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73e00/0xad6b7ddc1478fc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3354624->3522559) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939169 expref: 19 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.813425:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.813427:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.813433:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.813441:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.813477:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065213.813488:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263947648:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065213.813567:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065213.815401:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263947648:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065213.815417:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065213.815446:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265290496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2133us (3288us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.815454:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8037 00000100:00100000:0.0:1746065213.822134:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.822225:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265290752 00000100:00100000:2.0:1746065213.822233:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265290752 00002000:00100000:2.0:1746065213.822271:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097d04000 x1830881265290752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.822281:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04000 with x1830881265290752 ext(3145728->4194303) 00002000:00010000:2.0:1746065213.822286:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d04000 00000100:00100000:2.0:1746065213.822317:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6124 00000100:00100000:2.0:1746065213.822323:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265290752:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.830058:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265290752:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7726us (7924us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065213.830068:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6124 00002000:00100000:2.0:1746065213.830077:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097d04000 x1830881265290752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.830086:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04000 with x1830881265290752 ext(3145728->4194303) 00002000:00010000:2.0:1746065213.830090:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d04000 00000100:00100000:0.0:1746065213.842597:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.842647:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.842807:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265291008 00000100:00100000:2.0:1746065213.842815:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265291008 00000100:00100000:1.0:1746065213.842815:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265291136 00000100:00100000:1.0:1746065213.842818:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265291136 00002000:00100000:2.0:1746065213.842856:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097d04e00 x1830881265291008/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065213.842863:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17273 00002000:00100000:2.0:1746065213.842866:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04e00 with x1830881265291008 ext(4194304->5038079) 00000100:00100000:1.0:1746065213.842869:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265291136:12345-192.168.202.27@tcp:101:cat.0 00002000:00010000:2.0:1746065213.842870:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d04e00 00010000:00010000:1.0:1746065213.842881:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065213.842882:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6125 00000100:00100000:2.0:1746065213.842885:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265291008:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:1.0:1746065213.842895:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1478fd3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939177 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065213.842935:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263947776:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065213.843004:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.845910:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.846845:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:0.0:1746065213.846934:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime: 1746065211 -> 1746065214 00002000:00010000:0.0:1746065213.846937:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065211 -> 1746065214 00002000:00010000:0.0:1746065213.846938:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime: 1746065211 -> 1746065214 00000100:00100000:0.0:1746065213.846953:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996fbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263947776:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065213.846978:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1478fd3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939177 expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065213.846990:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1478fd3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939177 expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065213.847001:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f04b600, rc 0) 00000100:00100000:0.0:1746065213.847032:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265291136:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4162us (4384us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065213.847039:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17273 00000100:00100000:0.0:1746065213.847063:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265291264 00000100:00100000:0.0:1746065213.847068:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265291264 00000100:00100000:0.0:1746065213.847087:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265291392 00000100:00100000:0.0:1746065213.847089:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265291392 00000100:00100000:0.0:1746065213.847102:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17274 00000100:00100000:0.0:1746065213.847107:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265291264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065213.847117:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065213.847128:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478fda lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93917e expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.847141:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.847142:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.847148:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478fda lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93917e expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065213.847159:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478fda lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93917e expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065213.847165:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3e00, rc 0) 00000100:00100000:0.0:1746065213.847177:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265291264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 70us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065213.847181:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17274 00000100:00100000:0.0:1746065213.847189:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17275 00000100:00100000:0.0:1746065213.847193:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265291392:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065213.847198:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065213.847205:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939185 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.847213:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.847214:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.847217:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939185 expref: 20 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065213.847229:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939185 expref: 20 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065213.847235:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd2800, rc 0) 00000100:00100000:0.0:1746065213.847244:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265291392:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065213.847247:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17275 00000100:00100000:2.0:1746065213.849753:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265291008:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6858us (7155us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065213.849763:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6125 00002000:00100000:2.0:1746065213.849790:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097d04e00 x1830881265291008/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.849798:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04e00 with x1830881265291008 ext(4194304->5038079) 00002000:00010000:2.0:1746065213.849803:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d04e00 00000100:00100000:1.0:1746065213.865020:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.866635:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265291520 00000100:00100000:2.0:1746065213.866645:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265291520 00000100:00100000:2.0:1746065213.867162:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17276 00000100:00100000:2.0:1746065213.867171:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2347:x1830881265291520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065213.867185:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.867201:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93918c expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.867226:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.867232:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065213.867234:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065213.867238:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.867270:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.867280:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 32 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.867291:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263947904:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.867390:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.870082:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.870106:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263947904:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.870129:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.870143:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1400, rc 0) 00000100:00100000:3.0:1746065213.870151:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265291648 00000100:00100000:3.0:1746065213.870157:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265291648 00002000:00100000:3.0:1746065213.870189:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (2072576->2097151) req@ffff880091bc1180 x1830881265291648/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.870198:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1180 with x1830881265291648 ext(2072576->2097151) 00010000:00010000:3.0:1746065213.870204:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 33 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.870215:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 33 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:3.0:1746065213.870221:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bc1180 00000100:00100000:3.0:1746065213.870235:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2014 00000100:00100000:3.0:1746065213.870240:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265291648:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065213.870520:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2347:x1830881265291520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3165us (5320us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.870529:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17276 00000100:00100000:0.0:1746065213.873057:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265291648:12345-192.168.202.27@tcp:4:cat.0 Request processed in 2811us (2976us total) trans 17179874261 rc 0/0 00000100:00100000:0.0:1746065213.873067:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2014 00002000:00100000:0.0:1746065213.873075:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (2072576->2097151) req@ffff880091bc1180 x1830881265291648/t17179874261(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/448 e 0 to 0 dl 1746065224 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065213.873083:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1180 with x1830881265291648 ext(2072576->2097151) 00010000:00010000:0.0:1746065213.873090:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 35 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.873103:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 35 pid: 9550 timeout: 909 lvb_type: 0 00002000:00010000:0.0:1746065213.873108:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bc1180 00000100:00100000:0.0:1746065213.875630:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.875868:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265291776 00000100:00100000:3.0:1746065213.875875:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265291776 00010000:00010000:3.0:1746065213.875903:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 35 pid: 9550 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.875941:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8038 00000100:00100000:3.0:1746065213.875948:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265291776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065213.875959:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065213.875975:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 35 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.875986:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 35 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.876005:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd200/0xad6b7ddc1478fb0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2072576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939154 expref: 35 pid: 9550 timeout: 909 lvb_type: 0 00010000:00010000:3.0:1746065213.876034:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.876036:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.876042:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.876049:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.876078:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065213.876094:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263948032:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065213.876179:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065213.889459:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.889516:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263948032:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065213.889533:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065213.889538:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265292032 00000100:00100000:0.0:1746065213.889544:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265292032 00000100:00100000:2.0:1746065213.889568:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265291776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 13620us (13943us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.889576:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8038 00002000:00100000:0.0:1746065213.889579:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880091a90e00 x1830881265292032/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065213.889587:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90e00 with x1830881265292032 ext(1048576->2097151) 00002000:00010000:0.0:1746065213.889591:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90e00 00000100:00100000:0.0:1746065213.889612:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6126 00000100:00100000:0.0:1746065213.889618:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265292032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.901889:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265292032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12262us (12429us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065213.901897:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6126 00002000:00100000:2.0:1746065213.901905:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880091a90e00 x1830881265292032/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.901911:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90e00 with x1830881265292032 ext(1048576->2097151) 00002000:00010000:2.0:1746065213.901915:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90e00 00000100:00100000:0.0:1746065213.941406:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.941452:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.941536:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265292288 00000100:00100000:2.0:1746065213.941546:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265292288 00002000:00100000:2.0:1746065213.941588:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880091bc1f80 x1830881265292288/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.941598:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1f80 with x1830881265292288 ext(2097152->4194303) 00002000:00010000:2.0:1746065213.941604:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc1f80 00000100:00100000:2.0:1746065213.941628:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265292544 00000100:00100000:2.0:1746065213.941631:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265292544 00002000:00100000:2.0:1746065213.941643:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091bc1880 x1830881265292544/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.941650:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1880 with x1830881265292544 ext(2097152->4194303) 00002000:00010000:2.0:1746065213.941652:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc1880 00000100:00100000:2.0:1746065213.941663:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6127 00000100:00100000:2.0:1746065213.941675:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6128 00000100:00100000:2.0:1746065213.941680:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265292544:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065213.942958:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265292288:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065213.966317:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.966386:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265292672 00000100:00100000:2.0:1746065213.966393:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265292672 00000100:00100000:2.0:1746065213.966443:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17277 00000100:00100000:2.0:1746065213.966451:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2349:x1830881265292672:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065213.966466:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.966483:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939193 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.966507:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.966513:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.966515:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.966518:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1118208->1822719] (req 1118208->1822719) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.966542:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.966553:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 21 pid: 13375 timeout: 909 lvb_type: 0 00000100:00100000:2.0:1746065213.966563:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263948160:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.966652:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065213.972848:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.972883:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265292800 00000100:00100000:0.0:1746065213.972890:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265292800 00010000:00010000:0.0:1746065213.972917:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 22 pid: 13375 timeout: 909 lvb_type: 0 00000100:00100000:0.0:1746065213.972946:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8039 00000100:00100000:0.0:1746065213.972953:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265292800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065213.972964:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065213.972980:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 22 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.972992:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 22 pid: 13375 timeout: 909 lvb_type: 0 00010000:00010000:0.0:1746065213.973013:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.973015:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065213.973022:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.973029:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.973056:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065213.973066:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263948288:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065213.973128:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00010000:00010000:3.0:1746065213.973231:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc1478fe8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93918c expref: 22 pid: 13375 timeout: 909 lvb_type: 0 00000100:00100000:3.0:1746065213.973245:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263948160:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065213.973260:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 35 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.973267:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda600, rc 0) 00000100:00100000:3.0:1746065213.973287:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2349:x1830881265292672:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6838us (6978us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065213.973294:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17277 00000100:00100000:1.0:1746065213.980912:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.980991:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265292928 00000100:00100000:3.0:1746065213.980999:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265292928 00000100:00100000:3.0:1746065213.981035:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17278 00000100:00100000:3.0:1746065213.981042:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2352:x1830881265292928:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065213.981057:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.981071:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93919a expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.981093:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.981106:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939185 expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.981111:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.981113:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065213.981116:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3936256->4194303] (req 3936256->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.981140:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939185 expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065213.981150:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939185 expref: 23 pid: 9549 timeout: 909 lvb_type: 1 00000100:00100000:3.0:1746065213.981160:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263948416:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065213.981786:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.981795:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 30 pid: 9550 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065213.981802:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263948544:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.983170:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265292544:12345-192.168.202.27@tcp:3:cat.0 Request processed in 41484us (41712us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065213.983178:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6128 00002000:00100000:2.0:1746065213.983187:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091bc1880 x1830881265292544/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.983195:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1880 with x1830881265292544 ext(2097152->4194303) 00010000:00010000:2.0:1746065213.983202:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939185 expref: 22 pid: 9549 timeout: 909 lvb_type: 1 00010000:00010000:2.0:1746065213.983216:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939185 expref: 22 pid: 9549 timeout: 910 lvb_type: 1 00002000:00010000:2.0:1746065213.983221:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091bc1880 00000100:00100000:3.0:1746065213.983309:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.984183:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.984251:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265293184 00000100:00100000:3.0:1746065213.984256:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265293184 00002000:00100000:3.0:1746065213.984282:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1118208->1122303) req@ffff88009077ea00 x1830881265293184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/0 e 0 to 0 dl 1746065224 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.984290:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ea00 with x1830881265293184 ext(1118208->1122303) 00002000:00010000:3.0:1746065213.984293:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ea00 00000100:00100000:3.0:1746065213.984307:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6129 00000100:00100000:3.0:1746065213.984313:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265293184:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065213.984422:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265293184:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 109us (240us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065213.984427:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6129 00002000:00100000:3.0:1746065213.984432:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1118208->1122303) req@ffff88009077ea00 x1830881265293184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:129/0 lens 488/4536 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065213.984438:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ea00 with x1830881265293184 ext(1118208->1122303) 00002000:00010000:3.0:1746065213.984440:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ea00 00000100:00100000:2.0:1746065213.984536:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263948288:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065213.984550:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065213.984582:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265292800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11629us (11743us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.984590:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8039 00000100:00100000:0.0:1746065213.988913:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.989494:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263948416:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065213.989508:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263948544:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065213.989530:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3936256->4194303] (req 3936256->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.989545:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47800, rc 0) 00000100:00100000:2.0:1746065213.989578:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2352:x1830881265292928:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8537us (8673us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065213.989586:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17278 00000100:00100000:0.0:1746065213.989748:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065213.990005:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265293312 00000100:00100000:3.0:1746065213.990011:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265293312 00000100:00100000:3.0:1746065213.990043:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14540 00000100:00100000:3.0:1746065213.990049:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+16:2353:x1830881265293312:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065213.990068:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065213.990083:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0600/0xad6b7ddc1478ffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391a1 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.990130:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479004 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065213.990142:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065213.990156:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479004 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065213.990167:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc147900b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065213.990171:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc147900b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065213.990175:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc147900b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065213.990226:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065213.990235:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b800/0xad6b7ddc1478f24 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390dd expref: 53 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.990241:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc1478f86 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939131 expref: 35 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.990246:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065213.990265:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc1478f86 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939131 expref: 35 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.990273:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc1478f86 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939131 expref: 35 pid: 9571 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065213.990283:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263948672:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065213.990327:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b800/0xad6b7ddc1478f24 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390dd expref: 53 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065213.990334:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b800/0xad6b7ddc1478f24 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390dd expref: 53 pid: 7205 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065213.990340:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263948800:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065213.990355:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065213.990460:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265293440 00000100:00100000:2.0:1746065213.990463:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265293440 00000100:00100000:2.0:1746065213.990483:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17279 00000100:00100000:2.0:1746065213.990487:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265293440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065213.990494:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065213.990502:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdb000/0xad6b7ddc1479019 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391a8 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065213.990513:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065213.990520:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdb000/0xad6b7ddc1479019 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391a8 expref: 32 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.990528:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdb000/0xad6b7ddc1479019 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391a8 expref: 32 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065213.990541:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb000, rc 0) 00000100:00100000:2.0:1746065213.990555:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265293440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 67us (808us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065213.990560:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17279 00000100:00100000:2.0:1746065213.993194:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265292288:12345-192.168.202.27@tcp:3:cat.0 Request processed in 51518us (51787us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065213.993203:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6127 00002000:00100000:2.0:1746065213.993212:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880091bc1f80 x1830881265292288/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:129/0 lens 488/440 e 0 to 0 dl 1746065224 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065213.993221:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1f80 with x1830881265292288 ext(2097152->4194303) 00002000:00010000:2.0:1746065213.993226:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc1f80 00000100:00100000:3.0:1746065213.995456:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1880 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263948672:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065213.995467:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263948800:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065213.995486:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:2.0:1746065213.996023:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.996047:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.996237:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065213.996983:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065213.997058:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265293696 00000100:00100000:0.0:1746065213.997064:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265293696 00010000:00010000:0.0:1746065213.997090:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc1478f86 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939131 expref: 36 pid: 9571 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746065213.997110:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265293952 00000100:00100000:0.0:1746065213.997112:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265293952 00010000:00010000:0.0:1746065213.997122:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 31 pid: 9550 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746065213.997134:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265293824 00000100:00100000:0.0:1746065213.997136:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265293824 00010000:00010000:0.0:1746065213.997144:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b800/0xad6b7ddc1478f24 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390dd expref: 54 pid: 7205 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746065213.997156:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8040 00000100:00100000:0.0:1746065213.997163:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+36:2004:x1830881265293696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065213.997173:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065213.997177:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc1478f86 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939131 expref: 36 pid: 9571 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065213.997185:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc1478f86 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939131 expref: 36 pid: 9571 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065213.997204:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d400/0xad6b7ddc1478f86 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939131 expref: 36 pid: 9571 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065213.997218:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065213.997222:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997229:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997234:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997238:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065213.997268:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+35:2004:x1830881265293696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 105us (1247us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065213.997274:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8040 00000100:00100000:0.0:1746065213.997314:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8041 00000100:00100000:0.0:1746065213.997318:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265293952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065213.997325:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065213.997342:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 31 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065213.997352:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 31 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065213.997365:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a852a200/0xad6b7ddc1478fbe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939162 expref: 31 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065213.997385:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065213.997399:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265293952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065213.997405:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8041 00000100:00100000:0.0:1746065213.997414:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8042 00000100:00100000:0.0:1746065213.997419:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+54:2004:x1830881265293824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065213.997424:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065213.997428:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b800/0xad6b7ddc1478f24 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390dd expref: 54 pid: 7205 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065213.997434:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b800/0xad6b7ddc1478f24 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390dd expref: 54 pid: 7205 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065213.997444:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b800/0xad6b7ddc1478f24 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9390dd expref: 54 pid: 7205 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065213.997451:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065213.997454:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997463:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997470:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997485:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065213.997497:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+53:2004:x1830881265293824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065213.997502:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8042 00010000:00010000:0.0:1746065213.997632:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997638:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065213.997716:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:0.0:1746065213.997721:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065213.997738:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997746:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997755:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479004 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997760:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479004 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997766:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479004 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997770:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479004 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997794:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c1400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065213.997797:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479004 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997802:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479004 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997809:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065213.997811:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065213.997814:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479004 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997818:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479004 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997826:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc147900b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997830:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc147900b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997834:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc147900b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997837:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131019c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065213.997839:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc147900b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997843:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc147900b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997848:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008c512800) 00010000:00010000:0.0:1746065213.997850:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065213.997852:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc147900b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997856:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131019c00/0xad6b7ddc147900b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065213.997884:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0600/0xad6b7ddc1478ffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391a1 expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.997893:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391a1 expref: 17 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065213.997898:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065213.997900:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065213.997902:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a400, rc 0) 00000100:00100000:0.0:1746065213.997924:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+17:2353:x1830881265293312:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 7875us (9019us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065213.997929:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14540 00000100:00100000:1.0:1746065213.998227:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265293568 00000100:00100000:1.0:1746065213.998231:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265293568 00010000:00010000:1.0:1746065213.998248:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939185 expref: 21 pid: 9549 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746065213.998266:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8043 00000100:00100000:1.0:1746065213.998271:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265293568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065213.998277:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065213.998286:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939185 expref: 21 pid: 9549 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065213.998294:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939185 expref: 21 pid: 9549 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065213.998305:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc1478fe1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939185 expref: 21 pid: 9549 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065213.998316:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065213.998317:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065213.998322:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.998328:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065213.998354:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065213.998364:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263948928:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065213.998707:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065213.999969:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263948928:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065213.999979:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065214.000112:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265293568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1840us (3128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.000118:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8043 00000100:00100000:0.0:1746065214.000889:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.001229:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.001287:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265294336 00000100:00100000:2.0:1746065214.001292:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265294336 00002000:00100000:2.0:1746065214.001325:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1818624->1822719) req@ffff880091bc2d80 x1830881265294336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065214.001328:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265294464 00000100:00100000:1.0:1746065214.001330:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265294464 00002000:00100000:2.0:1746065214.001333:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc2d80 with x1830881265294336 ext(1818624->1822719) 00002000:00010000:2.0:1746065214.001336:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc2d80 00000100:00100000:2.0:1746065214.001360:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6130 00000100:00100000:2.0:1746065214.001366:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265294336:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065214.001735:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265294336:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 368us (847us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065214.001740:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6130 00002000:00100000:2.0:1746065214.001745:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1818624->1822719) req@ffff880091bc2d80 x1830881265294336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/4536 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.001942:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc2d80 with x1830881265294336 ext(1818624->1822719) 00002000:00010000:2.0:1746065214.001945:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc2d80 00000100:00100000:1.0:1746065214.001947:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17280 00000100:00100000:1.0:1746065214.001953:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265294464:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065214.001964:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.001976:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc1479020 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391af expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065214.002181:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065214.002211:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.002214:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.002223:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc1479020 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391af expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.002236:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc1479020 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391af expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.002244:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b60400, rc 0) 00000100:00100000:1.0:1746065214.002265:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265294464:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 313us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.002365:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265294720 00000100:00100000:2.0:1746065214.002368:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265294720 00002000:00100000:2.0:1746065214.002392:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3936256->3940351) req@ffff880091bc3b80 x1830881265294720/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065214.002470:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17280 00000100:00100000:0.0:1746065214.003024:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.003064:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.003104:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265294592 00000100:00100000:3.0:1746065214.003107:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265294592 00000100:00100000:3.0:1746065214.003127:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265294848 00000100:00100000:3.0:1746065214.003128:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265294848 00000100:00100000:3.0:1746065214.003139:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17281 00000100:00100000:3.0:1746065214.003144:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265294592:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065214.003151:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065214.003160:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1479027 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391b6 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065214.003174:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc3b80 with x1830881265294720 ext(3936256->3940351) 00002000:00010000:2.0:1746065214.003178:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc3b80 00000100:00100000:2.0:1746065214.003190:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6131 00000100:00100000:3.0:1746065214.003192:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263949056:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065214.003195:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265294720:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065214.003235:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065214.003269:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265294720:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 69us (1083us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065214.003274:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6131 00002000:00100000:2.0:1746065214.003279:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3936256->3940351) req@ffff880091bc3b80 x1830881265294720/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/4536 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065214.003285:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17282 00002000:00100000:2.0:1746065214.003286:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc3b80 with x1830881265294720 ext(3936256->3940351) 00002000:00010000:2.0:1746065214.003288:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc3b80 00000100:00100000:1.0:1746065214.003290:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265294848:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065214.003296:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.003302:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc147902e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391bd expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.003311:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.003313:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.003317:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc147902e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391bd expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.003338:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc147902e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391bd expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.003345:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61400, rc 0) 00000100:00100000:1.0:1746065214.003362:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265294848:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 72us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.003366:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17282 00000100:00100000:0.0:1746065214.005056:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.005665:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265295104 00000100:00100000:1.0:1746065214.005670:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265295104 00000100:00100000:0.0:1746065214.005718:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.005735:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265295232 00000100:00100000:0.0:1746065214.005738:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265295232 00000100:00100000:0.0:1746065214.005757:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17283 00000100:00100000:0.0:1746065214.005762:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265295232:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065214.005800:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065214.005811:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc1479035 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391c4 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065214.005841:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263949184:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065214.005889:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065214.006100:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5440 00000100:00100000:1.0:1746065214.006106:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4111850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+53:2349:x1830881265295104:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065214.006317:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4111850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+54:2349:x1830881265295104:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 210us (1264us total) trans 8589937037 rc 0/0 00000100:00100000:1.0:1746065214.006323:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5440 00000100:00100000:3.0:1746065214.007123:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263949056:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065214.007143:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1479027 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391b6 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.007152:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683aa00/0xad6b7ddc1479027 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391b6 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.007161:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683aa00, rc 0) 00000100:00100000:3.0:1746065214.007264:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265294592:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4119us (4239us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065214.007270:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17281 00000100:00100000:0.0:1746065214.007847:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.008110:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265295488 00000100:00100000:2.0:1746065214.008115:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265295488 00002000:00100000:2.0:1746065214.008138:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880097d06a00 x1830881265295488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 504/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.008146:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06a00 with x1830881265295488 ext(1048576->2097151) 00002000:00010000:2.0:1746065214.008149:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d06a00 00000100:00100000:2.0:1746065214.008168:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6132 00000100:00100000:2.0:1746065214.008173:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265295488:12345-192.168.202.27@tcp:3:cat.0 00002000:00010000:1.0:1746065214.008461:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746065213 -> 1746065214 00002000:00010000:1.0:1746065214.008464:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065213 -> 1746065214 00002000:00010000:1.0:1746065214.008465:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746065213 -> 1746065214 00000100:00100000:1.0:1746065214.008475:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263949184:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065214.008490:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc1479035 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391c4 expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.008499:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4200/0xad6b7ddc1479035 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391c4 expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.008510:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4200, rc 0) 00000100:00100000:1.0:1746065214.008528:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265295232:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 2765us (2810us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065214.008533:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17283 00000100:00100000:0.0:1746065214.009969:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.010224:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265295744 00000100:00100000:3.0:1746065214.010230:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265295744 00002000:00100000:3.0:1746065214.010257:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012b4ead80 x1830881265295744/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 504/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.010266:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4ead80 with x1830881265295744 ext(2097152->4194303) 00002000:00010000:3.0:1746065214.010270:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4ead80 00000100:00100000:3.0:1746065214.010326:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6133 00000100:00100000:3.0:1746065214.010334:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265295744:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065214.015223:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265295488:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7040us (7367us total) trans 0 rc 344064/344064 00000100:00100000:2.0:1746065214.015234:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6132 00002000:00100000:2.0:1746065214.015245:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880097d06a00 x1830881265295488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 504/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 344064/344064 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.015253:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06a00 with x1830881265295488 ext(1048576->2097151) 00002000:00010000:2.0:1746065214.015258:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d06a00 00000100:00100000:2.0:1746065214.017288:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.017458:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265296000 00000100:00100000:0.0:1746065214.017465:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265296000 00000100:00100000:0.0:1746065214.017507:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14541 00000100:00100000:0.0:1746065214.017515:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+17:2353:x1830881265296000:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065214.017536:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065214.017552:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4800/0xad6b7ddc147903c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391cb expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.017641:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479043 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065214.017653:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391a1 expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.017659:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479043 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065214.017681:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391a1 expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.017690:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391a1 expref: 18 pid: 9571 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746065214.017699:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263949312:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065214.017799:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065214.021144:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4eb480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263949312:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.021164:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479043 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:3.0:1746065214.021272:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265295744:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10936us (11304us total) trans 0 rc 2093056/2093056 00000100:00100000:3.0:1746065214.021281:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6133 00002000:00100000:3.0:1746065214.021291:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88012b4ead80 x1830881265295744/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 504/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 2093056/2093056 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.021299:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4ead80 with x1830881265295744 ext(2097152->4194303) 00002000:00010000:3.0:1746065214.021304:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4ead80 00000100:00100000:0.0:1746065214.021357:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.021510:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265296128 00000100:00100000:1.0:1746065214.021515:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265296128 00010000:00010000:1.0:1746065214.021536:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391a1 expref: 19 pid: 9571 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.021556:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8044 00000100:00100000:1.0:1746065214.021562:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265296128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065214.021572:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065214.021577:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391a1 expref: 19 pid: 9571 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746065214.021586:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391a1 expref: 19 pid: 9571 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746065214.021605:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc1479012 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391a1 expref: 19 pid: 9571 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746065214.021994:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.022062:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265296384 00000100:00100000:3.0:1746065214.022065:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265296384 00002000:00100000:3.0:1746065214.022089:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012b4eb800 x1830881265296384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.022096:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4eb800 with x1830881265296384 ext(2097152->3145727) 00002000:00010000:3.0:1746065214.022099:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4eb800 00000100:00100000:3.0:1746065214.022182:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6134 00000100:00100000:3.0:1746065214.022188:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265296384:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:1.0:1746065214.022231:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065214.022236:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479043 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.022243:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479043 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.022248:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479043 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065214.022358:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479043 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065214.022364:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479043 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.022385:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000004:00200000:0.0:1746065214.022387:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000100:00100000:1.0:1746065214.022434:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265296128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 871us (1075us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.022439:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8044 00010000:00010000:0.0:1746065214.023078:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4800/0xad6b7ddc147903c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391cb expref: 19 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.023096:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479043 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391cb expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.023102:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065214.023105:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065214.023107:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5c00, rc 0) 00000100:00100000:0.0:1746065214.023125:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+18:2353:x1830881265296000:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 5611us (5846us total) trans 8589937038 rc 0/0 00000100:00100000:0.0:1746065214.023131:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14541 00000100:00100000:0.0:1746065214.031228:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.031323:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265296512 00000100:00100000:1.0:1746065214.031331:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265296512 00000100:00100000:0.0:1746065214.031760:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.031934:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265296640 00000100:00100000:1.0:1746065214.031937:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265296640 00000100:00100000:0.0:1746065214.031946:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17284 00000100:00100000:0.0:1746065214.031958:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2352:x1830881265296512:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:1.0:1746065214.031961:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17285 00000100:00100000:1.0:1746065214.031965:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265296640:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065214.031978:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.031993:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1479051 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391d9 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.032030:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065214.032037:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391d2 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065214.032038:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263949440:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065214.032072:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 36 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.032080:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc147902e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391bd expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.032086:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478fda lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93917e expref: 22 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.032092:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065214.032093:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065214.032096:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->4403199] (req 4194304->4403199) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 22 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065214.032109:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00010000:00010000:0.0:1746065214.032196:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478fda lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93917e expref: 22 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.032206:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478fda lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93917e expref: 22 pid: 9549 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746065214.032214:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263949568:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065214.032237:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc147902e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391bd expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.032248:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc147902e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391bd expref: 9 pid: 10219 timeout: 910 lvb_type: 1 00000100:00100000:0.0:1746065214.032255:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263949696:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065214.032272:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 36 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.032278:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 36 pid: 9550 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746065214.032284:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263949824:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065214.032295:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.033167:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.033309:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265296384:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11107us (11302us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065214.033317:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6134 00002000:00100000:3.0:1746065214.033326:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012b4eb800 x1830881265296384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.033334:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4eb800 with x1830881265296384 ext(2097152->3145727) 00010000:00010000:3.0:1746065214.033339:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 35 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.033348:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 35 pid: 9550 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746065214.033354:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4eb800 00000100:00100000:1.0:1746065214.033437:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265296896 00000100:00100000:1.0:1746065214.033441:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265296896 00000100:00100000:1.0:1746065214.033467:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14542 00000100:00100000:1.0:1746065214.033472:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+18:2353:x1830881265296896:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065214.033488:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.033490:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065214.033507:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479043 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391cb expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.033522:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065214.033525:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065214.033532:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090176400/0xad6b7ddc147905f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391e0 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.033595:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1479066 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.033605:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1479066 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.033613:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1479066 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.033623:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1479066 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.033628:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1479066 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.033633:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1479066 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.033638:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090176600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065214.033641:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1479066 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.033646:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1479066 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.033652:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065214.033654:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065214.033657:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1479066 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.033661:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090176600/0xad6b7ddc1479066 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065214.033677:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090176400/0xad6b7ddc147905f lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e0 expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.033683:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090176400/0xad6b7ddc147905f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e0 expref: 18 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.033689:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090176400, rc 0) 00000100:00100000:1.0:1746065214.033704:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+17:2353:x1830881265296896:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 232us (539us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065214.033710:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14542 00000100:00100000:0.0:1746065214.037250:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.037287:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263949568:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.037297:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4eb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263949696:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.037305:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263949824:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.037330:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->4403199] (req 4194304->4403199) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 22 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.037345:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5600, rc 0) 00000100:00100000:1.0:1746065214.037396:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2352:x1830881265296512:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5443us (6175us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.037404:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17284 00000100:00100000:1.0:1746065214.037451:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263949440:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065214.037466:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1479051 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d9 expref: 21 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.037474:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1479051 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d9 expref: 21 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.037482:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a400, rc 0) 00000100:00100000:1.0:1746065214.037496:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265296640:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5531us (5738us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065214.037500:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17285 00000100:00100000:1.0:1746065214.037518:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265297024 00000100:00100000:1.0:1746065214.037521:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265297024 00010000:00010000:1.0:1746065214.037538:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc147902e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391bd expref: 10 pid: 10219 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746065214.038044:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8045 00000100:00100000:1.0:1746065214.038051:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265297024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065214.038062:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065214.038070:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc147902e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391bd expref: 10 pid: 10219 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.038078:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc147902e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391bd expref: 10 pid: 10219 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.038097:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097b61400/0xad6b7ddc147902e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391bd expref: 10 pid: 10219 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.038104:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065214.038133:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265297024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.038138:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8045 00000100:00100000:0.0:1746065214.038625:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.038663:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.038791:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265297152 00000100:00100000:2.0:1746065214.038795:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265297152 00010000:00010000:2.0:1746065214.038810:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478fda lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93917e expref: 20 pid: 9549 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746065214.038827:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8046 00000100:00100000:2.0:1746065214.038832:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265297152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065214.038838:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065214.038846:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478fda lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93917e expref: 20 pid: 9549 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746065214.038859:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478fda lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93917e expref: 20 pid: 9549 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746065214.038870:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1478fda lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93917e expref: 20 pid: 9549 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746065214.038892:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065214.038911:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265297152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 79us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.038916:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8046 00000100:00100000:1.0:1746065214.038962:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265297280 00000100:00100000:1.0:1746065214.038966:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265297280 00000100:00100000:1.0:1746065214.038985:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17286 00000100:00100000:1.0:1746065214.038989:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2356:x1830881265297280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065214.039000:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.039009:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391e7 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.039025:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.039031:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065214.039033:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065214.039036:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.039055:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.039067:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 19 pid: 13375 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.039077:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263949952:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.039857:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065214.039920:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.040127:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265297536 00000100:00100000:0.0:1746065214.040131:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265297536 00000100:00100000:0.0:1746065214.040191:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5441 00000100:00100000:0.0:1746065214.040197:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+17:2353:x1830881265297536:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:0.0:1746065214.040544:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+18:2353:x1830881265297536:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 346us (623us total) trans 8589937039 rc 0/0 00000100:00100000:0.0:1746065214.040549:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5441 00000100:00100000:1.0:1746065214.044483:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.044524:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.044614:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265297792 00000100:00100000:2.0:1746065214.044621:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265297792 00000100:00100000:2.0:1746065214.044652:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17287 00000100:00100000:0.0:1746065214.044653:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265297664 00000100:00100000:0.0:1746065214.044657:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265297664 00000100:00100000:2.0:1746065214.044658:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2347:x1830881265297792:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065214.044670:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065214.044675:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 35 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.044681:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391ee expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065214.044692:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8047 00000100:00100000:0.0:1746065214.044696:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265297664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065214.044701:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065214.044704:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065214.044706:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->4403199] (req 4194304->4403199) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.044712:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065214.044715:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->5038079] (req 4194304->5038079) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065214.044850:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.044866:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265297920 00000100:00100000:3.0:1746065214.044870:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265297920 00002000:00100000:3.0:1746065214.044893:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3936256->4194303) req@ffff880099cf1880 x1830881265297920/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.044901:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1880 with x1830881265297920 ext(3936256->4194303) 00010000:00010000:3.0:1746065214.044907:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 20 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.044915:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 20 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746065214.044921:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cf1880 00000100:00100000:3.0:1746065214.044933:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2015 00000100:00100000:3.0:1746065214.044937:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265297920:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065214.044966:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263949952:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.044987:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.044997:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a000, rc 0) 00000100:00100000:1.0:1746065214.045026:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2356:x1830881265297280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6036us (6362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.045031:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17286 00010000:00010000:0.0:1746065214.045240:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 35 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065214.045250:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 35 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.045252:0:10219:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [4194304->4403199] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.045265:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46000/0xad6b7ddc1478fcc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939170 expref: 35 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.045266:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [4194304->5038079] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.045272:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.045273:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.045278:0:10219:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.045284:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.045292:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065214.045296:0:10219:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.045303:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746065214.045308:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265297664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 612us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.045312:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263950208:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065214.045314:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8047 00000100:00100000:2.0:1746065214.045356:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065214.051050:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263950208:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065214.051068:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c5c00, rc 0) 00000100:00100000:2.0:1746065214.051108:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2347:x1830881265297792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6449us (6582us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.051116:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17287 00000100:00100000:0.0:1746065214.051819:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.052355:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265298176 00000100:00100000:3.0:1746065214.052362:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265298176 00002000:00100000:3.0:1746065214.052399:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4399104->4403199) req@ffff88012b4ea300 x1830881265298176/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.052406:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4ea300 with x1830881265298176 ext(4399104->4403199) 00010000:00010000:3.0:1746065214.053162:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.053173:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746065214.053179:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4ea300 00000100:00100000:3.0:1746065214.053200:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2016 00000100:00100000:3.0:1746065214.053208:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265298176:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065214.053321:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265298176:12345-192.168.202.27@tcp:3:cat.0 Request processed in 114us (1503us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065214.053326:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2016 00002000:00100000:3.0:1746065214.053331:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4399104->4403199) req@ffff88012b4ea300 x1830881265298176/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/4536 e 0 to 0 dl 1746065225 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.053337:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4ea300 with x1830881265298176 ext(4399104->4403199) 00010000:00010000:3.0:1746065214.053341:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.053349:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746065214.053354:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4ea300 00000100:00100000:0.0:1746065214.058707:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265297920:12345-192.168.202.27@tcp:4:cat.0 Request processed in 13756us (13845us total) trans 21474841659 rc 0/0 00000100:00100000:0.0:1746065214.058719:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2015 00002000:00100000:0.0:1746065214.058730:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3936256->4194303) req@ffff880099cf1880 x1830881265297920/t21474841659(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/448 e 0 to 0 dl 1746065225 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065214.058744:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1880 with x1830881265297920 ext(3936256->4194303) 00010000:00010000:0.0:1746065214.058752:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 22 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065214.058763:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 22 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:0.0:1746065214.058769:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cf1880 00000100:00100000:0.0:1746065214.061766:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.061836:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.061874:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265298688 00000100:00100000:1.0:1746065214.061882:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265298688 00000100:00100000:1.0:1746065214.062117:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5442 00000100:00100000:1.0:1746065214.062124:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+35:2352:x1830881265298688:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065214.062663:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+36:2352:x1830881265298688:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 538us (825us total) trans 8589937040 rc 0/0 00000100:00100000:1.0:1746065214.062670:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5442 00000100:00100000:2.0:1746065214.063197:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265298432 00000100:00100000:2.0:1746065214.063200:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265298432 00002000:00100000:2.0:1746065214.063225:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4403199) req@ffff88012b4e9c00 x1830881265298432/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.063234:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e9c00 with x1830881265298432 ext(4194304->4403199) 00010000:00010000:2.0:1746065214.063242:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.063253:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 20 pid: 10219 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746065214.063259:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4e9c00 00000100:00100000:2.0:1746065214.063274:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2017 00000100:00100000:2.0:1746065214.063279:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265298432:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065214.064398:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.064443:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265298816 00000100:00100000:3.0:1746065214.064448:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265298816 00010000:00010000:3.0:1746065214.064469:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 22 pid: 13375 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065214.064493:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8048 00000100:00100000:3.0:1746065214.064499:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265298816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.064507:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065214.064526:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 22 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.064539:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 22 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.064557:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d47800/0xad6b7ddc1478ff6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3936256->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93919a expref: 22 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.064796:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.064798:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.064805:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.064811:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.064834:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065214.064843:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263950336:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065214.065328:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.069971:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265298432:12345-192.168.202.27@tcp:4:cat.0 Request processed in 6682us (8201us total) trans 17179874262 rc 0/0 00000100:00100000:0.0:1746065214.069981:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2017 00002000:00100000:0.0:1746065214.069991:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4403199) req@ffff88012b4e9c00 x1830881265298432/t17179874262(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/448 e 0 to 0 dl 1746065225 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065214.069999:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e9c00 with x1830881265298432 ext(4194304->4403199) 00010000:00010000:0.0:1746065214.070008:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 22 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065214.070020:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 22 pid: 10219 timeout: 910 lvb_type: 0 00002000:00010000:0.0:1746065214.070026:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012b4e9c00 00000100:00100000:1.0:1746065214.070239:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.070387:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263950336:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065214.070402:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065214.070433:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265298816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5934us (6038us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.070441:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8048 00000100:00100000:0.0:1746065214.070444:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265299072 00000100:00100000:0.0:1746065214.070450:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265299072 00002000:00100000:0.0:1746065214.070474:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009077c000 x1830881265299072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065214.070481:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c000 with x1830881265299072 ext(2097152->3145727) 00002000:00010000:0.0:1746065214.070484:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077c000 00000100:00100000:0.0:1746065214.070504:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6135 00000100:00100000:0.0:1746065214.070510:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265299072:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065214.073512:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.073582:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265299200 00000100:00100000:3.0:1746065214.073588:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265299200 00010000:00010000:3.0:1746065214.073614:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 22 pid: 10219 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065214.073637:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8049 00000100:00100000:3.0:1746065214.073643:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265299200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.073653:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065214.073669:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 22 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.073678:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 22 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.073695:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa5600/0xad6b7ddc1479058 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4403199) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391d2 expref: 22 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.073706:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.073708:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.073714:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.073722:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.073749:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065214.073760:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263950464:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065214.073850:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065214.077552:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265299072:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7033us (7305us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065214.077562:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6135 00002000:00100000:1.0:1746065214.077572:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009077c000 x1830881265299072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065214.077582:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c000 with x1830881265299072 ext(2097152->3145727) 00002000:00010000:1.0:1746065214.077587:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077c000 00000100:00100000:3.0:1746065214.079826:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263950464:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065214.079842:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065214.079872:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265299200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6229us (6367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.079879:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8049 00000100:00100000:0.0:1746065214.081118:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.081204:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265299456 00000100:00100000:1.0:1746065214.081210:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265299456 00002000:00100000:1.0:1746065214.081244:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88012b4eb480 x1830881265299456/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065214.081252:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4eb480 with x1830881265299456 ext(4194304->5038079) 00002000:00010000:1.0:1746065214.081256:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4eb480 00000100:00100000:1.0:1746065214.081287:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6136 00000100:00100000:1.0:1746065214.081297:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265299456:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065214.084285:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.084389:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265299584 00000100:00100000:2.0:1746065214.084396:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265299584 00000100:00100000:2.0:1746065214.084492:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17288 00000100:00100000:2.0:1746065214.084500:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2356:x1830881265299584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065214.084517:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.084532:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc147907b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391f5 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.084554:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.084556:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.084562:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc147907b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391f5 expref: 35 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.084576:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc147907b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391f5 expref: 35 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.084587:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095779200, rc 0) 00000100:00100000:2.0:1746065214.085128:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2356:x1830881265299584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 627us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.085134:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17288 00000100:00100000:1.0:1746065214.086935:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265299456:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5635us (5813us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746065214.086943:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6136 00002000:00100000:1.0:1746065214.086951:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88012b4eb480 x1830881265299456/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065214.086960:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4eb480 with x1830881265299456 ext(4194304->5038079) 00002000:00010000:1.0:1746065214.086964:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4eb480 00000100:00100000:0.0:1746065214.090016:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.090062:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.090092:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265299840 00000100:00100000:2.0:1746065214.090100:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265299840 00000100:00100000:2.0:1746065214.090149:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265299712 00000100:00100000:2.0:1746065214.090151:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265299712 00000100:00100000:2.0:1746065214.090340:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17289 00000100:00100000:2.0:1746065214.090348:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265299840:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065214.090359:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17290 00010000:00010000:2.0:1746065214.090363:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065214.090367:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265299712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065214.090391:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1479082 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939203 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.090406:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.090411:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.090413:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.090414:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1479089 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9391fc expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.090421:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1479082 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939203 expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.090434:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1479082 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939203 expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.090443:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130104600, rc 0) 00000100:00100000:1.0:1746065214.090448:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263950592:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065214.090500:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265299840:12345-192.168.202.27@tcp:101:cat.0 Request processed in 152us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.090505:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17289 00000100:00100000:1.0:1746065214.091187:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.093662:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.093697:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.093804:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265300224 00000100:00100000:1.0:1746065214.093810:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265300224 00000100:00100000:1.0:1746065214.093857:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263950592:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065214.093882:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1479089 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391fc expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.093893:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683a400/0xad6b7ddc1479089 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391fc expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065214.094259:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265300352 00000100:00100000:2.0:1746065214.094263:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265300352 00002000:00100000:2.0:1746065214.094292:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009c5f2d80 x1830881265300352/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.094300:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2d80 with x1830881265300352 ext(3145728->4194303) 00002000:00010000:2.0:1746065214.094303:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f2d80 00010000:00010000:1.0:1746065214.094659:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a400, rc 0) 00000100:00100000:1.0:1746065214.094700:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265299712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4334us (4637us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065214.094707:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17290 00002000:00100000:1.0:1746065214.094748:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88009c5f0a80 x1830881265300224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065214.094755:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0a80 with x1830881265300224 ext(3145728->4194303) 00002000:00010000:1.0:1746065214.094758:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0a80 00000100:00100000:2.0:1746065214.094806:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6137 00000100:00100000:2.0:1746065214.094812:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265300352:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065214.095366:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6138 00000100:00100000:0.0:1746065214.095382:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265300224:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065214.097129:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065214.105472:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.105569:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265300480 00000100:00100000:1.0:1746065214.105577:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265300480 00000100:00100000:1.0:1746065214.105623:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17291 00000100:00100000:1.0:1746065214.105631:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265300480:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065214.105632:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265300224:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10256us (11974us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065214.105640:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6138 00010000:00010000:1.0:1746065214.105644:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00002000:00100000:0.0:1746065214.105648:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88009c5f0a80 x1830881265300224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065214.105656:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0a80 with x1830881265300224 ext(3145728->4194303) 00010000:00010000:1.0:1746065214.105658:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479090 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93920a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065214.105660:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0a80 00000100:00100000:1.0:1746065214.105699:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263950720:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065214.105764:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065214.109820:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265300352:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14998us (16112us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065214.109829:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6137 00002000:00100000:2.0:1746065214.109839:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009c5f2d80 x1830881265300352/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.109848:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2d80 with x1830881265300352 ext(3145728->4194303) 00002000:00010000:2.0:1746065214.109852:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f2d80 00000100:00100000:1.0:1746065214.111874:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263950720:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065214.111903:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479090 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93920a expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.111916:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479090 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93920a expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.111943:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31200, rc 0) 00000100:00100000:1.0:1746065214.111986:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265300480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6355us (6521us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065214.111992:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17291 00000100:00100000:0.0:1746065214.123255:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.123592:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265300736 00000100:00100000:2.0:1746065214.123601:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265300736 00002000:00100000:2.0:1746065214.123640:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009c5f1880 x1830881265300736/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.123649:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1880 with x1830881265300736 ext(4194304->5038079) 00002000:00010000:2.0:1746065214.123655:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f1880 00000100:00100000:2.0:1746065214.123683:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6139 00000100:00100000:2.0:1746065214.123690:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265300736:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065214.132258:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265300736:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8560us (9002us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065214.132269:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6139 00002000:00100000:2.0:1746065214.132278:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009c5f1880 x1830881265300736/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.132287:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1880 with x1830881265300736 ext(4194304->5038079) 00002000:00010000:2.0:1746065214.132292:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f1880 00000100:00100000:0.0:1746065214.184626:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.186117:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265300992 00000100:00100000:1.0:1746065214.186128:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265300992 00000100:00100000:1.0:1746065214.186495:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14543 00000100:00100000:1.0:1746065214.186503:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+36:2363:x1830881265300992:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065214.186523:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.186537:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1479097 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939211 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.186624:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147909e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.186636:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147909e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.186645:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147909e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065214.186654:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065214.186736:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136166e00/0xad6b7ddc1479097 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939211 expref: 39 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.186764:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147909e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939211 expref: 38 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.186786:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065214.186789:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065214.186791:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136167800, rc 0) 00000100:00100000:1.0:1746065214.186842:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+38:2363:x1830881265300992:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 340us (2224us total) trans 8589937041 rc 0/0 00000100:00100000:1.0:1746065214.186848:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14543 00000100:00100000:0.0:1746065214.246149:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.246213:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265301248 00000100:00100000:2.0:1746065214.246221:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265301248 00000100:00100000:2.0:1746065214.246271:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14544 00000100:00100000:2.0:1746065214.246278:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+54:2365:x1830881265301248:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065214.246299:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.246315:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc14790ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939218 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.246424:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14790b3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065214.246437:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14790b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065214.246448:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14790b3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065214.246457:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065214.246539:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a400/0xad6b7ddc14790ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939218 expref: 57 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.246571:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14790b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939218 expref: 56 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.246577:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065214.246579:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065214.246581:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683be00, rc 0) 00000100:00100000:2.0:1746065214.246625:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+56:2365:x1830881265301248:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 347us (484us total) trans 8589937042 rc 0/0 00000100:00100000:2.0:1746065214.246632:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14544 00000100:00100000:0.0:1746065214.262602:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.262703:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265301376 00000100:00100000:1.0:1746065214.262711:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265301376 00000100:00100000:1.0:1746065214.262763:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17292 00000100:00100000:1.0:1746065214.262770:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265301376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065214.262812:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.262828:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc14790c1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93921f expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065214.262877:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263950848:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065214.262955:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065214.268873:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263950848:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065214.268902:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc14790c1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93921f expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.268917:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc14790c1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93921f expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.268931:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166e00, rc 0) 00000100:00100000:1.0:1746065214.269144:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265301376:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6373us (6548us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065214.269152:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17292 00000100:00100000:0.0:1746065214.277733:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.278137:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265301504 00000100:00100000:1.0:1746065214.278145:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265301504 00000100:00100000:1.0:1746065214.278799:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17293 00000100:00100000:1.0:1746065214.278807:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2369:x1830881265301504:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065214.278824:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.278839:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939226 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.278864:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.278871:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065214.278873:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065214.278876:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.278902:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.278913:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 34 pid: 13375 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.278924:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263950976:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065214.279963:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.280484:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065214.280769:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265301760 00000100:00100000:3.0:1746065214.280790:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265301760 00002000:00100000:3.0:1746065214.280825:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88009c5f3100 x1830881265301760/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.280834:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3100 with x1830881265301760 ext(2097152->3145727) 00002000:00010000:3.0:1746065214.280838:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f3100 00000100:00100000:3.0:1746065214.280852:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6140 00000100:00100000:3.0:1746065214.280858:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265301760:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065214.281554:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263950976:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.281572:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.281587:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656e600, rc 0) 00000100:00100000:1.0:1746065214.281620:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2369:x1830881265301504:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2814us (3894us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.281626:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17293 00000100:00100000:0.0:1746065214.282130:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.282387:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265301888 00000100:00100000:1.0:1746065214.282391:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265301888 00002000:00100000:1.0:1746065214.282410:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1118208->1822719) req@ffff88009c5f0380 x1830881265301888/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065214.282418:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0380 with x1830881265301888 ext(1118208->1822719) 00010000:00010000:1.0:1746065214.282424:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 37 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746065214.282436:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 37 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:1.0:1746065214.282442:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f0380 00000100:00100000:1.0:1746065214.282457:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2018 00000100:00100000:1.0:1746065214.282462:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265301888:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065214.290577:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265301760:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9710us (10607us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065214.290587:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6140 00002000:00100000:3.0:1746065214.290597:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88009c5f3100 x1830881265301760/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.290605:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3100 with x1830881265301760 ext(2097152->3145727) 00002000:00010000:3.0:1746065214.290611:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f3100 00000100:00100000:0.0:1746065214.299109:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.299140:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265302016 00000100:00100000:0.0:1746065214.299147:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265302016 00000100:00100000:0.0:1746065214.299221:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17294 00000100:00100000:0.0:1746065214.299228:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265302016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065214.299245:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065214.299259:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9000/0xad6b7ddc14790cf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93922d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065214.299301:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263951104:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065214.299368:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065214.300980:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263951104:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065214.301001:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9000/0xad6b7ddc14790cf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93922d expref: 38 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.301011:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9000/0xad6b7ddc14790cf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93922d expref: 38 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.301035:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d9000, rc 0) 00000100:00100000:2.0:1746065214.301063:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265302016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1835us (1963us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065214.301070:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17294 00000100:00100000:1.0:1746065214.304998:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265301888:12345-192.168.202.27@tcp:4:cat.0 Request processed in 22524us (22858us total) trans 17179874263 rc 0/0 00000100:00100000:1.0:1746065214.305010:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2018 00002000:00100000:1.0:1746065214.305020:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1118208->1822719) req@ffff88009c5f0380 x1830881265301888/t17179874263(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/448 e 0 to 0 dl 1746065225 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065214.305029:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0380 with x1830881265301888 ext(1118208->1822719) 00010000:00010000:1.0:1746065214.305038:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 37 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746065214.305051:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 37 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:1.0:1746065214.305057:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f0380 00000100:00100000:0.0:1746065214.307960:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.308295:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265302144 00000100:00100000:2.0:1746065214.308303:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265302144 00000100:00100000:2.0:1746065214.308350:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17295 00000100:00100000:2.0:1746065214.308356:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265302144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065214.308382:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.308396:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc14790d6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939234 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.308439:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263951232:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065214.308513:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.310247:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065214.310458:0:9550:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff880092746a00 x1830881263951232) - normal race ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 38 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.310486:0:9550:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 38 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.310505:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1478fef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1118208->1822719) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939193 expref: 38 pid: 13375 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065214.311125:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265302272 00000100:00100000:3.0:1746065214.311131:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265302272 00000100:00100000:3.0:1746065214.311178:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 849 00000100:00100000:3.0:1746065214.311185:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881265302272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.311196:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065214.311197:0:7192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie ad6b7ddc1478fef) 00010000:00010000:3.0:1746065214.311199:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065214.311229:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881265302272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 44us (986us total) trans 0 rc 116/116 00000100:00100000:2.0:1746065214.311324:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263951232:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065214.311342:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.311343:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.311350:0:9550:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.311359:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.311393:0:9550:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.311408:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263951360:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065214.311450:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065214.311838:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 849 00000100:00100000:2.0:1746065214.315479:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263951360:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065214.315509:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc14790d6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939234 expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.315523:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f4d9200/0xad6b7ddc14790d6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939234 expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.315535:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f4d9200, rc 0) 00000100:00100000:2.0:1746065214.315568:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265302144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7211us (7615us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065214.315576:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17295 00000100:00100000:0.0:1746065214.321161:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.321943:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265302528 00000100:00100000:1.0:1746065214.321952:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265302528 00002000:00100000:1.0:1746065214.321992:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012dc3c000 x1830881265302528/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065214.322001:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3c000 with x1830881265302528 ext(1048576->2097151) 00002000:00010000:1.0:1746065214.322006:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3c000 00000100:00100000:1.0:1746065214.322034:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6141 00000100:00100000:1.0:1746065214.322040:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265302528:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065214.324449:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.326915:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265302656 00000100:00100000:3.0:1746065214.326925:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265302656 00000100:00100000:3.0:1746065214.326986:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17296 00000100:00100000:3.0:1746065214.326993:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265302656:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065214.327007:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065214.327021:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc14790dd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93923b expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.327042:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.327044:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.327052:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc14790dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93923b expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.327064:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc14790dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93923b expref: 37 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.327073:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4200, rc 0) 00000100:00100000:3.0:1746065214.327131:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265302656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 138us (2687us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.327137:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17296 00000100:00100000:0.0:1746065214.338437:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.339419:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265302784 00000100:00100000:2.0:1746065214.339428:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265302784 00000100:00100000:2.0:1746065214.339471:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17297 00000100:00100000:2.0:1746065214.339478:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2363:x1830881265302784:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065214.339492:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.339504:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939242 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.339534:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 23 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.339548:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1be00/0xad6b7ddc1478ebb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93909e expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.339554:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478e75 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93906d expref: 30 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.339559:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.339561:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.339564:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1265664->2019327] (req 1265664->2019327) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.339585:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478e75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93906d expref: 30 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.339595:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478e75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93906d expref: 30 pid: 3068 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746065214.339604:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263951488:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065214.340111:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1be00/0xad6b7ddc1478ebb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93909e expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.340121:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c1be00/0xad6b7ddc1478ebb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93909e expref: 9 pid: 10219 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746065214.340129:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263951616:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065214.340154:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 23 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.340161:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 23 pid: 3067 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746065214.340307:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265302528:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18266us (19153us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065214.340314:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6141 00002000:00100000:0.0:1746065214.340322:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012dc3c000 x1830881265302528/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065214.340336:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3c000 with x1830881265302528 ext(1048576->2097151) 00002000:00010000:0.0:1746065214.340340:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3c000 00000100:00100000:2.0:1746065214.340398:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263951744:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065214.340419:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.343518:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.343556:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.343580:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265302912 00000100:00100000:3.0:1746065214.343588:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265302912 00010000:00010000:3.0:1746065214.343621:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1be00/0xad6b7ddc1478ebb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93909e expref: 10 pid: 10219 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746065214.343652:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265303040 00000100:00100000:3.0:1746065214.343655:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265303040 00010000:00010000:3.0:1746065214.343664:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 24 pid: 3067 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065214.343752:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8050 00000100:00100000:3.0:1746065214.343759:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265302912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.343789:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065214.343809:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1be00/0xad6b7ddc1478ebb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93909e expref: 10 pid: 10219 timeout: 910 lvb_type: 1 00010000:00010000:3.0:1746065214.343818:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1be00/0xad6b7ddc1478ebb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93909e expref: 10 pid: 10219 timeout: 910 lvb_type: 1 00010000:00010000:3.0:1746065214.343839:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065214.343886:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265302912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 127us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.343892:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8050 00000100:00100000:3.0:1746065214.343905:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8051 00000100:00100000:3.0:1746065214.343909:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2006:x1830881265303040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.343916:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065214.343922:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 24 pid: 3067 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.343934:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 24 pid: 3067 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.343949:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065214.343963:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2006:x1830881265303040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.343968:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8051 00000100:00100000:2.0:1746065214.344048:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263951488:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065214.344058:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1be00/0xad6b7ddc1478ebb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93909e expref: 9 pid: 10219 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746065214.344082:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263951616:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065214.344091:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96600/0xad6b7ddc1478e2f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939051 expref: 23 pid: 3067 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746065214.344098:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263951744:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065214.344117:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1265664->2019327] (req 1265664->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.344125:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac200, rc 0) 00000100:00100000:2.0:1746065214.344142:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2363:x1830881265302784:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4666us (5713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.344149:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17297 00000100:00100000:0.0:1746065214.348109:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.349742:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265303168 00000100:00100000:3.0:1746065214.349752:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265303168 00010000:00010000:3.0:1746065214.349798:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478e75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93906d expref: 31 pid: 3068 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746065214.349836:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8052 00000100:00100000:3.0:1746065214.349843:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265303168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.349854:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065214.349871:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478e75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93906d expref: 31 pid: 3068 timeout: 910 lvb_type: 1 00010000:00010000:3.0:1746065214.349881:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478e75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93906d expref: 31 pid: 3068 timeout: 910 lvb_type: 1 00010000:00010000:3.0:1746065214.349899:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1b600/0xad6b7ddc1478e75 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93906d expref: 31 pid: 3068 timeout: 910 lvb_type: 1 00010000:00010000:3.0:1746065214.349927:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.349930:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.349936:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.349943:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.349971:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065214.349987:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263951872:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065214.350061:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065214.353448:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263951872:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065214.353463:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065214.353497:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265303168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3654us (5397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.353507:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8052 00000100:00100000:0.0:1746065214.354146:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.356073:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265303424 00000100:00100000:2.0:1746065214.356083:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265303424 00002000:00100000:2.0:1746065214.356125:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1265664->1269759) req@ffff880091aa5f80 x1830881265303424/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.356133:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa5f80 with x1830881265303424 ext(1265664->1269759) 00002000:00010000:2.0:1746065214.356139:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091aa5f80 00000100:00100000:2.0:1746065214.356169:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6142 00000100:00100000:2.0:1746065214.356175:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265303424:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065214.356310:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265303424:12345-192.168.202.27@tcp:3:cat.0 Request processed in 135us (2165us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065214.356319:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6142 00002000:00100000:2.0:1746065214.356324:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1265664->1269759) req@ffff880091aa5f80 x1830881265303424/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/4536 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.356331:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa5f80 with x1830881265303424 ext(1265664->1269759) 00002000:00010000:2.0:1746065214.356333:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091aa5f80 00000100:00100000:0.0:1746065214.358610:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.358849:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265303680 00000100:00100000:3.0:1746065214.358856:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265303680 00002000:00100000:3.0:1746065214.358890:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880091aa5500 x1830881265303680/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.358898:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa5500 with x1830881265303680 ext(2097152->4194303) 00002000:00010000:3.0:1746065214.358902:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa5500 00000100:00100000:3.0:1746065214.359390:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6143 00000100:00100000:3.0:1746065214.359398:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265303680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065214.365673:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.368665:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265303936 00000100:00100000:3.0:1746065214.368675:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265303936 00002000:00100000:3.0:1746065214.368713:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880092747800 x1830881265303936/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.368722:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747800 with x1830881265303936 ext(2097152->4194303) 00002000:00010000:3.0:1746065214.368728:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747800 00000100:00100000:3.0:1746065214.369901:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6144 00000100:00100000:3.0:1746065214.369917:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265303936:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065214.371074:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.373690:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265304192 00000100:00100000:2.0:1746065214.373699:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265304192 00002000:00100000:2.0:1746065214.373737:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (2015232->2019327) req@ffff880091aa6a00 x1830881265304192/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.373746:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6a00 with x1830881265304192 ext(2015232->2019327) 00002000:00010000:2.0:1746065214.373751:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091aa6a00 00000100:00100000:2.0:1746065214.373791:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6145 00000100:00100000:2.0:1746065214.373797:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265304192:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065214.378029:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265304192:12345-192.168.202.27@tcp:3:cat.0 Request processed in 4222us (6949us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065214.378042:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6145 00002000:00100000:2.0:1746065214.378053:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (2015232->2019327) req@ffff880091aa6a00 x1830881265304192/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/4536 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.378062:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6a00 with x1830881265304192 ext(2015232->2019327) 00002000:00010000:2.0:1746065214.378067:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091aa6a00 00000100:00100000:3.0:1746065214.387245:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265303680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27839us (28632us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065214.387255:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6143 00002000:00100000:3.0:1746065214.387266:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880091aa5500 x1830881265303680/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.387274:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa5500 with x1830881265303680 ext(2097152->4194303) 00002000:00010000:3.0:1746065214.387279:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa5500 00000100:00100000:3.0:1746065214.399121:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265303936:12345-192.168.202.27@tcp:3:cat.0 Request processed in 29198us (33446us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065214.399130:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6144 00002000:00100000:3.0:1746065214.399140:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880092747800 x1830881265303936/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.399149:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747800 with x1830881265303936 ext(2097152->4194303) 00002000:00010000:3.0:1746065214.399154:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092747800 00000100:00100000:0.0:1746065214.464557:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.464620:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265304320 00000100:00100000:2.0:1746065214.464630:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265304320 00000100:00100000:2.0:1746065214.464682:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17298 00000100:00100000:2.0:1746065214.464688:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265304320:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065214.464704:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.464719:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7aca00/0xad6b7ddc14790eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939249 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.464761:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263952000:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065214.464882:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00002000:00010000:2.0:1746065214.467553:0:13375:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065213 -> 1746065214 00002000:00010000:2.0:1746065214.467559:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065213 -> 1746065214 00002000:00010000:2.0:1746065214.467560:0:13375:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065213 -> 1746065214 00000100:00100000:2.0:1746065214.467576:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263952000:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065214.467600:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7aca00/0xad6b7ddc14790eb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939249 expref: 31 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.467611:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7aca00/0xad6b7ddc14790eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939249 expref: 31 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.467624:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7aca00, rc 0) 00000100:00100000:2.0:1746065214.467668:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265304320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2980us (3119us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065214.467675:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17298 00000100:00100000:1.0:1746065214.468530:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.468669:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265304448 00000100:00100000:2.0:1746065214.468675:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265304448 00000100:00100000:2.0:1746065214.468718:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17299 00000100:00100000:2.0:1746065214.468724:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2365:x1830881265304448:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065214.468738:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.468749:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939250 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.468770:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.468791:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc147907b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391f5 expref: 38 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.468798:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.468799:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.468802:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3407872->4194303] (req 3407872->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 38 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.468824:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc147907b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391f5 expref: 38 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.468837:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc147907b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391f5 expref: 38 pid: 10219 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746065214.468846:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263952128:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065214.468920:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.468929:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 21 pid: 10219 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746065214.468937:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263952256:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065214.469022:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065214.470349:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263952128:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065214.470358:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263952256:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065214.470383:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3407872->4194303] (req 3407872->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 38 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.470394:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ac800, rc 0) 00000100:00100000:2.0:1746065214.472911:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+38:2365:x1830881265304448:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4176us (4373us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.472922:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17299 00000100:00100000:0.0:1746065214.477198:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.477353:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265304576 00000100:00100000:3.0:1746065214.477361:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265304576 00010000:00010000:3.0:1746065214.477401:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc147907b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391f5 expref: 38 pid: 10219 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065214.477430:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8053 00000100:00100000:3.0:1746065214.477437:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881265304576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.477448:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065214.477463:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc147907b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391f5 expref: 38 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.477472:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc147907b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391f5 expref: 38 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.477491:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095779200/0xad6b7ddc147907b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391f5 expref: 38 pid: 10219 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.478303:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065214.478426:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065214.478461:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881265304576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1024us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.478467:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8053 00000100:00100000:2.0:1746065214.478671:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265304832 00000100:00100000:2.0:1746065214.478675:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265304832 00000100:00100000:1.0:1746065214.478690:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.478706:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17300 00000100:00100000:2.0:1746065214.478712:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2377:x1830881265304832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065214.478724:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.478735:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939257 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065214.478743:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265304704 00000100:00100000:3.0:1746065214.478745:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265304704 00010000:00010000:2.0:1746065214.478753:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.478756:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 22 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.478760:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065214.478761:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065214.478764:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 31 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065214.478769:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8054 00000100:00100000:3.0:1746065214.478787:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265304704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.478793:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065214.478800:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 22 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.478800:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.478809:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 22 pid: 10219 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.478811:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 21 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.478820:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc1479074 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391ee expref: 22 pid: 10219 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746065214.478820:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263952384:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065214.478827:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.478828:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.478833:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.478838:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.478854:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065214.478862:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263952512:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065214.478870:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065214.478877:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065214.480410:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263952384:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065214.480427:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 31 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.480437:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad000, rc 0) 00000100:00100000:3.0:1746065214.480469:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263952512:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065214.480479:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065214.480522:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2377:x1830881265304832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1808us (2218us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.480528:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17300 00000100:00100000:3.0:1746065214.480601:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265304704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1825us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.480608:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8054 00000100:00100000:0.0:1746065214.480969:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.481096:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265304960 00000100:00100000:3.0:1746065214.481100:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265304960 00002000:00100000:3.0:1746065214.481128:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1265664->2019327) req@ffff88012edac380 x1830881265304960/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.481137:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac380 with x1830881265304960 ext(1265664->2019327) 00010000:00010000:3.0:1746065214.481142:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 22 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.481153:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 22 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746065214.481158:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012edac380 00000100:00100000:3.0:1746065214.481173:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2019 00000100:00100000:3.0:1746065214.481178:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265304960:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065214.483668:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.483731:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265305216 00000100:00100000:2.0:1746065214.483739:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265305216 00002000:00100000:2.0:1746065214.483813:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3407872->3411967) req@ffff88012edaf100 x1830881265305216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.483822:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf100 with x1830881265305216 ext(3407872->3411967) 00002000:00010000:2.0:1746065214.483826:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf100 00000100:00100000:2.0:1746065214.483854:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6146 00000100:00100000:2.0:1746065214.483860:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265305216:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065214.483976:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265305216:12345-192.168.202.27@tcp:3:cat.0 Request processed in 115us (314us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065214.483983:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6146 00002000:00100000:2.0:1746065214.483988:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3407872->3411967) req@ffff88012edaf100 x1830881265305216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/4536 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.483994:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf100 with x1830881265305216 ext(3407872->3411967) 00002000:00010000:2.0:1746065214.483996:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf100 00000100:00100000:3.0:1746065214.495657:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265304960:12345-192.168.202.27@tcp:4:cat.0 Request processed in 14470us (14679us total) trans 21474841660 rc 0/0 00000100:00100000:3.0:1746065214.495668:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2019 00002000:00100000:3.0:1746065214.495678:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1265664->2019327) req@ffff88012edac380 x1830881265304960/t21474841660(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/448 e 0 to 0 dl 1746065225 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.495686:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac380 with x1830881265304960 ext(1265664->2019327) 00010000:00010000:3.0:1746065214.495695:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 24 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.495708:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 24 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746065214.495719:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012edac380 00000100:00100000:0.0:1746065214.496174:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.496378:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265305344 00000100:00100000:3.0:1746065214.496384:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265305344 00000100:00100000:3.0:1746065214.496411:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17301 00000100:00100000:3.0:1746065214.496416:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2365:x1830881265305344:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065214.496428:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065214.496440:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93925e expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.496460:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.496468:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1479082 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939203 expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.496473:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.496474:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.496477:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->3407871] (req 3145728->3407871) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.496498:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1479082 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939203 expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.496506:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1479082 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939203 expref: 23 pid: 10219 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746065214.496520:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263952640:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065214.496588:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.496595:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 32 pid: 9550 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065214.496603:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263952768:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065214.496617:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.498635:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.498709:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265305472 00000100:00100000:3.0:1746065214.498715:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265305472 00010000:00010000:3.0:1746065214.498739:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 24 pid: 13375 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065214.499101:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8055 00000100:00100000:3.0:1746065214.499107:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2007:x1830881265305472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.499117:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065214.499132:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 24 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.499142:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 24 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.499159:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ac200/0xad6b7ddc14790e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->2019327) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939242 expref: 24 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.500217:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.500221:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.500228:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.500235:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.500264:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065214.500275:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263952896:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065214.500679:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065214.501377:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263952640:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065214.501387:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263952768:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065214.501406:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->3407871] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.501418:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa4800, rc 0) 00000100:00100000:3.0:1746065214.501452:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2365:x1830881265305344:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5035us (5279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.501459:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17301 00000100:00100000:0.0:1746065214.506837:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.506862:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265305728 00000100:00100000:1.0:1746065214.506870:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265305728 00010000:00010000:1.0:1746065214.506896:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 32 pid: 9550 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.506928:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8056 00000100:00100000:1.0:1746065214.506933:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265305728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065214.506944:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065214.506960:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 32 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746065214.506970:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 32 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746065214.506988:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683a000/0xad6b7ddc147906d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391e7 expref: 32 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746065214.507012:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065214.507042:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265305728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 109us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.507052:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8056 00000100:00100000:1.0:1746065214.507093:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.507104:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265305600 00000100:00100000:1.0:1746065214.507106:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265305600 00010000:00010000:1.0:1746065214.507116:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1479082 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939203 expref: 24 pid: 10219 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746065214.507128:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8057 00000100:00100000:1.0:1746065214.507131:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265305600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065214.507136:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065214.507142:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1479082 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939203 expref: 24 pid: 10219 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.507150:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1479082 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939203 expref: 24 pid: 10219 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.507160:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880130104600/0xad6b7ddc1479082 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939203 expref: 24 pid: 10219 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.507168:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.507170:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.507175:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 30 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.507182:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 30 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.507210:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 30 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065214.507220:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263953024:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065214.507274:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065214.509557:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263952896:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065214.509573:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065214.509603:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265305472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10496us (10974us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.509612:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8055 00000100:00100000:0.0:1746065214.513065:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.513300:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.513357:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265306112 00000100:00100000:2.0:1746065214.513364:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265306112 00002000:00100000:2.0:1746065214.513416:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009ac67800 x1830881265306112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.513425:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac67800 with x1830881265306112 ext(1048576->2097151) 00002000:00010000:2.0:1746065214.513429:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac67800 00000100:00100000:2.0:1746065214.513442:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265306240 00000100:00100000:2.0:1746065214.513444:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265306240 00000100:00100000:1.0:1746065214.513447:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fab800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881263953024:192.168.202.27@tcp:105: 00002000:00100000:2.0:1746065214.513452:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009ac66680 x1830881265306240/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.513459:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac66680 with x1830881265306240 ext(1048576->2097151) 00002000:00010000:2.0:1746065214.513462:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac66680 00010000:00010000:1.0:1746065214.513468:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065214.513481:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6147 00000100:00100000:3.0:1746065214.513486:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6148 00000100:00100000:2.0:1746065214.513486:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265306112:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065214.513493:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265306240:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065214.513501:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265305600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6368us (6407us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.513508:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8057 00000100:00100000:0.0:1746065214.514377:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.514662:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265306496 00000100:00100000:2.0:1746065214.514666:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265306496 00002000:00100000:2.0:1746065214.514685:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3403776->3407871) req@ffff88009ac66300 x1830881265306496/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.514696:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac66300 with x1830881265306496 ext(3403776->3407871) 00002000:00010000:2.0:1746065214.514699:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac66300 00000100:00100000:2.0:1746065214.514713:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6149 00000100:00100000:2.0:1746065214.514718:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265306496:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065214.514787:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265306496:12345-192.168.202.27@tcp:3:cat.0 Request processed in 53us (404us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065214.514793:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6149 00002000:00100000:2.0:1746065214.514797:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3403776->3407871) req@ffff88009ac66300 x1830881265306496/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/4536 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.514804:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac66300 with x1830881265306496 ext(3403776->3407871) 00002000:00010000:2.0:1746065214.514806:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac66300 00000100:00100000:3.0:1746065214.520890:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265306240:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7389us (7580us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065214.520900:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6148 00002000:00100000:3.0:1746065214.520909:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009ac66680 x1830881265306240/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.520918:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac66680 with x1830881265306240 ext(1048576->2097151) 00002000:00010000:3.0:1746065214.520922:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac66680 00000100:00100000:2.0:1746065214.526868:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265306112:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13373us (13802us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065214.526881:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6147 00002000:00100000:2.0:1746065214.526891:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009ac67800 x1830881265306112/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.526899:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac67800 with x1830881265306112 ext(1048576->2097151) 00002000:00010000:2.0:1746065214.526904:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac67800 00000100:00100000:0.0:1746065214.548475:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.549278:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.549359:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265306752 00000100:00100000:2.0:1746065214.549366:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265306752 00002000:00100000:2.0:1746065214.549416:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3407871) req@ffff88009ac64380 x1830881265306752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.549426:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac64380 with x1830881265306752 ext(2097152->3407871) 00002000:00010000:2.0:1746065214.549430:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac64380 00000100:00100000:2.0:1746065214.549446:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265307008 00000100:00100000:2.0:1746065214.549448:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265307008 00002000:00100000:2.0:1746065214.549459:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8800900f0380 x1830881265307008/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 504/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.549471:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0380 with x1830881265307008 ext(2097152->4194303) 00002000:00010000:2.0:1746065214.549474:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f0380 00000100:00100000:2.0:1746065214.549493:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6150 00000100:00100000:2.0:1746065214.549500:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881265306752:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065214.550217:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6151 00000100:00100000:3.0:1746065214.550225:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265307008:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065214.559839:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265307008:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9608us (10556us total) trans 0 rc 1835008/1835008 00000100:00100000:3.0:1746065214.559847:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6151 00002000:00100000:3.0:1746065214.559854:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8800900f0380 x1830881265307008/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 504/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1835008/1835008 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.559861:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0380 with x1830881265307008 ext(2097152->4194303) 00002000:00010000:3.0:1746065214.559865:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f0380 00000100:00100000:2.0:1746065214.562513:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881265306752:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13007us (14040us total) trans 0 rc 1310720/1310720 00000100:00100000:2.0:1746065214.562522:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6150 00002000:00100000:2.0:1746065214.562530:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3407871) req@ffff88009ac64380 x1830881265306752/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1310720/1310720 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.562544:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac64380 with x1830881265306752 ext(2097152->3407871) 00002000:00010000:2.0:1746065214.562548:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac64380 00000100:00100000:0.0:1746065214.574068:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.574264:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265307264 00000100:00100000:2.0:1746065214.574273:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265307264 00002000:00100000:2.0:1746065214.574309:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800900f0e00 x1830881265307264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.574318:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0e00 with x1830881265307264 ext(4194304->5038079) 00002000:00010000:2.0:1746065214.574322:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f0e00 00000100:00100000:2.0:1746065214.574354:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6152 00000100:00100000:2.0:1746065214.574361:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265307264:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065214.581311:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265307264:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6941us (7242us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065214.581322:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6152 00002000:00100000:2.0:1746065214.581332:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800900f0e00 x1830881265307264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.581341:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0e00 with x1830881265307264 ext(4194304->5038079) 00002000:00010000:2.0:1746065214.581346:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f0e00 00000100:00100000:0.0:1746065214.626969:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.627009:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.627077:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265307392 00000100:00100000:1.0:1746065214.627086:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265307392 00000100:00100000:0.0:1746065214.627099:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.627127:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265307520 00000100:00100000:1.0:1746065214.627129:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265307520 00000100:00100000:1.0:1746065214.627139:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265307648 00000100:00100000:1.0:1746065214.627140:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265307648 00000100:00100000:1.0:1746065214.627156:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17302 00000100:00100000:1.0:1746065214.627162:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265307392:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065214.627177:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.627191:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1479107 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939265 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.627211:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.627212:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.627219:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1479107 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939265 expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.627237:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1479107 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939265 expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.627247:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3600, rc 0) 00000100:00100000:1.0:1746065214.627283:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2006:x1830881265307392:12345-192.168.202.27@tcp:101:cat.0 Request processed in 121us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.627289:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17302 00000100:00100000:3.0:1746065214.627299:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17303 00000100:00100000:1.0:1746065214.627304:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17304 00000100:00100000:3.0:1746065214.627307:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265307520:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065214.627309:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265307648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065214.627315:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065214.627316:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.627320:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc147910e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939273 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.627325:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1479115 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93926c expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065214.627350:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263953152:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065214.627356:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263953280:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065214.627428:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065214.627428:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065214.636623:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263953152:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065214.636650:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc147910e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939273 expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.636663:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3200/0xad6b7ddc147910e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939273 expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.636690:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3200, rc 0) 00000100:00100000:1.0:1746065214.636742:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265307648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9430us (9641us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065214.636751:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17304 00002000:00010000:3.0:1746065214.636765:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065213 -> 1746065214 00000100:00100000:3.0:1746065214.636799:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263953280:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065214.636816:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1479115 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93926c expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.636825:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30600/0xad6b7ddc1479115 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93926c expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.636835:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:3.0:1746065214.636853:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265307520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9548us (9843us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065214.636859:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17303 00000100:00100000:0.0:1746065214.646652:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.649420:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265307904 00000100:00100000:2.0:1746065214.649431:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265307904 00002000:00100000:2.0:1746065214.649472:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009577e300 x1830881265307904/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.649482:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577e300 with x1830881265307904 ext(1048576->2097151) 00002000:00010000:2.0:1746065214.649486:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577e300 00000100:00100000:3.0:1746065214.650665:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6153 00000100:00100000:3.0:1746065214.650676:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265307904:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065214.653904:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.653953:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265308032 00000100:00100000:3.0:1746065214.653960:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265308032 00000100:00100000:3.0:1746065214.654005:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17305 00000100:00100000:3.0:1746065214.654012:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2382:x1830881265308032:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065214.654026:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065214.654041:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93927a expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.654064:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.654072:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc1479020 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391af expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.654078:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1478fa2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939146 expref: 30 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.654084:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.654085:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.654089:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1511424->1921023] (req 1511424->1921023) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 26 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.654116:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1478fa2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939146 expref: 30 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.654126:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1478fa2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939146 expref: 30 pid: 9550 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746065214.654136:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263953408:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065214.654230:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc1479020 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391af expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.654238:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc1479020 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391af expref: 8 pid: 10219 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746065214.654247:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263953536:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065214.654905:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.654914:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 26 pid: 9550 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065214.654921:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263953664:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065214.654991:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065214.657974:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263953408:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065214.659016:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2006:x1830881265307904:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8339us (12367us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065214.659025:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6153 00002000:00100000:3.0:1746065214.659034:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009577e300 x1830881265307904/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.659042:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577e300 with x1830881265307904 ext(1048576->2097151) 00002000:00010000:3.0:1746065214.659046:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577e300 00000100:00100000:0.0:1746065214.661842:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.661959:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.662040:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265308160 00000100:00100000:1.0:1746065214.662047:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265308160 00010000:00010000:1.0:1746065214.662073:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1478fa2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939146 expref: 31 pid: 9550 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746065214.662094:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265308288 00000100:00100000:1.0:1746065214.662096:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265308288 00010000:00010000:1.0:1746065214.662103:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc1479020 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391af expref: 9 pid: 10219 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746065214.662116:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8058 00000100:00100000:1.0:1746065214.662121:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265308160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065214.662131:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065214.662146:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1478fa2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939146 expref: 31 pid: 9550 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.662155:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1478fa2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939146 expref: 31 pid: 9550 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.662174:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d46600/0xad6b7ddc1478fa2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939146 expref: 31 pid: 9550 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.662188:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065214.662219:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265308160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.662227:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8058 00000100:00100000:1.0:1746065214.662238:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8059 00000100:00100000:1.0:1746065214.662242:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265308288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065214.662246:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065214.662251:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc1479020 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391af expref: 9 pid: 10219 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.662258:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc1479020 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391af expref: 9 pid: 10219 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.662265:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065214.662274:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265308288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.662278:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8059 00010000:00010000:3.0:1746065214.662431:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc1479020 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9391af expref: 8 pid: 10219 timeout: 910 lvb_type: 1 00000100:00100000:3.0:1746065214.662442:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263953536:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065214.662452:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263953664:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065214.662473:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1511424->1921023] (req 1511424->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 24 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.662482:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31a00, rc 0) 00000100:00100000:3.0:1746065214.662512:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2382:x1830881265308032:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8501us (8616us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.662519:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17305 00000100:00100000:0.0:1746065214.663136:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.663243:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265308416 00000100:00100000:2.0:1746065214.663248:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265308416 00010000:00010000:2.0:1746065214.663263:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 24 pid: 9550 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746065214.663881:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8060 00000100:00100000:2.0:1746065214.663889:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881265308416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065214.663897:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065214.663908:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 24 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.663916:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 24 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.663931:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835da00/0xad6b7ddc1478f94 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939138 expref: 24 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.664058:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.664060:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.664066:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.664073:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.664099:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.664114:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263953792:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065214.664710:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.666896:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.666981:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265308544 00000100:00100000:3.0:1746065214.666987:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265308544 00000100:00100000:3.0:1746065214.667026:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17306 00000100:00100000:3.0:1746065214.667032:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2007:x1830881265308544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065214.667046:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065214.667064:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479123 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939281 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065214.667677:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.667717:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265308672 00000100:00100000:1.0:1746065214.667721:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265308672 00000100:00100000:3.0:1746065214.667734:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263953920:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065214.667973:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065214.668363:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263953792:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065214.668387:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065214.668392:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17307 00000100:00100000:1.0:1746065214.668400:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265308672:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065214.668410:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265308416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4521us (5274us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065214.668410:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065214.668417:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8060 00010000:00010000:1.0:1746065214.668421:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc147912a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939288 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065214.668448:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263954048:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065214.668472:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.668689:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.668883:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265308800 00000100:00100000:2.0:1746065214.668887:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265308800 00000100:00100000:2.0:1746065214.668905:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17308 00000100:00100000:2.0:1746065214.668909:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265308800:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065214.668915:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.668923:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc1479131 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93928f expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.668944:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263954176:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065214.668977:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cde40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.669073:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.669121:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265309056 00000100:00100000:3.0:1746065214.669124:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265309056 00002000:00100000:3.0:1746065214.669329:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1511424->1515519) req@ffff88009a6df100 x1830881265309056/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.669338:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df100 with x1830881265309056 ext(1511424->1515519) 00002000:00010000:3.0:1746065214.669342:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6df100 00000100:00100000:3.0:1746065214.669495:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6154 00000100:00100000:3.0:1746065214.669501:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2004:x1830881265309056:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065214.669609:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2004:x1830881265309056:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 108us (535us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065214.669615:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6154 00002000:00100000:3.0:1746065214.669620:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1511424->1515519) req@ffff88009a6df100 x1830881265309056/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/4536 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.669626:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df100 with x1830881265309056 ext(1511424->1515519) 00002000:00010000:3.0:1746065214.669629:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6df100 00000100:00100000:1.0:1746065214.670981:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fab800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263954048:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065214.671004:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc147912a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939288 expref: 22 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.671016:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2200/0xad6b7ddc147912a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939288 expref: 22 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.671029:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2200, rc 0) 00000100:00100000:2.0:1746065214.671054:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263954176:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065214.671057:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265308672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2658us (3379us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065214.671063:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17307 00010000:00010000:2.0:1746065214.671069:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc1479131 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93928f expref: 26 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.671077:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad600/0xad6b7ddc1479131 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93928f expref: 26 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.671088:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad600, rc 0) 00000100:00100000:2.0:1746065214.671104:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265308800:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2194us (2416us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065214.671110:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17308 00002000:00010000:3.0:1746065214.672497:0:13375:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065213 -> 1746065214 00002000:00010000:3.0:1746065214.672502:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065213 -> 1746065214 00002000:00010000:3.0:1746065214.672504:0:13375:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065213 -> 1746065214 00000100:00100000:3.0:1746065214.672516:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263953920:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065214.672536:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479123 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939281 expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.672546:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479123 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939281 expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.672553:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5c00, rc 0) 00000100:00100000:3.0:1746065214.672587:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265308544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5555us (5696us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065214.672594:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17306 00000100:00100000:0.0:1746065214.675047:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.675139:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265309184 00000100:00100000:3.0:1746065214.675145:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265309184 00000100:00100000:3.0:1746065214.675183:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17309 00000100:00100000:3.0:1746065214.675190:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2384:x1830881265309184:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065214.675206:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065214.675222:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939296 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.675246:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.675253:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065214.675254:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065214.675257:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.675280:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 36 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.675291:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 36 pid: 13375 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065214.675301:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263954304:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065214.676950:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.679305:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.679683:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265309440 00000100:00100000:2.0:1746065214.679692:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265309440 00002000:00100000:2.0:1746065214.679726:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1916928->1921023) req@ffff88009a6dea00 x1830881265309440/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.679735:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dea00 with x1830881265309440 ext(1916928->1921023) 00002000:00010000:2.0:1746065214.679739:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dea00 00000100:00100000:2.0:1746065214.679769:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6155 00000100:00100000:2.0:1746065214.679810:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265309440:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065214.679893:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263954304:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065214.679918:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.679936:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265309440:12345-192.168.202.27@tcp:3:cat.0 Request processed in 141us (638us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065214.679943:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6155 00002000:00100000:2.0:1746065214.679949:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1916928->1921023) req@ffff88009a6dea00 x1830881265309440/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/4536 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.679955:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dea00 with x1830881265309440 ext(1916928->1921023) 00002000:00010000:2.0:1746065214.679957:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dea00 00010000:00010000:3.0:1746065214.680250:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30800, rc 0) 00000100:00100000:3.0:1746065214.681323:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2384:x1830881265309184:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6130us (6280us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.681330:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17309 00000100:00100000:0.0:1746065214.681938:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.682503:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265309568 00000100:00100000:2.0:1746065214.682508:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265309568 00002000:00100000:2.0:1746065214.682536:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3407872->4194303) req@ffff88009a6df800 x1830881265309568/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.682550:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df800 with x1830881265309568 ext(3407872->4194303) 00010000:00010000:2.0:1746065214.682557:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 37 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.682569:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 37 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746065214.682575:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6df800 00000100:00100000:2.0:1746065214.682599:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2020 00000100:00100000:2.0:1746065214.682604:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265309568:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065214.698309:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881265309568:12345-192.168.202.27@tcp:4:cat.0 Request processed in 15696us (16364us total) trans 17179874264 rc 0/0 00000100:00100000:2.0:1746065214.698320:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2020 00002000:00100000:2.0:1746065214.698330:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3407872->4194303) req@ffff88009a6df800 x1830881265309568/t17179874264(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/448 e 0 to 0 dl 1746065225 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.698339:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df800 with x1830881265309568 ext(3407872->4194303) 00010000:00010000:2.0:1746065214.698347:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 39 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.698360:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 39 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746065214.698366:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6df800 00000100:00100000:0.0:1746065214.703327:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.703436:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265309696 00000100:00100000:2.0:1746065214.703446:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265309696 00010000:00010000:2.0:1746065214.703477:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 39 pid: 13375 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746065214.703512:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8061 00000100:00100000:2.0:1746065214.703518:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881265309696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065214.703529:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065214.703547:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 39 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.703558:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 39 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.703576:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ac800/0xad6b7ddc14790f2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3407872->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939250 expref: 39 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.703622:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.703624:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.703631:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.703638:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.703665:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.703677:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263954432:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065214.703763:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065214.705822:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263954432:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065214.705853:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065214.706017:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881265309696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2498us (2697us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.706025:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8061 00000100:00100000:0.0:1746065214.711453:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.711701:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265309952 00000100:00100000:2.0:1746065214.711709:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265309952 00002000:00100000:2.0:1746065214.711745:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800a4e50a80 x1830881265309952/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.711755:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50a80 with x1830881265309952 ext(2097152->3145727) 00002000:00010000:2.0:1746065214.711759:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e50a80 00000100:00100000:2.0:1746065214.711790:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6156 00000100:00100000:2.0:1746065214.711796:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265309952:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065214.722082:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265309952:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10278us (11801us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065214.722092:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6156 00002000:00100000:2.0:1746065214.722395:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800a4e50a80 x1830881265309952/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.722406:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e50a80 with x1830881265309952 ext(2097152->3145727) 00002000:00010000:2.0:1746065214.722411:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e50a80 00000100:00100000:0.0:1746065214.728097:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.729411:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265310080 00000100:00100000:3.0:1746065214.729420:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265310080 00000100:00100000:3.0:1746065214.729494:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17310 00000100:00100000:3.0:1746065214.729500:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2384:x1830881265310080:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065214.729514:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065214.729526:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93929d expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.729549:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.729556:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065214.729557:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065214.729560:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 24 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.729582:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.729591:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 29 pid: 13375 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065214.729601:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263954560:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065214.729929:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065214.731943:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263954560:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065214.731968:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 24 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.731980:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c30600, rc 0) 00000100:00100000:3.0:1746065214.732015:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2384:x1830881265310080:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2514us (3925us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.732022:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17310 00000100:00100000:0.0:1746065214.732924:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.733183:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265310208 00000100:00100000:2.0:1746065214.733188:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265310208 00002000:00100000:2.0:1746065214.733217:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3407871) req@ffff8800a4e52d80 x1830881265310208/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.733230:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52d80 with x1830881265310208 ext(3145728->3407871) 00010000:00010000:2.0:1746065214.733237:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 30 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.733248:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 30 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:2.0:1746065214.733253:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e52d80 00000100:00100000:2.0:1746065214.733279:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2021 00000100:00100000:2.0:1746065214.733285:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265310208:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065214.738104:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265310208:12345-192.168.202.27@tcp:4:cat.0 Request processed in 4810us (5172us total) trans 21474841661 rc 0/0 00000100:00100000:0.0:1746065214.738113:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2021 00002000:00100000:0.0:1746065214.738123:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3407871) req@ffff8800a4e52d80 x1830881265310208/t21474841661(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/448 e 0 to 0 dl 1746065225 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065214.738131:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52d80 with x1830881265310208 ext(3145728->3407871) 00010000:00010000:0.0:1746065214.738140:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 32 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065214.738153:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 32 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:0.0:1746065214.738159:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800a4e52d80 00000100:00100000:2.0:1746065214.748061:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.748323:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265310336 00000100:00100000:3.0:1746065214.748331:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265310336 00010000:00010000:3.0:1746065214.748357:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 32 pid: 13375 timeout: 910 lvb_type: 0 00000100:00100000:3.0:1746065214.748394:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8062 00000100:00100000:3.0:1746065214.748401:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265310336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.748413:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065214.748430:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 32 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.748439:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 32 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.748459:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4800/0xad6b7ddc1479100 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3407871) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93925e expref: 32 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.748474:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.748476:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065214.748482:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.748490:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.748517:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065214.748526:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263954688:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065214.750138:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065214.752951:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263954688:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065214.752968:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065214.753338:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265310336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4935us (5281us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.753347:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8062 00000100:00100000:0.0:1746065214.758893:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.758982:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265310464 00000100:00100000:1.0:1746065214.758990:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265310464 00000100:00100000:1.0:1746065214.759039:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14545 00000100:00100000:1.0:1746065214.759047:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+18:2388:x1830881265310464:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065214.759067:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.759081:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3800/0xad6b7ddc1479146 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392a4 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.759128:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147914d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.759139:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147914d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.759146:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147914d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.759159:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1479154 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.759166:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1479154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.759171:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1479154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.759222:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.759230:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147909e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939211 expref: 37 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.759236:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14790b3 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939218 expref: 55 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.759241:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 5/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.759264:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14790b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939218 expref: 55 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.759274:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14790b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939218 expref: 55 pid: 9571 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.759283:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263954816:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.759358:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147909e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939211 expref: 37 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.759366:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147909e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939211 expref: 37 pid: 7205 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.759385:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263954944:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.759404:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.760438:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.760473:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.760530:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265310848 00000100:00100000:2.0:1746065214.760535:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265310848 00002000:00100000:2.0:1746065214.760564:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009aecb100 x1830881265310848/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.760572:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb100 with x1830881265310848 ext(3145728->4194303) 00002000:00010000:2.0:1746065214.760575:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecb100 00000100:00100000:2.0:1746065214.760594:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265310976 00000100:00100000:2.0:1746065214.760597:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265310976 00002000:00100000:2.0:1746065214.760607:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009aec9500 x1830881265310976/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.760613:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9500 with x1830881265310976 ext(2097152->4194303) 00002000:00010000:2.0:1746065214.760615:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec9500 00000100:00100000:2.0:1746065214.760625:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6157 00000100:00100000:2.0:1746065214.760630:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265310848:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065214.761943:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6158 00000100:00100000:1.0:1746065214.761951:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265310976:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065214.767034:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.767089:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265311232 00000100:00100000:2.0:1746065214.767097:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265311232 00000100:00100000:2.0:1746065214.767148:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5443 00000100:00100000:2.0:1746065214.767155:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+38:8521:x1830881265311232:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1746065214.767186:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fab800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263954816:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.767194:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263954944:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.767211:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065214.767311:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+39:8521:x1830881265311232:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 156us (285us total) trans 8589937043 rc 0/0 00000100:00100000:2.0:1746065214.767317:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5443 00000100:00100000:0.0:1746065214.772538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.772708:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265310848:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12074us (12269us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065214.772717:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6157 00002000:00100000:0.0:1746065214.772726:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009aecb100 x1830881265310848/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065214.772735:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb100 with x1830881265310848 ext(3145728->4194303) 00002000:00010000:0.0:1746065214.772740:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecb100 00000100:00100000:2.0:1746065214.775098:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265311360 00000100:00100000:2.0:1746065214.775112:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265311360 00010000:00010000:2.0:1746065214.775152:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14790b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939218 expref: 56 pid: 9571 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746065214.775187:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8063 00000100:00100000:2.0:1746065214.775196:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+56:2005:x1830881265311360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065214.775211:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065214.775218:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14790b3 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939218 expref: 56 pid: 9571 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.775227:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14790b3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939218 expref: 56 pid: 9571 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.775247:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc14790b3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939218 expref: 56 pid: 9571 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.775259:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065214.775264:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065214.775272:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065214.775275:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065214.775279:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065214.775316:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+55:2005:x1830881265311360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 123us (2785us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.775322:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8063 00000100:00100000:0.0:1746065214.778905:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.779226:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265311488 00000100:00100000:2.0:1746065214.779236:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265311488 00010000:00010000:2.0:1746065214.779269:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147909e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939211 expref: 39 pid: 7205 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746065214.779294:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8064 00000100:00100000:2.0:1746065214.779300:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+39:2006:x1830881265311488:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065214.779312:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065214.779316:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147909e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939211 expref: 39 pid: 7205 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.779324:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147909e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939211 expref: 39 pid: 7205 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.779341:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147909e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939211 expref: 39 pid: 7205 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.779351:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065214.779356:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065214.779362:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065214.779429:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065214.779492:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065214.779524:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+38:2006:x1830881265311488:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 223us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.779529:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8064 00010000:00010000:1.0:1746065214.779619:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779625:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065214.779663:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:1.0:1746065214.779667:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065214.779680:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779688:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779713:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147914d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779719:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147914d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779727:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147914d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779732:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147914d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779737:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065214.779740:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147914d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779744:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147914d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779751:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065214.779753:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065214.779755:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147914d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779759:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2000/0xad6b7ddc147914d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779792:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1479154 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779797:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1479154 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779801:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1479154 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779805:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb2200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065214.779807:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1479154 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779814:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1479154 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779820:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097b72d00) 00010000:00010000:1.0:1746065214.779822:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065214.779823:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1479154 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779828:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2200/0xad6b7ddc1479154 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.779855:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3800/0xad6b7ddc1479146 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392a4 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.779864:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392a4 expref: 19 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.779869:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065214.779871:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065214.779873:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2a00, rc 0) 00000100:00100000:1.0:1746065214.780618:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+19:2388:x1830881265310464:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 21568us (21729us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.780626:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14545 00000100:00100000:3.0:1746065214.781073:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1746065214.781114:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263955072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746065214.781157:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065214.782038:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263955072 00000100:00100000:0.0:1746065214.782044:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263955072 00000100:00100000:0.0:1746065214.782087:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:0.0:1746065214.782093:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263955072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065214.782128:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:0.0:1746065214.782173:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263955072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 80us (1017us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065214.782179:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:3.0:1746065214.782238:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263955072:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065214.787770:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.787974:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265310976:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26023us (27499us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065214.787983:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6158 00002000:00100000:1.0:1746065214.787992:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009aec9500 x1830881265310976/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065214.788008:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9500 with x1830881265310976 ext(2097152->4194303) 00002000:00010000:1.0:1746065214.788012:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec9500 00000100:00100000:0.0:1746065214.788662:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.788717:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265311616 00000100:00100000:2.0:1746065214.788723:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265311616 00000100:00100000:2.0:1746065214.790047:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265311744 00000100:00100000:2.0:1746065214.790052:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265311744 00000100:00100000:2.0:1746065214.790079:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17311 00000100:00100000:2.0:1746065214.790085:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265311616:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:0.0:1746065214.790089:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17312 00000100:00100000:0.0:1746065214.790094:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265311744:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065214.790098:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065214.790098:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.790110:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc1479169 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392ab expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.790110:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1479162 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392b2 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.790128:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065214.790129:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065214.790135:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1479162 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b2 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.790145:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1479162 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b2 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065214.790149:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263955200:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065214.790153:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51b000, rc 0) 00000100:00100000:0.0:1746065214.790190:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265311744:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 95us (1528us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065214.790195:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17312 00000100:00100000:2.0:1746065214.790389:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cde40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.792711:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.792947:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263955200:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065214.792973:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc1479169 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ab expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.792989:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835de00/0xad6b7ddc1479169 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ab expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065214.792990:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265312000 00000100:00100000:1.0:1746065214.792996:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265312000 00010000:00010000:2.0:1746065214.793013:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835de00, rc 0) 00000100:00100000:1.0:1746065214.793035:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17313 00000100:00100000:1.0:1746065214.793044:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265312000:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:2.0:1746065214.793049:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265311616:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 2963us (5286us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065214.793054:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17311 00010000:00010000:1.0:1746065214.793059:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.793072:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc1479170 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392c0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.793091:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.793093:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.793103:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc1479170 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c0 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.793117:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc1479170 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c0 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.793126:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45800, rc 0) 00000100:00100000:1.0:1746065214.793152:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265312000:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 109us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.793158:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17313 00000100:00100000:0.0:1746065214.795062:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.795117:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.795528:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265311872 00000100:00100000:2.0:1746065214.795534:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265311872 00000100:00100000:2.0:1746065214.795559:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265312128 00000100:00100000:2.0:1746065214.795561:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265312128 00000100:00100000:2.0:1746065214.795588:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17314 00000100:00100000:2.0:1746065214.795594:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265311872:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065214.795606:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.795619:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1479177 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392b9 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.795636:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.795638:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.795645:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1479177 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b9 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.795656:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1479177 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b9 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.795665:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c000, rc 0) 00000100:00100000:2.0:1746065214.795696:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265311872:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 102us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.795701:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17314 00000100:00100000:2.0:1746065214.795712:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17315 00000100:00100000:2.0:1746065214.795716:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265312128:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065214.795722:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.795730:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc147917e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392c7 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.795740:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.795741:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.795745:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc147917e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c7 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.795754:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc147917e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c7 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065214.795760:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c200, rc 0) 00000100:00100000:2.0:1746065214.795803:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265312128:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 57us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.795808:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17315 00000100:00100000:0.0:1746065214.801109:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.801279:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265312384 00000100:00100000:1.0:1746065214.801287:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265312384 00000100:00100000:1.0:1746065214.801340:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14546 00000100:00100000:1.0:1746065214.801347:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+19:2388:x1830881265312384:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065214.801364:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.801391:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45a00/0xad6b7ddc1479185 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392ce expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.801475:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc147918c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.801489:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392a4 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.801495:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc147918c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.801520:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392a4 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.801530:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392a4 expref: 20 pid: 7205 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.801539:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263955328:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.801623:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.805550:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.805610:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265312768 00000100:00100000:2.0:1746065214.805617:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265312768 00000100:00100000:0.0:1746065214.805630:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.805648:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265312640 00000100:00100000:0.0:1746065214.805652:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265312640 00002000:00100000:2.0:1746065214.805657:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009adf4700 x1830881265312768/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.805666:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4700 with x1830881265312768 ext(4194304->5038079) 00002000:00010000:2.0:1746065214.805669:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4700 00010000:00010000:0.0:1746065214.805670:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392a4 expref: 21 pid: 7205 timeout: 910 lvb_type: 0 00000100:00100000:0.0:1746065214.805696:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8065 00000100:00100000:0.0:1746065214.805702:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+21:2005:x1830881265312640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065214.805706:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6159 00000100:00100000:2.0:1746065214.805711:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265312768:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:0.0:1746065214.805712:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065214.805717:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392a4 expref: 21 pid: 7205 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065214.805728:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392a4 expref: 21 pid: 7205 timeout: 910 lvb_type: 0 00010000:00010000:0.0:1746065214.805745:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065214.805749:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc147918c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065214.805757:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc147918c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065214.805763:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc147918c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.805821:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2a00/0xad6b7ddc147915b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392a4 expref: 21 pid: 7205 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.805838:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263955328:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.806053:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc147918c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065214.806054:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065214.806060:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc147918c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.806065:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc147918c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065214.806079:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000100:00100000:0.0:1746065214.806095:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+20:2005:x1830881265312640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 392us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065214.806101:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8065 00010000:00010000:1.0:1746065214.806174:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45a00/0xad6b7ddc1479185 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ce expref: 21 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.806185:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc147918c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ce expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.806191:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065214.806194:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065214.806196:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44c00, rc 0) 00000100:00100000:1.0:1746065214.806218:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+20:2388:x1830881265312384:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4872us (5117us total) trans 8589937044 rc 0/0 00000100:00100000:1.0:1746065214.806223:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14546 00000100:00100000:0.0:1746065214.810396:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.810448:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265313024 00000100:00100000:1.0:1746065214.810459:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265313024 00000100:00100000:1.0:1746065214.810500:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14547 00000100:00100000:1.0:1746065214.810505:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+20:2388:x1830881265313024:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065214.810523:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.810526:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1746065214.810545:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc147918c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ce expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.810557:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065214.810560:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065214.810569:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc147919a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392d5 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.810639:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc14791a1 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.810650:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc14791a1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.810657:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc14791a1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.810666:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc14791a1 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.810671:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc14791a1 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.810675:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc14791a1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00000100:00100000:3.0:1746065214.811112:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265312768:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5396us (5565us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065214.811121:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6159 00002000:00100000:3.0:1746065214.811131:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009adf4700 x1830881265312768/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.811139:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4700 with x1830881265312768 ext(4194304->5038079) 00002000:00010000:3.0:1746065214.811144:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4700 00010000:00010000:1.0:1746065214.811526:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065214.811530:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc14791a1 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.811535:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc14791a1 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.811543:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065214.811546:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065214.811548:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc14791a1 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.811553:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc14791a1 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065214.811579:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc147919a lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392d5 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.811585:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44000/0xad6b7ddc147919a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392d5 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.811591:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44000, rc 0) 00000100:00100000:1.0:1746065214.811612:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+19:2388:x1830881265313024:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1106us (1223us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065214.811617:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14547 00000100:00100000:0.0:1746065214.814096:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ceddf226-8ddf-479f-9953-8a74c62285a9:3759:1830881263955456:0@lo:400:kworker.0 00000100:00100000:3.0:1746065214.814097:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3761:1830881263955712:0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.814162:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263955584:0@lo:400:kworker.0 00000100:00100000:3.0:1746065214.814172:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065214.814195:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065214.814202:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3761:1830881263956224:0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.814222:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3760:1830881263956096:0@lo:400:kworker.0 00000100:00100000:3.0:1746065214.814231:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065214.814244:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263955584 00000100:00100000:3.0:1746065214.814249:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263956736:0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.814249:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263955584 00000100:00100000:3.0:1746065214.814271:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065214.814302:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1746065214.814308:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881263955584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.814343:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881263955584:12345-0@lo:400:kworker.0 Request processed in 36us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.814347:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1746065214.814360:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065214.814379:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263956608:0@lo:400:kworker.0 00000100:00100000:0.0:1746065214.814446:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065214.814464:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263955968:0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.814552:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263955712 00000100:00100000:2.0:1746065214.814555:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263955712 00000100:00100000:1.0:1746065214.814600:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263955840:0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.814618:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263956224 00000100:00100000:2.0:1746065214.814620:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263956224 00000100:00100000:2.0:1746065214.814636:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263956096 00000100:00100000:2.0:1746065214.814638:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263956096 00000100:00080000:1.0:1746065214.814639:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1746065214.814642:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065214.814649:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1746065214.814653:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3761:x1830881263955712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065214.814675:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1746065214.814680:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3761:x1830881263956224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065214.814702:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3761:x1830881263956224:12345-0@lo:400:kworker.0 Request processed in 23us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065214.814706:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1746065214.814714:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1746065214.814718:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3760:x1830881263956096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.814871:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3761:x1830881263955712:12345-0@lo:400:kworker.0 Request processed in 218us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.814876:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1746065214.814888:0:8144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263955456 00000100:00100000:2.0:1746065214.814890:0:8144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263955456 00000100:00100000:2.0:1746065214.814904:0:8144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1746065214.814908:0:8144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3759:x1830881263955456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065214.814946:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3760:x1830881263956096:12345-0@lo:400:kworker.0 Request processed in 228us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065214.814951:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1746065214.815025:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263956736 00000100:00100000:1.0:1746065214.815028:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263956736 00000100:00100000:1.0:1746065214.815138:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1746065214.815142:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263956736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065214.815210:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065214.815269:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3761:x1830881263956736:12345-0@lo:400:kworker.0 Request processed in 126us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.815274:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00000100:00100000:1.0:1746065214.815283:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263956608 00000100:00100000:1.0:1746065214.815285:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263956608 00000100:00100000:1.0:1746065214.815301:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:1.0:1746065214.815305:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881263956608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1746065214.815326:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881263956608:12345-0@lo:400:kworker.0 Request processed in 21us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.815333:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00080000:1.0:1746065214.815344:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065214.815345:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065214.815381:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881263955584:0@lo:400:kworker.0 00000100:00100000:0.0:1746065214.815390:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3760:1830881263956096:0@lo:400:kworker.0 00000100:00100000:0.0:1746065214.815396:0:3760:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841642 gen 2 00000004:00080000:0.0:1746065214.815400:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa5880, transno 21474841566 00000004:00080000:0.0:1746065214.815406:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa4380, transno 21474841567 00000004:00080000:0.0:1746065214.815408:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aba7100, transno 21474841568 00000004:00080000:0.0:1746065214.815410:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa4000, transno 21474841569 00000004:00080000:0.0:1746065214.815412:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa7b80, transno 21474841570 00000004:00080000:0.0:1746065214.815413:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aba6300, transno 21474841571 00000004:00080000:0.0:1746065214.815415:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa5c00, transno 21474841572 00000004:00080000:0.0:1746065214.815417:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aba5c00, transno 21474841573 00000004:00080000:0.0:1746065214.815419:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090dd9500, transno 21474841574 00000004:00080000:0.0:1746065214.815420:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09dc00, transno 21474841575 00000004:00080000:0.0:1746065214.815422:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090ddb100, transno 21474841576 00000004:00080000:0.0:1746065214.815423:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09fb80, transno 21474841577 00000004:00080000:0.0:1746065214.815425:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090ddad80, transno 21474841578 00000004:00080000:0.0:1746065214.815427:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09e680, transno 21474841579 00000004:00080000:0.0:1746065214.815429:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090dd8700, transno 21474841580 00000004:00080000:0.0:1746065214.815431:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f09c000, transno 21474841581 00000004:00080000:0.0:1746065214.815433:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3f100, transno 21474841586 00000004:00080000:0.0:1746065214.815435:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a78a80, transno 21474841587 00000004:00080000:0.0:1746065214.815437:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ea00, transno 21474841588 00000004:00080000:0.0:1746065214.815439:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a78000, transno 21474841589 00000004:00080000:0.0:1746065214.815441:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a78e00, transno 21474841590 00000004:00080000:0.0:1746065214.815443:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a78700, transno 21474841591 00000004:00080000:0.0:1746065214.815445:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ed80, transno 21474841592 00000004:00080000:0.0:1746065214.815446:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a7a680, transno 21474841593 00000004:00080000:0.0:1746065214.815448:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a92300, transno 21474841594 00000004:00080000:0.0:1746065214.815451:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135223100, transno 21474841595 00000004:00080000:0.0:1746065214.815452:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135220000, transno 21474841596 00000004:00080000:0.0:1746065214.815455:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a90000, transno 21474841597 00000004:00080000:0.0:1746065214.815456:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135222680, transno 21474841598 00000004:00080000:0.0:1746065214.815458:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221f80, transno 21474841599 00000004:00080000:0.0:1746065214.815460:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a91500, transno 21474841600 00000004:00080000:0.0:1746065214.815462:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221880, transno 21474841601 00000004:00080000:0.0:1746065214.815464:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d07800, transno 21474841609 00000004:00080000:0.0:1746065214.815465:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d07b80, transno 21474841610 00000004:00080000:0.0:1746065214.815467:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d07100, transno 21474841611 00000004:00080000:0.0:1746065214.815469:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d04a80, transno 21474841612 00000004:00080000:0.0:1746065214.815471:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d06680, transno 21474841613 00000004:00080000:0.0:1746065214.815473:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d06d80, transno 21474841614 00000004:00080000:0.0:1746065214.815475:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d06300, transno 21474841615 00000004:00080000:0.0:1746065214.815476:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d07480, transno 21474841616 00000004:00080000:0.0:1746065214.815478:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4e8e00, transno 21474841617 00000004:00080000:0.0:1746065214.815480:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd180, transno 21474841618 00000004:00080000:0.0:1746065214.815482:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4e9500, transno 21474841619 00000004:00080000:0.0:1746065214.815484:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd880, transno 21474841620 00000004:00080000:0.0:1746065214.815486:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4e8a80, transno 21474841621 00000004:00080000:0.0:1746065214.815488:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fc000, transno 21474841622 00000004:00080000:0.0:1746065214.815490:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4e9f80, transno 21474841623 00000004:00080000:0.0:1746065214.815491:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4e8380, transno 21474841624 00000004:00080000:0.0:1746065214.815494:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aeca300, transno 21474841631 00000004:00080000:0.0:1746065214.815496:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8000, transno 21474841632 00000004:00080000:0.0:1746065214.815497:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaed80, transno 21474841633 00000004:00080000:0.0:1746065214.815499:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aecbb80, transno 21474841634 00000004:00080000:0.0:1746065214.815501:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec9880, transno 21474841635 00000004:00080000:0.0:1746065214.815503:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac64700, transno 21474841636 00000004:00080000:0.0:1746065214.815505:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac67b80, transno 21474841637 00000004:00080000:0.0:1746065214.815507:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8e00, transno 21474841638 00000004:00080000:0.0:1746065214.815508:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d9180, transno 21474841640 00000004:00080000:0.0:1746065214.815510:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d8000, transno 21474841641 00000004:00080000:0.0:1746065214.815512:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984db800, transno 21474841642 00000100:00100000:0.0:1746065214.815517:0:3760:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88011dad7b80 x1830881263920000/t21474841643(21474841643) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065226 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000100:00100000:0.0:1746065214.815525:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263956608:0@lo:400:kworker.0 00000004:00080000:0.0:1746065214.815760:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 5 in progress, 0 in flight, 59 done 00000100:00100000:2.0:1746065214.815865:0:8144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3759:x1830881263955456:12345-0@lo:400:kworker.0 Request processed in 955us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.815872:0:8144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1746065214.816065:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065214.816121:0:3761:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874244 gen 2 00000004:00080000:3.0:1746065214.816126:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec6300, transno 17179874177 00000004:00080000:3.0:1746065214.816758:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec6680, transno 17179874178 00000004:00080000:3.0:1746065214.816761:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec6d80, transno 17179874179 00000004:00080000:3.0:1746065214.816763:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec4700, transno 17179874180 00000004:00080000:3.0:1746065214.816765:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec5f80, transno 17179874181 00000004:00080000:3.0:1746065214.816768:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec7b80, transno 17179874182 00000004:00080000:3.0:1746065214.816770:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bc0a80, transno 17179874183 00000004:00080000:3.0:1746065214.816785:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec4000, transno 17179874184 00000004:00080000:3.0:1746065214.816787:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bc3480, transno 17179874185 00000004:00080000:3.0:1746065214.816789:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bc0e00, transno 17179874186 00000004:00080000:3.0:1746065214.816791:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3e300, transno 17179874187 00000004:00080000:3.0:1746065214.816792:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bc0000, transno 17179874188 00000004:00080000:3.0:1746065214.816795:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e5500, transno 17179874189 00000004:00080000:3.0:1746065214.816797:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6a00, transno 17179874190 00000004:00080000:3.0:1746065214.816799:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3f480, transno 17179874191 00000004:00080000:3.0:1746065214.816800:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6300, transno 17179874192 00000004:00080000:3.0:1746065214.816802:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e5880, transno 17179874193 00000004:00080000:3.0:1746065214.816804:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e4e00, transno 17179874194 00000004:00080000:3.0:1746065214.816805:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984daa00, transno 17179874202 00000004:00080000:3.0:1746065214.816808:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6680, transno 17179874203 00000004:00080000:3.0:1746065214.816810:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa5180, transno 17179874204 00000004:00080000:3.0:1746065214.816812:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984da680, transno 17179874205 00000004:00080000:3.0:1746065214.816814:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615d880, transno 17179874206 00000004:00080000:3.0:1746065214.816816:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984dad80, transno 17179874207 00000004:00080000:3.0:1746065214.816817:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615c000, transno 17179874208 00000004:00080000:3.0:1746065214.816819:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d9c00, transno 17179874209 00000004:00080000:3.0:1746065214.816821:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e4700, transno 17179874210 00000004:00080000:3.0:1746065214.816823:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077e300, transno 17179874211 00000004:00080000:3.0:1746065214.816825:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077d180, transno 17179874212 00000004:00080000:3.0:1746065214.816827:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077f480, transno 17179874213 00000004:00080000:3.0:1746065214.816829:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077c380, transno 17179874214 00000004:00080000:3.0:1746065214.816831:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077c700, transno 17179874215 00000004:00080000:3.0:1746065214.816833:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077d880, transno 17179874216 00000004:00080000:3.0:1746065214.816834:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077ca80, transno 17179874217 00000004:00080000:3.0:1746065214.816836:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077ed80, transno 17179874218 00000004:00080000:3.0:1746065214.816838:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880129f41f80, transno 17179874219 00000004:00080000:3.0:1746065214.816839:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577d180, transno 17179874226 00000004:00080000:3.0:1746065214.816841:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577f100, transno 17179874227 00000004:00080000:3.0:1746065214.816843:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577c000, transno 17179874228 00000004:00080000:3.0:1746065214.816845:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577e680, transno 17179874229 00000004:00080000:3.0:1746065214.816847:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577ea00, transno 17179874230 00000004:00080000:3.0:1746065214.816849:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577ed80, transno 17179874231 00000004:00080000:3.0:1746065214.816850:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577c700, transno 17179874232 00000004:00080000:3.0:1746065214.816852:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009577ca80, transno 17179874233 00000004:00080000:3.0:1746065214.816854:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090dd8e00, transno 17179874234 00000004:00080000:3.0:1746065214.816856:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a4e00, transno 17179874236 00000004:00080000:3.0:1746065214.816858:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b02a00, transno 17179874237 00000004:00080000:3.0:1746065214.816859:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a7100, transno 17179874238 00000004:00080000:3.0:1746065214.816861:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b03480, transno 17179874239 00000004:00080000:3.0:1746065214.816863:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856df80, transno 17179874240 00000004:00080000:3.0:1746065214.816865:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856ca80, transno 17179874241 00000004:00080000:3.0:1746065214.816867:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b00000, transno 17179874242 00000004:00080000:3.0:1746065214.816869:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a5880, transno 17179874243 00000004:00080000:3.0:1746065214.816871:0:3761:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b02d80, transno 17179874244 00000100:00100000:3.0:1746065214.816875:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263956736:0@lo:400:kworker.0 00000004:00080000:1.0:1746065214.816938:0:8154:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 50 in progress, 0 in flight, 4 done 00000100:00100000:2.0:1746065214.817188:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065214.817208:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881263956352:0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.817232:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065214.817243:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881263956864:0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.817257:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065214.817278:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263956352 00000100:00100000:2.0:1746065214.817282:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263956352 00000100:00100000:2.0:1746065214.817306:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263956864 00000100:00100000:2.0:1746065214.817308:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263956864 00000100:00100000:2.0:1746065214.817319:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1746065214.817323:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881263956352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.817353:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881263956352:12345-0@lo:400:kworker.0 Request processed in 30us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.817357:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1746065214.817381:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1746065214.817385:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881263956864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.817415:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881263956864:12345-0@lo:400:kworker.0 Request processed in 29us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.817419:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1746065214.817440:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881263956352:0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.817450:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881263956864:0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.817464:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263955968 00000100:00100000:2.0:1746065214.817466:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263955968 00000100:00100000:2.0:1746065214.817483:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263955840 00000100:00100000:2.0:1746065214.817485:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263955840 00000100:00100000:2.0:1746065214.817497:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1746065214.817501:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881263955968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.817524:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881263955968:12345-0@lo:400:kworker.0 Request processed in 23us (1460us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.817528:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:2.0:1746065214.817536:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1746065214.817540:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263955840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.817561:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263955840:12345-0@lo:400:kworker.0 Request processed in 21us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.817565:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:2.0:1746065214.817581:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263955840:0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.817614:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.817627:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265313280 00000100:00100000:2.0:1746065214.817630:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265313280 00000100:00100000:2.0:1746065214.817644:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5444 00000100:00100000:2.0:1746065214.817648:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+19:2388:x1830881265313280:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065214.817764:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+20:2388:x1830881265313280:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 114us (150us total) trans 8589937045 rc 0/0 00000100:00100000:2.0:1746065214.817770:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5444 00000100:00100000:3.0:1746065214.818356:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3761:1830881263955712:0@lo:400:kworker.0 00000100:00100000:0.0:1746065214.818358:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263955968:0@lo:400:kworker.0 00000100:00100000:0.0:1746065214.818365:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3759:1830881263956480:0@lo:400:kworker.0 00000100:00100000:3.0:1746065214.818382:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3761:1830881263956224:0@lo:400:kworker.0 00000100:00100000:0.0:1746065214.818395:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065214.818591:0:8154:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 50 done 00000100:00080000:1.0:1746065214.818605:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065214.818607:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1746065214.818610:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065214.820794:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ceddf226-8ddf-479f-9953-8a74c62285a9:3759:1830881263955456:0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.820924:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263956480 00000100:00100000:2.0:1746065214.820931:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263956480 00000100:00100000:2.0:1746065214.820978:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1746065214.820984:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3759:x1830881263956480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065214.821035:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3759:x1830881263956480:12345-0@lo:400:kworker.0 Request processed in 51us (2638us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.821041:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00080000:1.0:1746065214.821107:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065214.821204:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3759:1830881263956480:0@lo:400:kworker.0 00000100:00100000:0.0:1746065214.833012:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.833984:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265313408 00000100:00100000:1.0:1746065214.833992:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265313408 00000100:00100000:1.0:1746065214.834031:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17316 00000100:00100000:1.0:1746065214.834038:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265313408:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065214.834039:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065214.834053:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.834067:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc14791a8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392dc expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065214.834075:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.834096:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.834109:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265313920 00000100:00100000:1.0:1746065214.834111:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263956992:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065214.834113:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265313920 00000100:00100000:0.0:1746065214.834120:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265313536 00000100:00100000:0.0:1746065214.834124:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265313536 00000100:00100000:0.0:1746065214.834140:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265313664 00000100:00100000:3.0:1746065214.834141:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14548 00000100:00100000:0.0:1746065214.834142:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265313664 00000100:00100000:3.0:1746065214.834146:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+38:2392:x1830881265313920:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:0.0:1746065214.834153:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17317 00000100:00100000:0.0:1746065214.834158:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881265313536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065214.834159:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065214.834165:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065214.834169:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2e00/0xad6b7ddc14791af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392f1 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.834174:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f70a400/0xad6b7ddc14791b6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392e3 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.834186:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065214.834188:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065214.834194:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70a400/0xad6b7ddc14791b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392e3 expref: 39 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.834205:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f70a400/0xad6b7ddc14791b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392e3 expref: 39 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.834213:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70a400, rc 0) 00000100:00100000:0.0:1746065214.834233:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881265313536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 75us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065214.834238:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17317 00010000:00010000:3.0:1746065214.834242:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14791bd lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065214.834253:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14791bd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065214.834253:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17318 00000100:00100000:0.0:1746065214.834257:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265313664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065214.834261:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14791bd lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065214.834262:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065214.834268:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f70a000/0xad6b7ddc14791c4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392ea expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1746065214.834269:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065214.834277:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065214.834279:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065214.834283:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f70a000/0xad6b7ddc14791c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ea expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.834292:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f70a000/0xad6b7ddc14791c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ea expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.834298:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70a000, rc 0) 00000100:00100000:0.0:1746065214.834312:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265313664:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065214.834317:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17318 00010000:00010000:3.0:1746065214.834340:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2e00/0xad6b7ddc14791af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f1 expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.834359:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14791bd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f1 expref: 40 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065214.834374:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065214.834377:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065214.834379:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3c00, rc 0) 00000100:00100000:3.0:1746065214.834404:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+40:2392:x1830881265313920:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 257us (365us total) trans 8589937046 rc 0/0 00000100:00100000:3.0:1746065214.834408:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14548 00000100:00100000:1.0:1746065214.834411:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00002000:00010000:1.0:1746065214.835762:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065214 -> 1746065215 00000100:00100000:1.0:1746065214.835808:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263956992:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065214.835827:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc14791a8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392dc expref: 33 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.835836:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc14791a8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392dc expref: 33 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.836147:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44a00, rc 0) 00000100:00100000:1.0:1746065214.836187:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265313408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2148us (3182us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065214.836194:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17316 00000100:00100000:0.0:1746065214.843910:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.844007:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265314048 00000100:00100000:1.0:1746065214.844015:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265314048 00000100:00100000:1.0:1746065214.844051:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17319 00000100:00100000:1.0:1746065214.844058:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2395:x1830881265314048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065214.844073:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.844087:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392f8 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.844111:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.844118:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065214.844120:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065214.844123:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 33 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.844147:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.844157:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 23 pid: 13375 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.844172:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263957120:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.844257:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.851634:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.851693:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265314176 00000100:00100000:3.0:1746065214.851700:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265314176 00000100:00100000:1.0:1746065214.851714:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263957120:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.851736:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 33 pid: 9549 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065214.851737:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1511424->1921023) req@ffff88009aba6300 x1830881265314176/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.851745:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba6300 with x1830881265314176 ext(1511424->1921023) 00010000:00010000:1.0:1746065214.851749:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45a00, rc 0) 00010000:00010000:3.0:1746065214.851751:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 24 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.851761:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 24 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746065214.851767:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aba6300 00000100:00100000:3.0:1746065214.851964:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2022 00000100:00100000:3.0:1746065214.851970:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265314176:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065214.851981:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2395:x1830881265314048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7923us (8083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.851988:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17319 00000100:00100000:2.0:1746065214.861658:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263957248:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746065214.861711:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065214.861842:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263957248 00000100:00100000:3.0:1746065214.861849:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263957248 00000100:00100000:3.0:1746065214.861884:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1746065214.861890:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881263957248:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746065214.861961:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445568512 avail 1316106240 00000100:00100000:3.0:1746065214.862381:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881263957248:12345-0@lo:41:osp-pre-0-1.0 Request processed in 491us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.862487:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263957248:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746065214.862517:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:3.0:1746065214.871273:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265314176:12345-192.168.202.27@tcp:4:cat.0 Request processed in 19294us (19637us total) trans 21474841662 rc 0/0 00000100:00100000:3.0:1746065214.871284:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2022 00002000:00100000:3.0:1746065214.871293:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1511424->1921023) req@ffff88009aba6300 x1830881265314176/t21474841662(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/448 e 0 to 0 dl 1746065225 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.871301:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba6300 with x1830881265314176 ext(1511424->1921023) 00010000:00010000:3.0:1746065214.871310:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 26 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:3.0:1746065214.871324:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 26 pid: 13375 timeout: 910 lvb_type: 0 00002000:00010000:3.0:1746065214.871330:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aba6300 00000100:00100000:0.0:1746065214.875699:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.876272:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265314304 00000100:00100000:2.0:1746065214.876279:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265314304 00010000:00010000:2.0:1746065214.876306:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 26 pid: 13375 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746065214.876336:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8066 00000100:00100000:2.0:1746065214.876341:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265314304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065214.876351:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065214.876392:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 26 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.876402:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 26 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.876420:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147911c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1511424->1921023) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93927a expref: 26 pid: 13375 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.876448:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.876450:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.876455:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 32 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.876461:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 32 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.876485:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 32 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.876494:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263957376:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065214.876561:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065214.880339:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2ad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263957376:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065214.880359:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065214.881134:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265314304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4789us (5437us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.881144:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8066 00000100:00100000:0.0:1746065214.883099:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.883460:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265314560 00000100:00100000:3.0:1746065214.883469:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265314560 00002000:00100000:3.0:1746065214.883513:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009ac64700 x1830881265314560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.883523:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac64700 with x1830881265314560 ext(1048576->2097151) 00002000:00010000:3.0:1746065214.883527:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac64700 00000100:00100000:3.0:1746065214.883576:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6160 00000100:00100000:3.0:1746065214.883695:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265314560:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065214.893263:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265314560:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9674us (10165us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065214.893272:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6160 00002000:00100000:2.0:1746065214.893281:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009ac64700 x1830881265314560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.893288:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac64700 with x1830881265314560 ext(1048576->2097151) 00002000:00010000:2.0:1746065214.893294:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009ac64700 00000100:00100000:1.0:1746065214.893665:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263957504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1746065214.893707:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065214.895333:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263957504 00000100:00100000:3.0:1746065214.895342:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263957504 00000100:00100000:3.0:1746065214.895393:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:3.0:1746065214.895400:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881263957504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746065214.895421:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1071621568 pending 5775360 free 3910598656 avail 3679076352 00000100:00100000:3.0:1746065214.895464:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881263957504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (1758us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.895469:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1746065214.895568:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263957504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746065214.909398:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065214.909416:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263957632:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065214.909470:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065214.909518:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263957632 00000100:00100000:1.0:1746065214.909525:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263957632 00000100:00100000:1.0:1746065214.909562:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:1.0:1746065214.909568:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3762:x1830881263957632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746065214.909585:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1073744192 pending 5373952 free 3906641920 avail 3675119616 00000100:00100000:1.0:1746065214.909630:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3762:x1830881263957632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.909635:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1746065214.909683:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263957632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065214.913851:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.914285:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265314816 00000100:00100000:2.0:1746065214.914293:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265314816 00002000:00100000:2.0:1746065214.914328:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009ac67b80 x1830881265314816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.914337:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac67b80 with x1830881265314816 ext(2097152->4194303) 00002000:00010000:2.0:1746065214.914341:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac67b80 00000100:00100000:2.0:1746065214.915138:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6161 00000100:00100000:2.0:1746065214.915151:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881265314816:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065214.918735:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.918911:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265315072 00000100:00100000:0.0:1746065214.918918:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265315072 00002000:00100000:0.0:1746065214.918951:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097fab800 x1830881265315072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065214.918960:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab800 with x1830881265315072 ext(2097152->4194303) 00002000:00010000:0.0:1746065214.918964:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fab800 00000100:00100000:0.0:1746065214.918991:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6162 00000100:00100000:0.0:1746065214.918998:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265315072:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065214.943965:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881265314816:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28809us (30111us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065214.943975:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6161 00002000:00100000:3.0:1746065214.943984:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009ac67b80 x1830881265314816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.943992:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac67b80 with x1830881265314816 ext(2097152->4194303) 00002000:00010000:3.0:1746065214.943997:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac67b80 00000100:00100000:0.0:1746065214.954245:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.954342:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265315200 00000100:00100000:1.0:1746065214.954350:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265315200 00000100:00100000:1.0:1746065214.954394:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17320 00000100:00100000:1.0:1746065214.954400:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2387:x1830881265315200:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065214.954413:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.954426:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9392ff expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.954449:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.954456:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1479177 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b9 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.954461:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc14790dd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93923b expref: 40 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.954467:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.954469:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.954471:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1617920->2097151] (req 1617920->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.954495:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc14790dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93923b expref: 40 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.954505:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc14790dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93923b expref: 40 pid: 9550 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746065214.954515:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263957760:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.954607:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1479177 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b9 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.954615:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1479177 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b9 expref: 10 pid: 9549 timeout: 910 lvb_type: 1 00000100:00100000:1.0:1746065214.954623:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263957888:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.954645:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.954652:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 21 pid: 9550 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.954664:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263958016:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.954679:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065214.962083:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265315072:12345-192.168.202.27@tcp:3:cat.0 Request processed in 43076us (43348us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065214.962093:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6162 00002000:00100000:1.0:1746065214.962103:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097fab800 x1830881265315072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065214.962111:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab800 with x1830881265315072 ext(2097152->4194303) 00002000:00010000:1.0:1746065214.962116:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fab800 00000100:00100000:1.0:1746065214.964498:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263957760:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065214.965097:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263957888:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.966860:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.966876:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.966914:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.966932:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265315456 00000100:00100000:1.0:1746065214.966938:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265315456 00000100:00100000:2.0:1746065214.966963:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265315584 00010000:00010000:1.0:1746065214.966966:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1479177 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b9 expref: 11 pid: 9549 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746065214.966967:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265315584 00010000:00010000:2.0:1746065214.966983:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 22 pid: 9550 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.966986:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8067 00000100:00100000:1.0:1746065214.966992:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265315456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065214.966998:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265315712 00000100:00100000:2.0:1746065214.967000:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265315712 00010000:00010000:1.0:1746065214.967002:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065214.967008:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc14790dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93923b expref: 41 pid: 9550 timeout: 910 lvb_type: 1 00010000:00010000:1.0:1746065214.967017:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1479177 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b9 expref: 11 pid: 9549 timeout: 910 lvb_type: 1 00000100:00100000:2.0:1746065214.967020:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8068 00000100:00100000:2.0:1746065214.967025:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265315584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065214.967026:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1479177 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b9 expref: 11 pid: 9549 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746065214.967032:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065214.967042:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835c000/0xad6b7ddc1479177 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b9 expref: 11 pid: 9549 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746065214.967047:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 22 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.967055:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 22 pid: 9550 timeout: 910 lvb_type: 0 00010000:00010000:1.0:1746065214.967067:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065214.967072:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065214.967099:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265315584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.967099:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265315456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.967105:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8068 00000100:00100000:1.0:1746065214.967108:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8067 00000100:00100000:2.0:1746065214.967116:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8069 00000100:00100000:2.0:1746065214.967219:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265315712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065214.967226:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065214.967232:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc14790dd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93923b expref: 41 pid: 9550 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746065214.967241:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc14790dd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93923b expref: 41 pid: 9550 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746065214.967251:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4200/0xad6b7ddc14790dd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93923b expref: 41 pid: 9550 timeout: 910 lvb_type: 1 00010000:00010000:2.0:1746065214.967268:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.967270:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.967276:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.967287:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.967473:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc14790c8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939226 expref: 21 pid: 9550 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.967482:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263958016:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.967502:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.967509:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00400, rc 0) 00000100:00100000:1.0:1746065214.967544:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2387:x1830881265315200:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 13144us (13307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.967550:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17320 00010000:00010000:2.0:1746065214.967641:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.967652:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d29f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263958144:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065214.968636:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065214.970358:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.970497:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265315328 00000100:00100000:1.0:1746065214.970503:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265315328 00000100:00100000:1.0:1746065214.970582:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17321 00000100:00100000:1.0:1746065214.970589:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2392:x1830881265315328:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065214.970602:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.970683:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939306 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.970710:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 32 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.970716:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.970718:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.970720:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [2064384->2097151] (req 2064384->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.970741:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 32 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.970749:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 32 pid: 9549 timeout: 910 lvb_type: 0 00000100:00100000:1.0:1746065214.970759:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263958272:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.970856:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065214.971272:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d29f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263958144:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065214.971290:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065214.971313:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881265315712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4191us (4398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.971321:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8069 00000100:00100000:0.0:1746065214.972016:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065214.972190:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265315968 00000100:00100000:1.0:1746065214.972194:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265315968 00002000:00100000:1.0:1746065214.972246:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1617920->1622015) req@ffff88009aecbb80 x1830881265315968/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065214.972256:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecbb80 with x1830881265315968 ext(1617920->1622015) 00002000:00010000:1.0:1746065214.972260:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecbb80 00000100:00100000:1.0:1746065214.972286:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6163 00000100:00100000:1.0:1746065214.972292:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881265315968:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065214.972495:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881265315968:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 202us (479us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065214.972501:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6163 00002000:00100000:1.0:1746065214.972506:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1617920->1622015) req@ffff88009aecbb80 x1830881265315968/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/4536 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065214.972512:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecbb80 with x1830881265315968 ext(1617920->1622015) 00002000:00010000:1.0:1746065214.972514:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecbb80 00000100:00100000:1.0:1746065214.975105:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263958272:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.975132:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [2064384->2097151] (req 2064384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.975145:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee800, rc 0) 00000100:00100000:1.0:1746065214.975177:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2392:x1830881265315328:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4588us (4823us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.975183:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17321 00000100:00100000:0.0:1746065214.976193:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.976235:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.976317:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265316352 00000100:00100000:2.0:1746065214.976323:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265316352 00010000:00010000:2.0:1746065214.976347:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 33 pid: 9549 timeout: 910 lvb_type: 0 00000100:00100000:2.0:1746065214.976382:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8070 00000100:00100000:2.0:1746065214.976388:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265316352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065214.976398:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065214.976407:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265316224 00000100:00100000:3.0:1746065214.976412:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265316224 00010000:00010000:2.0:1746065214.976413:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 33 pid: 9549 timeout: 910 lvb_type: 0 00010000:00010000:2.0:1746065214.976423:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 33 pid: 9549 timeout: 910 lvb_type: 0 00002000:00100000:3.0:1746065214.976437:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009aec9880 x1830881265316224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065214.976441:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d45a00/0xad6b7ddc14791d2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f8 expref: 33 pid: 9549 timeout: 910 lvb_type: 0 00002000:00100000:3.0:1746065214.976451:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9880 with x1830881265316224 ext(4194304->5038079) 00002000:00010000:3.0:1746065214.976454:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec9880 00010000:00010000:2.0:1746065214.976471:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065214.976473:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065214.976477:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6164 00010000:00010000:2.0:1746065214.976478:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065214.976483:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881265316224:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065214.976485:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.976511:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.976520:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263958400:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065214.976565:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065214.982843:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263958400:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065214.982862:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065214.982898:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265316352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6509us (6660us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.982907:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8070 00000100:00100000:0.0:1746065214.983046:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065214.983097:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265316608 00000100:00100000:3.0:1746065214.983104:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265316608 00002000:00100000:3.0:1746065214.983134:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (2064384->2068479) req@ffff88009aec8a80 x1830881265316608/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/0 e 0 to 0 dl 1746065225 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065214.983142:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8a80 with x1830881265316608 ext(2064384->2068479) 00002000:00010000:3.0:1746065214.983146:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec8a80 00000100:00100000:2.0:1746065214.983337:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6165 00000100:00100000:2.0:1746065214.983343:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265316608:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065214.983444:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265316608:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 100us (398us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065214.983449:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6165 00002000:00100000:2.0:1746065214.983453:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (2064384->2068479) req@ffff88009aec8a80 x1830881265316608/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:130/0 lens 488/4536 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.983461:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8a80 with x1830881265316608 ext(2064384->2068479) 00002000:00010000:2.0:1746065214.983464:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aec8a80 00000100:00100000:2.0:1746065214.983573:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881265316224:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7090us (7382us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065214.983578:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6164 00002000:00100000:2.0:1746065214.983582:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009aec9880 x1830881265316224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:130/0 lens 488/440 e 0 to 0 dl 1746065225 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065214.983589:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9880 with x1830881265316224 ext(4194304->5038079) 00002000:00010000:2.0:1746065214.983592:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec9880 00000100:00100000:0.0:1746065214.989400:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.989455:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.989537:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065214.989557:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265316736 00000100:00100000:0.0:1746065214.989563:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265316736 00000100:00100000:0.0:1746065214.989593:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17322 00000100:00100000:0.0:1746065214.989598:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2392:x1830881265316736:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065214.989612:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065214.989626:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93930d expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.989647:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 31 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.989654:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1479162 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b2 expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.989661:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1479107 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939265 expref: 27 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.989666:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065214.989667:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065214.989670:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->1814527] (req 1048576->1814527) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.989677:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265316864 00000100:00100000:2.0:1746065214.989682:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265316864 00010000:00010000:0.0:1746065214.989694:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1479107 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939265 expref: 27 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.989702:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1479107 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939265 expref: 27 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065214.989710:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265316992 00000100:00100000:2.0:1746065214.989712:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265316992 00000100:00100000:0.0:1746065214.989712:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263958528:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065214.989727:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17323 00000100:00100000:2.0:1746065214.989803:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265316864:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065214.989812:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065214.989819:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577b000/0xad6b7ddc14791ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939314 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065214.989844:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263958656:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065214.989850:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17324 00000100:00100000:1.0:1746065214.989857:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2387:x1830881265316992:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065214.989864:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065214.989872:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93931b expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.989890:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.989899:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f70a400/0xad6b7ddc14791b6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392e3 expref: 40 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.989905:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc1479170 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c0 expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.989910:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.989911:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065214.989914:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.989929:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc1479170 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c0 expref: 9 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.989936:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc1479170 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c0 expref: 9 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746065214.989945:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263958784:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065214.990050:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00010000:00010000:0.0:1746065214.990059:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1479162 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b2 expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065214.990068:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1479162 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b2 expref: 9 pid: 9549 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746065214.990075:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263958912:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065214.990100:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065214.990107:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 33 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746065214.990114:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263959040:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065214.990129:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4240 going to sleep for 11 seconds 00010000:00010000:1.0:1746065214.990252:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f70a400/0xad6b7ddc14791b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392e3 expref: 40 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065214.990260:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f70a400/0xad6b7ddc14791b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392e3 expref: 40 pid: 9550 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746065214.990267:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263959168:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.990297:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.990304:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 20 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065214.990312:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263959296:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.990327:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065214.995408:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263958528:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065214.995420:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263958912:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065214.995428:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263959040:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065214.995457:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->1814527] (req 1048576->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 27 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065214.995472:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538c00, rc 0) 00000100:00100000:2.0:1746065214.995510:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2392:x1830881265316736:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5910us (6115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.995518:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17322 00002000:00010000:3.0:1746065214.995926:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065214 -> 1746065215 00002000:00010000:3.0:1746065214.995930:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065214 -> 1746065215 00000100:00100000:3.0:1746065214.995944:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263958656:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065214.995965:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577b000/0xad6b7ddc14791ee lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939314 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.995974:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577b000/0xad6b7ddc14791ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939314 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065214.995985:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b000, rc 0) 00000100:00100000:3.0:1746065214.996004:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265316864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6203us (6549us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065214.996009:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17323 00000100:00100000:1.0:1746065214.996030:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263958784:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.996038:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263959168:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065214.996045:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263959296:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065214.996063:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065214.996076:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01a00, rc 0) 00000100:00100000:1.0:1746065214.996097:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2387:x1830881265316992:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6240us (6560us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065214.996102:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17324 00000100:00100000:2.0:1746065214.998275:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.998317:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065214.998345:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265317376 00000100:00100000:2.0:1746065214.998352:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265317376 00010000:00010000:2.0:1746065214.998389:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc1479170 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c0 expref: 10 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746065214.998724:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265317120 00000100:00100000:3.0:1746065214.998729:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265317120 00000100:00100000:2.0:1746065214.998730:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8071 00000100:00100000:2.0:1746065214.998737:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265317376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.998743:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1479107 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939265 expref: 27 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065214.998748:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065214.998763:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc1479170 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c0 expref: 10 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746065214.998768:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8072 00010000:00010000:2.0:1746065214.998789:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc1479170 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c0 expref: 10 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746065214.998790:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265317120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065214.998796:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065214.998806:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1479107 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939265 expref: 27 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065214.998813:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1479107 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939265 expref: 27 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065214.998826:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb3600/0xad6b7ddc1479107 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939265 expref: 27 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065214.998835:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065214.998867:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265317120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065214.998872:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8072 00010000:00010000:2.0:1746065214.998896:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45800/0xad6b7ddc1479170 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c0 expref: 10 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065214.998934:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065214.998964:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265317376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 228us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065214.998969:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8071 00000100:00100000:0.0:1746065215.000402:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.000436:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.000471:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.000534:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265317248 00000100:00100000:1.0:1746065215.000539:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265317248 00010000:00010000:1.0:1746065215.000559:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 32 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.000575:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265317632 00000100:00100000:1.0:1746065215.000577:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265317632 00010000:00010000:1.0:1746065215.000585:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70a400/0xad6b7ddc14791b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392e3 expref: 40 pid: 9550 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746065215.000597:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265317504 00000100:00100000:1.0:1746065215.000599:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265317504 00010000:00010000:1.0:1746065215.000605:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1479162 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b2 expref: 10 pid: 9549 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746065215.000615:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8073 00000100:00100000:1.0:1746065215.000620:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265317248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065215.000627:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065215.000637:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 32 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.000644:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 32 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.000657:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c7ad000/0xad6b7ddc14790f9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939257 expref: 32 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.000670:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065215.000692:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265317248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 72us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.000697:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8073 00000100:00100000:1.0:1746065215.000708:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8074 00000100:00100000:1.0:1746065215.000712:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265317632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065215.000718:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065215.000726:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f70a400/0xad6b7ddc14791b6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392e3 expref: 40 pid: 9550 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746065215.000733:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f70a400/0xad6b7ddc14791b6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392e3 expref: 40 pid: 9550 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746065215.000743:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f70a400/0xad6b7ddc14791b6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392e3 expref: 40 pid: 9550 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746065215.000752:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065215.000764:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881265317632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.000768:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8074 00000100:00100000:1.0:1746065215.000826:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8075 00000100:00100000:1.0:1746065215.000836:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265317504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065215.000843:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065215.000849:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1479162 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b2 expref: 10 pid: 9549 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746065215.000860:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1479162 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b2 expref: 10 pid: 9549 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746065215.000870:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51b000/0xad6b7ddc1479162 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392b2 expref: 10 pid: 9549 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746065215.000878:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.000880:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.000885:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.000892:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00000100:00080000:2.0:1746065215.000902:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1746065215.000914:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065215.000924:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263959424:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065215.000961:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.003123:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.003168:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.003317:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265317760 00000100:00100000:2.0:1746065215.003323:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265317760 00000100:00100000:1.0:1746065215.003349:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265317888 00000100:00100000:1.0:1746065215.003352:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265317888 00010000:00010000:2.0:1746065215.003360:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 21 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.003392:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8076 00000100:00100000:1.0:1746065215.003392:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17325 00000100:00100000:1.0:1746065215.003397:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2395:x1830881265317888:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065215.003398:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265317760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.003407:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065215.003409:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.003418:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc14791fc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939322 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.003420:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 21 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.003429:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 21 pid: 13375 timeout: 911 lvb_type: 0 00000100:00080000:3.0:1746065215.003465:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1746065215.003480:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.003482:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.003492:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc14791fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2633728->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939322 expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.003504:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc14791fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2633728->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939322 expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.003513:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01400, rc 0) 00000100:00100000:1.0:1746065215.003548:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2395:x1830881265317888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 149us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.003553:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17325 00010000:00010000:2.0:1746065215.003625:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099c30800/0xad6b7ddc1479138 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939296 expref: 21 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.003635:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.003637:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.003640:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.003650:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.003671:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.003681:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263959552:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065215.003730:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.005720:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263959552:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065215.005738:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.005771:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265317760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2372us (2601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.005800:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263959424:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065215.005803:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8076 00010000:00010000:1.0:1746065215.005810:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065215.005826:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265317504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4995us (5354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.006977:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.007019:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.007099:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8075 00000100:00100000:1.0:1746065215.007127:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265318016 00000100:00100000:1.0:1746065215.007132:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265318016 00000100:00100000:1.0:1746065215.007160:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265318144 00000100:00100000:1.0:1746065215.007162:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265318144 00000100:00100000:1.0:1746065215.007173:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17326 00000100:00100000:1.0:1746065215.007178:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265318016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065215.007193:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.007204:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1479203 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939329 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065215.007237:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263959680:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065215.007281:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00080000:3.0:1746065215.007310:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065215.007325:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17327 00000100:00100000:3.0:1746065215.007331:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265318144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065215.007337:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065215.007344:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc147920a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939330 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.007381:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263959808:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065215.007417:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.009885:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.009969:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265318272 00000100:00100000:2.0:1746065215.009975:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265318272 00000100:00100000:2.0:1746065215.010003:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17328 00000100:00100000:2.0:1746065215.010009:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265318272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.010021:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.010033:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc1479211 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939337 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.010056:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc1479211 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939337 expref: 41 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.010064:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc1479211 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939337 expref: 41 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.010073:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ba00, rc 0) 00000100:00100000:2.0:1746065215.010116:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265318272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 107us (237us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.010121:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17328 00000100:00100000:0.0:1746065215.010676:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263959680:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065215.010693:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1479203 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939329 expref: 34 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.010702:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc1479203 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939329 expref: 34 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.010712:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00c00, rc 0) 00000100:00100000:0.0:1746065215.010732:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265318016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3554us (3758us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065215.010737:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17326 00002000:00010000:2.0:1746065215.010941:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065214 -> 1746065215 00002000:00010000:2.0:1746065215.010945:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065214 -> 1746065215 00002000:00010000:2.0:1746065215.010946:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065214 -> 1746065215 00000100:00100000:2.0:1746065215.010953:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263959808:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.010965:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc147920a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939330 expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.010973:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b2800/0xad6b7ddc147920a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939330 expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.010979:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2800, rc 0) 00000100:00100000:2.0:1746065215.010995:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265318144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3665us (3975us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.011000:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17327 00000100:00100000:0.0:1746065215.012340:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.012455:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265318528 00000100:00100000:3.0:1746065215.012459:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265318528 00002000:00100000:3.0:1746065215.012483:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2629632->2633727) req@ffff88012f09df80 x1830881265318528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.012492:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09df80 with x1830881265318528 ext(2629632->2633727) 00002000:00010000:3.0:1746065215.012495:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09df80 00000100:00100000:3.0:1746065215.012515:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6166 00000100:00100000:3.0:1746065215.012520:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265318528:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065215.012911:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265318528:12345-192.168.202.27@tcp:3:cat.0 Request processed in 390us (573us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065215.012917:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6166 00002000:00100000:3.0:1746065215.012922:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2629632->2633727) req@ffff88012f09df80 x1830881265318528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.012930:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09df80 with x1830881265318528 ext(2629632->2633727) 00002000:00010000:3.0:1746065215.012932:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09df80 00000100:00100000:0.0:1746065215.013340:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.013510:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265318784 00000100:00100000:3.0:1746065215.013514:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265318784 00002000:00100000:3.0:1746065215.013527:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff88012f09ce00 x1830881265318784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.013534:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ce00 with x1830881265318784 ext(5033984->5038079) 00002000:00010000:3.0:1746065215.013537:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09ce00 00000100:00100000:3.0:1746065215.013555:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6167 00000100:00100000:3.0:1746065215.013560:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265318784:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065215.013607:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265318784:12345-192.168.202.27@tcp:3:cat.0 Request processed in 46us (268us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065215.013612:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6167 00002000:00100000:3.0:1746065215.013616:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff88012f09ce00 x1830881265318784/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.013622:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ce00 with x1830881265318784 ext(5033984->5038079) 00002000:00010000:3.0:1746065215.013625:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09ce00 00000100:00100000:1.0:1746065215.014187:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.014220:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265319040 00000100:00100000:2.0:1746065215.014223:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265319040 00002000:00100000:2.0:1746065215.014255:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1810432->1814527) req@ffff880097fa8a80 x1830881265319040/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.014262:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8a80 with x1830881265319040 ext(1810432->1814527) 00002000:00010000:2.0:1746065215.014265:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa8a80 00000100:00100000:2.0:1746065215.014282:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6168 00000100:00100000:2.0:1746065215.014286:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265319040:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065215.014350:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265319040:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 63us (164us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065215.014355:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6168 00002000:00100000:2.0:1746065215.014360:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1810432->1814527) req@ffff880097fa8a80 x1830881265319040/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.014377:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8a80 with x1830881265319040 ext(1810432->1814527) 00002000:00010000:2.0:1746065215.014379:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa8a80 00000100:00080000:3.0:1746065215.014444:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065215.020116:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.020345:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265319296 00000100:00100000:3.0:1746065215.020352:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265319296 00000100:00100000:3.0:1746065215.020404:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5445 00000100:00100000:3.0:1746065215.020411:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+55:2387:x1830881265319296:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065215.020582:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+56:2387:x1830881265319296:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 171us (472us total) trans 8589937047 rc 0/0 00000100:00100000:3.0:1746065215.020587:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5445 00000100:00080000:0.0:1746065215.020632:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065215.037237:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.037430:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265319424 00000100:00100000:3.0:1746065215.037439:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265319424 00000100:00100000:3.0:1746065215.038333:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14549 00000100:00100000:3.0:1746065215.038342:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+20:2400:x1830881265319424:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065215.038362:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065215.038386:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479218 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93933e expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.038440:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147921f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.038450:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147921f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.038459:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147921f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.038471:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc1479226 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.038476:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc1479226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.038480:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc1479226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.038536:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.038545:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14791bd lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f1 expref: 39 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.038551:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.038574:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14791bd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f1 expref: 39 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.038584:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14791bd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f1 expref: 39 pid: 9571 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746065215.038599:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263959936:192.168.202.27@tcp:104: 00000100:00080000:0.0:1746065215.038868:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065215.040976:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.044480:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.044575:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263959936:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065215.044594:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065215.044710:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265319680 00000100:00100000:2.0:1746065215.044716:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265319680 00000100:00100000:2.0:1746065215.044761:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5446 00000100:00100000:2.0:1746065215.044766:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4111450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+40:16305:x1830881265319680:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065215.044936:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4111450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+41:16305:x1830881265319680:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 169us (463us total) trans 8589937048 rc 0/0 00000100:00100000:2.0:1746065215.044942:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5446 00000100:00080000:0.0:1746065215.045306:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065215.048442:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.048471:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.048503:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.048527:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265319936 00000100:00100000:0.0:1746065215.048534:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265319936 00000100:00100000:0.0:1746065215.048561:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265320064 00000100:00100000:0.0:1746065215.048563:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265320064 00000100:00100000:0.0:1746065215.048586:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17329 00000100:00100000:0.0:1746065215.048593:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265319936:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065215.048608:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.048622:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c51a800/0xad6b7ddc1479234 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939345 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.048663:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263960064:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065215.048719:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.048739:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17330 00000100:00100000:0.0:1746065215.048743:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265320064:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065215.048749:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.048755:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c51ac00/0xad6b7ddc147923b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93934c expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.048769:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c51ac00/0xad6b7ddc147923b lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93934c expref: 23 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.048793:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c51ac00/0xad6b7ddc147923b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93934c expref: 23 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.048805:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51ac00, rc 0) 00000100:00100000:0.0:1746065215.048822:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265320064:12345-192.168.202.27@tcp:101:cat.0 Request processed in 78us (318us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065215.048831:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17330 00000100:00100000:1.0:1746065215.049040:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265319808 00000100:00100000:1.0:1746065215.049044:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265319808 00010000:00010000:1.0:1746065215.049059:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14791bd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f1 expref: 41 pid: 9571 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.049080:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8077 00000100:00100000:1.0:1746065215.049086:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+41:2005:x1830881265319808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065215.049094:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065215.049098:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14791bd lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f1 expref: 41 pid: 9571 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.049108:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14791bd lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f1 expref: 41 pid: 9571 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.049121:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3c00/0xad6b7ddc14791bd lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392f1 expref: 41 pid: 9571 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.049134:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065215.049138:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065215.049147:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065215.049154:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065215.049166:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065215.049181:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+40:2005:x1830881265319808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.049186:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8077 00010000:00010000:3.0:1746065215.049246:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049253:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065215.049289:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065215.049293:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065215.049309:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049318:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049329:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147921f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049334:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147921f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049340:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147921f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049345:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147921f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049354:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b3800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065215.049358:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147921f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049376:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147921f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049384:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065215.049386:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065215.049389:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147921f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049394:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147921f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049406:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc1479226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049411:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc1479226 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049415:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc1479226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049419:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b2800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065215.049422:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc1479226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049426:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc1479226 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049431:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b7e52600) 00010000:00010000:3.0:1746065215.049433:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065215.049435:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc1479226 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049440:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc1479226 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.049469:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93933e expref: 22 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.049477:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93933e expref: 21 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.049482:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065215.049484:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065215.049486:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baf600, rc 0) 00000100:00100000:3.0:1746065215.049505:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+21:2400:x1830881265319424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11166us (12275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.049510:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14549 00000100:00100000:0.0:1746065215.055172:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:2.0:1746065215.055307:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime: 1746065214 -> 1746065215 00002000:00010000:2.0:1746065215.055312:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065214 -> 1746065215 00002000:00010000:2.0:1746065215.055314:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime: 1746065214 -> 1746065215 00000100:00100000:2.0:1746065215.055328:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263960064:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.055353:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c51a800/0xad6b7ddc1479234 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939345 expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.055377:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c51a800/0xad6b7ddc1479234 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939345 expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065215.057709:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.057741:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.057762:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265320192 00000100:00100000:0.0:1746065215.057770:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265320192 00000100:00100000:0.0:1746065215.057989:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265320320 00000100:00100000:0.0:1746065215.057991:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265320320 00000100:00100000:0.0:1746065215.058001:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265320576 00000100:00100000:0.0:1746065215.058002:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265320576 00000100:00100000:3.0:1746065215.058012:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17331 00000100:00100000:0.0:1746065215.058021:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17332 00000100:00100000:3.0:1746065215.058022:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265320192:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:0.0:1746065215.058025:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265320320:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065215.058040:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17333 00010000:00010000:0.0:1746065215.058041:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065215.058045:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265320576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065215.058050:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.058051:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc1479242 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93935a expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.058059:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091bafe00/0xad6b7ddc1479249 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939368 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.058077:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091bafe00/0xad6b7ddc1479249 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939368 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065215.058088:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263960192:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065215.058090:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091bafe00/0xad6b7ddc1479249 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939368 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.058099:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bafe00, rc 0) 00000100:00100000:3.0:1746065215.058126:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265320576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 80us (383us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065215.058132:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17333 00000100:00100000:0.0:1746065215.058133:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4240 going to sleep for 11 seconds 00000100:00080000:0.0:1746065215.058141:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746065215.058152:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065215.058160:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc1479250 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939353 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.058180:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263960320:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065215.058199:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065215.058257:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51a800, rc 0) 00000100:00100000:0.0:1746065215.058277:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.058291:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265320448 00000100:00100000:2.0:1746065215.058295:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265319936:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9701us (9821us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065215.058295:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265320448 00000100:00100000:2.0:1746065215.058301:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17329 00000100:00100000:1.0:1746065215.058312:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17334 00000100:00100000:1.0:1746065215.058316:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265320448:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065215.058322:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.058327:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc1479257 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939361 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065215.058356:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263960448:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065215.058390:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.059734:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263960192:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.059755:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc1479242 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93935a expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.059765:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51ac00/0xad6b7ddc1479242 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93935a expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.059796:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51ac00, rc 0) 00000100:00100000:2.0:1746065215.059824:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265320320:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1798us (2120us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.059830:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17332 00000100:00100000:3.0:1746065215.061644:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881263960320:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065215.061664:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc1479250 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939353 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.061674:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091baea00/0xad6b7ddc1479250 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939353 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065215.061965:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263960448:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065215.061981:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc1479257 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939361 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.061990:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00200/0xad6b7ddc1479257 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939361 expref: 10 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.062018:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00200, rc 0) 00000100:00100000:1.0:1746065215.062050:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265320448:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3733us (3773us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065215.062058:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17334 00010000:00010000:3.0:1746065215.062479:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baea00, rc 0) 00000100:00100000:3.0:1746065215.062503:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265320192:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4483us (7339us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065215.062509:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17331 00000100:00100000:2.0:1746065215.064952:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.064985:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.065009:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265321088 00000100:00100000:1.0:1746065215.065015:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265321088 00000100:00100000:0.0:1746065215.065046:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:1.0:1746065215.065051:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2064383) req@ffff880097d29500 x1830881265321088/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065215.065059:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d29500 with x1830881265321088 ext(1048576->2064383) 00002000:00010000:1.0:1746065215.065063:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d29500 00000100:00100000:1.0:1746065215.065077:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265321216 00000100:00100000:1.0:1746065215.065079:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265321216 00000100:00100000:3.0:1746065215.065083:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6169 00002000:00100000:1.0:1746065215.065090:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1814528->2097151) req@ffff880097d2a680 x1830881265321216/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065215.065091:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2006:x1830881265321088:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:1.0:1746065215.065096:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2a680 with x1830881265321216 ext(1814528->2097151) 00002000:00010000:1.0:1746065215.065098:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d2a680 00000100:00100000:2.0:1746065215.065104:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265320832 00000100:00100000:2.0:1746065215.065107:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265320832 00000100:00100000:1.0:1746065215.065109:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6170 00000100:00100000:1.0:1746065215.065113:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2007:x1830881265321216:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065215.065134:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14550 00000100:00100000:2.0:1746065215.065139:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+21:2400:x1830881265320832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065215.065149:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.065163:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147925e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93936f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.065292:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065215.065304:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93933e expref: 22 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.065310:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065215.065334:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93933e expref: 22 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.065344:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93933e expref: 22 pid: 7205 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.065355:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263960576:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.065423:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065215.069547:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2007:x1830881265321216:12345-192.168.202.27@tcp:3:cat.0 Request processed in 4423us (4550us total) trans 0 rc 282624/282624 00000100:00100000:1.0:1746065215.069556:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6170 00002000:00100000:1.0:1746065215.069566:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1814528->2097151) req@ffff880097d2a680 x1830881265321216/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 282624/282624 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065215.069581:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2a680 with x1830881265321216 ext(1814528->2097151) 00002000:00010000:1.0:1746065215.069586:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d2a680 00000100:00100000:2.0:1746065215.070582:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263960576:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.070602:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:1.0:1746065215.070706:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.070787:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265321472 00000100:00100000:2.0:1746065215.070792:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265321472 00010000:00010000:2.0:1746065215.070814:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93933e expref: 23 pid: 7205 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.070833:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8078 00000100:00100000:2.0:1746065215.070839:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+23:2004:x1830881265321472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.070850:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.070855:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93933e expref: 23 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.070864:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93933e expref: 23 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.070909:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc147922d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93933e expref: 23 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.070928:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00000100:00100000:3.0:1746065215.070932:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2006:x1830881265321088:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5841us (5983us total) trans 0 rc 1015808/1015808 00010000:00010000:2.0:1746065215.070933:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:3.0:1746065215.070940:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6169 00010000:00010000:2.0:1746065215.070941:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00002000:00100000:3.0:1746065215.070945:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2064383) req@ffff880097d29500 x1830881265321088/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1015808/1015808 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065215.070947:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00002000:00100000:3.0:1746065215.070952:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d29500 with x1830881265321088 ext(1048576->2064383) 00002000:00010000:3.0:1746065215.070956:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d29500 00010000:00010000:2.0:1746065215.070966:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065215.070997:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065215.071003:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065215.071017:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000100:00100000:2.0:1746065215.071035:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+22:2004:x1830881265321472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 196us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.071041:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8078 00010000:00010000:0.0:1746065215.071115:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ae00/0xad6b7ddc147925e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93936f expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.071138:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93936f expref: 22 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.071144:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065215.071146:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065215.071148:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ac00, rc 0) 00000100:00100000:0.0:1746065215.071166:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+22:2400:x1830881265320832:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6027us (6120us total) trans 8589937049 rc 0/0 00000100:00100000:0.0:1746065215.071171:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14550 00000100:00100000:0.0:1746065215.076156:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.076208:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265321600 00000100:00100000:2.0:1746065215.076215:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265321600 00000100:00100000:2.0:1746065215.076257:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14551 00000100:00100000:2.0:1746065215.076263:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+22:2400:x1830881265321600:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065215.076283:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.076298:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ba00/0xad6b7ddc1479273 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939376 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.076359:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065215.076397:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93936f expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.076402:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065215.076424:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93936f expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.076432:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93936f expref: 23 pid: 7205 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.076442:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263960704:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.076512:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.078491:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.078552:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265321728 00000100:00100000:3.0:1746065215.078559:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265321728 00000100:00100000:3.0:1746065215.078653:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17335 00000100:00100000:3.0:1746065215.078660:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2403:x1830881265321728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065215.078673:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065215.078686:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93937d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.078713:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.078721:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065215.078723:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065215.078726:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.078754:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.078765:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 39 pid: 9549 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746065215.078811:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263960832:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065215.078876:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.080674:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.080939:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263960704:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065215.080957:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065215.081020:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265321856 00000100:00100000:2.0:1746065215.081025:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265321856 00010000:00010000:2.0:1746065215.081047:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93936f expref: 24 pid: 7205 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.081082:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8079 00000100:00100000:2.0:1746065215.081089:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+24:2004:x1830881265321856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.081099:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.081103:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93936f expref: 24 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.081116:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93936f expref: 24 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.081132:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ac00/0xad6b7ddc1479265 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93936f expref: 24 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.081146:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065215.081150:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065215.081156:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065215.081161:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065215.081182:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.081209:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+23:2004:x1830881265321856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 121us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.081215:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8079 00010000:00010000:3.0:1746065215.081305:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.081310:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065215.081348:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065215.081352:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065215.081376:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.081402:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577ba00/0xad6b7ddc1479273 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939376 expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.081415:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939376 expref: 22 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.081420:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065215.081422:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065215.081425:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a200, rc 0) 00000100:00100000:3.0:1746065215.081445:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+22:2400:x1830881265321600:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5182us (5296us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.081450:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14551 00000100:00100000:3.0:1746065215.082903:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263960832:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065215.082920:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 21 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.082932:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baf200, rc 0) 00000100:00100000:3.0:1746065215.082956:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2403:x1830881265321728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4296us (4470us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.082963:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17335 00000100:00100000:0.0:1746065215.084134:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.084168:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.084195:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.084219:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.084241:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.084302:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265322240 00000100:00100000:2.0:1746065215.084307:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265322240 00000100:00100000:2.0:1746065215.084334:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265322496 00000100:00100000:2.0:1746065215.084336:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265322496 00000100:00100000:2.0:1746065215.084346:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265322112 00000100:00100000:2.0:1746065215.084348:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265322112 00000100:00100000:2.0:1746065215.084356:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265322368 00000100:00100000:2.0:1746065215.084357:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265322368 00000100:00100000:2.0:1746065215.084391:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17336 00000100:00100000:2.0:1746065215.084397:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265322240:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065215.084412:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.084424:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1479288 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93938b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.084463:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263960960:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.084515:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.084529:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17337 00000100:00100000:2.0:1746065215.084535:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265322496:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065215.084541:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.084548:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147928f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939399 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.084563:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147928f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939399 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.084570:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147928f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939399 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.084579:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b600, rc 0) 00000100:00100000:2.0:1746065215.084593:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265322496:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 59us (398us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.084598:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17337 00000100:00100000:2.0:1746065215.084608:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17338 00000100:00100000:2.0:1746065215.084613:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265322112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065215.084618:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.084623:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577a600/0xad6b7ddc1479296 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939384 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.084641:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263961088:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.084658:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.084669:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17339 00000100:00100000:2.0:1746065215.084673:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265322368:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065215.084678:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.084683:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c539e00/0xad6b7ddc147929d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939392 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.084699:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263961216:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.084715:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065215.084833:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265321984 00000100:00100000:3.0:1746065215.084837:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265321984 00002000:00100000:3.0:1746065215.084860:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1617920->2097151) req@ffff880135220e00 x1830881265321984/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.084868:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220e00 with x1830881265321984 ext(1617920->2097151) 00010000:00010000:3.0:1746065215.084873:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 40 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.084883:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 40 pid: 9549 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.084888:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135220e00 00000100:00100000:3.0:1746065215.084899:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2023 00000100:00100000:3.0:1746065215.084903:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265321984:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065215.087597:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263960960:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.087624:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1479288 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93938b expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.087636:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc1479288 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93938b expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.087645:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577bc00, rc 0) 00000100:00100000:2.0:1746065215.087678:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265322240:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3281us (3510us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.087685:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17336 00000100:00100000:2.0:1746065215.087724:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263961216:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.087741:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c539e00/0xad6b7ddc147929d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939392 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.087749:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539e00/0xad6b7ddc147929d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939392 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.087756:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539e00, rc 0) 00000100:00100000:2.0:1746065215.087770:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265322368:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3096us (3528us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.087802:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17339 00000100:00100000:3.0:1746065215.087927:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263961088:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065215.087940:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577a600/0xad6b7ddc1479296 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939384 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.087948:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577a600/0xad6b7ddc1479296 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939384 expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.087969:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a600, rc 0) 00000100:00100000:3.0:1746065215.087986:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265322112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3373us (3766us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065215.087991:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17338 00000100:00100000:0.0:1746065215.092033:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.092203:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265322752 00000100:00100000:3.0:1746065215.092211:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265322752 00000100:00100000:3.0:1746065215.092248:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14552 00000100:00100000:3.0:1746065215.092254:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+22:2400:x1830881265322752:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065215.092270:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065215.092284:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14792a4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393a0 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.092377:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a800/0xad6b7ddc14792ab lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.092390:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a800/0xad6b7ddc14792ab lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065215.092398:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a800/0xad6b7ddc14792ab lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065215.092411:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065215.092473:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a400/0xad6b7ddc14792a4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a0 expref: 25 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.092486:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a800/0xad6b7ddc14792ab lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a0 expref: 24 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.092493:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065215.092496:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065215.092498:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c51a800, rc 0) 00000100:00100000:3.0:1746065215.093215:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+24:2400:x1830881265322752:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 959us (1187us total) trans 8589937050 rc 0/0 00000100:00100000:2.0:1746065215.093220:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881265321984:12345-192.168.202.27@tcp:4:cat.0 Request processed in 8313us (9087us total) trans 17179874265 rc 0/0 00000100:00100000:3.0:1746065215.093222:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14552 00000100:00100000:2.0:1746065215.093229:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2023 00002000:00100000:2.0:1746065215.093236:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1617920->2097151) req@ffff880135220e00 x1830881265321984/t17179874265(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/448 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.093245:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220e00 with x1830881265321984 ext(1617920->2097151) 00010000:00010000:2.0:1746065215.093251:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 42 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.093262:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 42 pid: 9549 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746065215.093267:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135220e00 00000100:00100000:0.0:1746065215.097217:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.097254:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.097267:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.097279:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.097291:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.097309:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265323136 00000100:00100000:0.0:1746065215.097317:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265323136 00000100:00100000:2.0:1746065215.097332:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265322880 00000100:00100000:2.0:1746065215.097337:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265322880 00000100:00100000:0.0:1746065215.097347:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265323392 00000100:00100000:0.0:1746065215.097349:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265323392 00010000:00010000:2.0:1746065215.097359:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 42 pid: 9549 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746065215.097360:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265323648 00000100:00100000:0.0:1746065215.097361:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265323648 00000100:00100000:0.0:1746065215.097385:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265323008 00000100:00100000:0.0:1746065215.097387:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265323008 00000100:00100000:2.0:1746065215.097395:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8080 00000100:00100000:0.0:1746065215.097397:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17340 00000100:00100000:2.0:1746065215.097401:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881265322880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065215.097403:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265323136:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065215.097413:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.097430:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 42 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.097432:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.097440:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 42 pid: 9549 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.097445:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17341 00010000:00010000:0.0:1746065215.097448:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065215.097454:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265323392:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065215.097454:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065215.097456:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065215.097457:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00400/0xad6b7ddc14791d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1617920->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ff expref: 42 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.097458:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.097467:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.097469:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.097471:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.097474:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.097480:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.097483:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.097490:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.097493:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 25 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.097496:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.097501:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.097503:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.097504:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263961344:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.097519:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.097521:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.097529:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.097537:0:8352:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### not re-adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 6/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.097537:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263961600:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.097550:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263961472:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065215.097570:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.097574:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065215.097575:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.097587:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17342 00000100:00100000:2.0:1746065215.097592:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17343 00000100:00100000:2.0:1746065215.097597:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265323008:12345-192.168.202.27@tcp:1:lfs.0 00000100:00100000:0.0:1746065215.097598:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265323648:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065215.097612:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.097612:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.097621:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1478a1c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de2 expref: 41 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.097621:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.097628:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478b96 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ebb expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.097628:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f70a000/0xad6b7ddc14791c4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ea expref: 30 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.097635:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc1478a54 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e13 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.097635:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc147917e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c7 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.097639:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.097640:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.097641:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.097641:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.097643:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.097643:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.097657:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc1478a54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e13 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.097657:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc147917e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c7 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.097664:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc147917e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c7 expref: 10 pid: 9549 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.097665:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc1478a54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e13 expref: 20 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746065215.097671:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263961728:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.097672:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263961856:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.097695:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478b96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ebb expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.097702:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478b96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ebb expref: 10 pid: 13375 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.097709:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263961984:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.097730:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1478a1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de2 expref: 41 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.097736:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1478a1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de2 expref: 41 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.097743:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263962112:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.097757:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528300 going to sleep for 11 seconds 00010000:00010000:0.0:1746065215.097757:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f70a000/0xad6b7ddc14791c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ea expref: 30 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.097769:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f70a000/0xad6b7ddc14791c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ea expref: 30 pid: 9550 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746065215.097795:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263962240:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065215.098406:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.098415:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 25 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746065215.098423:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263962368:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065215.098438:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.098469:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.098542:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.098608:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265323264 00000100:00100000:3.0:1746065215.098613:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265323264 00000100:00100000:3.0:1746065215.098633:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265323520 00000100:00100000:3.0:1746065215.098635:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265323520 00000100:00100000:3.0:1746065215.098648:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17344 00000100:00100000:3.0:1746065215.098653:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265323264:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065215.098670:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.098680:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.098683:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17345 00010000:00010000:3.0:1746065215.098685:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065215.098686:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065215.098689:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.098689:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265323520:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065215.098703:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.098704:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.098710:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 25 pid: 3068 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.098713:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 41 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.098717:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263962496:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.098723:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc14791fc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2633728->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939322 expref: 41 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.098728:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065215.098729:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065215.098731:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.098743:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc14791fc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2633728->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939322 expref: 41 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.098750:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc14791fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2633728->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939322 expref: 41 pid: 9549 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.098756:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263962624:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.099345:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065215.099351:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603d80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065215.099360:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 41 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.099380:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 41 pid: 9549 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.099387:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263962752:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.099405:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.104559:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.104580:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.104593:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.104617:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.104636:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265323904 00000100:00100000:0.0:1746065215.104642:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265323904 00010000:00010000:0.0:1746065215.104669:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1478a1c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de2 expref: 42 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746065215.104687:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265324160 00000100:00100000:0.0:1746065215.104689:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265324160 00010000:00010000:0.0:1746065215.104697:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc14791fc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2633728->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939322 expref: 43 pid: 9549 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746065215.104710:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8081 00000100:00100000:0.0:1746065215.104716:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265323904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065215.104727:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065215.104743:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1478a1c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de2 expref: 43 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746065215.104752:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1478a1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de2 expref: 43 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746065215.104799:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065215.104830:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265323904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 114us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.104836:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8081 00000100:00100000:0.0:1746065215.104851:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8082 00000100:00100000:0.0:1746065215.104855:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881265324160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065215.104861:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065215.104868:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc14791fc lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2633728->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939322 expref: 42 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.104875:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc14791fc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2633728->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939322 expref: 42 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.104885:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065215.104896:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881265324160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.104901:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8082 00000100:00100000:0.0:1746065215.104988:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265324032 00000100:00100000:0.0:1746065215.104991:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265324032 00002000:00100000:0.0:1746065215.105013:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1814527) req@ffff88013513a300 x1830881265324032/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.105020:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513a300 with x1830881265324032 ext(1048576->1814527) 00010000:00010000:0.0:1746065215.105026:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 26 pid: 3068 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.105033:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 26 pid: 3068 timeout: 911 lvb_type: 0 00002000:00010000:0.0:1746065215.105038:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013513a300 00000100:00100000:0.0:1746065215.105053:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265324288 00000100:00100000:0.0:1746065215.105055:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265324288 00002000:00100000:0.0:1746065215.105065:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2633727) req@ffff880135139f80 x1830881265324288/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.105071:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139f80 with x1830881265324288 ext(2097152->2633727) 00010000:00010000:0.0:1746065215.105074:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 42 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.105080:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 42 pid: 9549 timeout: 911 lvb_type: 0 00002000:00010000:0.0:1746065215.105085:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135139f80 00000100:00100000:0.0:1746065215.105093:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2024 00000100:00100000:0.0:1746065215.105097:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2006:x1830881265324032:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065215.105276:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2025 00000100:00100000:0.0:1746065215.105281:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881265324288:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065215.105449:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263961856:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065215.105459:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263961984:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065215.105467:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc1478a1c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938de2 expref: 43 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746065215.105481:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263962112:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065215.105501:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.105524:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263962496:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065215.105531:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.105598:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263961344:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.105609:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.105626:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263961472:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065215.105632:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.105650:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881265322880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8250us (8442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.105656:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8080 00010000:00010000:2.0:1746065215.105707:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f01400/0xad6b7ddc14791fc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2633728->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939322 expref: 41 pid: 9549 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.105716:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263962624:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.105723:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263962752:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.105731:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065215.105809:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263961728:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.105819:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263962368:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.113153:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263961600:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065215.113160:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065215.113177:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.113267:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265324416 00000100:00100000:2.0:1746065215.113273:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265324416 00010000:00010000:2.0:1746065215.113308:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 28 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.113331:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8083 00000100:00100000:2.0:1746065215.113336:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265324416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.113347:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.113373:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 28 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.113384:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 28 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.113405:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c30600/0xad6b7ddc147913f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93929d expref: 28 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.113418:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.113454:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265324416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.113459:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8083 00000100:00100000:2.0:1746065215.113489:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.113498:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265324672 00000100:00100000:2.0:1746065215.113501:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265324672 00010000:00010000:2.0:1746065215.113512:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478b96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ebb expref: 12 pid: 13375 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.113525:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8084 00000100:00100000:2.0:1746065215.113530:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265324672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.113537:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065215.113537:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065215.113546:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478b96 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ebb expref: 12 pid: 13375 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.113553:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478b96 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ebb expref: 12 pid: 13375 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746065215.113555:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065215.113566:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5200/0xad6b7ddc1478b96 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ebb expref: 12 pid: 13375 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746065215.113570:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065215.113575:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065215.113581:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265324544 00000100:00100000:0.0:1746065215.113584:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265324544 00000100:00100000:2.0:1746065215.113589:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265324672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 59us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.113594:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8084 00010000:00010000:0.0:1746065215.113598:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc1478a54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e13 expref: 21 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.113602:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265324800 00000100:00100000:2.0:1746065215.113605:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265324800 00010000:00010000:2.0:1746065215.113613:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc147917e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c7 expref: 12 pid: 9549 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746065215.113615:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8085 00000100:00100000:0.0:1746065215.113619:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265324544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065215.113624:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8086 00010000:00010000:0.0:1746065215.113625:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065215.113628:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265324800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065215.113633:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc1478a54 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e13 expref: 21 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.113634:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.113640:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc147917e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c7 expref: 12 pid: 9549 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746065215.113641:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc1478a54 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e13 expref: 21 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.113647:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc147917e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c7 expref: 12 pid: 9549 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746065215.113653:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3a00/0xad6b7ddc1478a54 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938e13 expref: 21 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.113656:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835c200/0xad6b7ddc147917e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392c7 expref: 12 pid: 9549 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.113663:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065215.113664:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.113666:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.113671:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.113673:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265324800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (103us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.113677:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8086 00010000:00010000:0.0:1746065215.113678:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.113694:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065215.113717:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265324544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.113722:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8085 00000100:00100000:2.0:1746065215.113729:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263962240:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.113745:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.113751:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.113803:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.113818:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265325184 00000100:00100000:0.0:1746065215.113821:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265325184 00010000:00010000:0.0:1746065215.113832:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f70a000/0xad6b7ddc14791c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ea expref: 31 pid: 9550 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746065215.113856:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8087 00010000:00010000:3.0:1746065215.113857:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.113861:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265325184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065215.113865:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.113867:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065215.113874:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f70a000/0xad6b7ddc14791c4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ea expref: 31 pid: 9550 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065215.113879:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.113881:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f70a000/0xad6b7ddc14791c4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ea expref: 31 pid: 9550 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065215.113885:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.113891:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.113891:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f70a000/0xad6b7ddc14791c4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9392ea expref: 31 pid: 9550 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065215.113897:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3d800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065215.113899:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.113900:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.113900:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.113902:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.113906:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.113907:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.113914:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.113918:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065215.113919:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc14792ce lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.113934:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265325184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.113940:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8087 00000100:00100000:3.0:1746065215.113957:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265323008:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 16359us (16665us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.113964:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17343 00000100:00100000:3.0:1746065215.113986:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265323776 00000100:00100000:3.0:1746065215.113996:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265323776 00002000:00100000:3.0:1746065215.114017:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (2064384->2097151) req@ffff880135138700 x1830881265323776/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.114024:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138700 with x1830881265323776 ext(2064384->2097151) 00010000:00010000:3.0:1746065215.114030:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 27 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.114038:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 27 pid: 9549 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.114043:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135138700 00000100:00100000:3.0:1746065215.114054:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265325056 00000100:00100000:3.0:1746065215.114057:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265325056 00002000:00100000:3.0:1746065215.114066:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009856df80 x1830881265325056/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.114073:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856df80 with x1830881265325056 ext(1048576->2097151) 00010000:00010000:3.0:1746065215.114077:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.114084:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.114088:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856df80 00000100:00100000:3.0:1746065215.114113:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2026 00000100:00100000:3.0:1746065215.114119:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265323776:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065215.114184:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2027 00000100:00100000:3.0:1746065215.114189:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265325056:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065215.114959:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.114968:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.114983:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.114990:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.114996:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.115001:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dd400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065215.115004:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.115010:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.115022:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.115028:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc14792c7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.115070:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265323648:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 17476us (17788us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.115078:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17342 00000100:00100000:2.0:1746065215.124155:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2006:x1830881265324032:12345-192.168.202.27@tcp:4:cat.0 Request processed in 19048us (19596us total) trans 21474841663 rc 0/0 00000100:00100000:2.0:1746065215.124165:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2024 00002000:00100000:2.0:1746065215.124175:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1814527) req@ffff88013513a300 x1830881265324032/t21474841663(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/448 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.124183:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513a300 with x1830881265324032 ext(1048576->1814527) 00010000:00010000:2.0:1746065215.124191:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 29 pid: 3068 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.124203:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 29 pid: 3068 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746065215.124210:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013513a300 00000100:00100000:3.0:1746065215.124745:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265325056:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10553us (10991us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065215.124752:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2027 00002000:00100000:3.0:1746065215.124758:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009856df80 x1830881265325056/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.124765:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856df80 with x1830881265325056 ext(1048576->2097151) 00010000:00010000:3.0:1746065215.124797:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.124806:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.124812:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856df80 00000100:00100000:3.0:1746065215.127762:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2005:x1830881265323776:12345-192.168.202.27@tcp:4:cat.0 Request processed in 13636us (14218us total) trans 21474841664 rc 0/0 00000100:00100000:3.0:1746065215.127786:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2026 00002000:00100000:3.0:1746065215.127796:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (2064384->2097151) req@ffff880135138700 x1830881265323776/t21474841664(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/448 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.127804:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138700 with x1830881265323776 ext(2064384->2097151) 00010000:00010000:3.0:1746065215.127813:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 29 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.127829:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 29 pid: 9549 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.127835:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880135138700 00000100:00100000:0.0:1746065215.129914:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.131214:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265325312 00000100:00100000:3.0:1746065215.131223:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265325312 00010000:00010000:3.0:1746065215.131253:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 29 pid: 3068 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746065215.131278:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8088 00000100:00100000:3.0:1746065215.131284:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2006:x1830881265325312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065215.131294:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065215.131313:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 29 pid: 3068 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.131324:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 29 pid: 3068 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.131342:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538c00/0xad6b7ddc14791e7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1814527) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93930d expref: 29 pid: 3068 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.131360:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.131362:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.131375:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.131387:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.131400:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265324288:12345-192.168.202.27@tcp:4:cat.0 Request processed in 26117us (26805us total) trans 17179874266 rc 0/0 00010000:00010000:3.0:1746065215.131408:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.131408:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2025 00002000:00100000:2.0:1746065215.131415:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2633727) req@ffff880135139f80 x1830881265324288/t17179874266(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/448 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065215.131423:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881265325312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 140us (1517us total) trans 0 rc 0/0 00002000:00100000:2.0:1746065215.131428:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139f80 with x1830881265324288 ext(2097152->2633727) 00000100:00100000:3.0:1746065215.131429:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8088 00010000:00010000:2.0:1746065215.131434:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 41 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.131442:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 41 pid: 9549 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746065215.131447:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880135139f80 00010000:00010000:3.0:1746065215.131469:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.131476:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.131490:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.131496:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.131503:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.131508:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c51a000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065215.131511:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.131521:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.131530:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.131536:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c51a000/0xad6b7ddc14792d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.131570:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265323264:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 32916us (33100us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.131577:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17344 00000100:00100000:0.0:1746065215.137354:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.137415:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265325440 00000100:00100000:3.0:1746065215.137424:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265325440 00010000:00010000:3.0:1746065215.137458:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 28 pid: 9549 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746065215.137496:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8089 00000100:00100000:3.0:1746065215.137503:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2004:x1830881265325440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065215.137515:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065215.137529:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 28 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.137539:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 28 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.137562:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131bee800/0xad6b7ddc14791e0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2064384->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939306 expref: 28 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.137574:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.137576:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.137580:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.137587:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.137617:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065215.137656:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2004:x1830881265325440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 154us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.137662:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8089 00010000:00010000:2.0:1746065215.138160:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.138168:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.138184:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.138189:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.138195:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.138200:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dda00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065215.138203:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.138213:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.138222:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.138227:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc14792b9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.138815:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+8:2006:x1830881265323136:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 41410us (41558us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.138824:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17340 00000100:00100000:2.0:1746065215.139435:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.139632:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.139683:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265325824 00000100:00100000:3.0:1746065215.139689:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265325824 00010000:00010000:3.0:1746065215.139711:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 41 pid: 9549 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746065215.139739:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8090 00000100:00100000:3.0:1746065215.139744:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265325824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065215.139754:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065215.139764:0:10893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065214 -> 1746065215 00002000:00010000:3.0:1746065215.139767:0:10893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065214 -> 1746065215 00002000:00010000:3.0:1746065215.139769:0:10893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065214 -> 1746065215 00010000:00010000:3.0:1746065215.139792:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 41 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.139801:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 41 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.139817:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f01a00/0xad6b7ddc14791f5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2633727] (req 2097152->2633727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93931b expref: 41 pid: 9549 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.139829:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.139831:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.139834:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.139841:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.139858:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065215.139880:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265325824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 136us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.139885:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8090 00000100:00100000:2.0:1746065215.140171:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265325696 00000100:00100000:2.0:1746065215.140175:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265325696 00000100:00100000:2.0:1746065215.140200:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14553 00000100:00100000:2.0:1746065215.140205:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+40:2407:x1830881265325696:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065215.140222:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.140234:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc14792e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393a7 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.140311:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065215.140323:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939376 expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.140334:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a800/0xad6b7ddc14792ab lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a0 expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.140545:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.140552:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.140564:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.140569:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.140579:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.140584:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065215.140587:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.140593:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.140600:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.140605:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc14792dc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.140647:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265323520:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 41958us (42104us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.140652:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17345 00010000:00010000:2.0:1746065215.140929:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 5/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065215.140953:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a800/0xad6b7ddc14792ab lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a0 expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.140963:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a800/0xad6b7ddc14792ab lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a0 expref: 23 pid: 7205 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.140972:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263962880:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.141037:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939376 expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.141045:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939376 expref: 23 pid: 7205 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.141052:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263963008:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065215.141336:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.141388:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265325952 00000100:00100000:3.0:1746065215.141392:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265325952 00010000:00010000:3.0:1746065215.141407:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746065215.141425:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8091 00000100:00100000:3.0:1746065215.141430:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265325952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065215.141440:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065215.141449:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.141456:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.141468:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc1479281 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93937d expref: 20 pid: 9550 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.141478:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.141480:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.141483:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.141488:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.141501:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065215.141520:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2007:x1830881265325952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.141525:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8091 00000100:00100000:2.0:1746065215.141617:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528240 going to sleep for 11 seconds 00010000:00010000:0.0:1746065215.141910:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.141917:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.141933:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.142331:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.142339:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.142345:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065215.142347:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.142354:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.142375:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.142381:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00c00/0xad6b7ddc14792c0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.142436:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2006:x1830881265323392:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 44983us (45167us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.142443:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17341 00000100:00100000:3.0:1746065215.142513:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.142748:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.143127:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265326080 00000100:00100000:0.0:1746065215.143131:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265326080 00000100:00100000:3.0:1746065215.143134:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.144008:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265326208 00000100:00100000:3.0:1746065215.144013:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265326208 00000100:00100000:3.0:1746065215.144088:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265326336 00000100:00100000:3.0:1746065215.144092:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265326336 00000100:00100000:2.0:1746065215.144122:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17346 00000100:00100000:2.0:1746065215.144131:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265326080:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.144145:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.144160:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009aa51600/0xad6b7ddc14792f1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393ae expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.144168:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17347 00000100:00100000:0.0:1746065215.144174:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265326208:12345-192.168.202.27@tcp:101:cat.0 00002000:00010000:2.0:1746065215.144181:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d73b, atime: 0x6812d73b, ctime: 0x6812d73b, blocks: 0x778 00010000:00010000:0.0:1746065215.144181:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.144189:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14792f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393b5 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.144195:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.144196:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00010000:0.0:1746065215.144199:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d73f, atime: 0x6812d73f, ctime: 0x6812d73f, blocks: 0x800 00010000:00010000:2.0:1746065215.144203:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa51600/0xad6b7ddc14792f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ae expref: 41 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.144205:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.144206:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.144210:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14792f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393b5 expref: 32 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.144214:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009aa51600/0xad6b7ddc14792f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ae expref: 41 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.144217:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14792f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393b5 expref: 32 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.144223:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa51600, rc 0) 00010000:00010000:0.0:1746065215.144223:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44e00, rc 0) 00000100:00100000:2.0:1746065215.144249:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265326080:12345-192.168.202.27@tcp:101:cat.0 Request processed in 120us (1737us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.144249:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265326208:12345-192.168.202.27@tcp:101:cat.0 Request processed in 75us (1502us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.144254:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17347 00000100:00100000:2.0:1746065215.144257:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17346 00000100:00100000:0.0:1746065215.144266:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17348 00000100:00100000:0.0:1746065215.144270:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265326336:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065215.144275:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.144280:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc14792ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393bc expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065215.144288:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d73f, atime: 0x6812d73f, ctime: 0x6812d73f, blocks: 0x808 00000100:00100000:2.0:1746065215.144294:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065215.144295:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.144296:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.144299:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc14792ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393bc expref: 32 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.144306:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc14792ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393bc expref: 32 pid: 11461 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065215.144307:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265326464 00000100:00100000:2.0:1746065215.144310:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265326464 00010000:00010000:0.0:1746065215.144312:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44400, rc 0) 00000100:00100000:2.0:1746065215.144325:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17349 00000100:00100000:0.0:1746065215.144325:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265326336:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (1191us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.144329:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265326464:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065215.144330:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17348 00010000:00010000:2.0:1746065215.144334:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.144341:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc1479306 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393c3 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065215.144350:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d73f, atime: 0x6812d73e, ctime: 0x6812d73f, blocks: 0x808 00010000:00010000:2.0:1746065215.144357:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.144358:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.144362:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc1479306 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393c3 expref: 42 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.144382:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc1479306 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393c3 expref: 42 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065215.144383:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065215.144389:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580f400, rc 0) 00000100:00100000:3.0:1746065215.144433:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.144442:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265326592 00000100:00100000:3.0:1746065215.144445:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265326592 00000100:00100000:3.0:1746065215.144464:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17350 00000100:00100000:3.0:1746065215.144468:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265326592:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065215.144473:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065215.144481:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b3c00/0xad6b7ddc147930d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393ca expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065215.144490:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 5034592, mtime: 0x6812d73f, atime: 0x6812d73f, ctime: 0x6812d73f, blocks: 0x1678 00010000:00010000:3.0:1746065215.144496:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.144497:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.144501:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3c00/0xad6b7ddc147930d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ca expref: 44 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.144514:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3c00/0xad6b7ddc147930d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ca expref: 44 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.144520:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3c00, rc 0) 00000100:00100000:3.0:1746065215.144534:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265326592:12345-192.168.202.27@tcp:101:cat.0 Request processed in 66us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.144538:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17350 00000100:00100000:3.0:1746065215.144561:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.144570:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265326720 00000100:00100000:3.0:1746065215.144572:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265326720 00000100:00100000:3.0:1746065215.144583:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17351 00000100:00100000:3.0:1746065215.144587:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265326720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065215.144592:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065215.144599:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479314 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393d1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065215.144609:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d73e, atime: 0x6812d73e, ctime: 0x6812d73e, blocks: 0x1008 00010000:00010000:3.0:1746065215.144615:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.144617:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.144620:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479314 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d1 expref: 33 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.144628:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479314 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d1 expref: 33 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065215.144726:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263962880:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.144767:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265327232 00000100:00100000:1.0:1746065215.144770:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265327232 00000100:00100000:1.0:1746065215.144917:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14554 00000100:00100000:1.0:1746065215.144922:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+56:2408:x1830881265327232:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065215.144934:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.144945:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147931b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393df expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.145019:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.145030:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.145035:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065215.145100:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3600, rc 0) 00000100:00100000:3.0:1746065215.145120:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265326720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 531us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.145122:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.145125:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17351 00000100:00100000:0.0:1746065215.145149:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263963008:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065215.145165:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065215.145187:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265326464:12345-192.168.202.27@tcp:101:cat.0 Request processed in 856us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.145191:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17349 00000100:00100000:0.0:1746065215.145234:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.145418:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265326976 00000100:00100000:1.0:1746065215.145421:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265326976 00010000:00010000:1.0:1746065215.145437:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a800/0xad6b7ddc14792ab lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a0 expref: 24 pid: 7205 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.145450:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265327360 00000100:00100000:1.0:1746065215.145451:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265327360 00010000:00010000:1.0:1746065215.145458:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939376 expref: 25 pid: 7205 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.145477:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8092 00000100:00100000:1.0:1746065215.145481:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+25:2004:x1830881265326976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065215.145488:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065215.145492:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a800/0xad6b7ddc14792ab lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a0 expref: 25 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.145498:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a800/0xad6b7ddc14792ab lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a0 expref: 25 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.145510:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c51a800/0xad6b7ddc14792ab lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a0 expref: 25 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.145521:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065215.145525:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065215.145530:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065215.145535:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065215.145553:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+24:2004:x1830881265326976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.145558:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8092 00000100:00100000:1.0:1746065215.145568:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8093 00000100:00100000:1.0:1746065215.145573:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+23:2004:x1830881265327360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065215.145578:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065215.145582:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939376 expref: 23 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.145589:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939376 expref: 23 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.145598:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc147927a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939376 expref: 23 pid: 7205 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.145605:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065215.145608:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065215.145614:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065215.145619:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065215.145624:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.145629:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.145633:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.145646:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065215.145661:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+22:2004:x1830881265327360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.145666:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8093 00010000:00010000:1.0:1746065215.145680:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.145686:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065215.145695:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065215.145866:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065215.145872:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065215.145881:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065215.145968:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b600/0xad6b7ddc14792e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a7 expref: 43 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.145982:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a7 expref: 42 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.145988:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065215.145990:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065215.145991:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b400, rc 0) 00000100:00100000:0.0:1746065215.146012:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+42:2407:x1830881265325696:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5807us (6381us total) trans 8589937051 rc 0/0 00000100:00100000:0.0:1746065215.146016:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14553 00010000:00010000:1.0:1746065215.146532:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147931b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393df expref: 59 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.146543:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393df expref: 58 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.146549:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065215.146551:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065215.146553:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00000, rc 0) 00000100:00100000:1.0:1746065215.146570:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+58:2408:x1830881265327232:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1648us (2186us total) trans 8589937052 rc 0/0 00000100:00100000:1.0:1746065215.146575:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14554 00000100:00100000:2.0:1746065215.146705:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.146743:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265327616 00000100:00100000:1.0:1746065215.146747:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265327616 00000100:00100000:1.0:1746065215.146768:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14555 00000100:00100000:1.0:1746065215.146789:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+22:2400:x1830881265327616:12345-192.168.202.27@tcp:36:lfs.0 00000100:00100000:2.0:1746065215.146791:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.146806:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265326848 00000100:00100000:2.0:1746065215.146808:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265326848 00000100:00100000:2.0:1746065215.146828:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17352 00000100:00100000:2.0:1746065215.146833:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2403:x1830881265326848:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065215.146835:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+22:2400:x1830881265327616:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 62us (131us total) trans 0 rc -116/-116 00010000:00010000:2.0:1746065215.146841:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065215.146841:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14555 00010000:00010000:2.0:1746065215.146854:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393d8 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.146876:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.146878:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.146883:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 20 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.146893:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 20 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.146900:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926e00, rc 0) 00000100:00100000:2.0:1746065215.146916:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2403:x1830881265326848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 83us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.146921:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17352 00000100:00100000:2.0:1746065215.156685:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.156731:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265327744 00000100:00100000:0.0:1746065215.156738:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265327744 00000100:00100000:2.0:1746065215.156808:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.157480:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17353 00000100:00100000:0.0:1746065215.157489:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2407:x1830881265327744:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065215.157502:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.157515:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393e6 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.157536:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3c00/0xad6b7ddc147930d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ca expref: 42 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.157544:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.157549:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.157551:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.157554:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3039232->3145727] (req 3039232->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 21 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.157577:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 21 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.157587:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 21 pid: 12260 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746065215.157597:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263963136:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065215.158183:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265328000 00000100:00100000:3.0:1746065215.158189:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265328000 00000100:00100000:3.0:1746065215.158218:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5447 00000100:00100000:3.0:1746065215.158223:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+22:2400:x1830881265328000:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:3.0:1746065215.158432:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+23:2400:x1830881265328000:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 207us (1623us total) trans 8589937053 rc 0/0 00000100:00100000:3.0:1746065215.158438:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5447 00010000:00010000:1.0:1746065215.158708:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b3c00/0xad6b7ddc147930d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ca expref: 42 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.158718:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b3c00/0xad6b7ddc147930d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ca expref: 42 pid: 10219 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746065215.158728:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263963264:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.158756:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065215.159361:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263963136:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065215.160145:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.160329:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.160382:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265328512 00000100:00100000:3.0:1746065215.160388:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265328512 00000100:00100000:2.0:1746065215.160410:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265328256 00000100:00100000:2.0:1746065215.160415:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265328256 00000100:00100000:3.0:1746065215.160422:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5448 00000100:00100000:3.0:1746065215.160428:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+23:2400:x1830881265328512:12345-192.168.202.27@tcp:35:lfs.0 00002000:00100000:2.0:1746065215.160443:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88009856f480 x1830881265328256/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.160452:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f480 with x1830881265328256 ext(2097152->3145727) 00010000:00010000:2.0:1746065215.160459:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 22 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.160469:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 22 pid: 12260 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746065215.160474:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856f480 00000100:00100000:2.0:1746065215.160496:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2028 00000100:00100000:2.0:1746065215.160502:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265328256:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065215.160547:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+24:2400:x1830881265328512:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 118us (217us total) trans 8589937054 rc 0/0 00000100:00100000:3.0:1746065215.160552:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5448 00000100:00100000:0.0:1746065215.160676:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.160691:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265328640 00000100:00100000:0.0:1746065215.160694:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265328640 00010000:00010000:0.0:1746065215.160707:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b3c00/0xad6b7ddc147930d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ca expref: 43 pid: 10219 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746065215.160730:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8094 00000100:00100000:0.0:1746065215.160735:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265328640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065215.160744:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065215.160753:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b3c00/0xad6b7ddc147930d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ca expref: 43 pid: 10219 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746065215.160809:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263963264:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065215.160829:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3039232->3145727] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.160839:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45c00, rc 0) 00000100:00100000:1.0:1746065215.160861:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2407:x1830881265327744:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3374us (4187us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.160868:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17353 00010000:00010000:0.0:1746065215.161054:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b3c00/0xad6b7ddc147930d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ca expref: 43 pid: 10219 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746065215.161070:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b3c00/0xad6b7ddc147930d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ca expref: 43 pid: 10219 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746065215.161082:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065215.161103:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881265328640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 368us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.161108:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8094 00000100:00100000:0.0:1746065215.166355:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.166429:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.166511:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.166612:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.166637:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265328896 00000100:00100000:2.0:1746065215.166645:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265328896 00000100:00100000:2.0:1746065215.166660:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265329152 00000100:00100000:2.0:1746065215.166662:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265329152 00002000:00100000:2.0:1746065215.166692:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008f7fc000 x1830881265329152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.166702:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fc000 with x1830881265329152 ext(1048576->2097151) 00002000:00010000:2.0:1746065215.166708:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fc000 00000100:00100000:3.0:1746065215.166818:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265329408 00000100:00100000:3.0:1746065215.166822:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265329408 00002000:00100000:3.0:1746065215.166839:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88008f7ff800 x1830881265329408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.166845:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff800 with x1830881265329408 ext(1048576->2097151) 00002000:00010000:3.0:1746065215.166848:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7ff800 00000100:00100000:2.0:1746065215.167144:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265329664 00000100:00100000:2.0:1746065215.167147:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265329664 00002000:00100000:2.0:1746065215.167162:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f7fdf80 x1830881265329664/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.167169:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fdf80 with x1830881265329664 ext(1048576->2097151) 00002000:00010000:2.0:1746065215.167172:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fdf80 00000100:00100000:2.0:1746065215.167185:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6171 00000100:00100000:2.0:1746065215.167191:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265329152:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:2.0:1746065215.167785:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88008f7fd880 x1830881265328896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.167792:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd880 with x1830881265328896 ext(0->1048575) 00002000:00010000:2.0:1746065215.167795:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd880 00000100:00100000:2.0:1746065215.167812:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6172 00000100:00100000:2.0:1746065215.167816:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265329408:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065215.167979:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6173 00000100:00100000:1.0:1746065215.167986:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265329664:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065215.168459:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6174 00000100:00100000:3.0:1746065215.168465:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265328896:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065215.168929:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265328256:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 8426us (8786us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065215.168935:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2028 00002000:00100000:1.0:1746065215.168941:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88009856f480 x1830881265328256/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065215.168948:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f480 with x1830881265328256 ext(2097152->3145727) 00010000:00010000:1.0:1746065215.168954:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 21 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.168971:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 21 pid: 12260 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746065215.168977:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856f480 00000100:00100000:0.0:1746065215.181287:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.181339:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.181404:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265329920 00000100:00100000:2.0:1746065215.181411:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265329920 00010000:00010000:2.0:1746065215.181442:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 21 pid: 12260 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.181466:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8095 00000100:00100000:2.0:1746065215.181472:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a10850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265329920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.181482:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.181499:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 21 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.181510:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 21 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.181529:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479337 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d8 expref: 21 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.181544:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.181546:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.181552:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.181559:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.181583:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 20 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.181593:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263963392:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065215.181654:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065215.182122:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265329792 00000100:00100000:1.0:1746065215.182128:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265329792 00000100:00100000:1.0:1746065215.182168:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17354 00000100:00100000:1.0:1746065215.182174:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2403:x1830881265329792:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065215.182186:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.182197:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479345 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393ed expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.182212:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.182213:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.182218:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479345 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ed expref: 28 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.182228:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479345 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ed expref: 28 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.182236:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:1.0:1746065215.182261:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2403:x1830881265329792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 87us (983us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.182381:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265329152:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15189us (15950us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065215.182389:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6171 00002000:00100000:3.0:1746065215.182398:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008f7fc000 x1830881265329152/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.182408:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fc000 with x1830881265329152 ext(1048576->2097151) 00002000:00010000:3.0:1746065215.182411:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fc000 00000100:00100000:1.0:1746065215.182460:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17354 00000100:00100000:1.0:1746065215.183532:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265329664:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15544us (16916us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065215.183542:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6173 00002000:00100000:1.0:1746065215.183548:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f7fdf80 x1830881265329664/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065215.183556:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fdf80 with x1830881265329664 ext(1048576->2097151) 00002000:00010000:1.0:1746065215.183559:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fdf80 00000100:00100000:2.0:1746065215.185351:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263963392:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065215.185377:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.185449:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a10850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265329920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3976us (4109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.185459:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8095 00000100:00100000:0.0:1746065215.189896:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.190393:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265330176 00000100:00100000:1.0:1746065215.190402:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265330176 00002000:00100000:1.0:1746065215.190439:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3039232->3043327) req@ffff88008f7fd180 x1830881265330176/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065215.190448:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd180 with x1830881265330176 ext(3039232->3043327) 00002000:00010000:1.0:1746065215.190453:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd180 00000100:00100000:1.0:1746065215.190488:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6175 00000100:00100000:1.0:1746065215.190495:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265330176:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065215.190603:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265330176:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 107us (714us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065215.190610:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6175 00002000:00100000:1.0:1746065215.190615:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3039232->3043327) req@ffff88008f7fd180 x1830881265330176/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065215.190621:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd180 with x1830881265330176 ext(3039232->3043327) 00002000:00010000:1.0:1746065215.190624:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd180 00000100:00100000:3.0:1746065215.191196:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265328896:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22730us (24848us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065215.191203:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6174 00002000:00100000:3.0:1746065215.191207:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88008f7fd880 x1830881265328896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.191214:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd880 with x1830881265328896 ext(0->1048575) 00002000:00010000:3.0:1746065215.191217:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd880 00000100:00100000:0.0:1746065215.195743:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.195943:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265330560 00000100:00100000:3.0:1746065215.195951:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265330560 00002000:00100000:3.0:1746065215.195984:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880092528e00 x1830881265330560/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.195992:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092528e00 with x1830881265330560 ext(2097152->4194303) 00002000:00010000:3.0:1746065215.195997:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092528e00 00000100:00100000:3.0:1746065215.196020:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6176 00000100:00100000:3.0:1746065215.196025:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881265330560:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065215.196509:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.197048:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265329408:12345-192.168.202.27@tcp:3:cat.0 Request processed in 29229us (30535us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065215.197056:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6172 00002000:00100000:0.0:1746065215.197062:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88008f7ff800 x1830881265329408/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.197069:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff800 with x1830881265329408 ext(1048576->2097151) 00002000:00010000:0.0:1746065215.197073:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7ff800 00000100:00100000:0.0:1746065215.197088:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265330688 00000100:00100000:0.0:1746065215.197091:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265330688 00002000:00100000:0.0:1746065215.197106:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009252aa00 x1830881265330688/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.197118:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252aa00 with x1830881265330688 ext(3145728->4194303) 00002000:00010000:0.0:1746065215.197121:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252aa00 00000100:00100000:2.0:1746065215.197374:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6177 00000100:00100000:2.0:1746065215.197383:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265330688:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065215.199743:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.199766:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265330816 00000100:00100000:1.0:1746065215.199786:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265330816 00000100:00100000:1.0:1746065215.199828:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17355 00000100:00100000:1.0:1746065215.199834:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2408:x1830881265330816:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065215.199847:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.199860:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393f4 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.199880:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009aa51600/0xad6b7ddc14792f1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ae expref: 43 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.199887:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.199888:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.199891:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [532480->790527] (req 532480->790527) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 43 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.199911:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009aa51600/0xad6b7ddc14792f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ae expref: 43 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.199920:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009aa51600/0xad6b7ddc14792f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ae expref: 43 pid: 12260 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746065215.199929:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263963520:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.199975:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065215.206611:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263963520:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065215.206639:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [532480->790527] (req 532480->790527) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 43 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.206655:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73400, rc 0) 00000100:00100000:1.0:1746065215.206707:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2408:x1830881265330816:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6871us (6968us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.206715:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17355 00000100:00100000:0.0:1746065215.211124:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.211741:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265330944 00000100:00100000:2.0:1746065215.211750:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265330944 00010000:00010000:2.0:1746065215.211801:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009aa51600/0xad6b7ddc14792f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ae expref: 43 pid: 12260 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.211834:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8096 00000100:00100000:2.0:1746065215.211840:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881265330944:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065215.211903:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265330688:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 14521us (15394us total) trans 0 rc 1048576/1048576 00010000:00010000:2.0:1746065215.211907:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065215.211910:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6177 00002000:00100000:0.0:1746065215.211917:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009252aa00 x1830881265330688/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746065215.211921:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009aa51600/0xad6b7ddc14792f1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ae expref: 43 pid: 12260 timeout: 911 lvb_type: 1 00002000:00100000:0.0:1746065215.211925:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252aa00 with x1830881265330688 ext(3145728->4194303) 00002000:00010000:0.0:1746065215.211929:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252aa00 00010000:00010000:2.0:1746065215.211931:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009aa51600/0xad6b7ddc14792f1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ae expref: 43 pid: 12260 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.211949:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009aa51600/0xad6b7ddc14792f1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ae expref: 43 pid: 12260 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.211969:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.211971:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.211977:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.211985:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.212078:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.212091:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263963648:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065215.212143:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.215651:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.216409:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265331072 00000100:00100000:1.0:1746065215.216417:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265331072 00000100:00100000:1.0:1746065215.216465:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17356 00000100:00100000:1.0:1746065215.216472:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2410:x1830881265331072:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065215.216485:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.216498:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9393fb expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.216521:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.216528:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065215.216530:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065215.216533:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 44 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.216557:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 19 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.216566:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 19 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.216576:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263963776:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.216642:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065215.217047:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881265330560:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 21020us (21311us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065215.217054:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6176 00002000:00100000:3.0:1746065215.217061:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880092528e00 x1830881265330560/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.217070:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092528e00 with x1830881265330560 ext(2097152->4194303) 00002000:00010000:3.0:1746065215.217073:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092528e00 00000100:00100000:2.0:1746065215.217209:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263963648:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065215.217222:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.217241:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881265330944:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5401us (6125us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.217247:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8096 00000100:00100000:0.0:1746065215.220898:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.221130:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263963776:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065215.221138:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265331328 00000100:00100000:3.0:1746065215.221143:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265331328 00010000:00010000:1.0:1746065215.221152:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 44 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.221165:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66e00, rc 0) 00002000:00100000:3.0:1746065215.221174:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x75:0x0] (786432->790527) req@ffff880097d07800 x1830881265331328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.221181:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07800 with x1830881265331328 ext(786432->790527) 00002000:00010000:3.0:1746065215.221184:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d07800 00000100:00100000:1.0:1746065215.221207:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+44:2410:x1830881265331072:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4735us (5563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.221210:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6178 00000100:00100000:1.0:1746065215.221214:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17356 00000100:00100000:3.0:1746065215.221216:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265331328:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065215.221350:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265331328:12345-192.168.202.27@tcp:3:cat.0 Request processed in 133us (459us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065215.221355:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6178 00002000:00100000:3.0:1746065215.221359:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x75:0x0] (786432->790527) req@ffff880097d07800 x1830881265331328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.221376:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07800 with x1830881265331328 ext(786432->790527) 00002000:00010000:3.0:1746065215.221378:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d07800 00000100:00100000:0.0:1746065215.223243:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.223276:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.223339:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.223528:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265331584 00000100:00100000:3.0:1746065215.223531:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265331456 00000100:00100000:3.0:1746065215.223533:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265331456 00000100:00100000:1.0:1746065215.223533:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265331584 00000100:00100000:2.0:1746065215.223539:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265331712 00000100:00100000:2.0:1746065215.223543:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265331712 00002000:00100000:3.0:1746065215.223562:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (3039232->3145727) req@ffff880097d07b80 x1830881265331456/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065215.223570:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17357 00000100:00100000:1.0:1746065215.223575:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2403:x1830881265331584:12345-192.168.202.27@tcp:101:cat.0 00002000:00100000:3.0:1746065215.223576:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07b80 with x1830881265331456 ext(3039232->3145727) 00000100:00100000:2.0:1746065215.223576:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17358 00000100:00100000:2.0:1746065215.223581:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2407:x1830881265331712:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065215.223583:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 21 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.223586:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.223588:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065215.223593:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 21 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.223596:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939402 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.223597:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939409 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065215.223599:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d07b80 00010000:00010000:1.0:1746065215.223612:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:3.0:1746065215.223613:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2029 00010000:00010000:2.0:1746065215.223614:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479314 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d1 expref: 32 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.223614:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065215.223617:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.223618:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265331456:12345-192.168.202.27@tcp:4:multiop.0 00010000:00010000:2.0:1746065215.223622:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479345 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ed expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.223626:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.223627:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.223628:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.223631:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2125823] (req 2097152->2125823) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.223632:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67400, rc 0) 00010000:00010000:2.0:1746065215.223656:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479345 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ed expref: 29 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065215.223659:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2403:x1830881265331584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 83us (381us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065215.223665:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479345 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ed expref: 29 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.223667:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17357 00000100:00100000:2.0:1746065215.223674:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263963904:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.223729:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479314 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d1 expref: 32 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.223737:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479314 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d1 expref: 32 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.223745:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263964032:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.223763:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.229500:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.229530:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265331840 00000100:00100000:0.0:1746065215.229536:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265331840 00010000:00010000:0.0:1746065215.229561:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479314 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d1 expref: 33 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:0.0:1746065215.229580:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8097 00000100:00100000:0.0:1746065215.229585:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265331840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065215.229593:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065215.229608:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479314 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d1 expref: 33 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746065215.229616:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479314 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d1 expref: 33 pid: 3067 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746065215.229636:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065215.229674:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265331840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 88us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.229678:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8097 00000100:00100000:2.0:1746065215.229950:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263963904:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.229959:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3600/0xad6b7ddc1479314 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393d1 expref: 32 pid: 3067 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.229972:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263964032:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.229993:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->2125823] (req 2097152->2125823) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.230006:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926800, rc 0) 00000100:00100000:2.0:1746065215.230038:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2407:x1830881265331712:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6456us (6698us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.230043:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17358 00000100:00100000:3.0:1746065215.230062:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265331456:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 6443us (6822us total) trans 17179874267 rc 0/0 00000100:00100000:3.0:1746065215.230319:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2029 00002000:00100000:3.0:1746065215.230328:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (3039232->3145727) req@ffff880097d07b80 x1830881265331456/t17179874267(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/448 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.230335:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07b80 with x1830881265331456 ext(3039232->3145727) 00010000:00010000:3.0:1746065215.230341:0:20324:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 23 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.230350:0:20324:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 23 pid: 13375 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.230356:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d07b80 00000100:00100000:2.0:1746065215.231950:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.232052:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265331968 00000100:00100000:0.0:1746065215.232058:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265331968 00010000:00010000:0.0:1746065215.232079:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479345 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ed expref: 29 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746065215.232128:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8098 00000100:00100000:0.0:1746065215.232134:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2006:x1830881265331968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065215.232142:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065215.232156:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479345 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ed expref: 29 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.232164:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479345 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ed expref: 29 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.232181:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479345 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393ed expref: 29 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.232312:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.232315:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.232321:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.232328:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.232354:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 28 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.232434:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263964160:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065215.232920:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.232920:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065215.233060:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265332096 00000100:00100000:3.0:1746065215.233063:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265332096 00010000:00010000:3.0:1746065215.233078:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 23 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746065215.233102:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8099 00000100:00100000:3.0:1746065215.233107:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265332096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065215.233114:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065215.233124:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 23 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.233133:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 23 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.233148:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45c00/0xad6b7ddc147933e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393e6 expref: 23 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.233167:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.233168:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.233172:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.233179:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.233185:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.233186:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.233189:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.233195:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.233210:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.233217:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263964288:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065215.233269:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.233281:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263964416:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065215.233299:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.237126:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.237212:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263964160:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065215.237233:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065215.237258:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263964288:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065215.237266:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263964416:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065215.237273:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881265331968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5139us (5327us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065215.237278:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.237282:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8098 00000100:00100000:3.0:1746065215.237291:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265332096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4184us (4373us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.237296:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8099 00000100:00100000:3.0:1746065215.237313:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265332352 00000100:00100000:3.0:1746065215.237317:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265332352 00002000:00100000:3.0:1746065215.237343:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2121728->2125823) req@ffff880097d06300 x1830881265332352/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.237351:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06300 with x1830881265332352 ext(2121728->2125823) 00002000:00010000:3.0:1746065215.237355:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d06300 00000100:00100000:3.0:1746065215.237376:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6179 00000100:00100000:3.0:1746065215.237381:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265332352:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065215.237462:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265332352:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 80us (343us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065215.237467:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6179 00002000:00100000:3.0:1746065215.237471:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x96:0x0] (2121728->2125823) req@ffff880097d06300 x1830881265332352/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.237477:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06300 with x1830881265332352 ext(2121728->2125823) 00002000:00010000:3.0:1746065215.237481:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d06300 00000100:00100000:0.0:1746065215.238080:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.238160:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265332608 00000100:00100000:3.0:1746065215.238163:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265332608 00002000:00100000:3.0:1746065215.238179:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880097d07480 x1830881265332608/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.238185:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07480 with x1830881265332608 ext(2097152->3145727) 00002000:00010000:3.0:1746065215.238188:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d07480 00000100:00100000:3.0:1746065215.238861:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6180 00000100:00100000:3.0:1746065215.238868:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265332608:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065215.243860:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.243924:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265332992 00000100:00100000:2.0:1746065215.243932:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265332992 00002000:00100000:2.0:1746065215.243966:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880097d04700 x1830881265332992/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.243976:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04700 with x1830881265332992 ext(3145728->4194303) 00002000:00010000:2.0:1746065215.243980:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d04700 00000100:00100000:2.0:1746065215.244011:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6181 00000100:00100000:2.0:1746065215.244017:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881265332992:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065215.244027:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.244664:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265333120 00000100:00100000:1.0:1746065215.244667:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265333120 00002000:00100000:1.0:1746065215.244684:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097d04380 x1830881265333120/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065215.244692:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04380 with x1830881265333120 ext(3145728->4194303) 00002000:00010000:1.0:1746065215.244695:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d04380 00000100:00100000:1.0:1746065215.244705:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6182 00000100:00100000:1.0:1746065215.244710:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265333120:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065215.247205:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265332608:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8329us (9117us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065215.247212:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6180 00002000:00100000:3.0:1746065215.247220:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880097d07480 x1830881265332608/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.247226:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07480 with x1830881265332608 ext(2097152->3145727) 00002000:00010000:3.0:1746065215.247229:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d07480 00000100:00100000:2.0:1746065215.255201:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881265332992:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 11175us (11339us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065215.255212:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6181 00002000:00100000:2.0:1746065215.255221:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880097d04700 x1830881265332992/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.255230:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04700 with x1830881265332992 ext(3145728->4194303) 00002000:00010000:2.0:1746065215.255235:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d04700 00000100:00100000:0.0:1746065215.257083:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.257152:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265333248 00000100:00100000:2.0:1746065215.257158:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265333248 00000100:00100000:2.0:1746065215.257187:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17359 00000100:00100000:2.0:1746065215.257192:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+32:2410:x1830881265333248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.257205:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.257301:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939410 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.257324:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 27 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.257331:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065215.257332:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065215.257335:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.257358:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 27 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.257377:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 27 pid: 12260 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.257387:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263964544:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.258150:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065215.261839:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265333120:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 17118us (17802us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065215.261850:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6182 00002000:00100000:1.0:1746065215.261860:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880097d04380 x1830881265333120/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065215.261869:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04380 with x1830881265333120 ext(3145728->4194303) 00002000:00010000:1.0:1746065215.261874:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d04380 00000100:00100000:2.0:1746065215.262377:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263964544:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.262573:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065215.262593:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.262607:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926200, rc 0) 00000100:00100000:0.0:1746065215.262628:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265333376 00000100:00100000:0.0:1746065215.262634:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265333376 00002000:00100000:0.0:1746065215.262659:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2125823) req@ffff880097fa9f80 x1830881265333376/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.262667:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa9f80 with x1830881265333376 ext(2097152->2125823) 00010000:00010000:0.0:1746065215.262672:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 28 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.262687:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 28 pid: 12260 timeout: 911 lvb_type: 0 00002000:00010000:0.0:1746065215.262693:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa9f80 00000100:00100000:2.0:1746065215.262769:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2410:x1830881265333248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5576us (5690us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.262786:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17359 00000100:00100000:0.0:1746065215.262872:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2030 00000100:00100000:0.0:1746065215.262879:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265333376:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065215.265955:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.266427:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265333504 00000100:00100000:2.0:1746065215.266435:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265333504 00000100:00100000:2.0:1746065215.266468:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17360 00000100:00100000:2.0:1746065215.266475:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2403:x1830881265333504:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.266491:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.266507:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939417 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.266527:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065215.266529:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065215.266533:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.266542:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.266550:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927200, rc 0) 00000100:00100000:2.0:1746065215.266595:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2403:x1830881265333504:12345-192.168.202.27@tcp:101:cat.0 Request processed in 120us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.266603:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17360 00000100:00100000:0.0:1746065215.268115:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2005:x1830881265333376:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 5232us (5538us total) trans 21474841665 rc 0/0 00000100:00100000:0.0:1746065215.268124:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2030 00002000:00100000:0.0:1746065215.268132:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2125823) req@ffff880097fa9f80 x1830881265333376/t21474841665(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/448 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.268140:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa9f80 with x1830881265333376 ext(2097152->2125823) 00010000:00010000:0.0:1746065215.268147:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 31 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.268158:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 31 pid: 12260 timeout: 911 lvb_type: 0 00002000:00010000:0.0:1746065215.268163:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa9f80 00000100:00100000:0.0:1746065215.272190:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.272239:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265333632 00000100:00100000:3.0:1746065215.272247:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265333632 00010000:00010000:3.0:1746065215.272276:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 31 pid: 12260 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746065215.272899:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8100 00000100:00100000:3.0:1746065215.272910:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2006:x1830881265333632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065215.272921:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065215.272933:0:9565:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065214 -> 1746065215 00002000:00010000:3.0:1746065215.272936:0:9565:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065214 -> 1746065215 00010000:00010000:3.0:1746065215.272941:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 31 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.272952:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 31 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.272971:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc1479361 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2125823) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939409 expref: 31 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.272991:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.272993:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.272999:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 32 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.273006:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 32 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.273013:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.273014:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.273017:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.273023:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.273048:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.273063:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263964672:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065215.273146:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 32 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.273195:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263964800:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065215.273217:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065215.275928:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263964672:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065215.275939:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263964800:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065215.275956:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065215.276002:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2006:x1830881265333632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3092us (3820us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.276011:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8100 00000100:00100000:0.0:1746065215.279178:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.279262:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265333888 00000100:00100000:2.0:1746065215.279270:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265333888 00002000:00100000:2.0:1746065215.279312:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800996fbb80 x1830881265333888/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.279321:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fbb80 with x1830881265333888 ext(3145728->4194303) 00002000:00010000:2.0:1746065215.279324:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996fbb80 00000100:00100000:2.0:1746065215.279420:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6183 00000100:00100000:2.0:1746065215.279428:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2005:x1830881265333888:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065215.284659:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.285214:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265334144 00000100:00100000:3.0:1746065215.285222:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265334144 00002000:00100000:3.0:1746065215.285255:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8800996fb480 x1830881265334144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.285263:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fb480 with x1830881265334144 ext(2097152->4194303) 00002000:00010000:3.0:1746065215.285267:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996fb480 00000100:00100000:3.0:1746065215.285289:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6184 00000100:00100000:3.0:1746065215.285295:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265334144:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065215.285479:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.285815:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265334400 00000100:00100000:0.0:1746065215.285819:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265334400 00002000:00100000:0.0:1746065215.285836:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091bc0a80 x1830881265334400/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.285844:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc0a80 with x1830881265334400 ext(3145728->4194303) 00002000:00010000:0.0:1746065215.285847:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc0a80 00000100:00100000:0.0:1746065215.285868:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6185 00000100:00100000:0.0:1746065215.285874:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265334400:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065215.288456:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2005:x1830881265333888:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9022us (9279us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065215.288465:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6183 00002000:00100000:2.0:1746065215.288473:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800996fbb80 x1830881265333888/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.288480:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fbb80 with x1830881265333888 ext(3145728->4194303) 00002000:00010000:2.0:1746065215.288484:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996fbb80 00000100:00100000:2.0:1746065215.297483:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265334400:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11600us (12766us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065215.297494:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6185 00002000:00100000:2.0:1746065215.297505:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091bc0a80 x1830881265334400/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.297513:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc0a80 with x1830881265334400 ext(3145728->4194303) 00002000:00010000:2.0:1746065215.297519:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc0a80 00000100:00100000:0.0:1746065215.305170:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.305205:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.305228:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.305250:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.305276:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265334528 00000100:00100000:2.0:1746065215.305284:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265334528 00000100:00100000:0.0:1746065215.305295:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265334656 00000100:00100000:0.0:1746065215.305298:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265334656 00000100:00100000:2.0:1746065215.305316:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265334784 00000100:00100000:2.0:1746065215.305318:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265334784 00000100:00100000:0.0:1746065215.305318:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265334912 00000100:00100000:0.0:1746065215.305320:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265334912 00000100:00100000:2.0:1746065215.305332:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17361 00000100:00100000:2.0:1746065215.305338:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265334528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.305352:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.305377:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479376 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93941e expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.305423:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263964928:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.305613:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.305729:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17362 00000100:00100000:0.0:1746065215.305736:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2005:x1830881265334656:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065215.305744:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.305752:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc147937d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939425 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.305764:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.305765:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.305793:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc147937d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939425 expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.305810:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc147937d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939425 expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.305820:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67800, rc 0) 00000100:00100000:0.0:1746065215.305840:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2005:x1830881265334656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 105us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.305845:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17362 00000100:00100000:0.0:1746065215.305858:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17363 00000100:00100000:0.0:1746065215.305863:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2005:x1830881265334784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065215.305868:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.305873:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93942c expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065215.305879:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17364 00010000:00010000:0.0:1746065215.305881:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.305883:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.305886:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065215.305887:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265334912:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065215.305894:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.305895:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.305900:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67200, rc 0) 00010000:00010000:1.0:1746065215.305902:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc147938b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939433 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.305911:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2005:x1830881265334784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 49us (683us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065215.305912:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.305914:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065215.305917:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17363 00010000:00010000:1.0:1746065215.305918:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc147938b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939433 expref: 25 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.305928:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc147938b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939433 expref: 25 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.305933:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2c800, rc 0) 00000100:00100000:1.0:1746065215.305950:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265334912:12345-192.168.202.27@tcp:101:cat.0 Request processed in 66us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.305955:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17364 00002000:00010000:2.0:1746065215.307329:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime: 1746065211 -> 1746065215 00002000:00010000:2.0:1746065215.307334:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime: 1746065211 -> 1746065215 00002000:00010000:2.0:1746065215.307336:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime: 1746065211 -> 1746065215 00000100:00100000:2.0:1746065215.307350:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263964928:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.307384:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479376 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93941e expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.307394:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc1479376 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93941e expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065215.307413:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265334144:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22115us (22761us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065215.307424:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6184 00002000:00100000:3.0:1746065215.307432:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8800996fb480 x1830881265334144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.307441:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fb480 with x1830881265334144 ext(2097152->4194303) 00002000:00010000:3.0:1746065215.307444:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996fb480 00010000:00010000:2.0:1746065215.307928:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926e00, rc 0) 00000100:00100000:2.0:1746065215.307954:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265334528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2616us (2791us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.307960:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17361 00000100:00100000:0.0:1746065215.315010:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.315095:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265335168 00000100:00100000:3.0:1746065215.315103:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265335168 00002000:00100000:3.0:1746065215.315136:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880091bc2680 x1830881265335168/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.315145:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc2680 with x1830881265335168 ext(4194304->5038079) 00002000:00010000:3.0:1746065215.315150:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc2680 00000100:00100000:3.0:1746065215.315177:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6186 00000100:00100000:3.0:1746065215.315183:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265335168:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065215.320241:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.320401:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265335424 00000100:00100000:3.0:1746065215.320408:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265335424 00002000:00100000:3.0:1746065215.320443:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880090dd8a80 x1830881265335424/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.320452:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8a80 with x1830881265335424 ext(4194304->5038079) 00002000:00010000:3.0:1746065215.320456:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090dd8a80 00000100:00100000:3.0:1746065215.320481:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6187 00000100:00100000:3.0:1746065215.320487:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265335424:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065215.326125:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265335168:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10933us (11113us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065215.326137:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6186 00002000:00100000:3.0:1746065215.326146:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880091bc2680 x1830881265335168/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.326155:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc2680 with x1830881265335168 ext(4194304->5038079) 00002000:00010000:3.0:1746065215.326161:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc2680 00000100:00100000:3.0:1746065215.330145:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265335424:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9649us (9903us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065215.330155:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6187 00002000:00100000:3.0:1746065215.330163:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880090dd8a80 x1830881265335424/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.330172:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8a80 with x1830881265335424 ext(4194304->5038079) 00002000:00010000:3.0:1746065215.330178:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090dd8a80 00000100:00100000:0.0:1746065215.331239:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.331801:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265335552 00000100:00100000:2.0:1746065215.331809:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265335552 00000100:00100000:2.0:1746065215.331854:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17365 00000100:00100000:2.0:1746065215.331861:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265335552:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.331874:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.331887:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d926c00/0xad6b7ddc1479392 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93943a expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.331926:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965056:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.333164:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.338393:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965056:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.338427:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d926c00/0xad6b7ddc1479392 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93943a expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.338441:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d926c00/0xad6b7ddc1479392 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93943a expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.338463:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926c00, rc 0) 00000100:00100000:2.0:1746065215.338505:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265335552:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6644us (7267us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.338512:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17365 00000100:00100000:0.0:1746065215.343746:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.344931:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265335680 00000100:00100000:2.0:1746065215.344940:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265335680 00000100:00100000:2.0:1746065215.344978:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17366 00000100:00100000:2.0:1746065215.344984:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265335680:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.344998:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.345011:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc1479399 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939441 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.345049:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965184:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.345104:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.347115:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965184:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.347140:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc1479399 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939441 expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.347151:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc1479399 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939441 expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.348510:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927c00, rc 0) 00000100:00100000:2.0:1746065215.348672:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265335680:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3684us (4931us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.348680:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17366 00000100:00100000:0.0:1746065215.400316:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.406131:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265335808 00000100:00100000:2.0:1746065215.406142:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265335808 00000100:00100000:2.0:1746065215.406199:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17367 00000100:00100000:2.0:1746065215.406207:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+43:2415:x1830881265335808:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065215.406223:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.406239:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939448 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.406264:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc1479306 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393c3 expref: 44 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.406276:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc147938b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939433 expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.406281:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.406283:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.406285:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1376256->1908735] (req 1376256->1908735) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 44 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.406309:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc147938b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939433 expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.406318:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc147938b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939433 expref: 22 pid: 13375 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.406328:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965312:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.406432:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc1479306 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393c3 expref: 44 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.406439:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc1479306 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393c3 expref: 44 pid: 13375 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.406446:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965440:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.406463:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.408584:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965312:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.408593:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965440:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.408614:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1376256->1908735] (req 1376256->1908735) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 44 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.408626:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926e00, rc 0) 00000100:00100000:2.0:1746065215.408662:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+44:2415:x1830881265335808:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2456us (8355us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.408669:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17367 00000100:00100000:0.0:1746065215.409162:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.409236:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265335936 00000100:00100000:3.0:1746065215.409241:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265335936 00010000:00010000:3.0:1746065215.409263:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc147938b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939433 expref: 23 pid: 13375 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746065215.409292:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8101 00000100:00100000:3.0:1746065215.409298:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265335936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065215.409307:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065215.409322:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc147938b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939433 expref: 23 pid: 13375 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065215.409331:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc147938b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939433 expref: 23 pid: 13375 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065215.409349:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ad2c800/0xad6b7ddc147938b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939433 expref: 23 pid: 13375 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065215.409372:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065215.409404:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265335936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 106us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.409409:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8101 00000100:00100000:0.0:1746065215.416942:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.417598:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265336064 00000100:00100000:2.0:1746065215.417607:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265336064 00010000:00010000:2.0:1746065215.417633:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc1479306 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393c3 expref: 44 pid: 13375 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.424187:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8102 00000100:00100000:2.0:1746065215.424202:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a850e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265336064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.424220:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.424240:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc1479306 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393c3 expref: 44 pid: 13375 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.424250:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc1479306 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393c3 expref: 44 pid: 13375 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.424267:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009580f400/0xad6b7ddc1479306 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393c3 expref: 44 pid: 13375 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.424281:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.424282:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.424287:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 43 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.424295:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 43 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.424316:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 43 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.424325:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263965568:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065215.427012:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.427044:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263965568:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065215.427059:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.427102:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a850e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265336064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2905us (10168us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.427112:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8102 00000100:00100000:0.0:1746065215.427436:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.427489:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265336320 00000100:00100000:3.0:1746065215.427495:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265336320 00002000:00100000:3.0:1746065215.427533:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1376256->1380351) req@ffff880091a90000 x1830881265336320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.427542:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90000 with x1830881265336320 ext(1376256->1380351) 00002000:00010000:3.0:1746065215.427546:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90000 00000100:00100000:3.0:1746065215.427562:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6188 00000100:00100000:3.0:1746065215.427569:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265336320:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065215.428020:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265336320:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 450us (583us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065215.428025:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6188 00002000:00100000:3.0:1746065215.428030:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1376256->1380351) req@ffff880091a90000 x1830881265336320/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.428036:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90000 with x1830881265336320 ext(1376256->1380351) 00002000:00010000:3.0:1746065215.428039:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a90000 00000100:00100000:1.0:1746065215.436858:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.437081:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265336576 00000100:00100000:3.0:1746065215.437090:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265336576 00002000:00100000:3.0:1746065215.437136:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1904640->1908735) req@ffff880097fa8380 x1830881265336576/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.437146:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8380 with x1830881265336576 ext(1904640->1908735) 00002000:00010000:3.0:1746065215.437152:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa8380 00000100:00100000:3.0:1746065215.437202:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6189 00000100:00100000:3.0:1746065215.437212:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265336576:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065215.437375:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265336576:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 153us (511us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065215.437381:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6189 00002000:00100000:3.0:1746065215.437387:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1904640->1908735) req@ffff880097fa8380 x1830881265336576/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.437394:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8380 with x1830881265336576 ext(1904640->1908735) 00002000:00010000:3.0:1746065215.437397:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa8380 00000100:00100000:0.0:1746065215.466382:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.467433:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265336704 00000100:00100000:2.0:1746065215.467442:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265336704 00000100:00100000:2.0:1746065215.467496:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17368 00000100:00100000:2.0:1746065215.467504:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2422:x1830881265336704:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065215.467521:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.467536:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93944f expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.467564:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.467571:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065215.467574:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065215.467577:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [880640->1023999] (req 880640->1023999) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 23 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.467600:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.467611:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 42 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.467621:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965696:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.467706:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.469599:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.469643:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.469736:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965696:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.469757:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [880640->1023999] (req 880640->1023999) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 23 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.469770:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927800, rc 0) 00000100:00100000:2.0:1746065215.469842:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2422:x1830881265336704:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2338us (3467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.469849:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17368 00000100:00100000:3.0:1746065215.469861:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265336960 00000100:00100000:3.0:1746065215.469866:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265336960 00002000:00100000:3.0:1746065215.469896:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880091a92d80 x1830881265336960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 504/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065215.469903:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265337216 00002000:00100000:3.0:1746065215.469905:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92d80 with x1830881265336960 ext(0->1048575) 00000100:00100000:1.0:1746065215.469909:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265337216 00010000:00010000:3.0:1746065215.469910:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 43 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.469920:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 44 pid: 13375 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.469930:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091a92d80 00002000:00100000:1.0:1746065215.469932:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880091a91f80 x1830881265337216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 504/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065215.469941:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91f80 with x1830881265337216 ext(1048576->2097151) 00002000:00010000:1.0:1746065215.469945:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a91f80 00000100:00100000:3.0:1746065215.469955:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2031 00000100:00100000:3.0:1746065215.469961:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+44:2006:x1830881265336960:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065215.469965:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6190 00000100:00100000:1.0:1746065215.469970:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+44:2006:x1830881265337216:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065215.472437:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.472653:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265337344 00000100:00100000:3.0:1746065215.472660:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265337344 00002000:00100000:3.0:1746065215.472688:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (532480->790527) req@ffff880097a6d180 x1830881265337344/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.472696:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d180 with x1830881265337344 ext(532480->790527) 00010000:00010000:3.0:1746065215.472703:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 47 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.472714:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 47 pid: 13375 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.472720:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a6d180 00000100:00100000:3.0:1746065215.472745:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2032 00000100:00100000:3.0:1746065215.472751:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265337344:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065215.477544:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265337216:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7564us (7891us total) trans 0 rc 516096/516096 00000100:00100000:2.0:1746065215.477555:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6190 00002000:00100000:2.0:1746065215.477564:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880091a91f80 x1830881265337216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 504/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 516096/516096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.477578:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91f80 with x1830881265337216 ext(1048576->2097151) 00002000:00010000:2.0:1746065215.477583:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a91f80 00000100:00100000:3.0:1746065215.478291:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265336960:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8328us (8697us total) trans 0 rc 790528/790528 00000100:00100000:3.0:1746065215.478297:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2031 00002000:00100000:3.0:1746065215.478303:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880091a92d80 x1830881265336960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 504/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 790528/790528 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.478309:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92d80 with x1830881265336960 ext(0->1048575) 00010000:00010000:3.0:1746065215.478316:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 47 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.478328:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 47 pid: 13375 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.478333:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091a92d80 00000100:00100000:3.0:1746065215.478446:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265337344:12345-192.168.202.27@tcp:4:cat.0 Request processed in 5695us (6013us total) trans 17179874268 rc 0/0 00000100:00100000:3.0:1746065215.478452:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2032 00002000:00100000:3.0:1746065215.478457:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (532480->790527) req@ffff880097a6d180 x1830881265337344/t17179874268(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/448 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.478463:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6d180 with x1830881265337344 ext(532480->790527) 00010000:00010000:3.0:1746065215.478467:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 45 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.478475:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 45 pid: 13375 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.478480:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a6d180 00000100:00100000:0.0:1746065215.485220:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.485384:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265337472 00000100:00100000:2.0:1746065215.485393:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265337472 00010000:00010000:2.0:1746065215.485423:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 45 pid: 13375 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.485510:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8103 00000100:00100000:2.0:1746065215.485518:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881265337472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.485532:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.485551:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 45 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.485562:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 45 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.485585:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc147934c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 532480->790527) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393f4 expref: 45 pid: 13375 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.485768:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.485770:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.485799:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.485806:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.485838:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.485848:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263965824:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065215.486203:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.488880:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263965824:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065215.488898:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.488936:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881265337472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3418us (3730us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.488944:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8103 00000100:00100000:0.0:1746065215.489812:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.489876:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.489972:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265337856 00000100:00100000:3.0:1746065215.489978:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265337856 00002000:00100000:3.0:1746065215.490008:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (880640->884735) req@ffff88009adf4000 x1830881265337856/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.490017:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4000 with x1830881265337856 ext(880640->884735) 00002000:00010000:3.0:1746065215.490021:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4000 00000100:00100000:3.0:1746065215.490036:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6191 00000100:00100000:3.0:1746065215.490041:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265337856:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065215.490144:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265337856:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 103us (269us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065215.490150:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6191 00002000:00100000:3.0:1746065215.490155:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (880640->884735) req@ffff88009adf4000 x1830881265337856/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.490162:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf4000 with x1830881265337856 ext(880640->884735) 00002000:00010000:3.0:1746065215.490165:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf4000 00000100:00100000:2.0:1746065215.490320:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265337600 00000100:00100000:2.0:1746065215.490325:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265337600 00000100:00100000:2.0:1746065215.490346:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17369 00000100:00100000:2.0:1746065215.490351:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265337600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.490359:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.490382:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d926800/0xad6b7ddc14793ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939456 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.490422:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965952:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.490837:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.493728:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.493925:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265338112 00000100:00100000:2.0:1746065215.493931:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265338112 00000100:00100000:3.0:1746065215.493956:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263965952:192.168.202.27@tcp:106: 00002000:00100000:2.0:1746065215.493973:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (1019904->1023999) req@ffff88008c45a680 x1830881265338112/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:3.0:1746065215.493982:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d926800/0xad6b7ddc14793ae lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939456 expref: 45 pid: 3067 timeout: 0 lvb_type: 1 00002000:00100000:2.0:1746065215.493987:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45a680 with x1830881265338112 ext(1019904->1023999) 00002000:00010000:2.0:1746065215.493991:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45a680 00010000:00010000:3.0:1746065215.493992:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d926800/0xad6b7ddc14793ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939456 expref: 45 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.494005:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926800, rc 0) 00000100:00100000:2.0:1746065215.494009:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6192 00000100:00100000:2.0:1746065215.494016:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265338112:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065215.494037:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265337600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3686us (4227us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065215.494043:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17369 00000100:00100000:2.0:1746065215.494110:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265338112:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 94us (387us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065215.494398:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6192 00002000:00100000:2.0:1746065215.494404:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (1019904->1023999) req@ffff88008c45a680 x1830881265338112/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.494411:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45a680 with x1830881265338112 ext(1019904->1023999) 00002000:00010000:2.0:1746065215.494414:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45a680 00000100:00100000:2.0:1746065215.504320:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.504353:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265338240 00000100:00100000:2.0:1746065215.504370:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265338240 00000100:00100000:2.0:1746065215.504405:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17370 00000100:00100000:2.0:1746065215.504412:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265338240:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.504425:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.504439:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc14793b5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93945d expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.504481:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263966080:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.505594:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.507100:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263966080:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.507127:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc14793b5 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93945d expref: 45 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.507139:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d927c00/0xad6b7ddc14793b5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93945d expref: 45 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.507162:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927c00, rc 0) 00000100:00100000:2.0:1746065215.507613:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265338240:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3196us (3296us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.507621:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17370 00000100:00100000:0.0:1746065215.513696:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.514065:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265338368 00000100:00100000:2.0:1746065215.514074:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265338368 00000100:00100000:2.0:1746065215.514321:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17371 00000100:00100000:2.0:1746065215.514329:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881265338368:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.514346:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.514370:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ae1f200/0xad6b7ddc14793bc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939464 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.514416:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263966208:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.516223:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.517998:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263966208:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.518022:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ae1f200/0xad6b7ddc14793bc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939464 expref: 45 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.518033:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae1f200/0xad6b7ddc14793bc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939464 expref: 45 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.518245:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae1f200, rc 0) 00000100:00100000:2.0:1746065215.518376:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881265338368:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4046us (4685us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.518383:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17371 00000100:00100000:0.0:1746065215.589626:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.589881:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265338496 00000100:00100000:2.0:1746065215.589891:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265338496 00000100:00100000:2.0:1746065215.589935:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17372 00000100:00100000:2.0:1746065215.589943:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265338496:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.589960:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.589976:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc14793c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93946b expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.590022:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263966336:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.590105:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00002000:00010000:2.0:1746065215.605468:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065214 -> 1746065215 00000100:00100000:2.0:1746065215.605495:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263966336:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.605525:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc14793c3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93946b expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.605538:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d927400/0xad6b7ddc14793c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93946b expref: 24 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.605696:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d927400, rc 0) 00000100:00100000:2.0:1746065215.608839:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265338496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 18887us (19210us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.608849:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17372 00000100:00100000:0.0:1746065215.611511:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.612148:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265338624 00000100:00100000:2.0:1746065215.612156:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265338624 00000100:00100000:2.0:1746065215.612188:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17373 00000100:00100000:2.0:1746065215.612193:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2427:x1830881265338624:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065215.612207:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.612221:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939472 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.612245:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc14792ff lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393bc expref: 34 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.612253:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 31 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.612258:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.612260:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.612262:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 34 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.613052:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 31 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.613064:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 31 pid: 10219 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.613075:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263966464:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.615495:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc14792ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393bc expref: 34 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.615509:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc14792ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393bc expref: 34 pid: 11461 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.615520:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092529c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263966592:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.615562:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.623357:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263966464:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.623380:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092529c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263966592:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065215.623405:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 34 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.623420:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926800, rc 0) 00000100:00100000:2.0:1746065215.623466:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2427:x1830881265338624:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11271us (11960us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.623474:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17373 00000100:00100000:0.0:1746065215.623874:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.623931:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265338752 00000100:00100000:3.0:1746065215.623937:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265338752 00010000:00010000:3.0:1746065215.623967:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc14792ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393bc expref: 34 pid: 11461 timeout: 911 lvb_type: 1 00000100:00100000:3.0:1746065215.624013:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8104 00000100:00100000:3.0:1746065215.624019:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265338752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065215.624030:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065215.624046:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc14792ff lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393bc expref: 34 pid: 11461 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065215.624054:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc14792ff lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393bc expref: 34 pid: 11461 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065215.624143:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc14792ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393bc expref: 34 pid: 11461 timeout: 911 lvb_type: 1 00010000:00010000:3.0:1746065215.624467:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065215.624493:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265338752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 474us (621us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.624499:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8104 00000100:00100000:2.0:1746065215.629454:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.629494:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.629527:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.629570:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265339136 00000100:00100000:0.0:1746065215.629578:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265339136 00002000:00100000:0.0:1746065215.629613:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880092529c00 x1830881265339136/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 504/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.629622:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529c00 with x1830881265339136 ext(0->1048575) 00002000:00010000:0.0:1746065215.629627:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092529c00 00000100:00100000:0.0:1746065215.629640:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265339392 00000100:00100000:0.0:1746065215.629643:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265339392 00002000:00100000:0.0:1746065215.629653:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880097a6e680 x1830881265339392/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.629659:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6e680 with x1830881265339392 ext(1048576->2097151) 00010000:00010000:0.0:1746065215.629665:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 32 pid: 10219 timeout: 911 lvb_type: 1 00010000:00010000:0.0:1746065215.629682:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 32 pid: 10219 timeout: 911 lvb_type: 1 00002000:00010000:0.0:1746065215.629687:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6e680 00000100:00100000:0.0:1746065215.629696:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265339264 00000100:00100000:0.0:1746065215.629698:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265339264 00002000:00100000:0.0:1746065215.629706:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880097d06680 x1830881265339264/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.629712:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06680 with x1830881265339264 ext(1048576->2097151) 00002000:00010000:0.0:1746065215.629715:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d06680 00000100:00100000:0.0:1746065215.629732:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2033 00000100:00100000:0.0:1746065215.629737:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2006:x1830881265339392:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065215.629797:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6193 00000100:00100000:2.0:1746065215.629804:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265339136:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065215.630317:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6194 00000100:00100000:0.0:1746065215.630322:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:2006:x1830881265339264:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065215.650655:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:2006:x1830881265339392:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20909us (21152us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065215.650668:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2033 00002000:00100000:2.0:1746065215.650678:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880097a6e680 x1830881265339392/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.650687:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6e680 with x1830881265339392 ext(1048576->2097151) 00010000:00010000:2.0:1746065215.650695:0:9553:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 34 pid: 10219 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.650708:0:9553:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 34 pid: 10219 timeout: 911 lvb_type: 1 00002000:00010000:2.0:1746065215.650714:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097a6e680 00000100:00100000:2.0:1746065215.659915:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2006:x1830881265339264:12345-192.168.202.27@tcp:3:cat.0 Request processed in 29583us (30377us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065215.659926:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6194 00002000:00100000:2.0:1746065215.659936:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880097d06680 x1830881265339264/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.659943:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06680 with x1830881265339264 ext(1048576->2097151) 00002000:00010000:2.0:1746065215.659949:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d06680 00000100:00100000:0.0:1746065215.661627:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.661720:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265339648 00000100:00100000:2.0:1746065215.661728:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265339648 00000100:00100000:2.0:1746065215.661762:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17374 00000100:00100000:2.0:1746065215.661768:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265339648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.661800:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.661815:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ae1f200/0xad6b7ddc14793d1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939479 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.661855:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800996f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263966720:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.663164:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065215.663283:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265339136:12345-192.168.202.27@tcp:3:cat.0 Request processed in 33477us (33834us total) trans 0 rc 905216/905216 00000100:00100000:3.0:1746065215.663291:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6193 00002000:00100000:3.0:1746065215.663299:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880092529c00 x1830881265339136/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 504/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 905216/905216 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.663307:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529c00 with x1830881265339136 ext(0->1048575) 00002000:00010000:3.0:1746065215.663311:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092529c00 00000100:00100000:0.0:1746065215.665022:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.665058:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.665067:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265339904 00000100:00100000:2.0:1746065215.665074:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265339904 00010000:00010000:2.0:1746065215.665099:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 32 pid: 10219 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746065215.665099:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265339776 00000100:00100000:1.0:1746065215.665103:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265339776 00000100:00100000:2.0:1746065215.665132:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8105 00000100:00100000:1.0:1746065215.665132:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17375 00000100:00100000:2.0:1746065215.665137:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2006:x1830881265339904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065215.665137:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265339776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.665148:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065215.665148:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.665159:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f67e00/0xad6b7ddc14793d8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939480 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.665168:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 32 pid: 10219 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746065215.665174:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.665188:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 32 pid: 10219 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.665242:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479384 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93942c expref: 32 pid: 10219 timeout: 911 lvb_type: 1 00010000:00010000:1.0:1746065215.665243:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f67e00/0xad6b7ddc14793d8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939480 expref: 34 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.665252:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f67e00/0xad6b7ddc14793d8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939480 expref: 34 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.665263:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67e00, rc 0) 00010000:00010000:2.0:1746065215.665652:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.665654:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.665660:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.665666:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.665692:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.665701:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263966848:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065215.665882:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265339776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 743us (822us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065215.665888:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17375 00000100:00100000:2.0:1746065215.665985:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.668703:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800996f9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263966720:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065215.671076:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ae1f200/0xad6b7ddc14793d1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939479 expref: 45 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.671234:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae1f200/0xad6b7ddc14793d1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939479 expref: 45 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.671250:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae1f200, rc 0) 00000100:00100000:2.0:1746065215.671309:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265339648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9539us (9685us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065215.671317:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17374 00000100:00100000:2.0:1746065215.673048:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263966848:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065215.673063:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.673105:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2006:x1830881265339904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7966us (8087us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.673115:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8105 00000100:00100000:0.0:1746065215.673389:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.674411:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265340160 00000100:00100000:3.0:1746065215.674418:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265340160 00002000:00100000:3.0:1746065215.674451:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (2088960->2093055) req@ffff880099ec4000 x1830881265340160/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.674461:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4000 with x1830881265340160 ext(2088960->2093055) 00002000:00010000:3.0:1746065215.674466:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec4000 00000100:00100000:3.0:1746065215.674520:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6195 00000100:00100000:3.0:1746065215.674526:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265340160:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065215.675914:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265340160:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 1385us (2522us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065215.675922:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6195 00002000:00100000:3.0:1746065215.675928:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (2088960->2093055) req@ffff880099ec4000 x1830881265340160/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.675936:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4000 with x1830881265340160 ext(2088960->2093055) 00002000:00010000:3.0:1746065215.675940:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec4000 00000100:00100000:0.0:1746065215.679919:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.680804:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265340288 00000100:00100000:3.0:1746065215.680813:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265340288 00000100:00100000:3.0:1746065215.680858:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17376 00000100:00100000:3.0:1746065215.680865:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2430:x1830881265340288:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065215.680879:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065215.680892:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939487 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.680915:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.680926:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065215.680928:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065215.680931:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.680952:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.680961:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 32 pid: 3067 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746065215.680971:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263966976:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065215.681028:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.681500:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.681575:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265340416 00000100:00100000:2.0:1746065215.681579:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265340416 00000100:00100000:2.0:1746065215.681599:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17377 00000100:00100000:2.0:1746065215.682905:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+44:2433:x1830881265340416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065215.682938:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.682952:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93948e expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.682980:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.682986:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065215.682988:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065215.682991:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 45 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.683012:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 22 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.683021:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 22 pid: 3067 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746065215.683031:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263967104:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065215.683087:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.684548:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.684623:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265340672 00000100:00100000:3.0:1746065215.684629:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265340672 00000100:00100000:0.0:1746065215.684650:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:3.0:1746065215.684658:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (2088960->2097151) req@ffff880099ec4700 x1830881265340672/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 8680/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.684667:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4700 with x1830881265340672 ext(2088960->2097151) 00010000:00010000:3.0:1746065215.684675:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 33 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.684685:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 33 pid: 3067 timeout: 911 lvb_type: 0 00000100:00100000:0.0:1746065215.684690:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263966976:192.168.202.27@tcp:104: 00002000:00010000:3.0:1746065215.684691:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec4700 00000100:00100000:3.0:1746065215.684704:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265340544 00000100:00100000:3.0:1746065215.684706:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265340544 00010000:00010000:0.0:1746065215.684709:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00002000:00100000:3.0:1746065215.684715:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x75:0x0] (880640->1023999) req@ffff880099ec5c00 x1830881265340544/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746065215.684721:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3de00, rc 0) 00002000:00100000:3.0:1746065215.684722:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5c00 with x1830881265340544 ext(880640->1023999) 00010000:00010000:3.0:1746065215.684726:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 23 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.684733:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 23 pid: 3067 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.684738:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec5c00 00000100:00100000:3.0:1746065215.684747:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2034 00000100:00100000:0.0:1746065215.684749:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2430:x1830881265340288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3884us (4836us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.684752:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265340672:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065215.684758:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17376 00000100:00100000:0.0:1746065215.684834:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2035 00000100:00100000:0.0:1746065215.684840:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265340544:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065215.684964:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263967104:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065215.684977:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 45 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.684986:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719800, rc 0) 00000100:00100000:1.0:1746065215.685001:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+45:2433:x1830881265340416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3397us (3504us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.685007:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17377 00000100:00100000:3.0:1746065215.687477:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265340672:12345-192.168.202.27@tcp:4:cat.0 Request processed in 2717us (2926us total) trans 21474841666 rc 0/0 00000100:00100000:3.0:1746065215.687485:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2034 00002000:00100000:3.0:1746065215.687493:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (2088960->2097151) req@ffff880099ec4700 x1830881265340672/t21474841666(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 8680/448 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.687502:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4700 with x1830881265340672 ext(2088960->2097151) 00010000:00010000:3.0:1746065215.687510:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.687520:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.687532:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec4700 00000100:00100000:0.0:1746065215.693076:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.694349:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265340800 00000100:00100000:3.0:1746065215.694367:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265340800 00010000:00010000:3.0:1746065215.694396:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746065215.694421:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8106 00000100:00100000:3.0:1746065215.694427:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265340800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065215.694439:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065215.694453:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.694462:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.694481:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d926800/0xad6b7ddc14793ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939472 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.694495:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.694497:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065215.694503:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.694510:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065215.694542:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.694552:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263967232:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065215.694606:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065215.694934:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265340544:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10093us (10282us total) trans 17179874269 rc 0/0 00000100:00100000:1.0:1746065215.694942:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2035 00002000:00100000:1.0:1746065215.694949:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (880640->1023999) req@ffff880099ec5c00 x1830881265340544/t17179874269(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/448 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065215.694961:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5c00 with x1830881265340544 ext(880640->1023999) 00010000:00010000:1.0:1746065215.694967:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 25 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.694978:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 25 pid: 3067 timeout: 911 lvb_type: 0 00002000:00010000:1.0:1746065215.694983:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec5c00 00000100:00100000:1.0:1746065215.703052:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.703146:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263967232:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065215.703161:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.703334:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265340928 00000100:00100000:2.0:1746065215.703340:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265340928 00010000:00010000:2.0:1746065215.703374:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 25 pid: 3067 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.703402:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8107 00000100:00100000:2.0:1746065215.703408:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265340928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.703418:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.703434:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 25 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.703444:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 25 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.703464:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d927800/0xad6b7ddc14793a7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 880640->1023999) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93944f expref: 25 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.703479:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.703481:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.703487:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 44 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.703495:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 44 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.703518:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 44 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.703529:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263967360:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065215.703659:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265340800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9231us (10589us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065215.703665:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8106 00000100:00100000:2.0:1746065215.704213:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065215.704518:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.704639:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265341184 00000100:00100000:2.0:1746065215.704644:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265341184 00002000:00100000:2.0:1746065215.704672:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009adf6d80 x1830881265341184/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.704681:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf6d80 with x1830881265341184 ext(1048576->2097151) 00002000:00010000:2.0:1746065215.704684:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf6d80 00000100:00100000:2.0:1746065215.704711:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6196 00000100:00100000:2.0:1746065215.704716:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2005:x1830881265341184:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065215.713088:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263967360:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065215.713110:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065215.713888:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2005:x1830881265341184:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9169us (9368us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065215.713898:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6196 00002000:00100000:3.0:1746065215.713906:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009adf6d80 x1830881265341184/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.713915:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf6d80 with x1830881265341184 ext(1048576->2097151) 00002000:00010000:3.0:1746065215.713919:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf6d80 00000100:00100000:2.0:1746065215.714100:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2007:x1830881265340928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10691us (11053us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.714107:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8107 00000100:00100000:0.0:1746065215.721565:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.721618:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.721693:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265341440 00000100:00100000:3.0:1746065215.721701:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265341440 00002000:00100000:3.0:1746065215.721736:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880099ec6d80 x1830881265341440/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.721745:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6d80 with x1830881265341440 ext(0->1048575) 00002000:00010000:3.0:1746065215.721750:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec6d80 00000100:00100000:3.0:1746065215.721809:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6197 00000100:00100000:3.0:1746065215.721816:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265341440:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065215.722494:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265341568 00000100:00100000:1.0:1746065215.722499:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265341568 00000100:00100000:1.0:1746065215.722537:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17378 00000100:00100000:1.0:1746065215.722542:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2430:x1830881265341568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065215.722551:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.722563:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939495 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.722584:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 46 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.722592:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065215.722594:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065215.722597:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.722621:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 46 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.722632:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 46 pid: 3067 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.722643:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263967488:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.723590:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065215.732287:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265341440:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10462us (10722us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065215.732297:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6197 00002000:00100000:3.0:1746065215.732306:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880099ec6d80 x1830881265341440/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.732314:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6d80 with x1830881265341440 ext(0->1048575) 00002000:00010000:3.0:1746065215.732318:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec6d80 00000100:00100000:1.0:1746065215.732406:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263967488:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065215.732433:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.732448:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31200, rc 0) 00000100:00100000:1.0:1746065215.732470:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2430:x1830881265341568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9928us (10852us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.732475:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17378 00000100:00100000:0.0:1746065215.733458:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.733516:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265341696 00000100:00100000:3.0:1746065215.733521:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265341696 00002000:00100000:3.0:1746065215.733544:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1908735) req@ffff88009077d180 x1830881265341696/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.733552:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d180 with x1830881265341696 ext(1048576->1908735) 00010000:00010000:3.0:1746065215.733558:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 45 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.733570:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 45 pid: 3067 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.733576:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009077d180 00000100:00100000:3.0:1746065215.733596:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2036 00000100:00100000:3.0:1746065215.733601:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881265341696:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065215.746425:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.746810:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265341824 00000100:00100000:1.0:1746065215.746818:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265341824 00000100:00100000:1.0:1746065215.746865:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17379 00000100:00100000:1.0:1746065215.746872:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+34:2433:x1830881265341824:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065215.746887:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.746900:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc14793f4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93949c expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.746919:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.746920:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.746926:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc14793f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93949c expref: 35 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.746940:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc14793f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93949c expref: 35 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.746948:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31400, rc 0) 00000100:00100000:1.0:1746065215.746983:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2433:x1830881265341824:12345-192.168.202.27@tcp:101:cat.0 Request processed in 112us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.746988:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17379 00000100:00100000:0.0:1746065215.753120:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265341696:12345-192.168.202.27@tcp:4:cat.0 Request processed in 19509us (19655us total) trans 17179874270 rc 0/0 00000100:00100000:0.0:1746065215.753130:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2036 00002000:00100000:0.0:1746065215.753140:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1908735) req@ffff88009077d180 x1830881265341696/t17179874270(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/448 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065215.753147:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:0.0:1746065215.753149:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d180 with x1830881265341696 ext(1048576->1908735) 00010000:00010000:0.0:1746065215.753158:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 47 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.753171:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 47 pid: 3067 timeout: 911 lvb_type: 0 00002000:00010000:0.0:1746065215.753176:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009077d180 00000100:00100000:0.0:1746065215.753194:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265342080 00000100:00100000:0.0:1746065215.753199:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265342080 00002000:00100000:0.0:1746065215.753225:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880090dd8e00 x1830881265342080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.753236:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8e00 with x1830881265342080 ext(1048576->2097151) 00002000:00010000:0.0:1746065215.753239:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd8e00 00000100:00100000:0.0:1746065215.753260:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6198 00000100:00100000:0.0:1746065215.753266:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265342080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065215.761695:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.762915:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265342208 00000100:00100000:2.0:1746065215.762923:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265342208 00010000:00010000:2.0:1746065215.762955:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 47 pid: 3067 timeout: 911 lvb_type: 0 00000100:00100000:2.0:1746065215.762998:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8108 00000100:00100000:2.0:1746065215.763006:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265342208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.763019:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.763034:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 47 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.763045:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 47 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.763065:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d926e00/0xad6b7ddc14793a0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1376256->1908735) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939448 expref: 47 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.763092:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.763094:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.763100:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.763107:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.763132:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.763143:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263967616:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065215.763227:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.765211:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265342080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11938us (12057us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065215.765221:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6198 00002000:00100000:2.0:1746065215.765230:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880090dd8e00 x1830881265342080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.765239:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8e00 with x1830881265342080 ext(1048576->2097151) 00002000:00010000:2.0:1746065215.765243:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880090dd8e00 00000100:00100000:2.0:1746065215.767280:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263967616:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065215.767299:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.767327:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265342208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4322us (5639us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.767336:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8108 00000100:00100000:0.0:1746065215.772020:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.772072:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.772163:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265342464 00000100:00100000:2.0:1746065215.772170:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265342464 00000100:00100000:2.0:1746065215.772217:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17380 00000100:00100000:2.0:1746065215.772224:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2433:x1830881265342464:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.772239:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.772251:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc14793fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394a3 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.772271:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.772272:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.772279:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc14793fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394a3 expref: 47 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.772291:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc14793fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394a3 expref: 47 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.772299:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf800, rc 0) 00000100:00100000:2.0:1746065215.772334:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+47:2433:x1830881265342464:12345-192.168.202.27@tcp:101:cat.0 Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.772343:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17380 00000100:00100000:3.0:1746065215.772561:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265342592 00000100:00100000:3.0:1746065215.772565:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265342592 00002000:00100000:3.0:1746065215.772590:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009077d880 x1830881265342592/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.772598:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d880 with x1830881265342592 ext(1048576->2097151) 00002000:00010000:3.0:1746065215.772602:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077d880 00000100:00100000:3.0:1746065215.772613:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6199 00000100:00100000:3.0:1746065215.772616:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265342592:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065215.780455:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.780578:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265342848 00000100:00100000:2.0:1746065215.780586:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265342848 00002000:00100000:2.0:1746065215.780618:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009077ca80 x1830881265342848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.780628:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ca80 with x1830881265342848 ext(1048576->2097151) 00002000:00010000:2.0:1746065215.780633:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ca80 00000100:00100000:2.0:1746065215.780651:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6200 00000100:00100000:2.0:1746065215.780657:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265342848:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065215.780928:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265342592:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8309us (8854us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065215.780935:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6199 00002000:00100000:3.0:1746065215.780940:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009077d880 x1830881265342592/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.780947:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d880 with x1830881265342592 ext(1048576->2097151) 00002000:00010000:3.0:1746065215.780950:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077d880 00000100:00100000:2.0:1746065215.801626:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265342848:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20957us (21166us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065215.801639:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6200 00002000:00100000:2.0:1746065215.801651:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009077ca80 x1830881265342848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.801659:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ca80 with x1830881265342848 ext(1048576->2097151) 00002000:00010000:2.0:1746065215.801665:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ca80 00000100:00100000:0.0:1746065215.804024:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.804063:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.804126:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265343104 00000100:00100000:2.0:1746065215.804134:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265343104 00002000:00100000:2.0:1746065215.804168:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88009077ed80 x1830881265343104/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.804176:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ed80 with x1830881265343104 ext(2097152->3145727) 00002000:00010000:2.0:1746065215.804181:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ed80 00000100:00100000:2.0:1746065215.804204:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265343360 00000100:00100000:2.0:1746065215.804206:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265343360 00002000:00100000:2.0:1746065215.804216:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009077df80 x1830881265343360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.804221:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077df80 with x1830881265343360 ext(2097152->3145727) 00002000:00010000:2.0:1746065215.804224:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077df80 00000100:00100000:2.0:1746065215.804234:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6201 00000100:00100000:2.0:1746065215.804239:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2006:x1830881265343104:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065215.805539:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6202 00000100:00100000:3.0:1746065215.805550:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2006:x1830881265343360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065215.820649:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.820894:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2006:x1830881265343104:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16653us (16874us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065215.820906:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6201 00002000:00100000:2.0:1746065215.820915:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88009077ed80 x1830881265343104/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.820924:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ed80 with x1830881265343104 ext(2097152->3145727) 00002000:00010000:2.0:1746065215.820929:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ed80 00000100:00100000:1.0:1746065215.820998:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265343488 00000100:00100000:1.0:1746065215.821006:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265343488 00000100:00100000:1.0:1746065215.821035:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17381 00000100:00100000:1.0:1746065215.821041:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2436:x1830881265343488:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065215.821053:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.821067:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394aa expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.821092:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 46 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.821099:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.821101:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.821110:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [782336->1048575] (req 782336->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.821134:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 46 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.821148:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 46 pid: 12260 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.821158:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263967744:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.821210:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.827674:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.827966:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265343616 00000100:00100000:2.0:1746065215.827974:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265343616 00000100:00100000:2.0:1746065215.828012:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17382 00000100:00100000:2.0:1746065215.828018:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2438:x1830881265343616:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065215.828034:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.828047:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394b1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.828070:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14792f8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393b5 expref: 36 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.828077:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc147937d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939425 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.828083:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.828085:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.828093:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1253376->1294335] (req 1253376->1294335) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.828117:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc147937d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939425 expref: 33 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.828126:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc147937d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939425 expref: 33 pid: 10219 timeout: 911 lvb_type: 1 00000100:00100000:1.0:1746065215.828135:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263967744:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.828136:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263967872:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065215.828156:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [782336->1048575] (req 782336->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.828165:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a600, rc 0) 00000100:00100000:1.0:1746065215.828184:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2436:x1830881265343488:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7143us (7544us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.828190:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17381 00010000:00010000:2.0:1746065215.828203:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14792f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393b5 expref: 36 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065215.828210:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14792f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393b5 expref: 36 pid: 11461 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.828217:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263968000:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065215.828234:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065215.828426:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.828451:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.828504:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265343744 00000100:00100000:0.0:1746065215.828507:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265343744 00000100:00100000:3.0:1746065215.828508:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2006:x1830881265343360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22961us (24444us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065215.828515:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6202 00010000:00010000:0.0:1746065215.828522:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 47 pid: 12260 timeout: 911 lvb_type: 0 00002000:00100000:3.0:1746065215.828523:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88009077df80 x1830881265343360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/440 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.828531:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077df80 with x1830881265343360 ext(2097152->3145727) 00002000:00010000:3.0:1746065215.828534:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077df80 00000100:00100000:0.0:1746065215.828543:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8109 00000100:00100000:0.0:1746065215.828547:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265343744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065215.828555:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065215.828567:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 47 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.828575:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 47 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.828596:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c719800/0xad6b7ddc14793e6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93948e expref: 47 pid: 12260 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.828607:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.828609:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065215.828614:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.828620:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065215.828822:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265343872 00000100:00100000:1.0:1746065215.828825:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265343872 00000100:00100000:1.0:1746065215.828852:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17383 00000100:00100000:1.0:1746065215.828857:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265343872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065215.828863:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.828869:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc1479410 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394b8 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065215.828892:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263968128:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065215.829741:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.829752:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263968256:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065215.829842:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065215.830549:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.831690:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263967872:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065215.831717:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263968000:192.168.202.27@tcp:104: 00002000:00010000:3.0:1746065215.831746:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime: 1746065215 -> 1746065216 00010000:00010000:0.0:1746065215.831746:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1253376->1294335] (req 1253376->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 36 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065215.831759:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2800, rc 0) 00000100:00100000:3.0:1746065215.831765:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263968128:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065215.831804:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+36:2438:x1830881265343616:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3784us (4136us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065215.831812:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc1479410 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b8 expref: 48 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065215.831812:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17382 00010000:00010000:3.0:1746065215.831820:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc1479410 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b8 expref: 48 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.831832:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b200, rc 0) 00000100:00100000:3.0:1746065215.831847:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265343872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2990us (3396us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065215.831853:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17383 00000100:00100000:2.0:1746065215.831942:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881263968256:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065215.831970:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.831997:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265343744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3449us (3571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.832004:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8109 00000100:00100000:0.0:1746065215.833672:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.833699:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.833725:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.833747:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265344256 00000100:00100000:0.0:1746065215.833752:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265344256 00010000:00010000:0.0:1746065215.833797:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14792f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393b5 expref: 36 pid: 11461 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.833866:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265344384 00000100:00100000:2.0:1746065215.833870:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265344384 00010000:00010000:2.0:1746065215.833883:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc147937d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939425 expref: 32 pid: 10219 timeout: 911 lvb_type: 1 00000100:00100000:2.0:1746065215.833901:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8110 00000100:00100000:2.0:1746065215.833906:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265344256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.833915:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.833928:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14792f8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393b5 expref: 36 pid: 11461 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.833937:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14792f8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393b5 expref: 36 pid: 11461 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.833967:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44e00/0xad6b7ddc14792f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393b5 expref: 36 pid: 11461 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.833982:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065215.834010:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265344256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065215.834016:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8110 00000100:00100000:2.0:1746065215.834027:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8111 00000100:00100000:2.0:1746065215.834032:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2007:x1830881265344384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065215.834040:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065215.834045:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc147937d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939425 expref: 32 pid: 10219 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.834053:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc147937d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939425 expref: 32 pid: 10219 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.834062:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f67800/0xad6b7ddc147937d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939425 expref: 32 pid: 10219 timeout: 911 lvb_type: 1 00010000:00010000:2.0:1746065215.834070:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.834071:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065215.834076:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 34 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.834082:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 34 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065215.834106:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 34 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.834116:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263968384:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065215.834162:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065215.834293:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265344128 00000100:00100000:3.0:1746065215.834297:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265344128 00002000:00100000:3.0:1746065215.834320:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (782336->786431) req@ffff88009077c380 x1830881265344128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.834328:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c380 with x1830881265344128 ext(782336->786431) 00002000:00010000:3.0:1746065215.834331:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077c380 00000100:00100000:3.0:1746065215.834343:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6203 00000100:00100000:3.0:1746065215.834348:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265344128:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065215.834477:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265344128:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 129us (808us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065215.834496:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6203 00002000:00100000:3.0:1746065215.834501:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (782336->786431) req@ffff88009077c380 x1830881265344128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.834507:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077c380 with x1830881265344128 ext(782336->786431) 00002000:00010000:3.0:1746065215.834510:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077c380 00000100:00100000:0.0:1746065215.841098:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.841135:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.841163:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.841182:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265344640 00000100:00100000:0.0:1746065215.841189:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265344640 00000100:00100000:0.0:1746065215.841410:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265344512 00000100:00100000:0.0:1746065215.841414:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265344512 00000100:00100000:1.0:1746065215.841438:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265344768 00000100:00100000:1.0:1746065215.841442:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265344768 00000100:00100000:1.0:1746065215.841615:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17384 00000100:00100000:1.0:1746065215.841623:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2436:x1830881265344640:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065215.841639:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.841654:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394c6 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.841680:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 35 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.841687:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065215.841689:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065215.841692:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->1458175] (req 1048576->1458175) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.841716:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 35 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.841726:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.841737:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263968512:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.841818:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.841888:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17385 00000100:00100000:0.0:1746065215.841893:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265344512:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065215.841900:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.841908:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc147941e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394bf expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.841931:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263968640:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065215.841953:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.842071:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17386 00000100:00100000:0.0:1746065215.842076:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265344768:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065215.842082:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065215.842087:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc1479425 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394cd expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.842104:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263968768:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065215.842123:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.842148:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881263968384:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065215.842160:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065215.842172:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2007:x1830881265344384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8140us (8447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065215.842179:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8111 00000100:00100000:0.0:1746065215.843010:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.843933:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265345024 00000100:00100000:2.0:1746065215.843939:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265345024 00002000:00100000:2.0:1746065215.843969:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1253376->1257471) req@ffff880134b01180 x1830881265345024/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.844011:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01180 with x1830881265345024 ext(1253376->1257471) 00010000:00010000:2.0:1746065215.844017:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 37 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.844027:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 37 pid: 3067 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746065215.844033:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b01180 00000100:00100000:2.0:1746065215.844061:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2037 00000100:00100000:2.0:1746065215.844067:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265345024:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065215.844167:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265345024:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 100us (1158us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065215.844173:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2037 00002000:00100000:2.0:1746065215.844178:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1253376->1257471) req@ffff880134b01180 x1830881265345024/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.844184:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01180 with x1830881265345024 ext(1253376->1257471) 00010000:00010000:2.0:1746065215.844188:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 37 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.844196:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 37 pid: 3067 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746065215.844201:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b01180 00002000:00010000:0.0:1746065215.844370:0:12260:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime: 1746065215 -> 1746065216 00002000:00010000:0.0:1746065215.844373:0:12260:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime: 1746065215 -> 1746065216 00000100:00100000:0.0:1746065215.844384:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263968640:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065215.844405:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc147941e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394bf expref: 47 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.844413:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31c00/0xad6b7ddc147941e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394bf expref: 47 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.844424:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31c00, rc 0) 00000100:00100000:0.0:1746065215.844444:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265344512:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2551us (3309us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065215.844449:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17385 00002000:00010000:0.0:1746065215.844508:0:13375:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065215 -> 1746065216 00002000:00010000:0.0:1746065215.844511:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065215 -> 1746065216 00002000:00010000:0.0:1746065215.844512:0:13375:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065215 -> 1746065216 00000100:00100000:0.0:1746065215.844519:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b02d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263968768:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065215.844531:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc1479425 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394cd expref: 36 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.844538:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc1479425 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394cd expref: 36 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.844545:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30c00, rc 0) 00000100:00100000:0.0:1746065215.844559:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265344768:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2484us (3396us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065215.844564:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17386 00000100:00100000:1.0:1746065215.844829:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263968512:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065215.844843:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->1458175] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 32 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.844856:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a800, rc 0) 00000100:00100000:1.0:1746065215.844884:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2436:x1830881265344640:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3262us (3794us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065215.844889:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17384 00000100:00100000:0.0:1746065215.845522:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.845864:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265345152 00000100:00100000:1.0:1746065215.845868:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265345152 00000100:00100000:1.0:1746065215.845933:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17387 00000100:00100000:1.0:1746065215.845940:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2007:x1830881265345152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065215.845949:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.845959:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc147942c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394d4 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065215.845992:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263968896:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065215.846529:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.849172:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065215.849201:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.849254:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265345280 00000100:00100000:2.0:1746065215.849260:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265345280 00000100:00100000:0.0:1746065215.849517:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263968896:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065215.849543:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc147942c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394d4 expref: 33 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.849554:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71aa00/0xad6b7ddc147942c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394d4 expref: 33 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065215.849567:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71aa00, rc 0) 00000100:00100000:0.0:1746065215.849596:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2007:x1830881265345152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3657us (4075us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065215.849606:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17387 00000100:00100000:0.0:1746065215.849621:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17388 00000100:00100000:0.0:1746065215.849626:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265345280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065215.849637:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065215.850045:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265345536 00000100:00100000:3.0:1746065215.850050:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265345536 00002000:00100000:3.0:1746065215.850076:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1290240->1294335) req@ffff880134b02680 x1830881265345536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.850085:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02680 with x1830881265345536 ext(1290240->1294335) 00010000:00010000:3.0:1746065215.850091:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.850101:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.850107:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b02680 00000100:00100000:3.0:1746065215.850119:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2038 00000100:00100000:3.0:1746065215.850124:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265345536:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065215.850205:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265345536:12345-192.168.202.27@tcp:3:cat.0 Request processed in 80us (1002us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065215.850209:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2038 00002000:00100000:3.0:1746065215.850214:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1290240->1294335) req@ffff880134b02680 x1830881265345536/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065215.850225:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02680 with x1830881265345536 ext(1290240->1294335) 00010000:00010000:3.0:1746065215.850229:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.850236:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00002000:00010000:3.0:1746065215.850241:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b02680 00010000:00010000:0.0:1746065215.850902:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479433 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394db expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065215.850945:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263969024:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065215.851001:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.855333:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.855614:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265345664 00000100:00100000:2.0:1746065215.855622:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265345664 00000100:00100000:2.0:1746065215.855667:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17389 00000100:00100000:2.0:1746065215.855674:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2007:x1830881265345664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065215.855688:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065215.855701:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc147943a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394e2 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065215.855747:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263969152:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065215.855851:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.856353:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.857453:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265345920 00000100:00100000:2.0:1746065215.857459:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265345920 00002000:00100000:2.0:1746065215.857487:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1253376->1294335) req@ffff88009a6dd180 x1830881265345920/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065215.857495:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dd180 with x1830881265345920 ext(1253376->1294335) 00010000:00010000:2.0:1746065215.857501:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:2.0:1746065215.857512:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 35 pid: 3067 timeout: 911 lvb_type: 0 00002000:00010000:2.0:1746065215.857518:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6dd180 00000100:00100000:1.0:1746065215.858301:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263969024:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065215.858324:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479433 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394db expref: 47 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.858336:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479433 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394db expref: 47 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065215.858370:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31a00, rc 0) 00000100:00100000:1.0:1746065215.858405:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265345280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8777us (9237us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065215.858416:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17388 00000100:00100000:2.0:1746065215.859339:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2039 00000100:00100000:2.0:1746065215.859349:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265345920:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065215.859805:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263969152:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065215.859826:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc147943a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394e2 expref: 33 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.859835:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc147943a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394e2 expref: 33 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.859845:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3a00, rc 0) 00000100:00100000:3.0:1746065215.859864:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2007:x1830881265345664:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4191us (4539us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065215.859870:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17389 00000100:00100000:0.0:1746065215.863402:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265345920:12345-192.168.202.27@tcp:4:cat.0 Request processed in 4048us (7042us total) trans 21474841667 rc 0/0 00000100:00100000:0.0:1746065215.863412:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2039 00002000:00100000:0.0:1746065215.863422:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1253376->1294335) req@ffff88009a6dd180 x1830881265345920/t21474841667(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:131/0 lens 488/448 e 0 to 0 dl 1746065226 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.863431:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dd180 with x1830881265345920 ext(1253376->1294335) 00010000:00010000:0.0:1746065215.863439:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 37 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:0.0:1746065215.863453:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 37 pid: 3067 timeout: 911 lvb_type: 0 00002000:00010000:0.0:1746065215.863459:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6dd180 00000100:00100000:0.0:1746065215.879639:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.879725:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265346048 00000100:00100000:3.0:1746065215.879733:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265346048 00000100:00100000:3.0:1746065215.879798:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17390 00000100:00100000:3.0:1746065215.879805:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2004:x1830881265346048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065215.879820:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065215.879833:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136166e00/0xad6b7ddc1479441 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394e9 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065215.879878:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263969280:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065215.879954:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20ee3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.880571:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.880690:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265346176 00000100:00100000:2.0:1746065215.880694:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265346176 00010000:00010000:2.0:1746065215.880714:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 37 pid: 3067 timeout: 911 lvb_type: 0 00000100:00100000:1.0:1746065215.882005:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8112 00000100:00100000:1.0:1746065215.882015:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265346176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065215.882026:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065215.882043:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 37 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.882054:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 37 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:1.0:1746065215.882074:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.882076:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065215.882081:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.882088:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.882111:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 33 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065215.882119:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263969408:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065215.882188:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065215.887368:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065215.887378:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263969408:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065215.887394:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065215.887394:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265346560 00000100:00100000:0.0:1746065215.887398:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265346560 00002000:00100000:0.0:1746065215.887431:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1454080->1458175) req@ffff88009a6dc000 x1830881265346560/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/0 e 0 to 0 dl 1746065226 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065215.887441:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265346176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5428us (6870us total) trans 0 rc 0/0 00002000:00100000:0.0:1746065215.887447:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881265346560 ext(1454080->1458175) 00000100:00100000:1.0:1746065215.887450:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8112 00002000:00010000:0.0:1746065215.887451:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dc000 00000100:00100000:0.0:1746065215.887474:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6204 00000100:00100000:0.0:1746065215.887480:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:2004:x1830881265346560:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065215.887566:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+34:2004:x1830881265346560:12345-192.168.202.27@tcp:3:cat.0 Request processed in 87us (215us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065215.887571:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6204 00002000:00100000:0.0:1746065215.887575:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1454080->1458175) req@ffff88009a6dc000 x1830881265346560/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:131/0 lens 488/4536 e 0 to 0 dl 1746065226 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065215.887582:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881265346560 ext(1454080->1458175) 00002000:00010000:0.0:1746065215.887585:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dc000 00010000:00010000:3.0:1746065215.887655:0:13375:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff880099cf1180 x1830881263969280) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 36 pid: 3067 timeout: 911 lvb_type: 0 00010000:00010000:3.0:1746065215.887675:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc1479409 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1253376->1294335) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394b1 expref: 36 pid: 3067 timeout: 911 lvb_type: 0 00000100:00100000:3.0:1746065215.887688:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263969280:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065215.887709:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136166e00/0xad6b7ddc1479441 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394e9 expref: 33 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.887718:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136166e00/0xad6b7ddc1479441 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394e9 expref: 33 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065215.887723:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166e00, rc 0) 00000100:00100000:3.0:1746065215.887754:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2004:x1830881265346048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7950us (8123us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065215.887759:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17390 00000100:00100000:0.0:1746065215.981658:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.982074:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265346688 00000100:00100000:2.0:1746065215.982083:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265346688 00000100:00100000:1.0:1746065215.983364:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14556 00000100:00100000:1.0:1746065215.983376:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+24:2446:x1830881265346688:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065215.983396:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065215.983443:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc1479448 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394f0 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.983489:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147944f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.983499:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147944f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.983510:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147944f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.983520:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc1479456 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.983525:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc1479456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.983530:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc1479456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.983581:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.983590:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a7 expref: 41 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.983601:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393df expref: 57 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.983606:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 5/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065215.983629:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393df expref: 57 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.983640:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393df expref: 57 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065215.983649:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263969536:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065215.986050:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a7 expref: 41 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065215.986063:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a7 expref: 41 pid: 7205 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065215.986076:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263969664:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.987443:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065215.989526:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263969536:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065215.989538:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263969664:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065215.989555:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065215.989696:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065215.990862:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265346944 00000100:00100000:3.0:1746065215.990868:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265346944 00000100:00100000:3.0:1746065215.991319:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5449 00000100:00100000:3.0:1746065215.991326:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+58:27241:x1830881265346944:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065215.992261:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065215.992388:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265347200 00000100:00100000:2.0:1746065215.992391:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265347200 00000100:00100000:2.0:1746065215.992413:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5450 00000100:00100000:2.0:1746065215.992418:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+42:8521:x1830881265347200:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065215.992496:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+43:8521:x1830881265347200:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 77us (235us total) trans 8589937056 rc 0/0 00000100:00100000:2.0:1746065215.992502:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5450 00000100:00100000:3.0:1746065215.992549:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+59:27241:x1830881265346944:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 1224us (2853us total) trans 8589937055 rc 0/0 00000100:00100000:3.0:1746065215.992554:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5449 00000100:00100000:1.0:1746065216.001798:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.001971:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265347328 00000100:00100000:0.0:1746065216.001979:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265347328 00010000:00010000:0.0:1746065216.002009:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393df expref: 59 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746065216.002506:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8113 00000100:00100000:0.0:1746065216.002515:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+59:2005:x1830881265347328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065216.002528:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065216.002533:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393df expref: 59 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.002548:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393df expref: 59 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.002565:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00000/0xad6b7ddc1479322 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393df expref: 59 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.002579:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065216.002583:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.002589:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.002593:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 13 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.002597:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065216.002645:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+58:2005:x1830881265347328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 131us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.002651:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8113 00000100:00100000:0.0:1746065216.003483:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.003845:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265347456 00000100:00100000:2.0:1746065216.003849:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265347456 00010000:00010000:2.0:1746065216.003867:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a7 expref: 43 pid: 7205 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.003885:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8114 00000100:00100000:2.0:1746065216.003889:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+43:2005:x1830881265347456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065216.003898:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065216.003902:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a7 expref: 43 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.003909:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a7 expref: 43 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.003921:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc14792ea lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393a7 expref: 43 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.003937:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.003940:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.003948:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.003953:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.003976:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065216.003999:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+42:2005:x1830881265347456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.004004:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8114 00010000:00010000:1.0:1746065216.004109:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004115:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:1.0:1746065216.004154:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:1.0:1746065216.004158:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065216.004174:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004182:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004192:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147944f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004196:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147944f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004201:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147944f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004206:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147944f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004210:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065216.004214:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147944f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004218:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147944f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004228:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065216.004231:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065216.004233:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147944f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004237:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147944f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004248:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc1479456 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004252:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc1479456 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004255:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc1479456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004259:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065216.004261:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc1479456 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004265:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc1479456 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004269:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097b72000) 00010000:00010000:1.0:1746065216.004271:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065216.004273:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc1479456 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004277:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc1479456 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.004300:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71bc00/0xad6b7ddc1479448 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394f0 expref: 26 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.004311:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394f0 expref: 25 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.004315:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065216.004317:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065216.004319:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71ba00, rc 0) 00000100:00100000:1.0:1746065216.004342:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+25:2446:x1830881265346688:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 20969us (22693us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.004347:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14556 00000100:00100000:0.0:1746065216.006824:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.006853:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.006906:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.006931:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265347584 00000100:00100000:0.0:1746065216.006936:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265347584 00000100:00100000:0.0:1746065216.006967:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265347712 00000100:00100000:0.0:1746065216.006969:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265347712 00000100:00100000:0.0:1746065216.006977:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265347840 00000100:00100000:0.0:1746065216.006979:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265347840 00000100:00100000:0.0:1746065216.006988:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17391 00000100:00100000:0.0:1746065216.006994:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+8:2006:x1830881265347584:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065216.007007:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.007019:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc1479464 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394f7 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.007054:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263969792:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065216.007116:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.007133:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17392 00000100:00100000:0.0:1746065216.007138:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265347712:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065216.007144:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.007152:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147946b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9394fe expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.007172:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263969920:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065216.007189:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.007211:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17393 00000100:00100000:0.0:1746065216.007215:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265347840:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065216.007221:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.007226:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1479472 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939505 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.007235:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.007236:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.007242:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1479472 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939505 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.007254:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1479472 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939505 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.007262:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31600, rc 0) 00000100:00100000:0.0:1746065216.007280:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265347840:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 64us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.007286:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17393 00000100:00100000:0.0:1746065216.009287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.010449:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.012287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.012633:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265347968 00000100:00100000:1.0:1746065216.012640:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265347968 00000100:00100000:1.0:1746065216.012678:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265348096 00000100:00100000:1.0:1746065216.012681:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265348096 00000100:00100000:1.0:1746065216.012694:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265348224 00000100:00100000:1.0:1746065216.012696:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265348224 00000100:00100000:1.0:1746065216.012710:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17394 00000100:00100000:1.0:1746065216.012716:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265347968:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065216.012732:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065216.012745:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc1479479 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93950c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.012765:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.012767:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.012789:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc1479479 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93950c expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.012804:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc1479479 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93950c expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.012814:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b600, rc 0) 00000100:00100000:1.0:1746065216.012851:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265347968:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 135us (3569us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.012856:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17394 00000100:00100000:1.0:1746065216.012870:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17395 00000100:00100000:1.0:1746065216.012875:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265348096:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065216.012880:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065216.012886:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1479480 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939513 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.012896:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.012897:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.012901:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1479480 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939513 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.012908:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1479480 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939513 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.012913:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71aa00, rc 0) 00000100:00100000:1.0:1746065216.012927:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265348096:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 52us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.012932:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17395 00000100:00100000:1.0:1746065216.012940:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17396 00000100:00100000:1.0:1746065216.012944:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265348224:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065216.012952:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065216.012960:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479487 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93951a expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.012970:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.012971:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.012975:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93951a expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.012983:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93951a expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.012988:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a000, rc 0) 00000100:00100000:1.0:1746065216.013001:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265348224:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 56us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.013006:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17396 00000100:00100000:1.0:1746065216.013078:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263969920:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065216.013098:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147946b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394fe expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.013106:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147946b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394fe expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.013114:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30e00, rc 0) 00000100:00100000:1.0:1746065216.013129:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265347712:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 5991us (6275us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065216.013136:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17392 00000100:00100000:1.0:1746065216.013224:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263969792:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065216.013237:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc1479464 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394f7 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.013244:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc1479464 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394f7 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.013250:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31000, rc 0) 00000100:00100000:1.0:1746065216.013264:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265347584:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 6270us (6446us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065216.013268:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17391 00000100:00100000:0.0:1746065216.026762:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.026871:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265348480 00000100:00100000:3.0:1746065216.026879:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265348480 00000100:00100000:3.0:1746065216.026924:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14557 00000100:00100000:3.0:1746065216.026930:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+25:2446:x1830881265348480:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065216.026944:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.026958:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147948e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939521 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.027047:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479495 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.027059:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394f0 expref: 26 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.027065:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479495 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.027089:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394f0 expref: 26 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.027098:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394f0 expref: 26 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.027108:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263970048:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.031087:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065216.035140:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263970048:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.035166:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479495 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065216.040848:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.041598:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265348608 00000100:00100000:2.0:1746065216.041606:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265348608 00010000:00010000:2.0:1746065216.041636:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394f0 expref: 27 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.041660:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8115 00000100:00100000:2.0:1746065216.041666:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+27:2004:x1830881265348608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065216.041677:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065216.041681:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394f0 expref: 27 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.041691:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394f0 expref: 27 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.041712:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147945d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394f0 expref: 27 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.041737:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.041742:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479495 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.041750:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479495 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.041756:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479495 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.041786:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065216.041828:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+26:2004:x1830881265348608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 161us (986us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.041834:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8115 00010000:00010000:2.0:1746065216.041858:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479495 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.041864:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479495 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065216.041879:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065216.041972:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880136167800/0xad6b7ddc147948e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939521 expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.041984:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479495 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939521 expref: 26 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.041993:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.041995:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065216.041996:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906d0a00, rc 0) 00000100:00100000:2.0:1746065216.042016:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+26:2446:x1830881265348480:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 15087us (15263us total) trans 8589937057 rc 0/0 00000100:00100000:2.0:1746065216.042022:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14557 00000100:00100000:0.0:1746065216.048299:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.048423:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265348864 00000100:00100000:2.0:1746065216.048430:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265348864 00000100:00100000:2.0:1746065216.048658:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14558 00000100:00100000:2.0:1746065216.048665:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+26:2446:x1830881265348864:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065216.048683:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065216.048685:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065216.048706:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479495 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939521 expref: 26 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.048718:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.048721:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065216.048729:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc14794a3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939528 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.048830:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc14794aa lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.048841:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc14794aa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.048847:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc14794aa lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065216.048857:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065216.048928:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc14794a3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939528 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.048939:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc14794aa lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939528 expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.048945:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.048947:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065216.048949:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3c00, rc 0) 00000100:00100000:2.0:1746065216.048984:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+27:2446:x1830881265348864:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 319us (693us total) trans 8589937058 rc 0/0 00000100:00100000:2.0:1746065216.048989:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14558 00000100:00100000:0.0:1746065216.051320:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.051750:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265348992 00000100:00100000:1.0:1746065216.051757:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265348992 00000100:00100000:1.0:1746065216.051831:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14559 00000100:00100000:1.0:1746065216.051837:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+27:2446:x1830881265348992:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065216.051855:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065216.051866:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc14794b8 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93952f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.051906:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc14794b8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93952f expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.051916:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc14794b8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93952f expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.051933:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065216.051936:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065216.051938:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b000, rc 0) 00000100:00100000:1.0:1746065216.051975:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+28:2446:x1830881265348992:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 137us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.051980:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14559 00000100:00100000:0.0:1746065216.053688:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.054004:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.054029:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.054328:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.054409:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.054427:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265349248 00000100:00100000:2.0:1746065216.054433:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265349248 00000100:00100000:2.0:1746065216.054472:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265349504 00000100:00100000:2.0:1746065216.054474:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265349504 00000100:00100000:2.0:1746065216.054486:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265349760 00000100:00100000:2.0:1746065216.054488:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265349760 00000100:00100000:2.0:1746065216.054496:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265349120 00000100:00100000:2.0:1746065216.054498:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265349120 00000100:00100000:2.0:1746065216.054509:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17397 00000100:00100000:2.0:1746065216.054514:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265349248:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065216.054543:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054557:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054568:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065216.054569:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065216.054572:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 4/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054595:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054605:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 31 pid: 3067 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.054615:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263970176:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065216.054676:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.054693:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17398 00000100:00100000:2.0:1746065216.054698:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265349504:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065216.054715:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054724:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054730:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc1479479 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93950c expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.054736:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc14793fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394a3 expref: 45 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054740:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.054742:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.054744:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054757:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc14793fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394a3 expref: 45 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054764:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc14793fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394a3 expref: 45 pid: 3067 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.054786:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263970304:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.054813:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc1479479 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93950c expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.054820:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc1479479 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93950c expref: 11 pid: 9549 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746065216.054827:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263970432:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.054847:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054854:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 25 pid: 12260 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.054867:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263970560:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065216.054882:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.054894:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17399 00000100:00100000:2.0:1746065216.054899:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265349760:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065216.054915:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054925:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 35 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054931:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479487 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93951a expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.054937:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054942:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.054943:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.054945:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054958:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.054965:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 31 pid: 12260 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.054971:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263970688:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.054994:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93951a expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.055000:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93951a expref: 11 pid: 9549 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746065216.055007:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263970816:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.055026:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 35 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.055033:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 35 pid: 12260 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.055040:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263970944:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065216.055054:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065216.055110:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17400 00000100:00100000:1.0:1746065216.055118:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265349120:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065216.055132:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.055140:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.055144:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065216.055145:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065216.055147:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.055160:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.055166:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 25 pid: 12260 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.055172:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263971072:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065216.055190:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.055423:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.055623:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265349376 00000100:00100000:3.0:1746065216.055627:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265349376 00000100:00100000:3.0:1746065216.055922:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265349632 00000100:00100000:3.0:1746065216.055925:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265349632 00000100:00100000:1.0:1746065216.056075:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17401 00000100:00100000:1.0:1746065216.056081:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265349376:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065216.056096:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.056106:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.056113:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1479472 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939505 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.056119:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc14793f4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93949c expref: 35 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.056124:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.056125:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.056127:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.056139:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc14793f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93949c expref: 35 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.056146:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc14793f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93949c expref: 35 pid: 12260 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.056153:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263971200:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065216.056198:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1479472 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939505 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.056205:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1479472 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939505 expref: 12 pid: 9549 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746065216.056212:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263971328:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065216.056230:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 31 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.056237:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 31 pid: 3067 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.056243:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263971456:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065216.056253:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065216.056493:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17402 00000100:00100000:3.0:1746065216.056500:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265349632:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065216.056514:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.056523:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 45 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.056530:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1479480 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939513 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.056536:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.056540:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.056541:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.056543:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.056557:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 25 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.056568:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 25 pid: 13375 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.056576:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263971584:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.056597:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1479480 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939513 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.056603:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1479480 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939513 expref: 12 pid: 9549 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746065216.056610:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263971712:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.056624:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 45 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.056631:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 45 pid: 13375 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.056638:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263971840:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.056649:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.057998:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263970304:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.058557:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881263970176:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.058572:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.066273:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.066292:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265350272 00000100:00100000:0.0:1746065216.066298:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265350272 00010000:00010000:0.0:1746065216.066323:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 26 pid: 12260 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.066410:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263970432:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065216.066421:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263970560:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.066446:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065216.066517:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263970688:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.066525:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263970816:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.066532:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263970944:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.066545:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.066590:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8116 00000100:00100000:0.0:1746065216.066597:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a850ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881265350272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065216.066607:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065216.066621:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 26 pid: 12260 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.066627:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881263971072:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065216.066630:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 26 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.066640:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.066647:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc14793ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939495 expref: 26 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.066672:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065216.066714:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a850ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265350272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.066720:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8116 00000100:00100000:0.0:1746065216.066787:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.066799:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265350528 00000100:00100000:0.0:1746065216.066802:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265350528 00010000:00010000:0.0:1746065216.066817:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93951a expref: 13 pid: 9549 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.066832:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8117 00000100:00100000:0.0:1746065216.066836:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265350528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065216.066844:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065216.066853:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479487 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93951a expref: 13 pid: 9549 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.066860:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479487 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93951a expref: 13 pid: 9549 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.066870:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479487 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93951a expref: 13 pid: 9549 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.066877:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065216.066890:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265350528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.066895:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8117 00000100:00100000:0.0:1746065216.066934:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.067114:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265350784 00000100:00100000:2.0:1746065216.067118:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265350784 00002000:00100000:2.0:1746065216.067140:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (782336->1048575) req@ffff880090ddad80 x1830881265350784/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.067147:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddad80 with x1830881265350784 ext(782336->1048575) 00010000:00010000:2.0:1746065216.067152:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 25 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.067161:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 25 pid: 12260 timeout: 912 lvb_type: 0 00002000:00010000:2.0:1746065216.067166:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090ddad80 00000100:00100000:2.0:1746065216.067183:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2040 00000100:00100000:2.0:1746065216.067188:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265350784:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065216.072624:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.072643:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.072659:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.072703:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263971328:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065216.072734:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263971456:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065216.072792:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.072810:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.072826:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265350144 00000100:00100000:1.0:1746065216.072831:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265350144 00010000:00010000:1.0:1746065216.072859:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc1479479 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93950c expref: 13 pid: 9549 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746065216.072878:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265350400 00000100:00100000:1.0:1746065216.072880:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265350400 00010000:00010000:1.0:1746065216.072889:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 32 pid: 12260 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.072899:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265350656 00000100:00100000:1.0:1746065216.072901:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265350656 00010000:00010000:1.0:1746065216.072909:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 36 pid: 12260 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.072918:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8118 00000100:00100000:1.0:1746065216.072923:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265350144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.072933:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.072949:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc1479479 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93950c expref: 13 pid: 9549 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.072957:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc1479479 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93950c expref: 13 pid: 9549 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.072975:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71b600/0xad6b7ddc1479479 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93950c expref: 13 pid: 9549 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.072994:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.073024:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265350144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 100us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.073030:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8118 00000100:00100000:1.0:1746065216.073041:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265350912 00000100:00100000:1.0:1746065216.073043:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265350912 00010000:00010000:1.0:1746065216.073050:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1479472 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939505 expref: 12 pid: 9549 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746065216.073058:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8119 00000100:00100000:1.0:1746065216.073062:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2007:x1830881265350400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.073067:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.073075:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 32 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073082:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 32 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073091:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d927200/0xad6b7ddc147936f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939417 expref: 32 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073098:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.073110:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2007:x1830881265350400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.073114:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8119 00000100:00100000:1.0:1746065216.073123:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8120 00000100:00100000:1.0:1746065216.073126:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881265350656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.073131:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.073136:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 36 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073142:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 36 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073151:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d926200/0xad6b7ddc1479368 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939410 expref: 36 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073158:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.073159:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.073163:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.073168:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.073184:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.073196:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265350656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 69us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.073200:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8120 00000100:00100000:1.0:1746065216.073208:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8121 00000100:00100000:1.0:1746065216.073212:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265350912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.073218:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.073225:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1479472 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939505 expref: 12 pid: 9549 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.073231:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1479472 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939505 expref: 12 pid: 9549 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.073239:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc1479472 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939505 expref: 12 pid: 9549 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.073246:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.073259:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265350912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.073263:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8121 00000100:00100000:1.0:1746065216.073305:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.073317:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265351168 00000100:00100000:1.0:1746065216.073319:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265351168 00010000:00010000:1.0:1746065216.073328:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 31 pid: 3067 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.073340:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8122 00000100:00100000:1.0:1746065216.073344:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2004:x1830881265351168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.073349:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.073365:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 31 pid: 3067 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073372:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 31 pid: 3067 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073385:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc14793df lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939487 expref: 31 pid: 3067 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073393:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.073406:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881265351168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 62us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.073410:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8122 00000100:00100000:1.0:1746065216.073447:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.073456:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265350016 00000100:00100000:1.0:1746065216.073459:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265350016 00010000:00010000:1.0:1746065216.073467:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc14793fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394a3 expref: 46 pid: 3067 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.073478:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8123 00000100:00100000:1.0:1746065216.073482:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265350016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.073487:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.073492:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc14793fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394a3 expref: 46 pid: 3067 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073499:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc14793fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394a3 expref: 46 pid: 3067 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073509:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf800/0xad6b7ddc14793fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394a3 expref: 46 pid: 3067 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.073520:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.073521:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.073524:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.073529:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.073540:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065216.073667:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.073674:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.073687:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.073693:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.073699:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.073708:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065216.073711:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.073717:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.073726:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.073731:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc14794c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065216.077589:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265349504:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 22881us (23576us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.077601:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17398 00000100:00100000:2.0:1746065216.078005:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265349888 00000100:00100000:2.0:1746065216.078011:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265349888 00002000:00100000:2.0:1746065216.078037:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1458175) req@ffff88012b4e8000 x1830881265349888/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.078046:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e8000 with x1830881265349888 ext(1048576->1458175) 00010000:00010000:2.0:1746065216.078052:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 30 pid: 3067 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.078062:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 30 pid: 3067 timeout: 912 lvb_type: 0 00002000:00010000:2.0:1746065216.078068:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b4e8000 00000100:00100000:2.0:1746065216.078091:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2041 00000100:00100000:2.0:1746065216.078098:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881265349888:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065216.078654:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.078690:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.078704:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265351040 00000100:00100000:0.0:1746065216.078708:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265351040 00010000:00010000:0.0:1746065216.078722:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1479480 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939513 expref: 11 pid: 9549 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.078738:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265351296 00000100:00100000:0.0:1746065216.078740:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265351296 00010000:00010000:0.0:1746065216.078748:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 29 pid: 13375 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746065216.078759:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8124 00000100:00100000:0.0:1746065216.078765:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265351040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065216.078784:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065216.078796:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1479480 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939513 expref: 11 pid: 9549 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.078826:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1479480 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939513 expref: 11 pid: 9549 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.078844:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065216.078863:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265351040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.078869:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8124 00000100:00100000:0.0:1746065216.078880:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8125 00000100:00100000:0.0:1746065216.078885:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2007:x1830881265351296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065216.078891:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065216.078897:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 29 pid: 13375 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.078904:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 29 pid: 13375 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.078913:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065216.078925:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2007:x1830881265351296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.078930:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8125 00000100:00100000:0.0:1746065216.079106:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2007:x1830881265350784:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11917us (12171us total) trans 17179874271 rc 0/0 00000100:00100000:0.0:1746065216.079111:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2040 00002000:00100000:0.0:1746065216.079117:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (782336->1048575) req@ffff880090ddad80 x1830881265350784/t17179874271(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/448 e 0 to 0 dl 1746065227 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.079123:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddad80 with x1830881265350784 ext(782336->1048575) 00010000:00010000:0.0:1746065216.079128:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 27 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.079135:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 27 pid: 12260 timeout: 912 lvb_type: 0 00002000:00010000:0.0:1746065216.079140:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090ddad80 00010000:00010000:0.0:1746065216.079205:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.079213:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.079226:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.079232:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.079238:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.079247:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065216.079250:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.079256:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.079264:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.079269:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489000/0xad6b7ddc14794cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.079310:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265349760:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 24411us (25280us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.079316:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17399 00010000:00010000:3.0:1746065216.080522:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f67400/0xad6b7ddc147935a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939402 expref: 26 pid: 13375 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.080539:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263971584:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.080552:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc1479480 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939513 expref: 10 pid: 9549 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746065216.080559:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263971712:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.080568:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263971840:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.080591:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065216.080708:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265350016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7223us (7258us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.080715:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8123 00000100:00100000:0.0:1746065216.082406:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.082474:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265351424 00000100:00100000:1.0:1746065216.082479:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265351424 00010000:00010000:1.0:1746065216.082501:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 45 pid: 13375 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.082530:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8126 00000100:00100000:1.0:1746065216.082536:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881265351424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.082546:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.082560:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 45 pid: 13375 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.082568:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 45 pid: 13375 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.082589:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f66e00/0xad6b7ddc1479353 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9393fb expref: 45 pid: 13375 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.082599:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.082601:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.082604:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.082611:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.083763:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.083790:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.083806:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.083813:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.083818:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.083823:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065216.083826:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.083831:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.083840:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065216.083885:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265349632:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 27384us (28461us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.083891:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17402 00010000:00010000:1.0:1746065216.084011:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc14794e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.084027:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.084040:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265351424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1505us (1639us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.084045:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8126 00000100:00100000:0.0:1746065216.086030:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.086208:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263971200:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065216.086230:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065216.086460:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265351552 00000100:00100000:1.0:1746065216.086465:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265351552 00010000:00010000:1.0:1746065216.086490:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 26 pid: 12260 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.086751:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8127 00000100:00100000:1.0:1746065216.086759:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265351552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.086769:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.086969:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 26 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.086979:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 26 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.086995:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc1479402 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 782336->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394aa expref: 26 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.087005:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.087007:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.087011:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.087019:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.087040:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.087068:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265351552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 310us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.087074:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8127 00010000:00010000:2.0:1746065216.087211:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.087218:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.087232:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.087238:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.087243:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.087248:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71bc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065216.087251:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.087256:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.087268:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.087273:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc14794d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.088315:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.089065:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265351680 00000100:00100000:1.0:1746065216.089071:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265351680 00010000:00010000:1.0:1746065216.089089:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc14793f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93949c expref: 35 pid: 12260 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.089109:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8128 00000100:00100000:1.0:1746065216.089114:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265351680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.089124:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.089134:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc14793f4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93949c expref: 35 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.089142:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc14793f4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93949c expref: 35 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.089155:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc14793f4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93949c expref: 35 pid: 12260 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.089165:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.089166:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.089169:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.089175:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.089189:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.089213:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265351680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.089219:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8128 00000100:00100000:2.0:1746065216.089299:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2007:x1830881265349120:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 34182us (34970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.089306:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17400 00010000:00010000:0.0:1746065216.090439:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.090452:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.090466:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.090472:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.090478:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.090484:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71ba00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065216.090487:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.090493:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.090503:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.090939:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc14794db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.090986:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265349376:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 34904us (36575us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.090993:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17401 00000100:00100000:2.0:1746065216.092181:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2004:x1830881265349888:12345-192.168.202.27@tcp:4:cat.0 Request processed in 13929us (19233us total) trans 21474841668 rc 0/0 00000100:00100000:2.0:1746065216.092190:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2041 00002000:00100000:2.0:1746065216.092199:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1458175) req@ffff88012b4e8000 x1830881265349888/t21474841668(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/448 e 0 to 0 dl 1746065227 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.092207:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e8000 with x1830881265349888 ext(1048576->1458175) 00010000:00010000:2.0:1746065216.092213:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 32 pid: 3067 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.092224:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 32 pid: 3067 timeout: 912 lvb_type: 0 00002000:00010000:2.0:1746065216.092229:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b4e8000 00000001:00080000:0.0:1746065216.092937:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841667 is committed 00000001:00080000:0.0:1746065216.092948:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841665 is committed 00000001:00080000:0.0:1746065216.092995:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841647 is committed 00000100:00100000:0.0:1746065216.096870:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.096977:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265351808 00000100:00100000:3.0:1746065216.096985:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265351808 00010000:00010000:3.0:1746065216.097339:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 8 pid: 3067 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.097378:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8129 00000100:00100000:3.0:1746065216.097384:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265351808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065216.097396:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.097411:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 8 pid: 3067 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.097421:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 8 pid: 3067 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.097440:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a800/0xad6b7ddc1479417 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1458175) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9394c6 expref: 8 pid: 3067 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.097743:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.097745:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.097750:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.097758:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.097993:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.098416:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2007:x1830881265351808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1030us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.098423:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8129 00010000:00010000:0.0:1746065216.098642:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.098650:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.098668:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.098673:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.098680:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.098685:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136167800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065216.098689:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.098695:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.098709:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.098715:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136167800/0xad6b7ddc14794bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.098792:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+8:2007:x1830881265349248:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 44257us (45087us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.098800:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17397 00010000:00010000:2.0:1746065216.101270:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065216.108951:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.110206:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265352064 00000100:00100000:2.0:1746065216.110215:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265352064 00000100:00100000:2.0:1746065216.110263:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14560 00000100:00100000:2.0:1746065216.110270:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+28:2446:x1830881265352064:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:2.0:1746065216.110309:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065216.110330:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc14794b8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93952f expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.110347:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.110350:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065216.110382:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.110394:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1478878 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d2c expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.110401:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc14788a2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d3a expref: 57 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.110407:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cdf expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.110412:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 41 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.110418:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc1478824 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ced expref: 57 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.110423:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478e1a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939043 expref: 41 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.110432:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1478e67 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939066 expref: 57 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.110437:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 10/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.110461:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1478e67 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939066 expref: 57 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.110471:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1478e67 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939066 expref: 57 pid: 7205 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.110483:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263971968:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.112807:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478e1a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939043 expref: 41 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.112821:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478e1a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939043 expref: 41 pid: 7205 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.112833:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972096:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.113900:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc1478824 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ced expref: 57 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.113912:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc1478824 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ced expref: 57 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.113921:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972224:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.113982:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 41 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.113989:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 41 pid: 7231 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.113996:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972352:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.114021:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cdf expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.114027:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cdf expref: 41 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.114034:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972480:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.114054:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc14788a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d3a expref: 57 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.114061:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc14788a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d3a expref: 57 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.114068:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984da680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972608:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.114088:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1478878 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d2c expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.114094:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1478878 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d2c expref: 41 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.114105:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972736:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065216.114118:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edbe40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065216.116034:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dad80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263971968:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065216.117153:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.118164:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265352320 00000100:00100000:3.0:1746065216.118172:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265352320 00000100:00100000:3.0:1746065216.119579:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5451 00000100:00100000:3.0:1746065216.119590:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+58:30397:x1830881265352320:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065216.120632:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+59:30397:x1830881265352320:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 1042us (3480us total) trans 8589937059 rc 0/0 00000100:00100000:3.0:1746065216.120640:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5451 00000100:00100000:3.0:1746065216.120887:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972096:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065216.128301:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.128974:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972224:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065216.129401:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.129419:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.129971:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972352:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.129979:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972480:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.129986:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984da680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972608:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.129991:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984daa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263972736:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.130030:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:2.0:1746065216.130082:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265352576 00000100:00100000:2.0:1746065216.130088:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265352576 00000100:00100000:2.0:1746065216.130120:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5452 00000100:00100000:2.0:1746065216.130125:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4111050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+42:8521:x1830881265352576:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065216.130394:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.130498:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4111050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+43:8521:x1830881265352576:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 372us (2208us total) trans 8589937060 rc 0/0 00000100:00100000:2.0:1746065216.130504:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5452 00000100:00100000:3.0:1746065216.131011:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265352960 00000100:00100000:3.0:1746065216.131015:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265352960 00010000:00010000:3.0:1746065216.131031:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cdf expref: 43 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.131049:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265352704 00000100:00100000:3.0:1746065216.131051:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265352704 00010000:00010000:3.0:1746065216.131059:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc1478824 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ced expref: 59 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.131080:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265353216 00000100:00100000:3.0:1746065216.131082:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265353216 00010000:00010000:3.0:1746065216.131089:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1478878 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d2c expref: 44 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.131102:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8130 00000100:00100000:3.0:1746065216.131107:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+44:2004:x1830881265352960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065216.131115:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.131119:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cdf expref: 44 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.131127:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cdf expref: 44 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.131142:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc1478816 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938cdf expref: 44 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.131154:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.131158:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.131166:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.131183:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+43:2004:x1830881265352960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 76us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.131188:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8130 00000100:00100000:3.0:1746065216.131217:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8131 00000100:00100000:3.0:1746065216.131221:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+59:2005:x1830881265352704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065216.131227:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.131230:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc1478824 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ced expref: 59 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.131237:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc1478824 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ced expref: 59 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.131246:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b4a25800/0xad6b7ddc1478824 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ced expref: 59 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.131253:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.131256:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.131260:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.131273:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+58:2005:x1830881265352704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.131278:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8131 00000100:00100000:3.0:1746065216.131288:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8132 00000100:00100000:3.0:1746065216.131292:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+42:2004:x1830881265353216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065216.131297:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.131300:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1478878 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d2c expref: 42 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.131307:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1478878 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d2c expref: 42 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.131315:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1478878 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d2c expref: 42 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.131321:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.131324:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.131329:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.131338:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+41:2004:x1830881265353216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.131342:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8132 00000100:00100000:0.0:1746065216.131485:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.131557:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.131953:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.131997:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265352832 00000100:00100000:2.0:1746065216.132000:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265352832 00010000:00010000:2.0:1746065216.132013:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 41 pid: 7231 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.132027:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265353088 00000100:00100000:2.0:1746065216.132028:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265353088 00010000:00010000:2.0:1746065216.132035:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc14788a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d3a expref: 58 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.132044:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8133 00000100:00100000:2.0:1746065216.132048:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+41:2004:x1830881265352832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065216.132054:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065216.132057:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 41 pid: 7231 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.132063:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 41 pid: 7231 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.132073:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7200/0xad6b7ddc147881d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938ce6 expref: 41 pid: 7231 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.132081:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.132084:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.132089:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065216.132103:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+40:2004:x1830881265352832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.132107:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8133 00000100:00100000:2.0:1746065216.132118:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8134 00000100:00100000:2.0:1746065216.132121:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+58:2004:x1830881265353088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065216.132127:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065216.132130:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc14788a2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d3a expref: 58 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.132135:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc14788a2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d3a expref: 58 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.132144:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb2400/0xad6b7ddc14788a2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd938d3a expref: 58 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.132151:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.132153:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.132160:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065216.132172:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+57:2004:x1830881265353088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.132177:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8134 00000100:00100000:1.0:1746065216.132478:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265353344 00000100:00100000:1.0:1746065216.132481:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265353344 00010000:00010000:1.0:1746065216.132493:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1478e67 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939066 expref: 57 pid: 7205 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.132507:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8135 00000100:00100000:1.0:1746065216.132512:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+57:2004:x1830881265353344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.132517:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.132520:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1478e67 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939066 expref: 57 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.132526:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1478e67 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939066 expref: 57 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.132535:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1478e67 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939066 expref: 57 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.132557:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065216.132560:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065216.132564:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.132583:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+56:2004:x1830881265353344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.132588:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8135 00000100:00100000:0.0:1746065216.136024:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.136216:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265353472 00000100:00100000:2.0:1746065216.136227:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265353472 00010000:00010000:2.0:1746065216.136261:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478e1a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939043 expref: 40 pid: 7205 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.136297:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8136 00000100:00100000:2.0:1746065216.136304:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+40:2006:x1830881265353472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065216.136316:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065216.136321:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478e1a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939043 expref: 40 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.136331:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478e1a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939043 expref: 40 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.136348:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc1478e1a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939043 expref: 40 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.136368:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.136373:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.136381:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.136389:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065216.136419:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065216.136458:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+39:2006:x1830881265353472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 154us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.136465:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8136 00010000:00010000:3.0:1746065216.136573:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.136579:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000040:00080000:3.0:1746065216.136980:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1047, 88 off99976 00000004:00080000:3.0:1746065216.136988:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812155214222ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.137013:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1064, 88 off101472 00000004:00080000:3.0:1746065216.137017:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812155243700ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.137035:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1065, 88 off101560 00000004:00080000:3.0:1746065216.137037:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812155263957ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.137046:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1048, 88 off100064 00000004:00080000:3.0:1746065216.137049:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812155275222ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.137056:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1049, 88 off100152 00000004:00080000:3.0:1746065216.137058:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812155284590ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.137065:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1066, 88 off101648 00000004:00080000:3.0:1746065216.137068:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812155294318ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.137075:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1067, 88 off101736 00000004:00080000:3.0:1746065216.137078:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812155304630ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.137085:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1068, 88 off101824 00000004:00080000:3.0:1746065216.137088:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812155314403ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.137095:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1050, 88 off100240 00000004:00080000:3.0:1746065216.137098:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812155324882ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.137105:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1069, 88 off101912 00000004:00080000:3.0:1746065216.137107:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812155333600ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.137113:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1051, 88 off100328 00000004:00080000:3.0:1746065216.137115:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812155341625ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.137121:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1070, 88 off102000 00000004:00080000:3.0:1746065216.137123:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812155349425ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.137130:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1052, 88 off100416 00000004:00080000:3.0:1746065216.137132:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812155358348ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.137156:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1053, 88 off100504 00000004:00080000:3.0:1746065216.137158:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812155384700ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.137166:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1054, 88 off100592 00000004:00080000:3.0:1746065216.137169:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812155395277ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.137177:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1055, 88 off100680 00000004:00080000:3.0:1746065216.137179:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812155405538ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.137188:0:9571:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1071, 88 off102088 00000004:00080000:3.0:1746065216.137191:0:9571:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812155417415ns, next at 761143559853ns, rc = 0 00000001:00080000:0.0:1746065216.141352:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937061 is committed 00000004:00080000:0.0:1746065216.141368:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1050 committed 00000004:00080000:0.0:1746065216.141375:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1036 committed 00000004:00080000:0.0:1746065216.141379:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1035 committed 00000004:00080000:0.0:1746065216.141380:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1034 committed 00000004:00080000:0.0:1746065216.141382:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1033 committed 00000004:00080000:0.0:1746065216.141383:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1049 committed 00000004:00080000:0.0:1746065216.141386:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1032 committed 00000004:00080000:0.0:1746065216.141387:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1048 committed 00000004:00080000:0.0:1746065216.141388:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1031 committed 00000004:00080000:0.0:1746065216.141390:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1047 committed 00000004:00080000:0.0:1746065216.141391:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1046 committed 00000004:00080000:0.0:1746065216.141393:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1045 committed 00000004:00080000:0.0:1746065216.141394:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1030 committed 00000004:00080000:0.0:1746065216.141395:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1029 committed 00000004:00080000:0.0:1746065216.141396:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1044 committed 00000004:00080000:0.0:1746065216.141397:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1043 committed 00000004:00080000:0.0:1746065216.141398:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1028 committed 00000001:00080000:0.0:1746065216.141402:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937060 is committed 00000001:00080000:0.0:1746065216.141406:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937059 is committed 00000004:00010000:3.0:1746065216.141576:0:9571:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88009856d500 reply state ffff880135112000 transno 8589937061 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.141593:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.141600:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.141603:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065216.141607:0:9571:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746065216.141679:0:9571:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065216.141691:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2446:x1830881265352064:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 31419us (32745us total) trans 8589937061 rc 0/0 00000100:00100000:3.0:1746065216.141699:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14560 00010000:00010000:3.0:1746065216.141720:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.141726:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.141730:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.141734:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065216.141737:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.141742:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.141748:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.141750:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065216.141752:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.141755:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc14794e9 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00000100:00100000:2.0:1746065216.141987:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263972992:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.142031:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142072:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263973504:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.142088:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142099:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263974016:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065216.142113:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142142:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263974528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065216.142157:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142171:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:2.0:1746065216.142176:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263973120:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.142190:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142199:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263973632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.142211:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142221:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263974144:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065216.142231:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142240:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263974656:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065216.142252:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142271:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263972992 00000100:00100000:2.0:1746065216.142277:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263972992 00000100:00100000:2.0:1746065216.142306:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263973504 00000100:00100000:2.0:1746065216.142308:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263973504 00000100:00100000:2.0:1746065216.142316:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263974016 00000100:00100000:2.0:1746065216.142318:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263974016 00000100:00100000:2.0:1746065216.142327:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263974528 00000100:00100000:2.0:1746065216.142328:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263974528 00000100:00100000:2.0:1746065216.142334:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263973120 00000100:00100000:2.0:1746065216.142335:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263973120 00000100:00100000:2.0:1746065216.142340:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263973632 00000100:00100000:2.0:1746065216.142341:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263973632 00000100:00100000:2.0:1746065216.142346:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263974144 00000100:00100000:2.0:1746065216.142347:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263974144 00000100:00100000:2.0:1746065216.142351:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263974656 00000100:00100000:2.0:1746065216.142352:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263974656 00000100:00100000:2.0:1746065216.142370:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17403 00000100:00100000:2.0:1746065216.142375:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263972992:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065216.142397:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17404 00000100:00100000:0.0:1746065216.142403:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263973504:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1746065216.142446:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746065216.142449:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065216.142459:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17405 00000100:00100000:2.0:1746065216.142463:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263974016:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065216.142478:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3759:x1830881263973504:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (388us total) trans 17179874272 rc 0/0 00000100:00100000:0.0:1746065216.142483:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17404 00000100:00100000:0.0:1746065216.142492:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17406 00000100:00100000:0.0:1746065216.142496:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263974528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065216.142505:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17407 00000100:00100000:0.0:1746065216.142508:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263973120:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.142529:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263974016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (414us total) trans 21474841669 rc 0/0 00000100:00100000:2.0:1746065216.142534:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17405 00000100:00100000:2.0:1746065216.142542:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17408 00000100:00100000:2.0:1746065216.142546:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3759:x1830881263973632:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065216.142548:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3759:x1830881263973120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (357us total) trans 17179874274 rc 0/0 00000100:00100000:0.0:1746065216.142553:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17407 00000100:00100000:0.0:1746065216.142560:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17409 00000100:00100000:0.0:1746065216.142563:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263974144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065216.142585:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065216.142587:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065216.142589:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065216.142591:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065216.142593:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:0.0:1746065216.142601:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263974144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 36us (368us total) trans 21474841670 rc 0/0 00000100:00100000:0.0:1746065216.142604:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17409 00000100:00100000:2.0:1746065216.142610:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+10:3759:x1830881263973632:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (398us total) trans 17179874275 rc 0/0 00000100:00100000:0.0:1746065216.142611:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17410 00000100:00100000:0.0:1746065216.142614:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881263974656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065216.142615:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17408 00000004:00080000:2.0:1746065216.142640:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa4380/2, rc 0, transno 17179874274 00000100:00100000:2.0:1746065216.142647:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263973120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065216.142648:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263974656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 32us (394us total) trans 21474841671 rc 0/0 00000100:00100000:0.0:1746065216.142652:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17410 00000004:00080000:2.0:1746065216.142654:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa6680/2, rc 0, transno 17179874275 00000100:00100000:2.0:1746065216.142657:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263973632:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.142664:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841647 gen 2 00000004:00080000:2.0:1746065216.142667:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad7b80, transno 21474841643 00000004:00080000:2.0:1746065216.142671:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d9f80, transno 21474841644 00000004:00080000:2.0:1746065216.142673:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad6a00, transno 21474841645 00000004:00080000:2.0:1746065216.142675:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad7800, transno 21474841646 00000004:00080000:2.0:1746065216.142677:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984db480, transno 21474841647 00000100:00100000:2.0:1746065216.142681:0:3759:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012dc3f100 x1830881263974144/t21474841670(21474841670) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065232 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:2.0:1746065216.142687:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3f100/2, rc 0, transno 21474841670 00002000:00010000:0.0:1746065216.142689:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00000100:00100000:2.0:1746065216.142690:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263974144:0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065216.142692:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065216.142693:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00000004:00080000:2.0:1746065216.142695:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b64a80/2, rc 0, transno 21474841671 00002000:00010000:0.0:1746065216.142695:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065216.142696:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:2.0:1746065216.142697:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263974656:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065216.142702:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa5c00/2, rc 0, transno 17179874272 00000100:00100000:2.0:1746065216.142705:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263973504:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065216.142710:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ca80/2, rc 0, transno 21474841669 00000100:00100000:0.0:1746065216.142710:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263974528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 214us (553us total) trans 21474841672 rc 0/0 00000100:00100000:2.0:1746065216.142712:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263974016:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065216.142714:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17406 00000004:00080000:2.0:1746065216.142718:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b65c00/2, rc 0, transno 21474841672 00000100:00100000:2.0:1746065216.142720:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263974528:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065216.142750:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263972992:12345-0@lo:2:osp-syn-1-0.0 Request processed in 375us (719us total) trans 17179874273 rc 0/0 00000100:00100000:2.0:1746065216.142754:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17403 00000100:00100000:3.0:1746065216.142761:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263972864:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065216.142768:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa5880/2, rc 0, transno 17179874273 00000100:00100000:2.0:1746065216.142771:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263972992:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065216.142799:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142817:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263972864 00000100:00100000:2.0:1746065216.142819:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263972864 00000100:00100000:3.0:1746065216.142821:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263973376:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.142830:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17411 00000100:00100000:3.0:1746065216.142833:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142833:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+9:3762:x1830881263972864:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065216.142840:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263973888:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065216.142850:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065216.142857:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263974400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065216.142869:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142876:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881263972864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (76us total) trans 17179874276 rc 0/0 00000100:00100000:2.0:1746065216.142880:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17411 00000004:00080000:3.0:1746065216.142884:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa5180/2, rc 0, transno 17179874276 00000100:00100000:2.0:1746065216.142886:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263973376 00000100:00100000:2.0:1746065216.142887:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263973376 00000100:00100000:3.0:1746065216.142888:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263972864:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065216.142891:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:2.0:1746065216.142894:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263973888 00000100:00100000:3.0:1746065216.142895:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263973248:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.142896:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263973888 00000100:00100000:2.0:1746065216.142902:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263974400 00000100:00100000:2.0:1746065216.142903:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263974400 00000100:00100000:3.0:1746065216.142905:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.142908:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263973248 00000100:00100000:2.0:1746065216.142909:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263973248 00000100:00100000:3.0:1746065216.142911:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263973760:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.142915:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17412 00000100:00100000:2.0:1746065216.142918:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+11:3762:x1830881263973376:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065216.142920:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065216.142925:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263974272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065216.142934:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065216.142939:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263974784:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065216.142944:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065216.142946:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065216.142947:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:3.0:1746065216.142948:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746065216.142950:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065216.142951:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065216.142963:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263973760 00000100:00100000:3.0:1746065216.142965:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263973760 00000100:00100000:2.0:1746065216.142966:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263973376:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (133us total) trans 17179874277 rc 0/0 00000100:00100000:2.0:1746065216.142970:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17412 00000100:00100000:3.0:1746065216.142975:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263974272 00000100:00100000:3.0:1746065216.142976:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263974272 00000100:00100000:2.0:1746065216.142977:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263974784 00000100:00100000:2.0:1746065216.142978:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263974784 00000100:00100000:3.0:1746065216.142983:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17413 00000100:00100000:3.0:1746065216.142987:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263973888:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065216.142988:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17414 00000100:00100000:2.0:1746065216.142991:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263974400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065216.143022:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00000004:00080000:3.0:1746065216.143023:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa7b80/2, rc 0, transno 17179874277 00002000:00010000:2.0:1746065216.143025:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00000100:00100000:3.0:1746065216.143026:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263973376:0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065216.143026:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065216.143028:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065216.143030:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:2.0:1746065216.143045:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263974400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (175us total) trans 21474841673 rc 0/0 00000100:00100000:2.0:1746065216.143049:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17414 00000100:00100000:3.0:1746065216.143053:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263973888:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (201us total) trans 21474841674 rc 0/0 00000100:00100000:2.0:1746065216.143056:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17415 00000100:00100000:3.0:1746065216.143059:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17413 00000100:00100000:2.0:1746065216.143060:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263973248:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065216.143067:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17416 00000100:00100000:3.0:1746065216.143071:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263973760:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.143093:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881263973248:12345-0@lo:2:osp-syn-1-0.0 Request processed in 32us (186us total) trans 17179874278 rc 0/0 00000100:00100000:2.0:1746065216.143097:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17415 00002000:00010000:3.0:1746065216.143100:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:3.0:1746065216.143102:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00000100:00100000:2.0:1746065216.143103:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17417 00002000:00010000:3.0:1746065216.143104:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065216.143105:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065216.143107:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:2.0:1746065216.143107:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881263974272:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065216.143120:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263973760:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (198us total) trans 17179874279 rc 0/0 00000100:00100000:3.0:1746065216.143123:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17416 00002000:00010000:2.0:1746065216.143131:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746065216.143132:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17418 00002000:00010000:2.0:1746065216.143133:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00000100:00100000:3.0:1746065216.143135:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263974784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065216.143135:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065216.143136:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065216.143137:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:2.0:1746065216.143152:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263974272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (217us total) trans 21474841675 rc 0/0 00000100:00100000:2.0:1746065216.143156:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17417 00000100:00100000:3.0:1746065216.143173:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881263974784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (224us total) trans 21474841676 rc 0/0 00000100:00100000:3.0:1746065216.143177:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17418 00000004:00080000:3.0:1746065216.143192:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa4000/2, rc 0, transno 17179874278 00000100:00100000:3.0:1746065216.143195:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263973248:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065216.143200:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3e300/2, rc 0, transno 17179874279 00000100:00100000:3.0:1746065216.143202:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263973760:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065216.143207:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b64e00/2, rc 0, transno 21474841675 00000100:00100000:3.0:1746065216.143210:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263974272:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065216.143214:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b67b80/2, rc 0, transno 21474841676 00000100:00100000:3.0:1746065216.143216:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263974784:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065216.143427:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 2 in flight, 5 done 00000100:00100000:2.0:1746065216.144955:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1746065216.144971:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263974912:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.145012:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065216.145833:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ce00/2, rc 0, transno 21474841674 00000100:00100000:3.0:1746065216.145837:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263973888:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065216.145845:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091b66680/2, rc 0, transno 21474841673 00000100:00100000:3.0:1746065216.145848:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263974400:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065216.146043:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263974912 00000100:00100000:0.0:1746065216.146048:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263974912 00000100:00100000:0.0:1746065216.146084:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17419 00000100:00100000:2.0:1746065216.146088:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.146091:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881263974912:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065216.146206:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881263974912:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (1193us total) trans 17179874280 rc 0/0 00000004:00080000:2.0:1746065216.146211:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d9f80/2, rc 0, transno 17179874280 00000100:00100000:0.0:1746065216.146213:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17419 00000100:00100000:2.0:1746065216.146215:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263974912:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065216.146363:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265353600 00000100:00100000:3.0:1746065216.146366:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265353600 00000100:00100000:3.0:1746065216.146915:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14561 00000100:00100000:3.0:1746065216.146921:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+7:2446:x1830881265353600:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065216.146933:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.146945:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14794f0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939536 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.146979:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14794f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939536 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.146989:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14794f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939536 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.147003:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.147005:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065216.147008:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47000, rc 0) 00000100:00100000:3.0:1746065216.147032:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2446:x1830881265353600:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 112us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.147037:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14561 00000100:00100000:2.0:1746065216.160495:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.160608:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265353728 00000100:00100000:3.0:1746065216.160616:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265353728 00000100:00100000:3.0:1746065216.160665:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 850 00000100:00100000:3.0:1746065216.160672:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2446:x1830881265353728:12345-192.168.202.27@tcp:103:mirror_io.0 00010000:00010000:3.0:1746065216.160683:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.160703:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc14794aa lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939528 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.160719:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.160722:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.160761:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+7:2446:x1830881265353728:12345-192.168.202.27@tcp:103:mirror_io.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.160766:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 850 00000100:00100000:2.0:1746065216.165266:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.165294:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265353984 00000100:00100000:2.0:1746065216.165302:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265353984 00000100:00100000:2.0:1746065216.165337:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5453 00000100:00100000:2.0:1746065216.165343:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+7:2446:x1830881265353984:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065216.165517:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2446:x1830881265353984:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 171us (256us total) trans 8589937062 rc 0/0 00000100:00100000:2.0:1746065216.165522:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5453 00000100:00100000:0.0:1746065216.169867:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.169924:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265354240 00000100:00100000:2.0:1746065216.169933:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265354240 00000100:00100000:2.0:1746065216.169980:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5454 00000100:00100000:2.0:1746065216.169987:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2446:x1830881265354240:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065216.170662:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2446:x1830881265354240:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 674us (799us total) trans 8589937063 rc 0/0 00000100:00100000:2.0:1746065216.170669:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5454 00000100:00100000:0.0:1746065216.207077:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.208812:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265354496 00000100:00100000:1.0:1746065216.208821:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265354496 00000100:00100000:1.0:1746065216.208872:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14562 00000100:00100000:1.0:1746065216.208880:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2455:x1830881265354496:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065216.208900:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065216.208915:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14794f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93953d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.208977:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc14794fe lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.208988:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc14794fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.208997:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc14794fe lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209008:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479505 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209013:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209018:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209094:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147950c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209101:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147950c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209107:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147950c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065216.209114:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065216.209168:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc14794fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209173:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc14794fe lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209182:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc14794fe lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209187:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc14794fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209192:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065216.209195:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc14794fe lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209200:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc14794fe lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209208:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065216.209211:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065216.209215:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc14794fe lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209219:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b200/0xad6b7ddc14794fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209238:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479505 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209243:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479505 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209247:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209251:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065216.209254:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479505 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209262:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479505 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209267:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880097b72200) 00010000:00010000:1.0:1746065216.209269:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065216.209271:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479505 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209275:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479505 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.209304:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc14794f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93953d expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.209314:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147950c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93953d expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.209320:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065216.209321:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065216.209323:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a000, rc 0) 00000100:00100000:1.0:1746065216.209372:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2455:x1830881265354496:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 493us (2304us total) trans 8589937064 rc 0/0 00000100:00100000:1.0:1746065216.209378:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14562 00000100:00100000:0.0:1746065216.225672:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.225892:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265354752 00000100:00100000:3.0:1746065216.225900:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265354752 00000100:00100000:3.0:1746065216.225948:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14563 00000100:00100000:3.0:1746065216.225955:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2457:x1830881265354752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065216.225975:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.225990:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147951a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939544 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.226050:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc1479521 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226061:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc1479521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226069:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc1479521 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226081:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc1479528 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226090:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc1479528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226095:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc1479528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226172:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147952f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226179:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147952f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226185:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147952f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065216.226192:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065216.226245:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc1479521 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226251:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc1479521 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226256:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc1479521 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226261:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc1479521 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226266:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065216.226269:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc1479521 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226274:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc1479521 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226286:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065216.226289:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065216.226292:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc1479521 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226297:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc1479521 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226320:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc1479528 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226325:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc1479528 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226329:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc1479528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226333:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065216.226336:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc1479528 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226340:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc1479528 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226346:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5dd00) 00010000:00010000:3.0:1746065216.226347:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065216.226349:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc1479528 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226365:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc1479528 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065216.226394:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147951a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939544 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.226405:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147952f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939544 expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.226410:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.226412:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065216.226414:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46000, rc 0) 00000100:00100000:3.0:1746065216.226449:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2457:x1830881265354752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 495us (785us total) trans 8589937065 rc 0/0 00000100:00100000:3.0:1746065216.226455:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14563 00000100:00100000:0.0:1746065216.231309:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.231373:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265355008 00000100:00100000:1.0:1746065216.231381:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265355008 00000100:00100000:1.0:1746065216.231431:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14564 00000100:00100000:1.0:1746065216.231437:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2456:x1830881265355008:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065216.231457:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065216.231472:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc147953d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93954b expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.231548:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479544 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.231559:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479544 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065216.231569:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479544 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065216.231577:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065216.231652:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71aa00/0xad6b7ddc147953d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93954b expref: 31 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.231681:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479544 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93954b expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.231689:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065216.231692:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065216.231695:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b600, rc 0) 00000100:00100000:1.0:1746065216.231740:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2456:x1830881265355008:12345-192.168.202.27@tcp:101:cat.0 Request processed in 302us (437us total) trans 8589937066 rc 0/0 00000100:00100000:1.0:1746065216.231746:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14564 00000100:00100000:0.0:1746065216.241811:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.241847:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.241867:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.241871:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265355264 00000100:00100000:3.0:1746065216.241879:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265355264 00000100:00100000:0.0:1746065216.241879:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.241892:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265355520 00000100:00100000:0.0:1746065216.241895:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265355520 00000100:00100000:0.0:1746065216.241912:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265355776 00000100:00100000:0.0:1746065216.241913:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265355776 00000100:00100000:0.0:1746065216.241922:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265356032 00000100:00100000:3.0:1746065216.241923:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14565 00000100:00100000:0.0:1746065216.241923:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265356032 00000100:00100000:3.0:1746065216.241930:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2451:x1830881265355264:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:0.0:1746065216.241933:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17420 00000100:00100000:0.0:1746065216.241938:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265355520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065216.241949:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.241949:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.241961:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939552 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.241962:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac30400/0xad6b7ddc1479559 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939560 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065216.241978:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d740, atime: 0x6812d740, ctime: 0x6812d740, blocks: 0x800 00010000:00010000:0.0:1746065216.241991:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.241993:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.242000:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac30400/0xad6b7ddc1479559 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939560 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.242012:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30400/0xad6b7ddc1479559 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939560 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.242020:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30400, rc 0) 00010000:00010000:3.0:1746065216.242039:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065216.242050:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265355520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 112us (203us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065216.242051:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147950c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93953d expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.242057:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147952f lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939544 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.242058:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17420 00010000:00010000:3.0:1746065216.242063:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065216.242070:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17421 00000100:00100000:0.0:1746065216.242074:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265355776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065216.242079:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.242086:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479567 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93956e expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.242088:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147952f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939544 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065216.242095:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d73f, atime: 0x6812d73f, ctime: 0x6812d73f, blocks: 0x808 00010000:00010000:3.0:1746065216.242098:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147952f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939544 expref: 10 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.242101:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.242103:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.242106:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479567 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93956e expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065216.242108:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263975040:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065216.242114:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479567 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93956e expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.242120:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31a00, rc 0) 00000100:00100000:0.0:1746065216.242132:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265355776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 58us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.242136:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17421 00000100:00100000:0.0:1746065216.242144:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17422 00000100:00100000:0.0:1746065216.242147:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265356032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065216.242152:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.242157:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147956e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93957c expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065216.242168:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d73f, atime: 0x6812d73e, ctime: 0x6812d73f, blocks: 0x1008 00010000:00010000:3.0:1746065216.242170:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147950c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93953d expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.242174:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.242175:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.242177:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147950c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93953d expref: 29 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.242178:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147956e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93957c expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065216.242185:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263975168:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065216.242186:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147956e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93957c expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.242192:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30c00, rc 0) 00000100:00100000:3.0:1746065216.242202:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.242202:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265356032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.242207:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17422 00000100:00100000:0.0:1746065216.242230:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.242251:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265355392 00000100:00100000:3.0:1746065216.242254:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265355392 00000100:00100000:0.0:1746065216.242262:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.245543:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265355648 00000100:00100000:3.0:1746065216.245552:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265355648 00000100:00100000:3.0:1746065216.246108:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17423 00000100:00100000:3.0:1746065216.246116:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265355392:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065216.246131:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.246146:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1479575 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939559 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065216.246162:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d740, atime: 0x6812d73f, ctime: 0x6812d740, blocks: 0x778 00010000:00010000:3.0:1746065216.246176:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.246178:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.246185:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1479575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939559 expref: 27 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.246197:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1479575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939559 expref: 27 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.246205:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f6800, rc 0) 00000100:00100000:1.0:1746065216.246213:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17424 00000100:00100000:1.0:1746065216.246222:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265355648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065216.246229:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065216.246239:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc147957c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939567 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065216.246255:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d73f, atime: 0x6812d73f, ctime: 0x6812d73f, blocks: 0x808 00010000:00010000:1.0:1746065216.246263:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.246265:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.246269:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc147957c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939567 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.246278:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc147957c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939567 expref: 10 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.246285:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71ae00, rc 0) 00000100:00100000:3.0:1746065216.246561:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265355392:12345-192.168.202.27@tcp:101:cat.0 Request processed in 445us (4329us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.246566:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17423 00000100:00100000:1.0:1746065216.246785:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265355648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 552us (4508us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.246791:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17424 00000100:00100000:2.0:1746065216.246829:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.246846:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265355904 00000100:00100000:0.0:1746065216.246850:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265355904 00000100:00100000:0.0:1746065216.246871:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17425 00000100:00100000:0.0:1746065216.246876:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265355904:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065216.246882:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.246889:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479583 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939575 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065216.246898:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:0.0:1746065216.246900:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 5034592, mtime: 0x6812d73f, atime: 0x6812d73f, ctime: 0x6812d73f, blocks: 0x1678 00010000:00010000:0.0:1746065216.246910:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.246911:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.246915:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939575 expref: 28 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065216.246922:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065216.246924:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939575 expref: 28 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.246930:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31200, rc 0) 00000100:00100000:2.0:1746065216.246931:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265356160 00000100:00100000:2.0:1746065216.246934:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265356160 00000100:00100000:2.0:1746065216.246949:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265356416 00000100:00100000:0.0:1746065216.246950:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265355904:12345-192.168.202.27@tcp:101:cat.0 Request processed in 74us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.246951:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265356416 00000100:00100000:0.0:1746065216.246956:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17425 00000100:00100000:0.0:1746065216.246968:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17426 00000100:00100000:2.0:1746065216.246972:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17427 00000100:00100000:0.0:1746065216.246973:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265356160:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065216.246976:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+18:2004:x1830881265356416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065216.246979:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065216.246983:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.246984:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc147958a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939583 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.246989:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc1479591 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939591 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.246993:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.246995:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.246998:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.246998:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc147958a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939583 expref: 45 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.247000:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.247004:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc1479591 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939591 expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.247005:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc147958a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939583 expref: 45 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.247010:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31400, rc 0) 00010000:00010000:2.0:1746065216.247012:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc1479591 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939591 expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.247019:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2c00, rc 0) 00000100:00100000:0.0:1746065216.247024:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265356160:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.247032:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17426 00000100:00100000:2.0:1746065216.247035:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+19:2004:x1830881265356416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 58us (112us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.247040:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17427 00000100:00100000:0.0:1746065216.249200:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.249246:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.249849:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.250173:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.250198:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265356672 00000100:00100000:3.0:1746065216.250205:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265356672 00000100:00100000:3.0:1746065216.250237:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265356288 00000100:00100000:3.0:1746065216.250240:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265356288 00000100:00100000:3.0:1746065216.250257:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265356544 00000100:00100000:3.0:1746065216.250259:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265356544 00000100:00100000:3.0:1746065216.250270:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17428 00000100:00100000:3.0:1746065216.250276:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265356672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065216.250288:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.250303:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1479598 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93959f expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.250324:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.250325:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.250333:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1479598 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93959f expref: 47 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.250346:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1479598 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93959f expref: 47 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.250366:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489e00, rc 0) 00000100:00100000:3.0:1746065216.250406:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265356672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 129us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.250411:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17428 00000100:00100000:3.0:1746065216.250425:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17429 00000100:00100000:3.0:1746065216.250430:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+19:2004:x1830881265356288:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065216.250437:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.250444:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147959f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93958a expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.250455:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.250456:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.250460:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147959f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93958a expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.250469:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147959f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93958a expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.250475:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488600, rc 0) 00000100:00100000:3.0:1746065216.250489:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881265356288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 59us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.250493:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17429 00000100:00100000:3.0:1746065216.250503:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17430 00000100:00100000:3.0:1746065216.250508:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265356544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065216.250515:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.250521:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489c00/0xad6b7ddc14795a6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939598 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.250529:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.250530:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.250533:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489c00/0xad6b7ddc14795a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939598 expref: 47 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.250541:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489c00/0xad6b7ddc14795a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939598 expref: 47 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.250546:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489c00, rc 0) 00000100:00100000:3.0:1746065216.250559:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265356544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.250563:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17430 00000100:00100000:1.0:1746065216.252716:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265356800 00000100:00100000:1.0:1746065216.252723:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265356800 00000100:00100000:1.0:1746065216.252748:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17431 00000100:00100000:1.0:1746065216.252753:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881265356800:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065216.252761:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065216.252769:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc14795ad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395a6 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.252794:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.252795:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.252800:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc14795ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395a6 expref: 21 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.252815:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc14795ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395a6 expref: 21 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.252822:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71be00, rc 0) 00000100:00100000:1.0:1746065216.252842:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881265356800:12345-192.168.202.27@tcp:101:cat.0 Request processed in 90us (2669us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.252847:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17431 00000100:00100000:0.0:1746065216.253125:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.253145:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263975040:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.253156:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263975168:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065216.253163:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065216.253176:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065216.253182:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265357056 00000100:00100000:0.0:1746065216.253185:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265357056 00010000:00010000:0.0:1746065216.253200:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147952f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939544 expref: 11 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746065216.253647:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265356928 00000100:00100000:0.0:1746065216.253651:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265356928 00010000:00010000:0.0:1746065216.253662:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147950c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93953d expref: 30 pid: 7205 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.254903:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8137 00000100:00100000:2.0:1746065216.254921:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265357056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065216.254931:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065216.254936:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147952f lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939544 expref: 11 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.254958:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147952f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939544 expref: 11 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.254974:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147952f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939544 expref: 11 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.254989:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.254993:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.254999:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.255003:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065216.255033:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265357056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 123us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.255038:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8137 00000100:00100000:2.0:1746065216.255052:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8138 00000100:00100000:2.0:1746065216.255056:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265356928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065216.255062:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065216.255065:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147950c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93953d expref: 30 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.255075:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147950c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93953d expref: 30 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.255084:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147950c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93953d expref: 30 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.255091:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.255093:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.255098:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.255102:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.255116:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065216.255123:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.255128:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065216.255141:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065216.255230:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939552 expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.255239:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939552 expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.255244:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.255246:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065216.255248:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46e00, rc 0) 00000100:00100000:2.0:1746065216.255268:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2451:x1830881265355264:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 13339us (13499us total) trans 8589937067 rc 0/0 00000100:00100000:2.0:1746065216.255273:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14565 00000100:00100000:2.0:1746065216.255306:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265356928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 249us (2143us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.255312:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8138 00000100:00100000:0.0:1746065216.265398:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.265542:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265357184 00000100:00100000:2.0:1746065216.265550:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265357184 00000100:00100000:2.0:1746065216.267346:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14566 00000100:00100000:2.0:1746065216.267367:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2457:x1830881265357184:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065216.267390:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065216.267405:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc14795bb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395ad expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.267449:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc14795bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ad expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.267460:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc14795bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ad expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.267473:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.267476:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065216.267478:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31c00, rc 0) 00000100:00100000:2.0:1746065216.267526:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2457:x1830881265357184:12345-192.168.202.27@tcp:101:cat.0 Request processed in 171us (2134us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.267531:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14566 00000100:00100000:0.0:1746065216.272372:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.272437:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.272453:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.272483:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.272513:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.272535:0:9553:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265357696 00000100:00100000:0.0:1746065216.272542:0:9553:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265357696 00002000:00100000:0.0:1746065216.272577:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009077f800 x1830881265357696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.272586:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f800 with x1830881265357696 ext(0->1048575) 00002000:00010000:0.0:1746065216.272592:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077f800 00000100:00100000:3.0:1746065216.272994:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265357568 00000100:00100000:3.0:1746065216.272999:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265357568 00000100:00100000:3.0:1746065216.273031:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14567 00000100:00100000:3.0:1746065216.273038:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2455:x1830881265357568:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065216.273055:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.273058:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065216.273078:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b600/0xad6b7ddc1479544 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93954b expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.273097:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.273100:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065216.273110:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc14795c2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395b4 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.273148:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065216.273158:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14794f0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939536 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.273164:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc14795bb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ad expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.273170:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065216.273193:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc14795bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ad expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.273203:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc14795bb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ad expref: 10 pid: 7205 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.273213:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263975296:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.273287:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14794f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939536 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.273299:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14794f0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939536 expref: 8 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.273306:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263975424:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.273326:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.273677:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6205 00000100:00100000:0.0:1746065216.273685:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265357696:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065216.277928:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265357952 00000100:00100000:1.0:1746065216.277941:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265357952 00002000:00100000:1.0:1746065216.277984:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800996fad80 x1830881265357952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.277993:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fad80 with x1830881265357952 ext(1048576->2097151) 00002000:00010000:1.0:1746065216.277999:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996fad80 00000100:00100000:1.0:1746065216.278021:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265358336 00000100:00100000:1.0:1746065216.278024:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265358336 00002000:00100000:1.0:1746065216.278035:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800996f9180 x1830881265358336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.278041:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f9180 with x1830881265358336 ext(1048576->2097151) 00002000:00010000:1.0:1746065216.278043:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f9180 00000100:00100000:1.0:1746065216.278051:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265358464 00000100:00100000:1.0:1746065216.278054:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265358464 00002000:00100000:1.0:1746065216.278064:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88013103a850 x1830881265358464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.278070:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013103a850 with x1830881265358464 ext(1048576->2097151) 00002000:00010000:1.0:1746065216.278073:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013103a850 00000100:00100000:1.0:1746065216.278083:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6206 00000100:00100000:1.0:1746065216.278090:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265357952:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065216.278716:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6207 00000100:00100000:1.0:1746065216.278722:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265358336:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065216.279238:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6208 00000100:00100000:1.0:1746065216.279244:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013103a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881265358464:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065216.284133:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.284224:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263975296:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.284234:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263975424:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.284254:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065216.289292:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265358720 00000100:00100000:2.0:1746065216.289303:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265358720 00010000:00010000:2.0:1746065216.289346:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc14795bb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ad expref: 11 pid: 7205 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.289402:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8139 00000100:00100000:2.0:1746065216.289410:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265358720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065216.289421:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065216.289426:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc14795bb lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ad expref: 11 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.289440:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc14795bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ad expref: 11 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.289457:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099c31c00/0xad6b7ddc14795bb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ad expref: 11 pid: 7205 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.289474:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.289480:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065216.289487:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065216.289491:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065216.289544:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265358720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 135us (5419us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.289550:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8139 00000100:00100000:0.0:1746065216.294344:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.294390:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.294414:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.294437:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265359104 00000100:00100000:0.0:1746065216.294437:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.294445:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265359104 00000100:00100000:0.0:1746065216.294450:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265359360 00000100:00100000:0.0:1746065216.294452:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265359360 00002000:00100000:2.0:1746065216.294477:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880134b03480 x1830881265359104/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.294477:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880134b02d80 x1830881265359360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.294486:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b03480 with x1830881265359104 ext(0->1048575) 00002000:00100000:0.0:1746065216.294486:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02d80 with x1830881265359360 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.294491:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b03480 00002000:00010000:0.0:1746065216.294491:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b02d80 00000100:00100000:0.0:1746065216.294508:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265359616 00000100:00100000:0.0:1746065216.294510:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265359616 00000100:00100000:2.0:1746065216.294516:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6209 00002000:00100000:0.0:1746065216.294518:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880134b00000 x1830881265359616/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065216.294521:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265359360:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:0.0:1746065216.294525:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00000 with x1830881265359616 ext(1048576->2097151) 00002000:00010000:0.0:1746065216.294527:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b00000 00000100:00100000:0.0:1746065216.294536:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6210 00000100:00100000:0.0:1746065216.294539:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265359104:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065216.295120:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6211 00000100:00100000:0.0:1746065216.295126:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265359616:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065216.295554:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265358592 00000100:00100000:3.0:1746065216.295559:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265358592 00010000:00010000:3.0:1746065216.295579:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14794f0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939536 expref: 9 pid: 9571 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.295600:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8140 00000100:00100000:3.0:1746065216.295606:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265358592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065216.295614:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.295618:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14794f0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939536 expref: 9 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.295628:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14794f0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939536 expref: 9 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.295644:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc14794f0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939536 expref: 9 pid: 9571 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.295663:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.295668:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065216.295675:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065216.295681:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065216.295696:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.295732:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265358592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 126us (1396us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.295737:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8140 00010000:00010000:3.0:1746065216.295755:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065216.295761:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000040:00080000:3.0:1746065216.295969:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1056, 88 off100768 00000004:00080000:3.0:1746065216.295974:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812314199923ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.295996:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1072, 88 off102176 00000004:00080000:3.0:1746065216.295998:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812314224959ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.296008:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1073, 88 off102264 00000004:00080000:3.0:1746065216.296011:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812314237777ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.296018:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1057, 88 off100856 00000004:00080000:3.0:1746065216.296020:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812314246904ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.296027:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1058, 88 off100944 00000004:00080000:3.0:1746065216.296029:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812314255977ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.296036:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1074, 88 off102352 00000004:00080000:3.0:1746065216.296038:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812314264879ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.296144:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1075, 88 off102440 00000004:00080000:3.0:1746065216.296149:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812314374968ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.296160:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1076, 88 off102528 00000004:00080000:3.0:1746065216.296163:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812314389169ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.296172:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1059, 88 off101032 00000004:00080000:3.0:1746065216.296174:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812314400412ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.296181:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1077, 88 off102616 00000004:00080000:3.0:1746065216.296183:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812314409517ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.296190:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1060, 88 off101120 00000004:00080000:3.0:1746065216.296192:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812314418548ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.296199:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1078, 88 off102704 00000004:00080000:3.0:1746065216.296201:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812314427286ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065216.296207:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1061, 88 off101208 00000004:00080000:3.0:1746065216.296209:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812314435888ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.296216:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1062, 88 off101296 00000004:00080000:3.0:1746065216.296219:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812314445154ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.296225:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1063, 88 off101384 00000004:00080000:3.0:1746065216.296227:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812314453853ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.296234:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1064, 88 off101472 00000004:00080000:3.0:1746065216.296236:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 812314462622ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065216.296243:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1079, 88 off102792 00000004:00080000:3.0:1746065216.296245:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 812314471897ns, next at 761143559853ns, rc = 0 00000100:00100000:3.0:1746065216.296313:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.296378:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265359872 00000100:00100000:2.0:1746065216.296382:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265359872 00002000:00100000:2.0:1746065216.296401:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f7fe300 x1830881265359872/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.296409:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe300 with x1830881265359872 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.296413:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fe300 00000100:00100000:2.0:1746065216.296430:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6212 00000100:00100000:2.0:1746065216.296435:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881265359872:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065216.296980:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.297471:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265358848 00000100:00100000:3.0:1746065216.297476:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265358848 00000100:00100000:3.0:1746065216.297496:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14568 00000100:00100000:3.0:1746065216.297501:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2451:x1830881265358848:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065216.297511:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.297522:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395bb expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.297557:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065216.297564:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.297577:0:7205:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065216.297585:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.297594:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.297597:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065216.297600:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.297606:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046800, rc 0) 00000100:00100000:3.0:1746065216.297626:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2451:x1830881265358848:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 125us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.297630:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14568 00000100:00100000:3.0:1746065216.304445:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881265357696:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 30752us (31998us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065216.304456:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6205 00002000:00100000:3.0:1746065216.304466:0:9553:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009077f800 x1830881265357696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065216.304475:0:9553:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f800 with x1830881265357696 ext(0->1048575) 00002000:00010000:3.0:1746065216.304480:0:9553:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077f800 00000100:00100000:1.0:1746065216.304572:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265357952:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 26480us (32115us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065216.304579:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6206 00002000:00100000:1.0:1746065216.304584:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800996fad80 x1830881265357952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.304592:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996fad80 with x1830881265357952 ext(1048576->2097151) 00002000:00010000:1.0:1746065216.304596:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996fad80 00000001:00080000:1.0:1746065216.306931:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937068 is committed 00000004:00080000:1.0:1746065216.306939:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1058 committed 00000004:00080000:1.0:1746065216.306957:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1045 committed 00000004:00080000:1.0:1746065216.307184:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1044 committed 00000004:00080000:1.0:1746065216.307186:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1043 committed 00000004:00080000:1.0:1746065216.307187:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1042 committed 00000004:00080000:1.0:1746065216.307189:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1057 committed 00000004:00080000:1.0:1746065216.307190:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1041 committed 00000004:00080000:1.0:1746065216.307192:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1056 committed 00000004:00080000:1.0:1746065216.307193:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1040 committed 00000004:00080000:1.0:1746065216.307194:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1055 committed 00000004:00080000:1.0:1746065216.307196:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1054 committed 00000004:00080000:1.0:1746065216.307198:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1053 committed 00000004:00080000:1.0:1746065216.307199:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1039 committed 00000004:00080000:1.0:1746065216.307200:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1038 committed 00000004:00080000:1.0:1746065216.307202:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1052 committed 00000004:00080000:1.0:1746065216.307203:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1051 committed 00000004:00080000:1.0:1746065216.307204:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1037 committed 00000001:00080000:1.0:1746065216.307208:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937067 is committed 00000001:00080000:1.0:1746065216.307217:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937063 is committed 00000100:00100000:2.0:1746065216.307444:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263975552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065216.307488:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065216.307575:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395b4 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.307586:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.307588:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065216.307592:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.307600:0:7231:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.307606:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.307625:0:7231:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065216.307633:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092528700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263976576:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065216.307686:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065216.307698:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263975936:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065216.307760:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263975680:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065216.308121:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263975552 00000100:00100000:0.0:1746065216.308127:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263975552 00000100:00100000:0.0:1746065216.308155:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17432 00000100:00100000:0.0:1746065216.308160:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263975552:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065216.308254:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065216.308256:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065216 -> 1746065216 00002000:00010000:0.0:1746065216.308258:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065216 -> 1746065216 00002000:00010000:0.0:1746065216.308260:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065216 -> 1746065216 00002000:00010000:0.0:1746065216.308261:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065216.308770:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263975552:12345-0@lo:2:osp-syn-0-0.0 Request processed in 608us (1280us total) trans 21474841677 rc 0/0 00000100:00100000:0.0:1746065216.308793:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17432 00000100:00100000:0.0:1746065216.308824:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263975808:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065216.308844:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065216.308857:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263976320:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065216.308869:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065216.308877:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263976960:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065216.308892:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065216.308903:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263977472:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065216.308916:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065216.308929:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065216.308933:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263977088:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065216.308947:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065216.308958:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263977600:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065216.308969:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065216.308986:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263975808 00000100:00100000:0.0:1746065216.308988:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263975808 00000100:00100000:0.0:1746065216.309003:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263976320 00000100:00100000:0.0:1746065216.309004:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263976320 00000100:00100000:0.0:1746065216.309013:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263976960 00000100:00100000:0.0:1746065216.309014:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263976960 00000100:00100000:0.0:1746065216.309023:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263977472 00000100:00100000:0.0:1746065216.309024:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263977472 00000100:00100000:0.0:1746065216.309032:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263977088 00000100:00100000:0.0:1746065216.309033:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263977088 00000100:00100000:0.0:1746065216.309040:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263977600 00000100:00100000:0.0:1746065216.309042:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263977600 00000100:00100000:0.0:1746065216.309050:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17433 00000100:00100000:0.0:1746065216.309053:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3761:x1830881263975808:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065216.309100:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065216.309103:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065215 -> 1746065215 00002000:00010000:0.0:1746065216.309104:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065214 -> 1746065214 00002000:00010000:0.0:1746065216.309106:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065215 -> 1746065215 00002000:00010000:0.0:1746065216.309108:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746065216.309127:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3761:x1830881263975808:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (283us total) trans 21474841678 rc 0/0 00000100:00100000:0.0:1746065216.309132:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17433 00000100:00100000:0.0:1746065216.309143:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17434 00000100:00100000:0.0:1746065216.309147:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+15:3761:x1830881263976320:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065216.309194:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+16:3761:x1830881263976320:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (323us total) trans 21474841679 rc 0/0 00000100:00100000:0.0:1746065216.309198:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17434 00000100:00100000:0.0:1746065216.309207:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17435 00000100:00100000:0.0:1746065216.309211:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3761:x1830881263976960:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065216.309257:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00002000:00010000:0.0:1746065216.309260:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065215 -> 1746065215 00002000:00010000:0.0:1746065216.309262:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065215 -> 1746065215 00002000:00010000:0.0:1746065216.309263:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065215 -> 1746065215 00002000:00010000:0.0:1746065216.309265:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00000100:00100000:0.0:1746065216.309282:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881263976960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (388us total) trans 17179874281 rc 0/0 00000100:00100000:0.0:1746065216.309286:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17435 00000100:00100000:0.0:1746065216.309295:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17436 00000100:00100000:0.0:1746065216.309298:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3761:x1830881263977472:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065216.309337:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065216.309339:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065216.309340:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065216.309341:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065216.309343:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:0.0:1746065216.309373:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881263977472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 74us (456us total) trans 17179874282 rc 0/0 00000100:00100000:0.0:1746065216.309378:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17436 00000100:00100000:0.0:1746065216.309387:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17437 00000100:00100000:0.0:1746065216.309390:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3761:x1830881263977088:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065216.309435:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881263977088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (487us total) trans 17179874283 rc 0/0 00000100:00100000:0.0:1746065216.309440:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17437 00000100:00100000:0.0:1746065216.309455:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17438 00000100:00100000:0.0:1746065216.309458:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+17:3761:x1830881263977600:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065216.309495:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:0.0:1746065216.309497:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065216.309499:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065216.309500:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065216.309502:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:0.0:1746065216.309518:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881263977600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (548us total) trans 17179874284 rc 0/0 00000100:00100000:0.0:1746065216.309523:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17438 00000004:00080000:0.0:1746065216.309551:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aeca300/2, rc 0, transno 17179874283 00000100:00100000:0.0:1746065216.309559:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263977088:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065216.309566:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615ea00/2, rc 0, transno 17179874284 00000100:00100000:0.0:1746065216.309568:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263977600:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065216.309574:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec6680/2, rc 0, transno 21474841678 00000100:00100000:0.0:1746065216.309576:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263975808:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065216.309581:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3480/2, rc 0, transno 21474841679 00000100:00100000:0.0:1746065216.309584:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263976320:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065216.309588:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6de300/2, rc 0, transno 17179874281 00000100:00100000:0.0:1746065216.309590:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263976960:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065216.309595:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec8e00/2, rc 0, transno 17179874282 00000100:00100000:0.0:1746065216.309597:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263977472:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065216.309752:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec7b80/2, rc 0, transno 21474841677 00000100:00100000:2.0:1746065216.309756:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263975552:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065216.309761:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263976064:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065216.309793:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.309809:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263976704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.309824:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.309833:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263977216:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.309844:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.309853:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263977728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.309862:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.309870:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1746065216.309874:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263976832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.309886:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.309894:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263977344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.309907:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065216.309925:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263976064 00000100:00100000:2.0:1746065216.309928:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263976064 00000100:00100000:2.0:1746065216.309944:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263976704 00000100:00100000:2.0:1746065216.309946:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263976704 00000100:00100000:2.0:1746065216.309953:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263977216 00000100:00100000:2.0:1746065216.309955:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263977216 00000100:00100000:2.0:1746065216.309960:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263977728 00000100:00100000:2.0:1746065216.309962:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263977728 00000100:00100000:2.0:1746065216.309968:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263976832 00000100:00100000:2.0:1746065216.309969:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263976832 00000100:00100000:2.0:1746065216.309976:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263977344 00000100:00100000:2.0:1746065216.309977:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263977344 00000100:00100000:2.0:1746065216.309984:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17439 00000100:00100000:2.0:1746065216.309988:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+16:3759:x1830881263976064:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065216.310034:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065216.310036:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065216.310037:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065216.310039:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065216.310041:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:2.0:1746065216.310062:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+17:3759:x1830881263976064:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (267us total) trans 21474841680 rc 0/0 00000100:00100000:2.0:1746065216.310067:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17439 00000100:00100000:2.0:1746065216.310077:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17440 00000100:00100000:2.0:1746065216.310081:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263976704:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065216.310114:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065216.310117:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065216 -> 1746065216 00002000:00010000:2.0:1746065216.310118:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065215 -> 1746065215 00002000:00010000:2.0:1746065216.310120:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065216 -> 1746065216 00002000:00010000:2.0:1746065216.310121:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 1912 -> 1912 00000100:00100000:2.0:1746065216.310137:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263976704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (312us total) trans 17179874285 rc 0/0 00000100:00100000:2.0:1746065216.310141:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17440 00000100:00100000:2.0:1746065216.310150:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17441 00000100:00100000:2.0:1746065216.310154:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263977216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065216.310188:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065216.310190:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065216.310191:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065216.310193:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065216.310194:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065216.310209:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263977216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (364us total) trans 17179874286 rc 0/0 00000100:00100000:2.0:1746065216.310214:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17441 00000100:00100000:2.0:1746065216.310222:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17442 00000100:00100000:2.0:1746065216.310225:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263977728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.310268:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263977728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (404us total) trans 17179874287 rc 0/0 00000100:00100000:2.0:1746065216.310275:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17442 00000100:00100000:2.0:1746065216.310283:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17443 00000100:00100000:2.0:1746065216.310286:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263976832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065216.310312:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065216.310314:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065215 -> 1746065215 00002000:00010000:2.0:1746065216.310316:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065215 -> 1746065215 00002000:00010000:2.0:1746065216.310317:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065215 -> 1746065215 00002000:00010000:2.0:1746065216.310319:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065216.310331:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263976832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (445us total) trans 17179874288 rc 0/0 00000100:00100000:2.0:1746065216.310335:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17443 00000100:00100000:2.0:1746065216.310342:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17444 00000100:00100000:2.0:1746065216.310345:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263977344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065216.310401:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881263977344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (493us total) trans 17179874289 rc 0/0 00000100:00100000:2.0:1746065216.310406:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17444 00000004:00080000:2.0:1746065216.310431:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dc380/2, rc 0, transno 17179874288 00000100:00100000:2.0:1746065216.310434:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263976832:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065216.310440:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec8380/2, rc 0, transno 17179874289 00000100:00100000:2.0:1746065216.310442:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263977344:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065216.310447:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dd500/2, rc 0, transno 17179874285 00000100:00100000:2.0:1746065216.310449:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263976704:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065216.310454:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009aec8000/2, rc 0, transno 17179874286 00000100:00100000:2.0:1746065216.310456:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263977216:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065216.310461:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e6a00/2, rc 0, transno 17179874287 00000100:00100000:2.0:1746065216.310463:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263977728:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065216.310468:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec5f80/2, rc 0, transno 21474841680 00000100:00100000:2.0:1746065216.310470:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263976064:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065216.310529:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065216.310547:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263976448:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065216.310566:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065216.310732:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065216.310748:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263976192:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065216.310765:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065216.310809:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263975936 00000100:00100000:1.0:1746065216.310813:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263975936 00000100:00100000:1.0:1746065216.310827:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263976448 00000100:00100000:1.0:1746065216.310829:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263976448 00000100:00100000:1.0:1746065216.310837:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263975680 00000100:00100000:1.0:1746065216.310838:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263975680 00000100:00100000:1.0:1746065216.310843:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263976192 00000100:00100000:1.0:1746065216.310845:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263976192 00000100:00100000:1.0:1746065216.310852:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17445 00000100:00100000:1.0:1746065216.310857:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263975936:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065216.310908:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065216.310910:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065216.310912:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065216.310914:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065216.310915:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:1.0:1746065216.310936:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263975936:12345-0@lo:2:osp-syn-0-0.0 Request processed in 79us (407us total) trans 21474841681 rc 0/0 00000100:00100000:1.0:1746065216.310941:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17445 00000100:00100000:1.0:1746065216.310953:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17446 00000100:00100000:1.0:1746065216.310958:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881263976448:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065216.311008:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881263976448:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (441us total) trans 21474841682 rc 0/0 00000100:00100000:1.0:1746065216.311013:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17446 00000100:00100000:1.0:1746065216.311023:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17447 00000100:00100000:1.0:1746065216.311027:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3760:x1830881263975680:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065216.311064:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065216.311066:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065215 -> 1746065215 00002000:00010000:1.0:1746065216.311067:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065215 -> 1746065215 00002000:00010000:1.0:1746065216.311069:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065215 -> 1746065215 00002000:00010000:1.0:1746065216.311070:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065216.311091:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263975680:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (359us total) trans 21474841683 rc 0/0 00000100:00100000:1.0:1746065216.311096:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17447 00000100:00100000:1.0:1746065216.311196:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17448 00000100:00100000:1.0:1746065216.311201:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+20:3760:x1830881263976192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065216.311240:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:1.0:1746065216.311242:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065216.311243:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065216.311245:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065216.311247:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:1.0:1746065216.311264:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881263976192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (498us total) trans 21474841684 rc 0/0 00000100:00100000:1.0:1746065216.311269:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17448 00000004:00080000:1.0:1746065216.311292:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec6300/2, rc 0, transno 21474841683 00000100:00100000:1.0:1746065216.311296:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263975680:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065216.311302:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3800/2, rc 0, transno 21474841684 00000100:00100000:1.0:1746065216.311305:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881263976192:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065216.311400:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099ec5500/2, rc 0, transno 21474841681 00000100:00100000:3.0:1746065216.311404:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263975936:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065216.311410:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135222680/2, rc 0, transno 21474841682 00000100:00100000:3.0:1746065216.311412:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135222680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881263976448:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065216.314620:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800996f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881265358336:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 35889us (42128us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065216.314630:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6207 00002000:00100000:0.0:1746065216.314639:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800996f9180 x1830881265358336/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.314647:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800996f9180 with x1830881265358336 ext(1048576->2097151) 00002000:00010000:0.0:1746065216.314652:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800996f9180 00000100:00100000:3.0:1746065216.325167:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092528700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881263976576:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065216.325204:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc14795c2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395b4 expref: 28 pid: 7231 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065216.325242:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395b4 expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.325270:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488000, rc 0) 00000100:00100000:3.0:1746065216.325306:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2455:x1830881265357568:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 52267us (52940us total) trans 8589937068 rc 0/0 00000100:00100000:3.0:1746065216.325314:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14567 00000100:00100000:1.0:1746065216.325847:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.325881:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.325913:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013103a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265358464:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 46668us (53397us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.325922:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6208 00002000:00100000:2.0:1746065216.325929:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88013103a850 x1830881265358464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.325938:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013103a850 with x1830881265358464 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.325942:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88013103a850 00000100:00100000:2.0:1746065216.327031:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265360128 00000100:00100000:2.0:1746065216.327040:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265360128 00000100:00100000:2.0:1746065216.327083:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5455 00000100:00100000:2.0:1746065216.327090:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2451:x1830881265360128:12345-192.168.202.27@tcp:49:multiop.0 00000100:00100000:2.0:1746065216.327165:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2451:x1830881265360128:12345-192.168.202.27@tcp:49:multiop.0 Request processed in 75us (1282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.327170:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5455 00000100:00100000:3.0:1746065216.327251:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265360000 00000100:00100000:3.0:1746065216.327254:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265360000 00000100:00100000:3.0:1746065216.327277:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14569 00000100:00100000:3.0:1746065216.327282:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2456:x1830881265360000:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065216.327290:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.327303:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc14795d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395c2 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.327339:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc14795d7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c2 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.327350:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc14795d7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c2 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.327373:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.327376:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065216.327379:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047800, rc 0) 00000100:00100000:3.0:1746065216.327396:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2456:x1830881265360000:12345-192.168.202.27@tcp:101:cat.0 Request processed in 113us (1551us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.327401:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14569 00000100:00100000:2.0:1746065216.332145:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2005:x1830881265359104:12345-192.168.202.27@tcp:3:cat.0 Request processed in 37596us (37746us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.332155:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6210 00002000:00100000:2.0:1746065216.332165:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880134b03480 x1830881265359104/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.332179:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b03480 with x1830881265359104 ext(0->1048575) 00002000:00010000:2.0:1746065216.332184:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b03480 00000100:00100000:2.0:1746065216.334325:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265359360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 39796us (39902us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.334335:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6209 00002000:00100000:2.0:1746065216.334343:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880134b02d80 x1830881265359360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.334351:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b02d80 with x1830881265359360 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.334367:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b02d80 00000100:00100000:2.0:1746065216.339051:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2004:x1830881265359872:12345-192.168.202.27@tcp:3:cat.0 Request processed in 42608us (42731us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.339061:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6212 00002000:00100000:2.0:1746065216.339069:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f7fe300 x1830881265359872/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.339078:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe300 with x1830881265359872 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.339082:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fe300 00000100:00100000:0.0:1746065216.341152:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.342750:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265360256 00000100:00100000:2.0:1746065216.342760:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265360256 00000100:00100000:3.0:1746065216.342987:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5456 00000100:00100000:3.0:1746065216.342994:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2457:x1830881265360256:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:3.0:1746065216.343104:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2457:x1830881265360256:12345-192.168.202.27@tcp:49:cat.0 Request processed in 109us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.343111:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5456 00000100:00100000:2.0:1746065216.344732:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265359616:12345-192.168.202.27@tcp:3:cat.0 Request processed in 49603us (50290us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.344740:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6211 00002000:00100000:2.0:1746065216.344748:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880134b00000 x1830881265359616/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.344761:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00000 with x1830881265359616 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.344766:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b00000 00000100:00100000:0.0:1746065216.353860:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.354109:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265360384 00000100:00100000:2.0:1746065216.354118:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265360384 00000100:00100000:2.0:1746065216.354159:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17449 00000100:00100000:2.0:1746065216.354165:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2451:x1830881265360384:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065216.354181:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065216.354195:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395c9 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.354219:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479583 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939575 expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.354227:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1479598 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93959f expref: 46 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.354233:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.354235:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.354238:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4001792->4042751] (req 4001792->4042751) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 29 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.354261:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1479598 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93959f expref: 46 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.354271:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1479598 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93959f expref: 46 pid: 13375 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746065216.354286:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263977856:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.355214:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939575 expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.355223:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479583 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939575 expref: 29 pid: 12258 timeout: 912 lvb_type: 1 00000100:00100000:2.0:1746065216.355232:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263977984:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065216.355694:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.355957:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065216.356131:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265360512 00000100:00100000:1.0:1746065216.356136:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265360512 00000100:00100000:1.0:1746065216.356165:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17450 00000100:00100000:1.0:1746065216.356175:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+21:2455:x1830881265360512:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065216.356185:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065216.356195:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395d0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.356213:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147956e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93957c expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.356221:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc14795ad lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395a6 expref: 22 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.356226:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.356228:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.356231:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2482176->2785279] (req 2482176->2785279) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.356250:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc14795ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395a6 expref: 22 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.356258:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc14795ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395a6 expref: 22 pid: 3067 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746065216.356265:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263978112:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065216.356507:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147956e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93957c expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.356516:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147956e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93957c expref: 9 pid: 12260 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746065216.356523:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263978240:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065216.356544:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.358852:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.358889:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.358925:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.358941:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.358958:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265360640 00000100:00100000:0.0:1746065216.358963:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265360640 00010000:00010000:0.0:1746065216.358989:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1479598 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93959f expref: 47 pid: 13375 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.359008:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265361152 00000100:00100000:0.0:1746065216.359010:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265361152 00010000:00010000:0.0:1746065216.359020:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479583 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939575 expref: 30 pid: 12258 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.359031:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265361280 00000100:00100000:0.0:1746065216.359032:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265361280 00010000:00010000:0.0:1746065216.359040:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc14795ad lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395a6 expref: 23 pid: 3067 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.359052:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8141 00000100:00100000:0.0:1746065216.359057:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265360640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065216.359067:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065216.359192:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8142 00000100:00100000:1.0:1746065216.359198:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2005:x1830881265361152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.359205:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065216.359269:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263977856:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065216.359278:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263977984:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.359297:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [4001792->4042751] (req 4001792->4042751) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 30 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065216.359430:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8143 00000100:00100000:3.0:1746065216.359439:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881265361280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065216.359446:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.359457:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc14795ad lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395a6 expref: 23 pid: 3067 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746065216.359465:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc14795ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395a6 expref: 23 pid: 3067 timeout: 912 lvb_type: 1 00010000:00010000:3.0:1746065216.359482:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.359512:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881265361280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.359517:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8143 00010000:00010000:2.0:1746065216.359605:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44a00, rc 0) 00000100:00100000:2.0:1746065216.359623:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2451:x1830881265360384:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5459us (5771us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.359629:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17449 00000100:00100000:2.0:1746065216.359646:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265360896 00000100:00100000:2.0:1746065216.359649:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265360896 00002000:00100000:2.0:1746065216.359665:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008f3e6d80 x1830881265360896/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.359673:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6d80 with x1830881265360896 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.359676:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e6d80 00000100:00100000:2.0:1746065216.359685:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6213 00000100:00100000:2.0:1746065216.359689:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265360896:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:0.0:1746065216.360193:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1479598 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93959f expref: 47 pid: 13375 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.360203:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1479598 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93959f expref: 47 pid: 13375 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.360214:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489e00/0xad6b7ddc1479598 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93959f expref: 47 pid: 13375 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.360228:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065216.360244:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265360640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1187us (1398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.360249:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8141 00000100:00100000:0.0:1746065216.360279:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.360330:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065216.360384:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479583 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939575 expref: 29 pid: 12258 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.360393:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479583 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939575 expref: 29 pid: 12258 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.360408:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31200/0xad6b7ddc1479583 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939575 expref: 29 pid: 12258 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.360414:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065216.360421:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.360422:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065216.360424:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265361792 00000100:00100000:0.0:1746065216.360427:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265361792 00010000:00010000:1.0:1746065216.360428:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.360434:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.360437:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147956e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93957c expref: 11 pid: 12260 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.360449:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8144 00000100:00100000:0.0:1746065216.360452:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265361792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.360456:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 28 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.360457:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065216.360464:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147956e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93957c expref: 11 pid: 12260 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746065216.360465:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263978368:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065216.360472:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147956e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93957c expref: 11 pid: 12260 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.360481:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.360482:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.360485:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.360492:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065216.360501:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48be40 going to sleep for 11 seconds 00010000:00010000:0.0:1746065216.360506:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 22 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.360513:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263978496:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065216.360521:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc14795ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395a6 expref: 22 pid: 3067 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.360527:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065216.360530:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263978112:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065216.360537:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147956e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93957c expref: 11 pid: 12260 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746065216.360544:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263978240:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065216.360561:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.360568:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906d0a00, rc 0) 00000100:00100000:1.0:1746065216.360584:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+21:2455:x1830881265360512:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4413us (4892us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.360589:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17450 00000100:00100000:0.0:1746065216.360623:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265361408 00000100:00100000:0.0:1746065216.360626:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265361408 00002000:00100000:0.0:1746065216.360640:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88008f3e4700 x1830881265361408/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.360647:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4700 with x1830881265361408 ext(1048576->2097151) 00002000:00010000:0.0:1746065216.360649:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e4700 00000100:00100000:0.0:1746065216.360657:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265361664 00000100:00100000:0.0:1746065216.360659:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265361664 00002000:00100000:0.0:1746065216.360666:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f3e7800 x1830881265361664/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.360676:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7800 with x1830881265361664 ext(1048576->2097151) 00002000:00010000:0.0:1746065216.360678:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e7800 00000100:00100000:0.0:1746065216.360685:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6214 00000100:00100000:0.0:1746065216.360689:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265361408:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065216.361158:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6215 00000100:00100000:2.0:1746065216.361164:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2007:x1830881265361664:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065216.362079:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.362233:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.362260:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265362176 00000100:00100000:1.0:1746065216.362263:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.362264:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265362176 00002000:00100000:0.0:1746065216.362281:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009aba6d80 x1830881265362176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.362288:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba6d80 with x1830881265362176 ext(1048576->2097151) 00002000:00010000:0.0:1746065216.362291:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba6d80 00000100:00100000:0.0:1746065216.362303:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265362304 00000100:00100000:0.0:1746065216.362305:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265362304 00002000:00100000:0.0:1746065216.362314:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800984dad80 x1830881265362304/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.362319:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984dad80 with x1830881265362304 ext(1048576->2097151) 00002000:00010000:0.0:1746065216.362322:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984dad80 00000100:00100000:0.0:1746065216.362329:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265362560 00000100:00100000:0.0:1746065216.362330:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265362560 00002000:00100000:0.0:1746065216.362338:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800984db800 x1830881265362560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.362343:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984db800 with x1830881265362560 ext(1048576->2097151) 00002000:00010000:0.0:1746065216.362345:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984db800 00000100:00100000:0.0:1746065216.362367:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6216 00000100:00100000:0.0:1746065216.362372:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881265362176:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065216.362425:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6217 00000100:00100000:3.0:1746065216.362431:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265362304:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065216.362815:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6218 00000100:00100000:0.0:1746065216.362820:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881265362560:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065216.365379:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263978496:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065216.365400:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065216.365442:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265361792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4987us (5026us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.365455:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8144 00000100:00100000:0.0:1746065216.365490:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263978368:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065216.365503:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065216.365516:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2005:x1830881265361152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6319us (6590us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.365521:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8142 00000100:00100000:0.0:1746065216.367033:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.367074:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.367099:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265363072 00000100:00100000:1.0:1746065216.367106:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265363072 00002000:00100000:1.0:1746065216.367141:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4001792->4005887) req@ffff88009aba4700 x1830881265363072/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.367150:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba4700 with x1830881265363072 ext(4001792->4005887) 00002000:00010000:1.0:1746065216.367155:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aba4700 00000100:00100000:1.0:1746065216.367181:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265362816 00000100:00100000:1.0:1746065216.367183:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265362816 00002000:00100000:1.0:1746065216.367195:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2482176->2486271) req@ffff88009aba6680 x1830881265362816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.367201:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba6680 with x1830881265362816 ext(2482176->2486271) 00002000:00010000:1.0:1746065216.367204:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba6680 00000100:00100000:1.0:1746065216.367215:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6219 00000100:00100000:1.0:1746065216.367220:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881265363072:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065216.367313:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881265363072:12345-192.168.202.27@tcp:3:cat.0 Request processed in 92us (285us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065216.367319:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6219 00002000:00100000:1.0:1746065216.367325:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4001792->4005887) req@ffff88009aba4700 x1830881265363072/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/4536 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.367332:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba4700 with x1830881265363072 ext(4001792->4005887) 00002000:00010000:1.0:1746065216.367334:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aba4700 00000100:00100000:1.0:1746065216.367369:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6220 00000100:00100000:1.0:1746065216.367373:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265362816:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065216.367425:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265362816:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 51us (350us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065216.367430:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6220 00002000:00100000:1.0:1746065216.367434:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2482176->2486271) req@ffff88009aba6680 x1830881265362816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/4536 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.367648:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba6680 with x1830881265362816 ext(2482176->2486271) 00002000:00010000:1.0:1746065216.367651:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba6680 00000100:00100000:2.0:1746065216.370023:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265360896:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10327us (11128us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.370032:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6213 00002000:00100000:2.0:1746065216.370039:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88008f3e6d80 x1830881265360896/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.370047:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6d80 with x1830881265360896 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.370051:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e6d80 00000100:00100000:2.0:1746065216.375284:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265361408:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14585us (14995us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.375294:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6214 00002000:00100000:2.0:1746065216.375305:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88008f3e4700 x1830881265361408/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.375314:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4700 with x1830881265361408 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.375320:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e4700 00000100:00100000:2.0:1746065216.376767:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881265362176:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 14391us (14686us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.376788:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6216 00002000:00100000:2.0:1746065216.376794:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009aba6d80 x1830881265362176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.376802:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba6d80 with x1830881265362176 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.376806:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba6d80 00000100:00100000:3.0:1746065216.380484:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881265362304:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 18045us (18243us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065216.380494:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6217 00002000:00100000:3.0:1746065216.380503:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800984dad80 x1830881265362304/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065216.380511:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984dad80 with x1830881265362304 ext(1048576->2097151) 00002000:00010000:3.0:1746065216.380516:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984dad80 00000100:00100000:2.0:1746065216.382960:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2007:x1830881265361664:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21790us (22623us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.382970:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6215 00002000:00100000:2.0:1746065216.382980:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f3e7800 x1830881265361664/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.382988:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7800 with x1830881265361664 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.382992:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e7800 00000100:00100000:2.0:1746065216.388300:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+46:2005:x1830881265362560:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 25472us (26029us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.388310:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6218 00002000:00100000:2.0:1746065216.388320:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800984db800 x1830881265362560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.388328:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984db800 with x1830881265362560 ext(1048576->2097151) 00002000:00010000:2.0:1746065216.388333:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984db800 00000100:00100000:0.0:1746065216.399836:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.399892:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265363328 00000100:00100000:2.0:1746065216.399900:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265363328 00002000:00100000:2.0:1746065216.399939:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4038656->4042751) req@ffff88009aba4380 x1830881265363328/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.399948:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba4380 with x1830881265363328 ext(4038656->4042751) 00002000:00010000:2.0:1746065216.399953:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aba4380 00000100:00100000:2.0:1746065216.399986:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6221 00000100:00100000:2.0:1746065216.399992:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265363328:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065216.400102:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265363328:12345-192.168.202.27@tcp:3:cat.0 Request processed in 110us (273us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065216.400108:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6221 00002000:00100000:2.0:1746065216.400112:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4038656->4042751) req@ffff88009aba4380 x1830881265363328/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/4536 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.400119:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba4380 with x1830881265363328 ext(4038656->4042751) 00002000:00010000:2.0:1746065216.400121:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aba4380 00000100:00100000:1.0:1746065216.400292:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.400314:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.400335:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265363584 00000100:00100000:0.0:1746065216.400339:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265363584 00002000:00100000:0.0:1746065216.400365:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2781184->2785279) req@ffff8800984d9c00 x1830881265363584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.400373:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d9c00 with x1830881265363584 ext(2781184->2785279) 00002000:00010000:0.0:1746065216.400377:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d9c00 00000100:00100000:0.0:1746065216.400386:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265363840 00000100:00100000:0.0:1746065216.400388:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265363840 00002000:00100000:0.0:1746065216.400398:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800984daa00 x1830881265363840/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.400405:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984daa00 with x1830881265363840 ext(2097152->3145727) 00002000:00010000:0.0:1746065216.400407:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984daa00 00000100:00100000:0.0:1746065216.400415:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6222 00000100:00100000:0.0:1746065216.400419:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265363584:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065216.400454:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6223 00000100:00100000:3.0:1746065216.400461:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265363840:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065216.400473:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265363584:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 53us (181us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065216.400478:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6222 00002000:00100000:0.0:1746065216.400482:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2781184->2785279) req@ffff8800984d9c00 x1830881265363584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/4536 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.400489:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d9c00 with x1830881265363584 ext(2781184->2785279) 00002000:00010000:0.0:1746065216.400492:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d9c00 00000100:00100000:0.0:1746065216.408504:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.408565:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265364096 00000100:00100000:2.0:1746065216.408575:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265364096 00000100:00100000:2.0:1746065216.408614:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5457 00000100:00100000:2.0:1746065216.408620:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4110c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2455:x1830881265364096:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065216.408845:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4110c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2455:x1830881265364096:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 224us (349us total) trans 8589937069 rc 0/0 00000100:00100000:2.0:1746065216.408851:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5457 00000100:00100000:3.0:1746065216.417762:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265363840:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17293us (17438us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065216.417783:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6223 00002000:00100000:3.0:1746065216.417793:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800984daa00 x1830881265363840/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065216.417801:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984daa00 with x1830881265363840 ext(2097152->3145727) 00002000:00010000:3.0:1746065216.417806:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984daa00 00000100:00100000:0.0:1746065216.420472:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.420630:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265364224 00000100:00100000:1.0:1746065216.420644:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265364224 00000100:00100000:1.0:1746065216.420695:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17451 00000100:00100000:1.0:1746065216.420703:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+46:2456:x1830881265364224:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065216.420718:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065216.420731:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395d7 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.420756:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 27 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.420809:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065216.420811:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065216.420815:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 47 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.420843:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 27 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.420854:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 27 pid: 10219 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.420865:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263978624:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065216.420946:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.425055:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.425118:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265364352 00000100:00100000:2.0:1746065216.425125:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265364352 00000100:00100000:2.0:1746065216.425166:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17452 00000100:00100000:2.0:1746065216.425173:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2457:x1830881265364352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065216.425190:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065216.425203:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395de expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.425226:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.425232:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065216.425234:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065216.425236:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.425261:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.425276:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 20 pid: 9549 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.425289:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263978752:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065216.425380:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.425556:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263978624:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.425574:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 47 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.425584:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70aa00, rc 0) 00000100:00100000:2.0:1746065216.425605:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+47:2456:x1830881265364224:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4903us (5141us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.425610:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17451 00000100:00100000:0.0:1746065216.426232:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.426267:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265364480 00000100:00100000:3.0:1746065216.426271:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265364480 00002000:00100000:3.0:1746065216.426295:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4001792->4042751) req@ffff88009aba4000 x1830881265364480/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065216.426303:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba4000 with x1830881265364480 ext(4001792->4042751) 00010000:00010000:3.0:1746065216.426308:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 28 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.426316:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 28 pid: 10219 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746065216.426321:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aba4000 00000100:00100000:3.0:1746065216.426339:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2042 00000100:00100000:3.0:1746065216.426344:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265364480:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065216.428919:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263978752:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.428941:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.428954:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44c00, rc 0) 00000100:00100000:0.0:1746065216.428981:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.428986:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2457:x1830881265364352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3813us (3938us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.428993:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17452 00000100:00100000:2.0:1746065216.429089:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265364608 00000100:00100000:2.0:1746065216.429094:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265364608 00002000:00100000:2.0:1746065216.429120:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2482176->2785279) req@ffff88009aba5f80 x1830881265364608/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.429128:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba5f80 with x1830881265364608 ext(2482176->2785279) 00010000:00010000:2.0:1746065216.429133:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 21 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.429143:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 21 pid: 9549 timeout: 912 lvb_type: 0 00002000:00010000:2.0:1746065216.429148:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aba5f80 00000100:00100000:2.0:1746065216.429161:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2043 00000100:00100000:2.0:1746065216.429166:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265364608:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065216.436409:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2005:x1830881265364480:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10054us (10167us total) trans 17179874290 rc 0/0 00000100:00100000:3.0:1746065216.436421:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2042 00002000:00100000:3.0:1746065216.436433:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4001792->4042751) req@ffff88009aba4000 x1830881265364480/t17179874290(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/448 e 0 to 0 dl 1746065227 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065216.436441:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba4000 with x1830881265364480 ext(4001792->4042751) 00010000:00010000:3.0:1746065216.436450:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 30 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.436463:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 30 pid: 10219 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746065216.436469:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aba4000 00000100:00100000:0.0:1746065216.438373:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.438417:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265364864 00000100:00100000:3.0:1746065216.438425:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265364864 00000100:00080000:3.0:1746065216.438447:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065216.438451:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.438479:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265365120 00000100:00100000:3.0:1746065216.438482:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265365120 00000100:00100000:0.0:1746065216.438482:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.438499:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1135 00000100:00100000:0.0:1746065216.438500:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.438505:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:2007:x1830881265364864:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065216.438524:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265364736 00000100:00100000:0.0:1746065216.438527:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265364736 00000100:00100000:3.0:1746065216.438548:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:2007:x1830881265364864:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 43us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.438553:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1135 00000100:00100000:3.0:1746065216.438562:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265364992 00000100:00100000:3.0:1746065216.438564:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265364992 00000100:00100000:3.0:1746065216.438575:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1136 00000100:00100000:3.0:1746065216.438578:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+5:2007:x1830881265365120:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065216.438584:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 239 00000100:00100000:0.0:1746065216.438589:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2007:x1830881265364736:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065216.438594:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+5:2007:x1830881265365120:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 15us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.438602:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1136 00000100:00100000:3.0:1746065216.438609:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1137 00000100:00100000:0.0:1746065216.438610:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c72a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2007:x1830881265364736:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 21us (127us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.438612:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2007:x1830881265364992:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065216.438615:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 239 00000100:00100000:3.0:1746065216.438629:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2007:x1830881265364992:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 16us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.438633:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1137 00000100:00080000:3.0:1746065216.438643:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065216.441961:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881265364608:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12787us (12973us total) trans 21474841685 rc 0/0 00000100:00100000:0.0:1746065216.441975:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2043 00002000:00100000:0.0:1746065216.441986:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2482176->2785279) req@ffff88009aba5f80 x1830881265364608/t21474841685(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/448 e 0 to 0 dl 1746065227 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.441994:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba5f80 with x1830881265364608 ext(2482176->2785279) 00010000:00010000:0.0:1746065216.442003:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 23 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.442013:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 23 pid: 9549 timeout: 912 lvb_type: 0 00002000:00010000:0.0:1746065216.442019:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009aba5f80 00000100:00100000:0.0:1746065216.449847:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.449908:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265365248 00000100:00100000:2.0:1746065216.449915:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265365248 00000100:00100000:0.0:1746065216.449942:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065216.449943:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 23 pid: 9549 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.449971:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265365376 00000100:00100000:2.0:1746065216.449973:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265365376 00010000:00010000:2.0:1746065216.449989:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 30 pid: 10219 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.450007:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8145 00000100:00100000:2.0:1746065216.450014:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265365248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065216.450025:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065216.450038:0:9565:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065215 -> 1746065216 00002000:00010000:2.0:1746065216.450041:0:9565:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065215 -> 1746065216 00010000:00010000:2.0:1746065216.450046:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 23 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.450055:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 23 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.450073:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800906d0a00/0xad6b7ddc14795e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2482176->2785279) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d0 expref: 23 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.450089:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.450091:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.450096:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.450103:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.450129:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 9 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065216.450139:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263978880:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065216.450209:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.451623:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8146 00000100:00100000:0.0:1746065216.451636:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2005:x1830881265365376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065216.451646:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1746065216.451660:0:10893:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065215 -> 1746065216 00002000:00010000:0.0:1746065216.451663:0:10893:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065215 -> 1746065216 00002000:00010000:0.0:1746065216.451664:0:10893:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065215 -> 1746065216 00010000:00010000:0.0:1746065216.451670:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 30 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.451682:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 30 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.451704:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44a00/0xad6b7ddc14795de lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4001792->4042751) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c9 expref: 30 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.451720:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.451721:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.451726:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 46 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.451732:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 46 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.451752:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 46 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.451760:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263979008:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065216.451833:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.453337:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263979008:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065216.453364:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065216.454010:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2005:x1830881265365376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2376us (4066us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.454018:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8146 00000100:00100000:3.0:1746065216.454211:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263978880:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065216.454222:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.454252:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881265365248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4238us (4413us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.454258:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8145 00000100:00100000:0.0:1746065216.457273:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.457314:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265365632 00000100:00100000:2.0:1746065216.457321:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265365632 00002000:00100000:2.0:1746065216.457371:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88008f3e7100 x1830881265365632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.457380:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7100 with x1830881265365632 ext(2097152->3145727) 00002000:00010000:2.0:1746065216.457383:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e7100 00000100:00100000:2.0:1746065216.457551:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6224 00000100:00100000:2.0:1746065216.457558:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265365632:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065216.463128:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.463866:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265365888 00000100:00100000:3.0:1746065216.463873:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265365888 00000100:00100000:2.0:1746065216.463896:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+47:2005:x1830881265365632:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6337us (6628us total) trans 0 rc 1048576/1048576 00002000:00100000:3.0:1746065216.463903:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88008f3e6680 x1830881265365888/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065216.463905:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6224 00002000:00100000:2.0:1746065216.463910:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88008f3e7100 x1830881265365632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065216.463912:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6680 with x1830881265365888 ext(2097152->3145727) 00002000:00010000:3.0:1746065216.463916:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e6680 00002000:00100000:2.0:1746065216.463916:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7100 with x1830881265365632 ext(2097152->3145727) 00002000:00010000:2.0:1746065216.463919:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e7100 00000100:00100000:2.0:1746065216.463932:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6225 00000100:00100000:2.0:1746065216.463938:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265365888:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065216.468546:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.469185:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265366016 00000100:00100000:3.0:1746065216.469194:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265366016 00000100:00100000:3.0:1746065216.469237:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17453 00000100:00100000:3.0:1746065216.469243:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2456:x1830881265366016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065216.469257:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.469270:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc14795fa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395e5 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.469291:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.469293:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.469299:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc14795fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395e5 expref: 23 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.469312:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc14795fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395e5 expref: 23 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.469320:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc000, rc 0) 00000100:00100000:3.0:1746065216.469367:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2456:x1830881265366016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 124us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.469373:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17453 00000100:00100000:2.0:1746065216.479395:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265365888:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15443us (16260us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.479408:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6225 00002000:00100000:2.0:1746065216.479421:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88008f3e6680 x1830881265365888/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.479430:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e6680 with x1830881265365888 ext(2097152->3145727) 00002000:00010000:2.0:1746065216.479437:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f3e6680 00000100:00100000:0.0:1746065216.483534:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.483645:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265366144 00000100:00100000:2.0:1746065216.483654:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265366144 00000100:00100000:2.0:1746065216.483706:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17454 00000100:00100000:2.0:1746065216.483713:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2457:x1830881265366144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065216.483730:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065216.483750:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45a00/0xad6b7ddc1479601 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395ec expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.483798:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.483800:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.483809:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45a00/0xad6b7ddc1479601 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ec expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.483823:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45a00/0xad6b7ddc1479601 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ec expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.483834:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45a00, rc 0) 00000100:00100000:2.0:1746065216.483873:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2457:x1830881265366144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 161us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.483878:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17454 00000100:00100000:0.0:1746065216.484932:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.484962:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.485036:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265366528 00000100:00100000:2.0:1746065216.485040:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265366528 00002000:00100000:2.0:1746065216.485065:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880129f43100 x1830881265366528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.485074:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43100 with x1830881265366528 ext(2097152->4194303) 00002000:00010000:2.0:1746065216.485078:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f43100 00000100:00100000:2.0:1746065216.485152:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265366656 00000100:00100000:2.0:1746065216.485155:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265366656 00002000:00100000:2.0:1746065216.485166:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880129f41500 x1830881265366656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.485173:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41500 with x1830881265366656 ext(3145728->4194303) 00002000:00010000:2.0:1746065216.485175:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f41500 00000100:00100000:1.0:1746065216.485198:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6226 00000100:00100000:1.0:1746065216.485205:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265366528:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065216.486949:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6227 00000100:00100000:2.0:1746065216.486960:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881265366656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065216.505054:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.507700:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.510258:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265366912 00000100:00100000:1.0:1746065216.510272:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265366912 00002000:00100000:1.0:1746065216.510311:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880129f41180 x1830881265366912/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.510321:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41180 with x1830881265366912 ext(3145728->4194303) 00002000:00010000:1.0:1746065216.510326:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f41180 00000100:00100000:1.0:1746065216.510345:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265367168 00000100:00100000:1.0:1746065216.510347:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265367168 00002000:00100000:1.0:1746065216.510366:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880129f40380 x1830881265367168/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.510378:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40380 with x1830881265367168 ext(3145728->4194303) 00002000:00010000:1.0:1746065216.510381:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f40380 00000100:00100000:1.0:1746065216.510402:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6228 00000100:00100000:1.0:1746065216.510409:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2005:x1830881265366912:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065216.511043:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6229 00000100:00100000:2.0:1746065216.511049:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265367168:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065216.523336:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265366528:12345-192.168.202.27@tcp:3:cat.0 Request processed in 38123us (38398us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065216.523347:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6226 00002000:00100000:2.0:1746065216.523367:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_009: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880129f43100 x1830881265366528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.523377:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43100 with x1830881265366528 ext(2097152->4194303) 00002000:00010000:2.0:1746065216.523383:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f43100 00000100:00100000:2.0:1746065216.530564:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881265366656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 43598us (45591us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065216.530575:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6227 00002000:00100000:2.0:1746065216.530586:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880129f41500 x1830881265366656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.530595:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41500 with x1830881265366656 ext(3145728->4194303) 00002000:00010000:2.0:1746065216.530600:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f41500 00000100:00100000:1.0:1746065216.545443:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2005:x1830881265366912:12345-192.168.202.27@tcp:3:cat.0 Request processed in 35026us (40389us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065216.545454:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6228 00002000:00100000:1.0:1746065216.545463:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880129f41180 x1830881265366912/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.545472:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41180 with x1830881265366912 ext(3145728->4194303) 00002000:00010000:1.0:1746065216.545477:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f41180 00000100:00100000:2.0:1746065216.558579:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.558665:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265367680 00000100:00100000:1.0:1746065216.558673:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265367680 00002000:00100000:1.0:1746065216.558708:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88012f09f480 x1830881265367680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.558717:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f480 with x1830881265367680 ext(4194304->5038079) 00002000:00010000:1.0:1746065216.558722:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09f480 00000100:00100000:1.0:1746065216.558739:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6230 00000100:00100000:1.0:1746065216.558744:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265367680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065216.559842:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.559881:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265367424 00000100:00100000:0.0:1746065216.559885:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265367424 00000100:00100000:0.0:1746065216.559910:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14570 00000100:00100000:0.0:1746065216.559915:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2464:x1830881265367424:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065216.559930:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.559943:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc1479608 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395f3 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.559994:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147960f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560004:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147960f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560012:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147960f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560022:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479616 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560028:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560033:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560111:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147961d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560118:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147961d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560123:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147961d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065216.560134:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065216.560184:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147960f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560189:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147960f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560193:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147960f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560198:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147960f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560202:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065216.560206:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147960f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560211:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147960f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560220:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065216.560222:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065216.560225:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147960f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560229:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46200/0xad6b7ddc147960f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560243:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479616 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560247:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479616 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560255:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479616 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560259:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f47400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065216.560261:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479616 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560266:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479616 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560272:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008ec47700) 00010000:00010000:0.0:1746065216.560274:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065216.560276:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479616 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560280:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479616 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065216.560323:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc1479608 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395f3 expref: 32 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.560333:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147961d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395f3 expref: 31 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.560338:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065216.560340:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065216.560342:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46600, rc 0) 00000100:00100000:0.0:1746065216.560378:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2464:x1830881265367424:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 462us (538us total) trans 8589937070 rc 0/0 00000100:00100000:0.0:1746065216.560383:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14570 00000100:00100000:3.0:1746065216.563241:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265367168:12345-192.168.202.27@tcp:3:cat.0 Request processed in 52182us (55537us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065216.563251:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6229 00002000:00100000:3.0:1746065216.563261:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880129f40380 x1830881265367168/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065216.563268:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40380 with x1830881265367168 ext(3145728->4194303) 00002000:00010000:3.0:1746065216.563274:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f40380 00000100:00100000:2.0:1746065216.568939:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.568971:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265367936 00000100:00100000:0.0:1746065216.568980:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265367936 00000100:00100000:0.0:1746065216.569031:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14571 00000100:00100000:0.0:1746065216.569039:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2462:x1830881265367936:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065216.569061:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.569076:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46400/0xad6b7ddc147962b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9395fa expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.569138:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc1479632 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569150:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc1479632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569161:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc1479632 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569171:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479639 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569176:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569181:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569254:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479640 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569262:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479640 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569268:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479640 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065216.569279:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065216.569331:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc1479632 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569336:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc1479632 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569341:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc1479632 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569347:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc1479632 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569364:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065216.569367:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc1479632 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569372:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc1479632 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569382:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065216.569384:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065216.569388:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc1479632 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569393:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc1479632 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569404:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479639 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569408:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479639 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569416:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569421:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f47a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065216.569423:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479639 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569427:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479639 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569431:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008ec47500) 00010000:00010000:0.0:1746065216.569433:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065216.569435:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479639 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569439:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc1479639 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065216.569468:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46400/0xad6b7ddc147962b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395fa expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.569477:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479640 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395fa expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.569483:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065216.569484:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065216.569486:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47400, rc 0) 00000100:00100000:0.0:1746065216.569536:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2462:x1830881265367936:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 498us (604us total) trans 8589937071 rc 0/0 00000100:00100000:0.0:1746065216.569542:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14571 00000100:00100000:1.0:1746065216.574876:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265367680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16119us (16293us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746065216.574888:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6230 00002000:00100000:1.0:1746065216.574900:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88012f09f480 x1830881265367680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.574909:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f480 with x1830881265367680 ext(4194304->5038079) 00002000:00010000:1.0:1746065216.574914:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09f480 00000100:00100000:0.0:1746065216.582875:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.582910:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.582945:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.583017:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265368192 00000100:00100000:1.0:1746065216.583023:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265368192 00002000:00100000:1.0:1746065216.583068:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880129f42a00 x1830881265368192/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.583077:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42a00 with x1830881265368192 ext(4194304->5038079) 00002000:00010000:1.0:1746065216.583082:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f42a00 00000100:00100000:1.0:1746065216.583099:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6231 00000100:00100000:1.0:1746065216.583105:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881265368192:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065216.583726:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265368448 00000100:00100000:3.0:1746065216.583730:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265368448 00000100:00100000:3.0:1746065216.583751:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265368704 00000100:00100000:3.0:1746065216.583753:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265368704 00000100:00100000:3.0:1746065216.583764:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5458 00000100:00100000:3.0:1746065216.583769:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2462:x1830881265368448:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065216.583836:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5459 00000100:00100000:1.0:1746065216.583842:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2456:x1830881265368704:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065216.583956:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2462:x1830881265368448:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 186us (1044us total) trans 8589937073 rc 0/0 00000100:00100000:1.0:1746065216.583956:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2456:x1830881265368704:12345-192.168.202.27@tcp:35:cat.0 Request processed in 113us (1010us total) trans 8589937072 rc 0/0 00000100:00100000:1.0:1746065216.583961:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5459 00000100:00100000:3.0:1746065216.583963:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5458 00000100:00100000:1.0:1746065216.596531:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881265368192:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13411us (13648us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746065216.596546:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6231 00002000:00100000:1.0:1746065216.596561:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880129f42a00 x1830881265368192/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.596571:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42a00 with x1830881265368192 ext(4194304->5038079) 00002000:00010000:1.0:1746065216.596578:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f42a00 00000100:00100000:0.0:1746065216.609863:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.610005:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265368960 00000100:00100000:2.0:1746065216.610012:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265368960 00000100:00100000:2.0:1746065216.610059:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5460 00000100:00100000:2.0:1746065216.610066:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2457:x1830881265368960:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065216.610238:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2457:x1830881265368960:12345-192.168.202.27@tcp:35:cat.0 Request processed in 172us (381us total) trans 8589937074 rc 0/0 00000100:00100000:2.0:1746065216.610244:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5460 00000100:00100000:0.0:1746065216.728644:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.730460:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265369216 00000100:00100000:2.0:1746065216.730469:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265369216 00000100:00100000:2.0:1746065216.730531:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14572 00000100:00100000:2.0:1746065216.730538:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2469:x1830881265369216:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065216.730560:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065216.730579:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147964e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939601 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.730641:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1479655 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730652:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1479655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730661:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1479655 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730673:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147965c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730678:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147965c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730683:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147965c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730753:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479663 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730761:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479663 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730766:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479663 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065216.730790:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065216.730880:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1479655 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730887:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1479655 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730892:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1479655 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730897:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1479655 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730902:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065216.730905:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1479655 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730915:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1479655 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730927:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065216.730929:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065216.730933:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1479655 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730937:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3a00/0xad6b7ddc1479655 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730977:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147965c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730983:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147965c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730987:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147965c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730991:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065216.730993:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147965c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.730997:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147965c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.731004:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f854600) 00010000:00010000:2.0:1746065216.731006:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065216.731008:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147965c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.731013:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147965c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065216.731052:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147964e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939601 expref: 35 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.731065:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479663 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939601 expref: 34 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.731071:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065216.731073:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065216.731075:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3e00, rc 0) 00000100:00100000:2.0:1746065216.731134:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2469:x1830881265369216:12345-192.168.202.27@tcp:101:cat.0 Request processed in 594us (2494us total) trans 8589937075 rc 0/0 00000100:00100000:2.0:1746065216.731141:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14572 00000100:00100000:0.0:1746065216.739550:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.739644:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265369472 00000100:00100000:1.0:1746065216.739652:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265369472 00002000:00100000:1.0:1746065216.739704:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880129f42d80 x1830881265369472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.739715:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42d80 with x1830881265369472 ext(0->1048575) 00002000:00010000:1.0:1746065216.739720:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f42d80 00000100:00100000:1.0:1746065216.739760:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6232 00000100:00100000:1.0:1746065216.739767:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265369472:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065216.742941:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.742993:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265369600 00000100:00100000:3.0:1746065216.743000:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265369600 00000100:00100000:3.0:1746065216.743048:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 851 00000100:00100000:3.0:1746065216.743055:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265369600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065216.743066:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.743087:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479663 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939601 expref: 34 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.743112:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.743116:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.743158:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265369600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.743164:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 851 00000100:00100000:1.0:1746065216.770541:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265369472:12345-192.168.202.27@tcp:3:cat.0 Request processed in 30765us (30989us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065216.770551:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6232 00002000:00100000:1.0:1746065216.770561:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880129f42d80 x1830881265369472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.770570:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42d80 with x1830881265369472 ext(0->1048575) 00002000:00010000:1.0:1746065216.770575:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f42d80 00000100:00100000:0.0:1746065216.780981:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.781039:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.781066:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265369728 00000100:00100000:3.0:1746065216.781074:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265369728 00000100:00100000:3.0:1746065216.781108:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265369856 00000100:00100000:3.0:1746065216.781110:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265369856 00000100:00100000:2.0:1746065216.781121:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17455 00000100:00100000:2.0:1746065216.781129:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2462:x1830881265369728:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065216.781148:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065216.781162:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939608 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065216.781177:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17456 00000100:00100000:3.0:1746065216.781182:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+47:2464:x1830881265369856:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065216.781185:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.781187:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065216.781192:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc14795fa lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395e5 expref: 22 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.781195:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93960f expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.781197:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.781199:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.781203:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.781207:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1479575 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939559 expref: 29 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.781213:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc147958a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939583 expref: 48 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.781217:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.781218:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.781220:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [458752->1048575] (req 458752->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 48 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.781227:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc14795fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395e5 expref: 22 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.781231:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc147958a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939583 expref: 48 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.781236:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc14795fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395e5 expref: 22 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.781237:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc147958a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939583 expref: 48 pid: 12258 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746065216.781246:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263979264:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065216.781246:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263979136:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.781492:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.781500:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 11 pid: 10219 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.781507:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263979392:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065216.781523:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb240 going to sleep for 11 seconds 00010000:00010000:3.0:1746065216.781573:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1479575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939559 expref: 29 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.781580:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1479575 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939559 expref: 29 pid: 10219 timeout: 912 lvb_type: 1 00000100:00100000:3.0:1746065216.781587:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263979520:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.781603:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065216.787466:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263979264:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065216.787467:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.787492:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265369984 00000100:00100000:3.0:1746065216.787497:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265369984 00010000:00010000:3.0:1746065216.787524:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc14795fa lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395e5 expref: 23 pid: 10219 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.787547:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8147 00000100:00100000:2.0:1746065216.787551:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263979136:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.787552:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265369984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065216.787560:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263979392:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.787562:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.787580:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc14795fa lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395e5 expref: 23 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.787582:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [4096000->4194303] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 11 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.787589:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc14795fa lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395e5 expref: 23 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.787608:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc000/0xad6b7ddc14795fa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395e5 expref: 23 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.787800:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3800, rc 0) 00000100:00100000:2.0:1746065216.787837:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2462:x1830881265369728:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6709us (6867us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.787846:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17455 00010000:00010000:3.0:1746065216.787990:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.788011:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881265369984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 458us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.788016:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8147 00000100:00100000:0.0:1746065216.790130:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.790176:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265370112 00000100:00100000:3.0:1746065216.790182:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265370112 00010000:00010000:3.0:1746065216.790203:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 11 pid: 10219 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.790236:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8148 00000100:00100000:3.0:1746065216.790242:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265370112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065216.790258:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.790271:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 11 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.790279:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 11 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.790417:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44c00/0xad6b7ddc14795f3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395de expref: 11 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.790437:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.790439:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.790445:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.790452:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.790480:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 10 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065216.790491:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263979648:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065216.790733:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065216.791614:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263979520:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.791634:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [458752->1048575] (req 458752->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 48 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.791653:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46c00, rc 0) 00000100:00100000:3.0:1746065216.791678:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+48:2464:x1830881265369856:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10496us (10639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.791685:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17456 00000100:00100000:0.0:1746065216.797860:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.797907:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.797978:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265370240 00000100:00100000:1.0:1746065216.797985:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265370240 00010000:00010000:1.0:1746065216.798013:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc147958a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939583 expref: 48 pid: 12258 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746065216.798043:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265370368 00000100:00100000:1.0:1746065216.798045:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265370368 00010000:00010000:1.0:1746065216.798053:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1479575 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939559 expref: 30 pid: 10219 timeout: 912 lvb_type: 1 00000100:00100000:1.0:1746065216.798066:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8149 00000100:00100000:1.0:1746065216.798073:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+48:2007:x1830881265370240:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.798083:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.798099:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc147958a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939583 expref: 48 pid: 12258 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.798108:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc147958a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939583 expref: 48 pid: 12258 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.798124:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31400/0xad6b7ddc147958a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939583 expref: 48 pid: 12258 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.798138:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.798169:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881265370240:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.798176:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8149 00000100:00100000:1.0:1746065216.798188:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8150 00000100:00100000:1.0:1746065216.798192:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2007:x1830881265370368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.798197:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.798203:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1479575 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939559 expref: 30 pid: 10219 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.798211:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1479575 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939559 expref: 30 pid: 10219 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.798222:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800b49f6800/0xad6b7ddc1479575 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939559 expref: 30 pid: 10219 timeout: 912 lvb_type: 1 00010000:00010000:1.0:1746065216.798234:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.798235:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.798241:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 46 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.798248:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 46 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.798269:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 46 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065216.798280:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263979776:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065216.798324:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.800482:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.800562:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265370624 00000100:00100000:1.0:1746065216.800568:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265370624 00002000:00100000:1.0:1746065216.800601:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4096000->4100095) req@ffff88012f1a4000 x1830881265370624/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.800609:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4000 with x1830881265370624 ext(4096000->4100095) 00002000:00010000:1.0:1746065216.800613:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a4000 00000100:00100000:1.0:1746065216.800640:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6233 00000100:00100000:1.0:1746065216.800647:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265370624:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065216.800752:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265370624:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 105us (278us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065216.800758:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6233 00002000:00100000:1.0:1746065216.800763:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4096000->4100095) req@ffff88012f1a4000 x1830881265370624/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/4536 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.800770:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a4000 with x1830881265370624 ext(4096000->4100095) 00002000:00010000:1.0:1746065216.800801:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a4000 00000100:00100000:3.0:1746065216.800955:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263979648:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065216.800971:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.802177:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265370112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11932us (12050us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.802186:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8148 00000100:00100000:0.0:1746065216.806286:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.806551:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.806654:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263979776:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065216.806671:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.806710:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2007:x1830881265370368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8515us (8801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.806719:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8150 00000100:00100000:3.0:1746065216.808073:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265370752 00000100:00100000:3.0:1746065216.808081:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265370752 00000100:00100000:3.0:1746065216.808115:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17457 00000100:00100000:3.0:1746065216.808121:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265370752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065216.808134:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.808146:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147967f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939616 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065216.808184:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263979904:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065216.808831:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265371008 00000100:00100000:2.0:1746065216.808836:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265371008 00002000:00100000:2.0:1746065216.808861:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x75:0x0] (458752->462847) req@ffff88012f1a5f80 x1830881265371008/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.808870:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5f80 with x1830881265371008 ext(458752->462847) 00002000:00010000:2.0:1746065216.808873:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a5f80 00000100:00100000:3.0:1746065216.810602:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065216.810794:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.810878:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6234 00000100:00100000:2.0:1746065216.810890:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265371008:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065216.810994:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265371008:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 108us (4443us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065216.811000:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6234 00002000:00100000:2.0:1746065216.811005:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x75:0x0] (458752->462847) req@ffff88012f1a5f80 x1830881265371008/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/4536 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.811013:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5f80 with x1830881265371008 ext(458752->462847) 00002000:00010000:2.0:1746065216.811016:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a5f80 00000100:00100000:3.0:1746065216.811135:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265371136 00000100:00100000:3.0:1746065216.811139:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265371136 00000100:00100000:3.0:1746065216.811162:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17458 00000100:00100000:3.0:1746065216.811166:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2462:x1830881265371136:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065216.811174:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.811186:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93961d expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.811205:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 46 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.811212:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45a00/0xad6b7ddc1479601 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ec expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.811217:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.811219:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.811222:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->4870143] (req 4194304->4870143) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.811242:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45a00/0xad6b7ddc1479601 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ec expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.811251:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d45a00/0xad6b7ddc1479601 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ec expref: 30 pid: 9549 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.811260:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263980032:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065216.811304:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 46 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.811313:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 46 pid: 9549 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.811320:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263980160:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065216.811336:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949f00 going to sleep for 11 seconds 00002000:00010000:3.0:1746065216.819829:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746065216 -> 1746065217 00002000:00010000:3.0:1746065216.819835:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065214 -> 1746065216 00002000:00010000:3.0:1746065216.819837:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746065216 -> 1746065217 00000100:00100000:3.0:1746065216.819854:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263979904:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065216.819880:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147967f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939616 expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.819892:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147967f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939616 expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.820572:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73600, rc 0) 00000100:00100000:3.0:1746065216.820624:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265370752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 12501us (14343us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065216.820632:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17457 00000100:00100000:3.0:1746065216.820756:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.820907:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.820924:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265371264 00000100:00100000:3.0:1746065216.820929:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265371264 00010000:00010000:3.0:1746065216.820951:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 47 pid: 9549 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.820970:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265371392 00000100:00100000:3.0:1746065216.820972:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265371392 00010000:00010000:3.0:1746065216.820980:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45a00/0xad6b7ddc1479601 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ec expref: 31 pid: 9549 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.820998:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8151 00000100:00100000:3.0:1746065216.821003:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881265371264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065216.821015:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.821027:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 47 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.821035:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 47 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.821053:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065216.821366:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263980032:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.821377:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc14795ec lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395d7 expref: 47 pid: 9549 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.821897:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+46:2007:x1830881265371264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 893us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.821904:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8151 00000100:00100000:3.0:1746065216.821917:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8152 00000100:00100000:3.0:1746065216.821923:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2006:x1830881265371392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065216.821930:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.821938:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d45a00/0xad6b7ddc1479601 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ec expref: 31 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.821946:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d45a00/0xad6b7ddc1479601 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ec expref: 31 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.821958:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45a00/0xad6b7ddc1479601 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395ec expref: 31 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.821971:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.821973:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.821978:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.821985:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.822007:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065216.822016:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263980288:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065216.822139:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.822240:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265371520 00000100:00100000:0.0:1746065216.822243:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265371520 00000100:00100000:0.0:1746065216.822270:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17459 00000100:00100000:0.0:1746065216.822276:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2464:x1830881265371520:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065216.822287:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.822298:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939624 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.822313:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30400/0xad6b7ddc1479559 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939560 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.822323:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147959f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93958a expref: 23 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.822329:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.822330:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.822333:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 5/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->1413119] (req 1048576->1413119) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 23 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.822358:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147959f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93958a expref: 23 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.822368:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147959f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93958a expref: 23 pid: 13375 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.822376:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263980416:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065216.822413:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac30400/0xad6b7ddc1479559 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939560 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.822420:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30400/0xad6b7ddc1479559 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939560 expref: 9 pid: 12260 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.822428:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263980544:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065216.822441:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.822551:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263980160:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.822571:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.822585:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73200, rc 0) 00000100:00100000:2.0:1746065216.822605:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2462:x1830881265371136:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11438us (11813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.822611:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17458 00000100:00100000:3.0:1746065216.822673:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.832697:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263980416:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065216.836269:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.836296:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.836319:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.836338:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265372032 00000100:00100000:0.0:1746065216.836344:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265372032 00010000:00010000:0.0:1746065216.836383:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147959f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93958a expref: 24 pid: 13375 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.836407:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8153 00000100:00100000:0.0:1746065216.836413:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265372032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065216.836423:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065216.836438:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147959f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93958a expref: 24 pid: 13375 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.836447:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147959f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93958a expref: 24 pid: 13375 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.836466:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147959f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93958a expref: 24 pid: 13375 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.836480:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065216.836510:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881265372032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.836515:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8153 00000100:00100000:0.0:1746065216.836621:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263980544:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065216.836642:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->1413119] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 22 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.836651:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd200, rc 0) 00000100:00100000:0.0:1746065216.836670:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2464:x1830881265371520:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 14394us (14532us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.836676:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17459 00000100:00100000:0.0:1746065216.836688:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265371904 00000100:00100000:0.0:1746065216.836690:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265371904 00000100:00100000:0.0:1746065216.836708:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17460 00000100:00100000:0.0:1746065216.836713:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+46:2469:x1830881265371904:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065216.836723:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.836732:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93962b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.836746:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.836752:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065216.836754:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065216.836756:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [5033984->5242879] (req 5033984->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 47 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.836796:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.836806:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 29 pid: 9549 timeout: 912 lvb_type: 0 00000100:00100000:0.0:1746065216.836815:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263980672:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065216.836859:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065216.836965:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265371776 00000100:00100000:1.0:1746065216.836969:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265371776 00002000:00100000:1.0:1746065216.836990:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4866048->4870143) req@ffff88012f1a6a00 x1830881265371776/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.836998:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6a00 with x1830881265371776 ext(4866048->4870143) 00010000:00010000:1.0:1746065216.837003:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 30 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.837010:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 30 pid: 9549 timeout: 912 lvb_type: 0 00002000:00010000:1.0:1746065216.837015:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1a6a00 00000100:00100000:1.0:1746065216.837026:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2044 00000100:00100000:1.0:1746065216.837031:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881265371776:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065216.837108:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2004:x1830881265371776:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 76us (847us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065216.837114:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2044 00002000:00100000:1.0:1746065216.837119:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4866048->4870143) req@ffff88012f1a6a00 x1830881265371776/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/4536 e 0 to 0 dl 1746065227 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.837125:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6a00 with x1830881265371776 ext(4866048->4870143) 00010000:00010000:1.0:1746065216.837129:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 30 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.837136:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 30 pid: 9549 timeout: 912 lvb_type: 0 00002000:00010000:1.0:1746065216.837142:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1a6a00 00000100:00100000:3.0:1746065216.837388:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263980288:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065216.837398:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065216.837417:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2006:x1830881265371392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 15495us (16510us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065216.837422:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8152 00000100:00100000:0.0:1746065216.843437:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.843509:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.843545:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265372160 00000100:00100000:0.0:1746065216.843552:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265372160 00010000:00010000:0.0:1746065216.843581:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac30400/0xad6b7ddc1479559 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939560 expref: 10 pid: 12260 timeout: 912 lvb_type: 1 00000100:00100000:0.0:1746065216.843612:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8154 00000100:00100000:0.0:1746065216.843619:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265372160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065216.843631:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065216.843649:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac30400/0xad6b7ddc1479559 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939560 expref: 10 pid: 12260 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.843659:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac30400/0xad6b7ddc1479559 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939560 expref: 10 pid: 12260 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.843677:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30400/0xad6b7ddc1479559 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939560 expref: 10 pid: 12260 timeout: 912 lvb_type: 1 00010000:00010000:0.0:1746065216.843692:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.843694:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065216.843700:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.843707:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065216.843733:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.843744:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263980800:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065216.843826:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.844011:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263980672:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.844029:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [5033984->5242879] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 47 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.844039:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dcc00, rc 0) 00000100:00100000:2.0:1746065216.844062:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+47:2469:x1830881265371904:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7348us (7765us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.844069:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17460 00000100:00100000:3.0:1746065216.844135:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265372416 00000100:00100000:3.0:1746065216.844138:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265372416 00000100:00100000:3.0:1746065216.844160:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14573 00000100:00100000:3.0:1746065216.844165:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2472:x1830881265372416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065216.844178:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065216.844190:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc147969b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939632 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.844244:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc14796a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844253:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc14796a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844260:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc14796a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844271:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc14796a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844275:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc14796a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844279:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc14796a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844370:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc14796b0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844378:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc14796b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844383:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc14796b0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065216.844389:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065216.844445:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc14796a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844450:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc14796a2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844457:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc14796a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844461:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc14796a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844467:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065216.844470:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc14796a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844475:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc14796a2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844481:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065216.844484:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065216.844487:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc14796a2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844490:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72a00/0xad6b7ddc14796a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844501:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc14796a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844506:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc14796a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844510:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc14796a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844514:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065216.844516:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc14796a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844523:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc14796a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844528:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5dd00) 00010000:00010000:3.0:1746065216.844530:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065216.844532:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc14796a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844536:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f72c00/0xad6b7ddc14796a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065216.844562:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc147969b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939632 expref: 16 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.844570:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc14796b0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939632 expref: 15 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.844575:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065216.844577:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065216.844579:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73600, rc 0) 00000100:00100000:3.0:1746065216.844601:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2472:x1830881265372416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 436us (1172us total) trans 8589937076 rc 0/0 00000100:00100000:3.0:1746065216.844606:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14573 00000100:00100000:0.0:1746065216.850434:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.850536:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265372672 00000100:00100000:2.0:1746065216.850542:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265372672 00002000:00100000:2.0:1746065216.850579:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4870143) req@ffff88012f1a5880 x1830881265372672/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.850587:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5880 with x1830881265372672 ext(4194304->4870143) 00010000:00010000:2.0:1746065216.850595:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 29 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.850607:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 29 pid: 9549 timeout: 912 lvb_type: 0 00002000:00010000:2.0:1746065216.850618:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1a5880 00000100:00100000:0.0:1746065216.851998:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.852019:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.852307:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263980800:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065216.852326:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.852480:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265372160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8860us (8969us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.852494:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8154 00000100:00100000:1.0:1746065216.852526:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265372800 00000100:00100000:1.0:1746065216.852528:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265372800 00000100:00100000:1.0:1746065216.852560:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 852 00000100:00100000:1.0:1746065216.852565:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265372800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.852574:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.852591:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc14796b0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939632 expref: 15 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.852606:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065216.852609:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.852622:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265372800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065216.852627:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 852 00000100:00100000:0.0:1746065216.852812:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.852858:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.852873:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265372928 00000100:00100000:0.0:1746065216.852876:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265372928 00000100:00100000:0.0:1746065216.852897:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265373056 00000100:00100000:0.0:1746065216.852899:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265373056 00000100:00100000:0.0:1746065216.852909:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265373184 00000100:00100000:0.0:1746065216.852910:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265373184 00000100:00100000:0.0:1746065216.852927:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17461 00000100:00100000:0.0:1746065216.852931:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2007:x1830881265372928:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065216.852941:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.852951:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc14796be lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939639 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.852994:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263980928:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065216.853032:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.853054:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17462 00000100:00100000:0.0:1746065216.853059:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265373056:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065216.853064:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.853081:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc14796c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939640 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.853102:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263981056:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065216.853118:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.853128:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17463 00000100:00100000:0.0:1746065216.853132:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2007:x1830881265373184:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065216.853137:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.853143:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f04a000/0xad6b7ddc14796cc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939647 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.853159:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263981184:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065216.853171:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.853368:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2045 00000100:00100000:2.0:1746065216.853387:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2005:x1830881265372672:12345-192.168.202.27@tcp:4:multiop.0 00002000:00010000:2.0:1746065216.857972:0:12260:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime: 1746065216 -> 1746065217 00002000:00010000:2.0:1746065216.857978:0:12260:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime: 1746065215 -> 1746065217 00002000:00010000:2.0:1746065216.857980:0:12260:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime: 1746065216 -> 1746065217 00000100:00100000:2.0:1746065216.857995:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263980928:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065216.858023:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc14796be lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939639 expref: 34 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.858036:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dce00/0xad6b7ddc14796be lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939639 expref: 34 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.858055:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dce00, rc 0) 00000100:00100000:2.0:1746065216.858098:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+33:2007:x1830881265372928:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5165us (6078us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065216.858106:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17461 00002000:00010000:1.0:1746065216.860059:0:1880:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065216 -> 1746065217 00002000:00010000:1.0:1746065216.860065:0:1880:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065216 -> 1746065217 00002000:00010000:1.0:1746065216.860067:0:1880:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065216 -> 1746065217 00000100:00100000:1.0:1746065216.860079:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263981056:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065216.860099:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc14796c5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939640 expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.860109:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc14796c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939640 expref: 10 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065216.860128:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd600, rc 0) 00000100:00100000:1.0:1746065216.860475:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265373056:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7415us (7662us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065216.860482:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17462 00002000:00010000:2.0:1746065216.860585:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746065216 -> 1746065217 00002000:00010000:2.0:1746065216.860588:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746065216 -> 1746065217 00000100:00100000:2.0:1746065216.860595:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263981184:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065216.860610:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f04a000/0xad6b7ddc14796cc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939647 expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.860624:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f04a000/0xad6b7ddc14796cc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939647 expref: 32 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065216.860631:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f04a000, rc 0) 00000100:00100000:2.0:1746065216.860646:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2007:x1830881265373184:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7514us (7788us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065216.860651:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17463 00000100:00100000:0.0:1746065216.869373:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.869592:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.869619:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265373568 00000100:00100000:0.0:1746065216.869625:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265373568 00002000:00100000:0.0:1746065216.869656:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1409024->1413119) req@ffff88012f3c1500 x1830881265373568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.869667:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c1500 with x1830881265373568 ext(1409024->1413119) 00002000:00010000:0.0:1746065216.869672:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3c1500 00000100:00100000:0.0:1746065216.869690:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6235 00000100:00100000:0.0:1746065216.869696:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265373568:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065216.869810:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265373568:12345-192.168.202.27@tcp:3:cat.0 Request processed in 114us (217us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065216.869817:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6235 00002000:00100000:0.0:1746065216.869822:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1409024->1413119) req@ffff88012f3c1500 x1830881265373568/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/4536 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.869829:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c1500 with x1830881265373568 ext(1409024->1413119) 00002000:00010000:0.0:1746065216.869832:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3c1500 00000100:00100000:2.0:1746065216.872358:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265373312 00000100:00100000:2.0:1746065216.872365:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265373312 00000100:00100000:2.0:1746065216.872404:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17464 00000100:00100000:2.0:1746065216.872410:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2472:x1830881265373312:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065216.872422:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065216.872436:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93964e expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.872457:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 46 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.872464:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065216.872466:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065216.872469:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 32 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.872492:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 46 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.872506:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 46 pid: 10219 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.872516:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263981312:192.168.202.27@tcp:104: 00000001:00080000:0.0:1746065216.873369:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874290 is committed 00000001:00080000:0.0:1746065216.873377:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874289 is committed 00000001:00080000:0.0:1746065216.873402:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874270 is committed 00000100:00100000:0.0:1746065216.873510:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.875549:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265373824 00000100:00100000:3.0:1746065216.875557:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265373824 00000100:00100000:3.0:1746065216.875625:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5461 00000100:00100000:3.0:1746065216.875633:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2464:x1830881265373824:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065216.875804:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2464:x1830881265373824:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 171us (2294us total) trans 8589937077 rc 0/0 00000100:00100000:3.0:1746065216.875811:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5461 00000100:00100000:0.0:1746065216.875947:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265372672:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 22561us (25519us total) trans 17179874291 rc 0/0 00000100:00100000:0.0:1746065216.875954:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2045 00002000:00100000:0.0:1746065216.875961:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4870143) req@ffff88012f1a5880 x1830881265372672/t17179874291(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/448 e 0 to 0 dl 1746065227 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.875969:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5880 with x1830881265372672 ext(4194304->4870143) 00010000:00010000:0.0:1746065216.875976:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 11 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.875987:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 11 pid: 9549 timeout: 912 lvb_type: 0 00002000:00010000:0.0:1746065216.875993:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f1a5880 00000100:00100000:0.0:1746065216.883755:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.885120:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265374080 00000100:00100000:1.0:1746065216.885127:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265374080 00010000:00010000:1.0:1746065216.885155:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 11 pid: 9549 timeout: 912 lvb_type: 0 00000100:00100000:1.0:1746065216.885177:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8155 00000100:00100000:1.0:1746065216.885183:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265374080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065216.885193:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065216.885209:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 11 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.885218:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 11 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.885236:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73200/0xad6b7ddc1479686 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4870143) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93961d expref: 11 pid: 9549 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.885251:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.885252:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065216.885258:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.885266:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065216.885292:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065216.885302:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263981440:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065216.886544:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.886571:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263981312:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.886590:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.886601:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2200, rc 0) 00000100:00100000:2.0:1746065216.886630:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2472:x1830881265373312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14220us (17264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.886637:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17464 00000100:00100000:2.0:1746065216.886992:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.889733:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.889861:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265373952 00000100:00100000:3.0:1746065216.889870:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265373952 00002000:00100000:3.0:1746065216.889904:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x75:0x0] (458752->1048575) req@ffff88012f09e300 x1830881265373952/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065216.889914:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e300 with x1830881265373952 ext(458752->1048575) 00010000:00010000:3.0:1746065216.889922:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 27 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.889934:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 27 pid: 10219 timeout: 912 lvb_type: 0 00002000:00010000:3.0:1746065216.889940:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09e300 00000100:00100000:3.0:1746065216.890958:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2046 00000100:00100000:3.0:1746065216.890967:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881265373952:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065216.899924:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.899945:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.900010:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263981440:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065216.900029:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065216.900031:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265374336 00000100:00100000:0.0:1746065216.900037:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265374336 00000100:00100000:3.0:1746065216.900061:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265374080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 14878us (16313us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065216.900068:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265374464 00000100:00100000:0.0:1746065216.900070:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265374464 00000100:00100000:3.0:1746065216.900071:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8155 00000100:00100000:0.0:1746065216.900085:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17465 00000100:00100000:0.0:1746065216.900091:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265374336:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065216.900108:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.900122:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc14796da lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939655 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.900163:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263981568:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065216.900364:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17466 00000100:00100000:0.0:1746065216.900371:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881265374464:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065216.900378:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065216.900386:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc14796e1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93965c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065216.900409:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263981696:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065216.901651:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.902159:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.904728:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265373952:12345-192.168.202.27@tcp:4:cat.0 Request processed in 13754us (14994us total) trans 17179874292 rc 0/0 00000100:00100000:0.0:1746065216.904738:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2046 00002000:00100000:0.0:1746065216.904748:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x75:0x0] (458752->1048575) req@ffff88012f09e300 x1830881265373952/t17179874292(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/448 e 0 to 0 dl 1746065227 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065216.904757:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e300 with x1830881265373952 ext(458752->1048575) 00010000:00010000:0.0:1746065216.904766:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 31 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:0.0:1746065216.904801:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 31 pid: 10219 timeout: 912 lvb_type: 0 00002000:00010000:0.0:1746065216.904812:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09e300 00002000:00010000:3.0:1746065216.905098:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065216 -> 1746065217 00000100:00100000:3.0:1746065216.905113:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263981696:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065216.905139:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc14796e1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93965c expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.905155:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099cd2800/0xad6b7ddc14796e1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93965c expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065216.905168:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd2800, rc 0) 00000100:00100000:3.0:1746065216.905190:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881265374464:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4820us (5244us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065216.905196:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17466 00000100:00100000:0.0:1746065216.905358:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263981568:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065216.905372:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc14796da lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939655 expref: 30 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.905379:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc14796da lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939655 expref: 30 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065216.905389:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9000, rc 0) 00000100:00100000:0.0:1746065216.905407:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265374336:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5316us (5492us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065216.905413:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17465 00000100:00100000:0.0:1746065216.910304:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065216.910514:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.910739:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265374720 00000100:00100000:2.0:1746065216.910746:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265374720 00002000:00100000:2.0:1746065216.910813:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff88012f3c3800 x1830881265374720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.910823:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c3800 with x1830881265374720 ext(5033984->5038079) 00002000:00010000:2.0:1746065216.910827:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c3800 00000100:00100000:2.0:1746065216.910853:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6236 00000100:00100000:2.0:1746065216.910859:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265374720:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065216.910958:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265374720:12345-192.168.202.27@tcp:3:cat.0 Request processed in 99us (660us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065216.910964:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6236 00002000:00100000:2.0:1746065216.910969:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff88012f3c3800 x1830881265374720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/4536 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065216.910976:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c3800 with x1830881265374720 ext(5033984->5038079) 00002000:00010000:2.0:1746065216.910979:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c3800 00000100:00100000:3.0:1746065216.913007:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265374848 00000100:00100000:3.0:1746065216.913014:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265374848 00010000:00010000:3.0:1746065216.913037:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 29 pid: 10219 timeout: 912 lvb_type: 0 00000100:00100000:3.0:1746065216.913066:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8156 00000100:00100000:3.0:1746065216.913072:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265374848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065216.913082:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065216.913096:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 29 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.913106:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 29 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.913123:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f46c00/0xad6b7ddc1479678 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 458752->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93960f expref: 29 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:3.0:1746065216.913137:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.913140:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065216.913145:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 8 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.913153:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 8 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065216.913175:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 8 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065216.913185:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263981824:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065216.913238:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.917688:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065216.917960:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265375104 00000100:00100000:3.0:1746065216.917967:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265375104 00000100:00100000:3.0:1746065216.917999:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5462 00000100:00100000:3.0:1746065216.918005:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2469:x1830881265375104:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065216.918153:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2469:x1830881265375104:12345-192.168.202.27@tcp:35:cat.0 Request processed in 148us (472us total) trans 8589937078 rc 0/0 00000100:00100000:3.0:1746065216.918160:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5462 00000100:00100000:0.0:1746065216.918721:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.918882:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263981824:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065216.918895:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065216.919066:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265375360 00000100:00100000:1.0:1746065216.919070:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265375360 00002000:00100000:1.0:1746065216.919091:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012f3c1c00 x1830881265375360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.919100:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c1c00 with x1830881265375360 ext(0->1048575) 00002000:00010000:1.0:1746065216.919104:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c1c00 00000100:00100000:1.0:1746065216.919245:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6237 00000100:00100000:1.0:1746065216.919250:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2006:x1830881265375360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065216.920048:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265374848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6974us (9532us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.920055:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8156 00000100:00100000:1.0:1746065216.939805:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2006:x1830881265375360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20516us (21046us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065216.939817:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6237 00002000:00100000:1.0:1746065216.939828:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012f3c1c00 x1830881265375360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.939837:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c1c00 with x1830881265375360 ext(0->1048575) 00002000:00010000:1.0:1746065216.939842:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c1c00 00000100:00100000:0.0:1746065216.947374:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.947435:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265375488 00000100:00100000:2.0:1746065216.947443:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265375488 00000100:00100000:2.0:1746065216.947494:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17467 00000100:00100000:2.0:1746065216.947501:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2472:x1830881265375488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065216.947517:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065216.947530:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939663 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.947555:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.947561:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065216.947563:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065216.947566:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 10 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.947590:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.947600:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 21 pid: 10219 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.947611:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263981952:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065216.947695:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065216.958275:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.958360:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265375616 00000100:00100000:1.0:1746065216.958368:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265375616 00002000:00100000:1.0:1746065216.958404:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1413119) req@ffff88012f3c2d80 x1830881265375616/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.958414:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c2d80 with x1830881265375616 ext(1048576->1413119) 00010000:00010000:1.0:1746065216.958421:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 22 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.958435:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 22 pid: 10219 timeout: 912 lvb_type: 0 00002000:00010000:1.0:1746065216.958440:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3c2d80 00000100:00100000:1.0:1746065216.958467:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2047 00000100:00100000:1.0:1746065216.958473:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881265375616:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065216.958632:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263981952:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065216.958653:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 10 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.958664:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3200, rc 0) 00000100:00100000:2.0:1746065216.958685:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2472:x1830881265375488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11186us (11319us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.958691:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17467 00000100:00100000:1.0:1746065216.973180:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881265375616:12345-192.168.202.27@tcp:4:cat.0 Request processed in 14695us (14901us total) trans 21474841686 rc 0/0 00000100:00100000:1.0:1746065216.973193:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2047 00002000:00100000:1.0:1746065216.973206:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1413119) req@ffff88012f3c2d80 x1830881265375616/t21474841686(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:132/0 lens 488/448 e 0 to 0 dl 1746065227 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.973215:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c2d80 with x1830881265375616 ext(1048576->1413119) 00010000:00010000:1.0:1746065216.973226:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 24 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:1.0:1746065216.973242:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 24 pid: 10219 timeout: 912 lvb_type: 0 00002000:00010000:1.0:1746065216.973249:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012f3c2d80 00000100:00100000:0.0:1746065216.979945:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065216.983979:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265375744 00000100:00100000:2.0:1746065216.983989:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265375744 00010000:00010000:2.0:1746065216.984023:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 24 pid: 10219 timeout: 912 lvb_type: 0 00000100:00100000:2.0:1746065216.984051:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8157 00000100:00100000:2.0:1746065216.984058:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881265375744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065216.984079:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065216.984095:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 24 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.984106:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 24 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.984126:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147968d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1413119) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939624 expref: 24 pid: 10219 timeout: 912 lvb_type: 0 00010000:00010000:2.0:1746065216.984155:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.984157:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065216.984162:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 9 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.984169:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 9 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065216.984195:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 9 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065216.984205:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263982080:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065216.984282:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065216.987614:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263982080:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065216.987631:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065216.987667:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881265375744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3609us (7728us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065216.987677:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8157 00000100:00100000:0.0:1746065216.997205:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065216.997279:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265376000 00000100:00100000:1.0:1746065216.997288:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265376000 00002000:00100000:1.0:1746065216.997322:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88012f3c0380 x1830881265376000/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/0 e 0 to 0 dl 1746065227 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065216.997332:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0380 with x1830881265376000 ext(1048576->2097151) 00002000:00010000:1.0:1746065216.997337:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3c0380 00000100:00100000:1.0:1746065216.997365:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6238 00000100:00100000:1.0:1746065216.997371:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265376000:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065217.008938:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265376000:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11558us (11732us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065217.008952:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6238 00002000:00100000:1.0:1746065217.008962:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88012f3c0380 x1830881265376000/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:132/0 lens 488/440 e 0 to 0 dl 1746065227 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065217.008976:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0380 with x1830881265376000 ext(1048576->2097151) 00002000:00010000:1.0:1746065217.008981:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3c0380 00000100:00100000:0.0:1746065217.030850:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.033935:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265376128 00000100:00100000:2.0:1746065217.033945:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265376128 00000100:00100000:2.0:1746065217.034012:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17468 00000100:00100000:2.0:1746065217.034020:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2472:x1830881265376128:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065217.034035:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065217.034048:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93966a expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.034071:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.034072:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.034078:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 10 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.034091:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 10 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.034099:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2a00, rc 0) 00000100:00100000:2.0:1746065217.034143:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2472:x1830881265376128:12345-192.168.202.27@tcp:101:cat.0 Request processed in 124us (3300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.034148:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17468 00000100:00080000:3.0:1746065217.034234:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065217.040990:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.042206:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265376384 00000100:00100000:2.0:1746065217.042215:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265376384 00000100:00100000:2.0:1746065217.042279:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14574 00000100:00100000:2.0:1746065217.042287:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2477:x1830881265376384:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065217.042308:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065217.042324:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2000/0xad6b7ddc14796f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939671 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.042393:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc14796fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042405:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc14796fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042415:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc14796fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042426:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479704 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042430:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042435:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042552:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2600/0xad6b7ddc147970b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042561:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2600/0xad6b7ddc147970b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042567:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2600/0xad6b7ddc147970b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065217.042575:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065217.042632:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc14796fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042638:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc14796fd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042643:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc14796fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042648:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc14796fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042653:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065217.042657:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc14796fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042662:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc14796fd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042671:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065217.042673:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065217.042676:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc14796fd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042681:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc14796fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042703:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479704 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042707:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479704 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042711:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479704 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042714:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f2c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065217.042716:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479704 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042723:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479704 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042728:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f854600) 00010000:00010000:2.0:1746065217.042730:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065217.042731:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479704 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042735:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479704 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.042762:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2000/0xad6b7ddc14796f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939671 expref: 38 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.042770:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2600/0xad6b7ddc147970b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939671 expref: 37 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.042787:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065217.042788:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065217.042790:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2600, rc 0) 00000100:00100000:2.0:1746065217.042824:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2477:x1830881265376384:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 539us (1842us total) trans 8589937079 rc 0/0 00000100:00100000:2.0:1746065217.042829:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14574 00000100:00080000:3.0:1746065217.042934:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065217.046958:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.047744:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.047850:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265376640 00000100:00100000:1.0:1746065217.047858:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265376640 00000100:00100000:3.0:1746065217.047992:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265376512 00000100:00100000:3.0:1746065217.047996:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265376512 00000100:00100000:3.0:1746065217.048044:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 853 00000100:00100000:3.0:1746065217.048052:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881265376512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065217.048064:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065217.048084:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2600/0xad6b7ddc147970b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939671 expref: 37 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.048103:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065217.048107:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065217.048140:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881265376512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.048146:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 853 00000100:00100000:1.0:1746065217.048316:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17469 00000100:00100000:1.0:1746065217.048322:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2477:x1830881265376640:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065217.048334:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065217.048345:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939678 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.048372:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.048379:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 9 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.048383:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.048385:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.048388:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2543616->2605055] (req 2543616->2605055) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.048410:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 9 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.048419:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 9 pid: 1880 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.048433:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263982208:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065217.048487:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 29 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.048494:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 29 pid: 3068 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.048501:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263982336:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065217.048516:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00080000:1.0:1746065217.048545:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065217.052770:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.053032:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263982208:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065217.053043:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263982336:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065217.053066:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2543616->2605055] (req 2543616->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.053079:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdba00, rc 0) 00000100:00100000:1.0:1746065217.053122:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2477:x1830881265376640:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4799us (5377us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.053129:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17469 00000100:00100000:2.0:1746065217.053754:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265376768 00000100:00100000:2.0:1746065217.053760:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265376768 00010000:00010000:2.0:1746065217.053803:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 29 pid: 3068 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746065217.053829:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8158 00000100:00100000:2.0:1746065217.053836:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265376768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065217.053847:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065217.053863:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 29 pid: 3068 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.053872:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 29 pid: 3068 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.053888:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dcc00/0xad6b7ddc1479694 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93962b expref: 29 pid: 3068 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.053904:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065217.053922:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265376768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.053927:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8158 00000100:00100000:2.0:1746065217.053981:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.054021:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.054038:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265377280 00000100:00100000:2.0:1746065217.054041:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265377280 00002000:00100000:2.0:1746065217.054061:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88012f09d180 x1830881265377280/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.054069:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881265377280 ext(2097152->4194303) 00010000:00010000:2.0:1746065217.054075:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 10 pid: 1880 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.054084:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 10 pid: 1880 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.054091:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09d180 00000100:00100000:2.0:1746065217.054100:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265377152 00000100:00100000:2.0:1746065217.054101:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265377152 00000100:00080000:2.0:1746065217.054116:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00100000:2.0:1746065217.054126:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4095999) req@ffff88012f09ca80 x1830881265377152/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.054132:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ca80 with x1830881265377152 ext(2097152->4095999) 00002000:00010000:2.0:1746065217.054135:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ca80 00000100:00100000:2.0:1746065217.054148:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2048 00000100:00100000:2.0:1746065217.054152:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265377280:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065217.055258:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6239 00000100:00100000:2.0:1746065217.055265:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265377152:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065217.091586:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.093437:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265377536 00000100:00100000:2.0:1746065217.093447:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265377536 00000100:00100000:2.0:1746065217.093508:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14575 00000100:00100000:2.0:1746065217.093516:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2482:x1830881265377536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065217.093536:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065217.093551:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090685400/0xad6b7ddc1479720 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93967f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.093614:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479727 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093624:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479727 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093636:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479727 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093647:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147972e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093652:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147972e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093656:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147972e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093729:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090684200/0xad6b7ddc1479735 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093737:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090684200/0xad6b7ddc1479735 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093742:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090684200/0xad6b7ddc1479735 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065217.093750:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065217.093833:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479727 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093838:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479727 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093842:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479727 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093846:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479727 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093851:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090685000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065217.093854:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479727 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093860:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479727 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093869:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065217.093871:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065217.093874:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479727 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093878:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479727 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093893:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147972e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093897:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147972e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093900:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147972e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093903:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090684a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065217.093905:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147972e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093908:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147972e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093913:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f854500) 00010000:00010000:2.0:1746065217.093915:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065217.093916:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147972e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093924:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147972e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065217.093950:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090685400/0xad6b7ddc1479720 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93967f expref: 39 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.093959:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090684200/0xad6b7ddc1479735 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93967f expref: 38 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.093964:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065217.093966:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065217.093967:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090684200, rc 0) 00000100:00100000:2.0:1746065217.094007:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2482:x1830881265377536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 492us (2429us total) trans 8589937080 rc 0/0 00000100:00100000:2.0:1746065217.094012:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14575 00000100:00100000:3.0:1746065217.095109:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265377280:12345-192.168.202.27@tcp:3:cat.0 Request processed in 40952us (41124us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065217.095117:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2048 00002000:00100000:3.0:1746065217.095124:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88012f09d180 x1830881265377280/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.095133:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d180 with x1830881265377280 ext(2097152->4194303) 00010000:00010000:3.0:1746065217.095139:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 10 pid: 1880 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.095151:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 10 pid: 1880 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.095157:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09d180 00000100:00100000:0.0:1746065217.099714:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.099956:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265377792 00000100:00100000:2.0:1746065217.099963:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265377792 00000100:00100000:2.0:1746065217.100016:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14576 00000100:00100000:2.0:1746065217.100023:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2481:x1830881265377792:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065217.100043:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065217.100057:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090685400/0xad6b7ddc1479743 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939686 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.100114:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147974a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100125:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147974a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100137:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147974a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100148:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479751 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100153:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100157:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100232:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc1479758 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100239:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc1479758 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100245:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc1479758 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065217.100251:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065217.100308:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147974a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100313:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147974a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100318:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147974a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100323:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147974a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100327:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090684a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065217.100330:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147974a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100335:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147974a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100344:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065217.100357:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065217.100361:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147974a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.100365:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090684a00/0xad6b7ddc147974a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00000100:00080000:3.0:1746065217.100404:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746065217.101375:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479751 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.101383:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479751 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.101387:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479751 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.101391:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880090685000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065217.101393:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479751 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.101397:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479751 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.101404:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f854400) 00010000:00010000:2.0:1746065217.101406:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065217.101408:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479751 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.101415:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090685000/0xad6b7ddc1479751 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.101447:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090685400/0xad6b7ddc1479743 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939686 expref: 17 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.101457:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc1479758 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939686 expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.101463:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065217.101465:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065217.101467:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091baf600, rc 0) 00000100:00100000:2.0:1746065217.101513:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2481:x1830881265377792:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1489us (1806us total) trans 8589937081 rc 0/0 00000100:00100000:2.0:1746065217.101519:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14576 00010000:00010000:2.0:1746065217.105522:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065217.111481:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.111533:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.111553:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.111579:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265377920 00000100:00100000:1.0:1746065217.111586:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265377920 00010000:00010000:1.0:1746065217.111612:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 10 pid: 1880 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.111636:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265378304 00000100:00100000:1.0:1746065217.111637:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265378304 00000100:00100000:1.0:1746065217.111651:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8159 00000100:00100000:1.0:1746065217.111657:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265377920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.111668:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.111683:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 10 pid: 1880 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.111694:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 10 pid: 1880 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.111711:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2a00/0xad6b7ddc14796ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93966a expref: 10 pid: 1880 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.111726:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.111728:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.111733:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.111740:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.111764:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065217.111794:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263982464:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065217.111853:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065217.111912:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 854 00000100:00100000:1.0:1746065217.111917:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265378304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.111923:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.111935:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091baf600/0xad6b7ddc1479758 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939686 expref: 16 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.111944:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065217.111947:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.111963:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265378304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.111969:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 854 00000100:00100000:1.0:1746065217.112008:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265378176 00000100:00100000:1.0:1746065217.112011:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265378176 00000100:00100000:1.0:1746065217.112025:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5463 00000100:00100000:1.0:1746065217.112029:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4110850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2481:x1830881265378176:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065217.112150:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4110850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2481:x1830881265378176:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 120us (616us total) trans 8589937082 rc 0/0 00000100:00100000:1.0:1746065217.112155:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5463 00000100:00100000:2.0:1746065217.112540:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265377152:12345-192.168.202.27@tcp:3:cat.0 Request processed in 57275us (58518us total) trans 0 rc 1998848/1998848 00000100:00100000:2.0:1746065217.112547:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6239 00002000:00100000:2.0:1746065217.112554:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4095999) req@ffff88012f09ca80 x1830881265377152/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 1998848/1998848 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.112562:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ca80 with x1830881265377152 ext(2097152->4095999) 00002000:00010000:2.0:1746065217.112565:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ca80 00000100:00100000:0.0:1746065217.120361:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.120390:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.120410:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.121940:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.121963:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265378432 00000100:00100000:0.0:1746065217.121970:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265378432 00000100:00100000:1.0:1746065217.122267:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265378560 00000100:00100000:1.0:1746065217.122272:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265378560 00000100:00100000:1.0:1746065217.122300:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265378688 00000100:00100000:1.0:1746065217.122302:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265378688 00000100:00100000:1.0:1746065217.122321:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265378816 00000100:00100000:1.0:1746065217.122322:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265378816 00000100:00100000:1.0:1746065217.122335:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17470 00000100:00100000:1.0:1746065217.122340:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265378560:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065217.122361:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065217.122374:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c000/0xad6b7ddc1479766 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93968d expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.122394:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.122396:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.122402:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c000/0xad6b7ddc1479766 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93968d expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065217.122415:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c000/0xad6b7ddc1479766 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93968d expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065217.122423:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c000, rc 0) 00000100:00100000:1.0:1746065217.122461:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265378560:12345-192.168.202.27@tcp:101:cat.0 Request processed in 120us (2113us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.122466:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17470 00000100:00100000:1.0:1746065217.122479:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17471 00000100:00100000:1.0:1746065217.122484:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265378688:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065217.122490:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065217.122498:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc147976d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939694 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.122508:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.122509:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.122513:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc147976d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939694 expref: 24 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065217.122521:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc147976d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939694 expref: 24 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065217.122526:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d600, rc 0) 00000100:00100000:1.0:1746065217.122539:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265378688:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.122544:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17471 00000100:00100000:1.0:1746065217.122552:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17472 00000100:00100000:1.0:1746065217.122556:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265378816:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065217.122560:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065217.122565:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1479774 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93969b expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065217.122594:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263982592:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065217.122628:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eee40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065217.122661:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.122674:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265378944 00000100:00100000:1.0:1746065217.122677:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265378944 00000100:00100000:1.0:1746065217.122698:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17473 00000100:00100000:1.0:1746065217.122702:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265378944:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065217.122708:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065217.122714:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147977b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396a2 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065217.122736:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263982720:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065217.122753:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065217.122837:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263982464:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065217.122850:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.122863:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265377920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11207us (11392us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.122869:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8159 00000100:00100000:1.0:1746065217.122882:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 855 00000100:00100000:1.0:1746065217.122887:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881265378432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.122893:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.122908:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090684200/0xad6b7ddc1479735 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93967f expref: 38 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.122917:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065217.122920:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.122931:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac563050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881265378432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (996us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.122936:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 855 00000100:00080000:2.0:1746065217.123018:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065217.126023:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.126073:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.126240:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265379328 00000100:00100000:0.0:1746065217.126245:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265379328 00000100:00100000:0.0:1746065217.126274:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17474 00000100:00100000:0.0:1746065217.126280:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2472:x1830881265379328:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065217.126292:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065217.126305:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396a9 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.126326:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.126333:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065217.126335:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065217.126338:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.126369:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.126383:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 30 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746065217.126391:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263982848:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065217.126444:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065217.126551:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265379200 00000100:00100000:2.0:1746065217.126555:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265379200 00002000:00100000:2.0:1746065217.126577:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2543616->2547711) req@ffff88008c52b800 x1830881265379200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.126585:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52b800 with x1830881265379200 ext(2543616->2547711) 00010000:00010000:2.0:1746065217.126590:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.126599:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.126604:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c52b800 00000100:00100000:2.0:1746065217.126614:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2049 00000100:00100000:2.0:1746065217.126618:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265379200:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065217.126718:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265379200:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 99us (702us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065217.126724:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2049 00002000:00100000:2.0:1746065217.126729:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2543616->2547711) req@ffff88008c52b800 x1830881265379200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/4536 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.126735:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52b800 with x1830881265379200 ext(2543616->2547711) 00010000:00010000:2.0:1746065217.126739:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.126746:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.126751:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c52b800 00000100:00100000:0.0:1746065217.130552:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263982848:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065217.130579:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.130594:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3e00, rc 0) 00000100:00100000:0.0:1746065217.130630:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2472:x1830881265379328:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4349us (4555us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065217.130637:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17474 00000100:00100000:0.0:1746065217.130757:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263982720:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065217.130793:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147977b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a2 expref: 25 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065217.130803:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c200/0xad6b7ddc147977b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a2 expref: 25 pid: 12260 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746065217.131374:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065216 -> 1746065217 00000100:00100000:1.0:1746065217.131385:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263982592:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065217.131399:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1479774 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93969b expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065217.131408:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c600/0xad6b7ddc1479774 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93969b expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065217.131416:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c600, rc 0) 00000100:00100000:1.0:1746065217.131438:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265378816:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8882us (11027us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065217.131443:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17472 00010000:00010000:0.0:1746065217.132374:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c200, rc 0) 00000100:00100000:2.0:1746065217.133081:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.134259:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265378944:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11550us (11592us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065217.134268:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17473 00000100:00100000:3.0:1746065217.134878:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265379584 00000100:00100000:3.0:1746065217.134885:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265379584 00002000:00100000:3.0:1746065217.134914:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2600960->2605055) req@ffff88012f09c380 x1830881265379584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.134922:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c380 with x1830881265379584 ext(2600960->2605055) 00010000:00010000:3.0:1746065217.134930:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 29 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.134942:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 29 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.134948:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09c380 00000100:00100000:3.0:1746065217.135187:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2050 00000100:00100000:3.0:1746065217.135194:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265379584:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065217.135509:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265379584:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 314us (2430us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065217.135515:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2050 00002000:00100000:3.0:1746065217.135520:0:29493:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_009: refresh rw locks for [0x2c0000401:0x78:0x0] (2600960->2605055) req@ffff88012f09c380 x1830881265379584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/4536 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.135527:0:29493:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09c380 with x1830881265379584 ext(2600960->2605055) 00010000:00010000:3.0:1746065217.135531:0:29493:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 29 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.135540:0:29493:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 29 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.135545:0:29493:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09c380 00000100:00100000:2.0:1746065217.148522:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.148598:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265379712 00000100:00100000:1.0:1746065217.148606:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265379712 00000100:00100000:1.0:1746065217.149988:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17475 00000100:00100000:1.0:1746065217.149998:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2481:x1830881265379712:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065217.150013:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065217.150029:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396b0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.150052:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065217.150057:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.150063:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065217.150066:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->3354623] (req 3145728->3354623) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 11 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.150096:0:12260:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.150112:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->3354623] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 11 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.150122:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d200, rc 0) 00000100:00100000:1.0:1746065217.151325:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2481:x1830881265379712:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1326us (2806us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.151332:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17475 00000100:00100000:0.0:1746065217.156942:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.156982:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.157016:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.157152:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265379968 00000100:00100000:2.0:1746065217.157159:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265379968 00002000:00100000:2.0:1746065217.157193:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2543616->2605055) req@ffff88008c52ad80 x1830881265379968/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.157201:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52ad80 with x1830881265379968 ext(2543616->2605055) 00010000:00010000:2.0:1746065217.157208:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 29 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.157220:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 29 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.157226:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c52ad80 00000100:00100000:2.0:1746065217.157245:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265380480 00000100:00100000:2.0:1746065217.157248:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265380480 00002000:00100000:2.0:1746065217.157257:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88008c52bb80 x1830881265380480/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.157263:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52bb80 with x1830881265380480 ext(0->1048575) 00002000:00010000:2.0:1746065217.157266:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c52bb80 00000100:00100000:2.0:1746065217.157277:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2051 00000100:00100000:2.0:1746065217.157282:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265379968:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065217.157380:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6240 00000100:00100000:2.0:1746065217.157385:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265380480:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065217.157914:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265380224 00000100:00100000:1.0:1746065217.157918:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265380224 00000100:00100000:1.0:1746065217.157942:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5464 00000100:00100000:1.0:1746065217.157946:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2477:x1830881265380224:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065217.158452:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2477:x1830881265380224:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 124us (1137us total) trans 8589937083 rc 0/0 00000100:00100000:1.0:1746065217.158460:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5464 00000100:00100000:3.0:1746065217.159076:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.159113:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265380736 00000100:00100000:2.0:1746065217.159118:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265380736 00002000:00100000:2.0:1746065217.159137:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880091a90a80 x1830881265380736/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.159146:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90a80 with x1830881265380736 ext(1048576->2097151) 00002000:00010000:2.0:1746065217.159150:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90a80 00000100:00100000:2.0:1746065217.159167:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6241 00000100:00100000:2.0:1746065217.159171:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265380736:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065217.173881:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265380480:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16486us (16855us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065217.173891:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6240 00002000:00100000:2.0:1746065217.173899:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88008c52bb80 x1830881265380480/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.173908:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52bb80 with x1830881265380480 ext(0->1048575) 00002000:00010000:2.0:1746065217.173913:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c52bb80 00000100:00100000:2.0:1746065217.174032:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265379968:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 16749us (17049us total) trans 17179874293 rc 0/0 00000100:00100000:2.0:1746065217.174038:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2051 00002000:00100000:2.0:1746065217.174043:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2543616->2605055) req@ffff88008c52ad80 x1830881265379968/t17179874293(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/448 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.174050:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c52ad80 with x1830881265379968 ext(2543616->2605055) 00010000:00010000:2.0:1746065217.174056:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.174070:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.174076:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c52ad80 00000100:00100000:0.0:1746065217.179142:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.179306:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265380864 00000100:00100000:1.0:1746065217.179314:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265380864 00010000:00010000:1.0:1746065217.179341:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.179643:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8160 00000100:00100000:1.0:1746065217.179651:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265380864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.179663:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.179678:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.179694:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.179711:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479719 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2543616->2605055) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939678 expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.179734:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.179736:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.179741:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.179749:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.179793:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.179803:0:7192:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 10 pid: 10219 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.179813:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263983104:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065217.179872:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065217.187067:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263983104:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065217.187087:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.187475:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265380864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7823us (8338us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.187485:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8160 00000100:00100000:0.0:1746065217.189560:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.192545:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265380736:12345-192.168.202.27@tcp:3:cat.0 Request processed in 33367us (33465us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065217.192555:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6241 00002000:00100000:0.0:1746065217.192564:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880091a90a80 x1830881265380736/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065217.192573:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90a80 with x1830881265380736 ext(1048576->2097151) 00002000:00010000:0.0:1746065217.192579:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90a80 00000100:00100000:2.0:1746065217.192793:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265381120 00000100:00100000:2.0:1746065217.192800:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265381120 00002000:00100000:2.0:1746065217.192826:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff8800957db800 x1830881265381120/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.192833:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db800 with x1830881265381120 ext(3145728->4194303) 00010000:00010000:2.0:1746065217.192840:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 11 pid: 10219 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.192851:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 11 pid: 10219 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.192857:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957db800 00000100:00100000:2.0:1746065217.192883:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2052 00000100:00100000:2.0:1746065217.192889:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265381120:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065217.210973:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265381120:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 18072us (21406us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065217.210984:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2052 00002000:00100000:2.0:1746065217.210993:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff8800957db800 x1830881265381120/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.211002:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db800 with x1830881265381120 ext(3145728->4194303) 00010000:00010000:2.0:1746065217.211010:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 11 pid: 10219 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.211028:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 11 pid: 10219 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.211034:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957db800 00000100:00100000:0.0:1746065217.219719:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.219802:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265381248 00000100:00100000:1.0:1746065217.219810:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265381248 00010000:00010000:1.0:1746065217.219841:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 11 pid: 10219 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.219875:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8161 00000100:00100000:1.0:1746065217.219882:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265381248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.219894:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.219908:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 11 pid: 10219 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.219918:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 11 pid: 10219 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.219936:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd3e00/0xad6b7ddc1479782 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396a9 expref: 11 pid: 10219 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.219957:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.219959:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.219965:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 10 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.219971:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 10 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.220047:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 10 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065217.220058:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263983232:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065217.220878:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b20eef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065217.227712:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.227749:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.227807:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.227820:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265381504 00000100:00100000:0.0:1746065217.227822:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265381632 00000100:00100000:2.0:1746065217.227827:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265381504 00000100:00100000:0.0:1746065217.227827:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265381632 00000100:00100000:2.0:1746065217.227866:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265381376 00000100:00100000:2.0:1746065217.227869:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265381376 00000100:00100000:0.0:1746065217.227874:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17476 00000100:00100000:0.0:1746065217.227880:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265381504:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065217.227883:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17477 00000100:00100000:2.0:1746065217.227888:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265381632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065217.227895:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065217.227899:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065217.227899:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17478 00000100:00100000:1.0:1746065217.227906:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265381376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065217.227909:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1479797 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396c5 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.227909:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1479790 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396be expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.227911:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065217.227916:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc147979e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396b7 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065217.227946:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263983488:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065217.227946:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263983360:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065217.227946:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263983616:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065217.228489:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065217.229900:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065217.230061:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065217.230854:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.230903:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265381888 00000100:00100000:3.0:1746065217.230909:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265381888 00000100:00100000:0.0:1746065217.230935:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263983232:192.168.202.27@tcp:105: 00002000:00100000:3.0:1746065217.230942:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3350528->3354623) req@ffff88012f09e680 x1830881265381888/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:0.0:1746065217.230951:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065217.230975:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265381248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11094us (11264us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065217.230984:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8161 00002000:00100000:3.0:1746065217.231056:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e680 with x1830881265381888 ext(3350528->3354623) 00002000:00010000:3.0:1746065217.231061:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09e680 00000100:00100000:1.0:1746065217.231166:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263983360:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065217.231311:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6242 00000100:00100000:3.0:1746065217.231318:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265381888:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065217.231940:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265381888:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 621us (1088us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065217.231946:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6242 00002000:00100000:3.0:1746065217.231952:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3350528->3354623) req@ffff88012f09e680 x1830881265381888/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/4536 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.231959:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09e680 with x1830881265381888 ext(3350528->3354623) 00002000:00010000:3.0:1746065217.231963:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09e680 00010000:00010000:1.0:1746065217.232245:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc147979e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b7 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065217.232257:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c200/0xad6b7ddc147979e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b7 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065217.232278:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c200, rc 0) 00000100:00100000:1.0:1746065217.232300:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265381376:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4395us (4492us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065217.232306:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17478 00000100:00100000:2.0:1746065217.236531:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881263983616:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065217.236564:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1479790 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396be expref: 31 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065217.236577:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fda600/0xad6b7ddc1479790 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396be expref: 31 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065217.236600:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda600, rc 0) 00000100:00100000:2.0:1746065217.236638:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265381504:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8758us (8932us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065217.236646:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17476 00000100:00100000:3.0:1746065217.237128:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263983488:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065217.237147:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1479797 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396c5 expref: 25 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.237156:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ad2d800/0xad6b7ddc1479797 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396c5 expref: 25 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.237172:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2d800, rc 0) 00000100:00100000:3.0:1746065217.237192:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265381632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9303us (9442us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065217.237198:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17477 00000100:00100000:2.0:1746065217.243112:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.243188:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265382016 00000100:00100000:3.0:1746065217.243197:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265382016 00000100:00100000:3.0:1746065217.243230:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17479 00000100:00100000:3.0:1746065217.243237:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2482:x1830881265382016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065217.243251:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.243266:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396cc expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.243292:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 9 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.243299:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065217.243301:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065217.243304:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 31 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.243328:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 9 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.243338:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 9 pid: 12260 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746065217.243357:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263983744:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065217.244135:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065217.249184:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.249756:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263983744:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065217.250151:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 31 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.250173:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61200, rc 0) 00000100:00100000:3.0:1746065217.250215:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2482:x1830881265382016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6979us (7111us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.250223:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17479 00000100:00100000:2.0:1746065217.250312:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265382272 00000100:00100000:2.0:1746065217.250319:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265382272 00002000:00100000:2.0:1746065217.250359:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800957d9f80 x1830881265382272/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.250367:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9f80 with x1830881265382272 ext(4194304->5038079) 00010000:00010000:2.0:1746065217.250373:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 10 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.250383:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 10 pid: 12260 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.250388:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957d9f80 00000100:00100000:2.0:1746065217.250403:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2053 00000100:00100000:2.0:1746065217.250409:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265382272:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065217.250721:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.250793:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265382400 00000100:00100000:3.0:1746065217.250797:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265382400 00002000:00100000:3.0:1746065217.250810:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3354623) req@ffff8800957dad80 x1830881265382400/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.250816:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957dad80 with x1830881265382400 ext(3145728->3354623) 00010000:00010000:3.0:1746065217.250821:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 12 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.250830:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 12 pid: 12260 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.250836:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957dad80 00000100:00100000:3.0:1746065217.250849:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2054 00000100:00100000:3.0:1746065217.250853:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265382400:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065217.268026:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265382400:12345-192.168.202.27@tcp:4:cat.0 Request processed in 17163us (17296us total) trans 17179874294 rc 0/0 00000100:00100000:3.0:1746065217.268040:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2054 00002000:00100000:3.0:1746065217.268050:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3354623) req@ffff8800957dad80 x1830881265382400/t17179874294(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/448 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.268064:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957dad80 with x1830881265382400 ext(3145728->3354623) 00010000:00010000:3.0:1746065217.268208:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 14 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.268222:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 14 pid: 12260 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.268228:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957dad80 00000100:00100000:2.0:1746065217.268373:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265382272:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17962us (19194us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065217.268383:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2053 00002000:00100000:2.0:1746065217.268388:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800957d9f80 x1830881265382272/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.268397:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9f80 with x1830881265382272 ext(4194304->5038079) 00010000:00010000:2.0:1746065217.268402:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 12 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.268411:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 12 pid: 12260 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.268417:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957d9f80 00000100:00100000:0.0:1746065217.277390:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.278498:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.278611:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265382656 00000100:00100000:3.0:1746065217.278619:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265382656 00000100:00100000:3.0:1746065217.278653:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17480 00000100:00100000:3.0:1746065217.278659:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265382656:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065217.278673:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.278686:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc14797ac lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396d3 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065217.278726:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263983872:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065217.278794:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065217.278850:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265382528 00000100:00100000:2.0:1746065217.278853:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265382528 00010000:00010000:2.0:1746065217.278867:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 14 pid: 12260 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746065217.278882:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8162 00000100:00100000:2.0:1746065217.278885:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265382528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065217.278892:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065217.278906:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 14 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.278916:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 14 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.278931:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.278932:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.278937:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.278943:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.278963:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065217.278970:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263984000:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065217.278988:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065217.283206:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263984000:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065217.283224:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065217.283260:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265382528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4372us (5875us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.283268:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8162 00010000:00010000:3.0:1746065217.285110:0:9549:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff880091a92680 x1830881263983872) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 13 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.285143:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d200/0xad6b7ddc1479789 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3354623) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396b0 expref: 13 pid: 12260 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746065217.285174:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263983872:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065217.285197:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc14797ac lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396d3 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.285208:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61600/0xad6b7ddc14797ac lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396d3 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.285215:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61600, rc 0) 00000100:00100000:3.0:1746065217.285248:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265382656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6588us (6750us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065217.285255:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17480 00000100:00100000:0.0:1746065217.287119:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.287239:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265382912 00000100:00100000:2.0:1746065217.287245:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265382912 00002000:00100000:2.0:1746065217.287278:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800957d8a80 x1830881265382912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.287287:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8a80 with x1830881265382912 ext(2097152->3145727) 00002000:00010000:2.0:1746065217.287291:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d8a80 00000100:00100000:2.0:1746065217.287323:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6243 00000100:00100000:2.0:1746065217.287330:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265382912:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065217.302333:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.302439:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265383040 00000100:00100000:3.0:1746065217.302447:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265383040 00000100:00100000:3.0:1746065217.302617:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17481 00000100:00100000:3.0:1746065217.302624:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2472:x1830881265383040:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065217.302641:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.302655:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61800/0xad6b7ddc14797b3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396da expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.302676:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.302678:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.302683:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61800/0xad6b7ddc14797b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396da expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.302695:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61800/0xad6b7ddc14797b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396da expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.302703:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61800, rc 0) 00000100:00100000:3.0:1746065217.303388:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2472:x1830881265383040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 761us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.303394:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17481 00000100:00100000:2.0:1746065217.304542:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265382912:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17210us (17425us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065217.304551:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6243 00002000:00100000:2.0:1746065217.304560:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800957d8a80 x1830881265382912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.304573:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8a80 with x1830881265382912 ext(2097152->3145727) 00002000:00010000:2.0:1746065217.304577:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d8a80 00000100:00100000:2.0:1746065217.313985:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.314440:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265383168 00000100:00100000:3.0:1746065217.314447:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265383168 00000100:00100000:3.0:1746065217.314491:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17482 00000100:00100000:3.0:1746065217.314498:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+24:2482:x1830881265383168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065217.314513:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.314527:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396e1 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.314550:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 9 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.314557:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065217.314558:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065217.314561:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.314583:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 9 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.314592:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 9 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746065217.314602:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263984128:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065217.314660:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065217.314703:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.314747:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265383424 00000100:00100000:3.0:1746065217.314750:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265383424 00002000:00100000:3.0:1746065217.314769:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff880091a92680 x1830881265383424/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.314793:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92680 with x1830881265383424 ext(5033984->5038079) 00002000:00010000:3.0:1746065217.314797:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a92680 00000100:00100000:3.0:1746065217.314811:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6244 00000100:00100000:3.0:1746065217.314816:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265383424:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065217.314897:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265383424:12345-192.168.202.27@tcp:3:cat.0 Request processed in 80us (193us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065217.314902:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6244 00002000:00100000:3.0:1746065217.314907:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff880091a92680 x1830881265383424/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/4536 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.314913:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92680 with x1830881265383424 ext(5033984->5038079) 00002000:00010000:3.0:1746065217.314915:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a92680 00000100:00100000:2.0:1746065217.315090:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.316180:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265383680 00000100:00100000:3.0:1746065217.316186:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265383680 00000100:00100000:3.0:1746065217.316229:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14577 00000100:00100000:3.0:1746065217.316235:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2486:x1830881265383680:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065217.316250:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.316263:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc14797c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396e8 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.316316:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc14797c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316327:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc14797c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316335:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc14797c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316357:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc14797cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316362:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc14797cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316367:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc14797cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316440:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc14797d6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316448:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc14797d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316455:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc14797d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065217.316462:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065217.316553:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc14797c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316560:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc14797c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316564:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc14797c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316569:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc14797c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316574:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065217.316578:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc14797c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316584:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc14797c8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316593:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065217.316595:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065217.316598:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc14797c8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.316603:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc14797c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.318786:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc14797cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.318797:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc14797cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.318803:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc14797cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.318808:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065217.318811:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc14797cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.318816:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc14797cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.318828:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5d800) 00010000:00010000:3.0:1746065217.318831:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065217.318834:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc14797cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.318839:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc14797cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.318889:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc14797c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e8 expref: 41 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.318899:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc14797d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e8 expref: 40 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.318905:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065217.318908:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065217.318910:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60200, rc 0) 00000100:00100000:3.0:1746065217.321565:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2486:x1830881265383680:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5321us (6466us total) trans 8589937084 rc 0/0 00000100:00100000:3.0:1746065217.321574:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14577 00000100:00100000:2.0:1746065217.322060:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.322088:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265383936 00000100:00100000:2.0:1746065217.322094:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265383936 00000100:00100000:3.0:1746065217.322163:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263984128:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065217.322185:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.322199:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60e00, rc 0) 00000100:00100000:3.0:1746065217.322227:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2482:x1830881265383168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7731us (8251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.322233:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17482 00000100:00100000:2.0:1746065217.323422:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5465 00000100:00100000:2.0:1746065217.323432:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2472:x1830881265383936:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065217.323579:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2472:x1830881265383936:12345-192.168.202.27@tcp:35:cat.0 Request processed in 150us (1520us total) trans 8589937085 rc 0/0 00000100:00100000:2.0:1746065217.323585:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5465 00000100:00100000:0.0:1746065217.323945:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.323992:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265384064 00000100:00100000:3.0:1746065217.323996:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265384064 00002000:00100000:3.0:1746065217.324018:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3063808->4194303) req@ffff8800957db480 x1830881265384064/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 504/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.324027:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db480 with x1830881265384064 ext(3063808->4194303) 00010000:00010000:3.0:1746065217.324033:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 10 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.324043:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 10 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.324048:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800957db480 00000100:00100000:3.0:1746065217.324058:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2055 00000100:00100000:3.0:1746065217.324062:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265384064:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065217.330442:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.330531:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265384192 00000100:00100000:3.0:1746065217.330540:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265384192 00000100:00100000:3.0:1746065217.330589:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 856 00000100:00100000:3.0:1746065217.330598:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881265384192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065217.330609:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065217.330632:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc14797d6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e8 expref: 40 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.330654:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065217.330657:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065217.330698:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881265384192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 101us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.330706:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 856 00000100:00100000:3.0:1746065217.337020:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265384064:12345-192.168.202.27@tcp:4:cat.0 Request processed in 12947us (13065us total) trans 21474841687 rc 0/0 00000100:00100000:3.0:1746065217.337035:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2055 00002000:00100000:3.0:1746065217.337310:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3063808->4194303) req@ffff8800957db480 x1830881265384064/t21474841687(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 504/448 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.337322:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db480 with x1830881265384064 ext(3063808->4194303) 00010000:00010000:3.0:1746065217.337449:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.337462:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.337468:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800957db480 00000100:00100000:0.0:1746065217.345472:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.348170:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265384320 00000100:00100000:3.0:1746065217.348181:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265384320 00010000:00010000:3.0:1746065217.349572:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746065217.349608:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8163 00000100:00100000:3.0:1746065217.349614:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265384320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065217.349625:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065217.349641:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.349651:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.349672:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3800/0xad6b7ddc1479671 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096000->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939608 expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.349697:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.349699:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.349705:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 24 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.349712:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 24 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.349738:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 24 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065217.349747:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263984256:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065217.349835:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065217.350286:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.350624:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265384448 00000100:00100000:3.0:1746065217.350629:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265384448 00000100:00100000:3.0:1746065217.350654:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17483 00000100:00100000:3.0:1746065217.350659:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2486:x1830881265384448:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065217.350670:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.350685:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396ef expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.350700:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.350711:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c000/0xad6b7ddc1479766 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93968d expref: 32 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.350716:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.350717:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.350719:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [208896->450559] (req 208896->450559) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 32 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.350734:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c000/0xad6b7ddc1479766 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93968d expref: 32 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.350742:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c000/0xad6b7ddc1479766 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93968d expref: 32 pid: 9549 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746065217.350749:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263984384:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065217.350810:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.350817:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 11 pid: 10219 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746065217.350823:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263984512:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065217.350837:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065217.361303:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.361392:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263984384:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065217.361402:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263984512:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065217.361424:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [208896->450559] (req 208896->450559) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 32 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.361437:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61a00, rc 0) 00000100:00100000:3.0:1746065217.361662:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263984256:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065217.361671:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.361724:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265384576 00000100:00100000:1.0:1746065217.361729:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265384576 00010000:00010000:1.0:1746065217.361749:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 12 pid: 10219 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.361770:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8164 00000100:00100000:1.0:1746065217.361800:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265384576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.361813:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.361829:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 12 pid: 10219 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.361837:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 12 pid: 10219 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.361854:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc14796d3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93964e expref: 12 pid: 10219 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.361872:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065217.362104:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2486:x1830881265384448:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11444us (11818us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.362111:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17483 00000100:00100000:3.0:1746065217.362165:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265384320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 12550us (16701us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.362170:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8163 00000100:00100000:1.0:1746065217.362289:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265384576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 488us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.362294:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8164 00000100:00100000:3.0:1746065217.364353:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.364747:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265384704 00000100:00100000:0.0:1746065217.364754:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265384704 00010000:00010000:0.0:1746065217.364790:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c000/0xad6b7ddc1479766 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93968d expref: 32 pid: 9549 timeout: 913 lvb_type: 1 00000100:00100000:0.0:1746065217.364813:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8165 00000100:00100000:0.0:1746065217.364818:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265384704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065217.364829:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065217.364845:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c000/0xad6b7ddc1479766 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93968d expref: 32 pid: 9549 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746065217.364855:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c000/0xad6b7ddc1479766 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93968d expref: 32 pid: 9549 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746065217.364874:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c000/0xad6b7ddc1479766 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93968d expref: 32 pid: 9549 timeout: 913 lvb_type: 1 00010000:00010000:0.0:1746065217.364905:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065217.364907:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065217.364913:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 31 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.364920:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 31 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.364946:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 31 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065217.364956:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263984640:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065217.365012:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065217.371691:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.371749:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.371803:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.371824:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265384960 00000100:00100000:3.0:1746065217.371831:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265384960 00000100:00100000:2.0:1746065217.371861:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265385216 00000100:00100000:2.0:1746065217.371867:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265385216 00002000:00100000:3.0:1746065217.371869:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091a91500 x1830881265384960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.371877:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91500 with x1830881265384960 ext(2097152->4194303) 00002000:00010000:3.0:1746065217.371882:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a91500 00002000:00100000:2.0:1746065217.371883:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (208896->212991) req@ffff880091a93b80 x1830881265385216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.371892:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93b80 with x1830881265385216 ext(208896->212991) 00002000:00010000:2.0:1746065217.371895:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a93b80 00000100:00100000:3.0:1746065217.371896:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6245 00000100:00100000:3.0:1746065217.371902:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265384960:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065217.371905:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265385472 00000100:00100000:2.0:1746065217.371906:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265385472 00002000:00100000:2.0:1746065217.371915:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091a93100 x1830881265385472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.371922:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93100 with x1830881265385472 ext(3145728->4194303) 00002000:00010000:2.0:1746065217.371925:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a93100 00000100:00100000:2.0:1746065217.371933:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6246 00000100:00100000:2.0:1746065217.371937:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265385216:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065217.372026:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265385216:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 88us (276us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065217.372032:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6246 00002000:00100000:2.0:1746065217.372037:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (208896->212991) req@ffff880091a93b80 x1830881265385216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/4536 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.372043:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93b80 with x1830881265385216 ext(208896->212991) 00002000:00010000:2.0:1746065217.372046:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a93b80 00000100:00100000:2.0:1746065217.372056:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6247 00000100:00100000:2.0:1746065217.372060:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265385472:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065217.373090:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263984640:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065217.373108:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.373140:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265384704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8321us (8801us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.373148:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8165 00000100:00100000:2.0:1746065217.395585:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.397269:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265385728 00000100:00100000:0.0:1746065217.397280:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265385728 00002000:00100000:0.0:1746065217.397324:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x75:0x0] (446464->450559) req@ffff88012f09fb80 x1830881265385728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065217.397337:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09fb80 with x1830881265385728 ext(446464->450559) 00002000:00010000:0.0:1746065217.397341:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09fb80 00000100:00100000:0.0:1746065217.397377:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6248 00000100:00100000:0.0:1746065217.397384:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265385728:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065217.397502:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265385728:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 118us (1924us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065217.397508:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6248 00002000:00100000:0.0:1746065217.397513:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x75:0x0] (446464->450559) req@ffff88012f09fb80 x1830881265385728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/4536 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065217.397519:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09fb80 with x1830881265385728 ext(446464->450559) 00002000:00010000:0.0:1746065217.397521:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09fb80 00000100:00100000:3.0:1746065217.399018:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265385472:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 26953us (27210us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065217.399026:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6247 00002000:00100000:3.0:1746065217.399032:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091a93100 x1830881265385472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.399039:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93100 with x1830881265385472 ext(3145728->4194303) 00002000:00010000:3.0:1746065217.399043:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a93100 00000100:00100000:0.0:1746065217.407993:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.413429:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265385984 00000100:00100000:3.0:1746065217.413440:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265385984 00000100:00100000:3.0:1746065217.413508:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14578 00000100:00100000:3.0:1746065217.413514:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2489:x1830881265385984:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065217.413537:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.413553:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc14797eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396f6 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.413614:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14797f2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413624:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14797f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413633:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14797f2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413643:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14797f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413647:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14797f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413652:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14797f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413732:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc1479800 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413740:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc1479800 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413745:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc1479800 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065217.413752:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065217.413848:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14797f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413857:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14797f2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413861:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14797f2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413866:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14797f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413870:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065217.413873:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14797f2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413877:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14797f2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413885:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065217.413887:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065217.413890:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14797f2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413894:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc14797f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413919:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14797f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413922:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14797f9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413926:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14797f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413928:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065217.413930:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14797f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413934:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14797f9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413938:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5d900) 00010000:00010000:3.0:1746065217.413940:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065217.413941:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14797f9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413945:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc14797f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.413970:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc14797eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396f6 expref: 20 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.413978:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc1479800 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396f6 expref: 19 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.413983:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065217.413984:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065217.413986:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b52b0400, rc 0) 00000100:00100000:3.0:1746065217.414039:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2489:x1830881265385984:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 524us (6053us total) trans 8589937086 rc 0/0 00000100:00100000:3.0:1746065217.414044:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14578 00000100:00100000:0.0:1746065217.415971:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.416031:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265384960:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 44127us (44345us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065217.416033:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265386240 00000100:00100000:3.0:1746065217.416040:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6245 00000100:00100000:1.0:1746065217.416040:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265386240 00002000:00100000:3.0:1746065217.416048:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091a91500 x1830881265384960/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.416057:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91500 with x1830881265384960 ext(2097152->4194303) 00002000:00010000:3.0:1746065217.416061:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a91500 00000100:00100000:1.0:1746065217.416076:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5466 00000100:00100000:1.0:1746065217.416082:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2486:x1830881265386240:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065217.416211:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2486:x1830881265386240:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 128us (244us total) trans 8589937087 rc 0/0 00000100:00100000:1.0:1746065217.416216:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5466 00000100:00100000:0.0:1746065217.417954:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.417991:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.418046:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265386624 00000100:00100000:2.0:1746065217.418051:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265386624 00000100:00100000:1.0:1746065217.418056:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265386496 00000100:00100000:1.0:1746065217.418058:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265386496 00000100:00100000:2.0:1746065217.418090:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 857 00000100:00100000:1.0:1746065217.418090:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5467 00000100:00100000:2.0:1746065217.418096:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265386624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065217.418096:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2489:x1830881265386496:12345-192.168.202.27@tcp:35:multiop.0 00010000:00010000:2.0:1746065217.418106:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065217.418126:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc1479800 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396f6 expref: 20 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.418144:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065217.418147:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065217.418173:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265386624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 77us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.418178:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 857 00000100:00100000:1.0:1746065217.418196:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2489:x1830881265386496:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 100us (247us total) trans 8589937088 rc 0/0 00000100:00100000:1.0:1746065217.418200:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5467 00000100:00100000:0.0:1746065217.446060:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.451000:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265386752 00000100:00100000:2.0:1746065217.451012:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265386752 00000100:00100000:2.0:1746065217.451084:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17484 00000100:00100000:2.0:1746065217.451092:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2489:x1830881265386752:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065217.451109:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065217.451123:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9396fd expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.451149:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.451157:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61800/0xad6b7ddc14797b3 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396da expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.451163:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.451165:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.451169:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2646016->3031039] (req 2646016->3031039) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.451197:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61800/0xad6b7ddc14797b3 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396da expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.451208:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f61800/0xad6b7ddc14797b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396da expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746065217.451218:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263984768:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065217.451325:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 30 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.451333:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 30 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746065217.451340:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263984896:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065217.451370:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065217.459683:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.459803:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265387008 00000100:00100000:3.0:1746065217.459811:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265387008 00000100:00100000:3.0:1746065217.459849:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14579 00000100:00100000:3.0:1746065217.459856:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2494:x1830881265387008:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065217.459876:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.459890:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc1479815 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939704 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.459946:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc147981c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.459956:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc147981c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.459964:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc147981c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.459973:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc1479823 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.459978:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc1479823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.459982:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc1479823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460053:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc147982a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460064:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc147982a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460068:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc147982a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065217.460074:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065217.460123:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc147981c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460128:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc147981c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460133:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc147981c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460137:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc147981c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460141:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065217.460144:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc147981c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460148:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc147981c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460155:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065217.460158:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065217.460160:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc147981c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460164:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539a00/0xad6b7ddc147981c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460260:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc1479823 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460265:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc1479823 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460269:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc1479823 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460272:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065217.460274:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc1479823 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460278:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc1479823 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460283:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5de00) 00010000:00010000:3.0:1746065217.460284:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065217.460286:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc1479823 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460289:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538a00/0xad6b7ddc1479823 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065217.460323:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc1479815 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939704 expref: 22 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.460331:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc147982a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939704 expref: 21 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.460336:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065217.460339:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065217.460340:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538c00, rc 0) 00000100:00100000:3.0:1746065217.460751:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2494:x1830881265387008:12345-192.168.202.27@tcp:101:cat.0 Request processed in 893us (1074us total) trans 8589937089 rc 0/0 00000100:00100000:3.0:1746065217.460757:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14579 00000100:00100000:0.0:1746065217.483666:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.483747:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265387264 00000100:00100000:3.0:1746065217.483755:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265387264 00002000:00100000:3.0:1746065217.483808:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800957dbb80 x1830881265387264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.483817:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957dbb80 with x1830881265387264 ext(4194304->5038079) 00010000:00010000:3.0:1746065217.483824:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.483835:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.483841:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957dbb80 00000100:00100000:3.0:1746065217.483856:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2056 00000100:00100000:3.0:1746065217.483862:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265387264:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065217.487716:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.487744:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.487760:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.487792:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265387520 00000100:00100000:0.0:1746065217.487798:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265387520 00000100:00100000:0.0:1746065217.487838:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265387648 00000100:00100000:0.0:1746065217.487840:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265387648 00000100:00100000:0.0:1746065217.487854:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17485 00000100:00100000:0.0:1746065217.487860:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265387520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065217.487873:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065217.487887:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1479838 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93970b expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065217.487927:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263985024:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065217.487995:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065217.488019:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.488065:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.488090:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265387776 00000100:00100000:0.0:1746065217.488093:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265387776 00000100:00100000:0.0:1746065217.488111:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17486 00000100:00100000:0.0:1746065217.488116:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265387648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065217.488121:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065217.488128:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc147983f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939712 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.488139:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065217.488147:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc147983f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939712 expref: 16 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065217.488155:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a656e600/0xad6b7ddc147983f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939712 expref: 16 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065217.488167:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656e600, rc 0) 00000100:00100000:0.0:1746065217.488188:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265387648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (427us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065217.488194:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17486 00000100:00100000:0.0:1746065217.488206:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17487 00000100:00100000:0.0:1746065217.488211:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265387776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065217.488217:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065217.488224:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479846 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939719 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.488233:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065217.488235:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065217.488241:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479846 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939719 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065217.488253:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479846 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939719 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065217.488260:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656ec00, rc 0) 00000100:00100000:0.0:1746065217.488273:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265387776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 62us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065217.488278:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17487 00000100:00100000:0.0:1746065217.488329:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265387392 00000100:00100000:0.0:1746065217.488331:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265387392 00010000:00010000:0.0:1746065217.488354:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61800/0xad6b7ddc14797b3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396da expref: 15 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746065217.488370:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265387904 00000100:00100000:0.0:1746065217.488373:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265387904 00000100:00100000:0.0:1746065217.488387:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8166 00000100:00100000:0.0:1746065217.488391:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265387392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065217.488398:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065217.488410:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f61800/0xad6b7ddc14797b3 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396da expref: 15 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746065217.488418:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f61800/0xad6b7ddc14797b3 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396da expref: 15 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746065217.488429:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065217.488444:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265387392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065217.488449:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8166 00000100:00100000:0.0:1746065217.488458:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 858 00000100:00100000:0.0:1746065217.488461:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265387904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065217.488467:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065217.488479:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc147982a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939704 expref: 21 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.488490:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065217.488493:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065217.488503:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265387904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065217.488507:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 858 00010000:00010000:2.0:1746065217.488722:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61800/0xad6b7ddc14797b3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396da expref: 14 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746065217.488745:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263984768:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065217.488755:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263984896:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065217.488792:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2646016->3031039] (req 2646016->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.488804:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97e00, rc 0) 00000100:00100000:2.0:1746065217.488822:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2489:x1830881265386752:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 37731us (42769us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.488827:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17484 00000100:00100000:3.0:1746065217.502259:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265387264:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18389us (18591us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065217.502268:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2056 00002000:00100000:3.0:1746065217.502277:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800957dbb80 x1830881265387264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.502286:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957dbb80 with x1830881265387264 ext(4194304->5038079) 00010000:00010000:3.0:1746065217.502295:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.502307:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.502313:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957dbb80 00000100:00100000:0.0:1746065217.507768:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.507971:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.508041:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265388160 00000100:00100000:1.0:1746065217.508049:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265388160 00010000:00010000:1.0:1746065217.508078:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.508101:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8167 00000100:00100000:1.0:1746065217.508107:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265388160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.508117:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.508132:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.508142:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.508164:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61200/0xad6b7ddc14797a5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396cc expref: 31 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.508180:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.508182:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.508187:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.508193:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.508219:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065217.508229:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263985152:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065217.508294:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065217.508461:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263985024:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065217.508484:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1479838 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93970b expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065217.508493:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc1479838 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93970b expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065217.508505:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdaa00, rc 0) 00000100:00100000:2.0:1746065217.508543:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265387520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 20683us (20798us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065217.508546:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265388032 00000100:00100000:3.0:1746065217.508549:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265388032 00000100:00100000:2.0:1746065217.508549:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17485 00000100:00100000:2.0:1746065217.508565:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17488 00000100:00100000:2.0:1746065217.508570:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265388032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065217.508579:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065217.508587:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97000/0xad6b7ddc147984d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939720 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065217.508611:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263985280:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065217.508630:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065217.511451:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263985280:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065217.511475:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a97000/0xad6b7ddc147984d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939720 expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065217.511486:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a97000/0xad6b7ddc147984d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939720 expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065217.511495:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97000, rc 0) 00000100:00100000:2.0:1746065217.511528:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265388032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2958us (3556us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065217.511536:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17488 00000100:00100000:0.0:1746065217.511803:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.512239:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263985152:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065217.512250:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.512274:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265388160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4167us (4512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.512275:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265388288 00000100:00100000:3.0:1746065217.512280:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265388288 00000100:00100000:1.0:1746065217.512281:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8167 00000100:00100000:3.0:1746065217.512722:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17489 00000100:00100000:3.0:1746065217.512729:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2494:x1830881265388288:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065217.512740:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.512751:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939727 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.513481:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.513488:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065217.513490:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065217.513493:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.513517:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 29 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.513528:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 29 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746065217.513540:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263985408:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065217.514447:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.515265:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065217.515949:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265388544 00000100:00100000:2.0:1746065217.515955:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265388544 00002000:00100000:2.0:1746065217.515987:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2646016->2650111) req@ffff880136a7bb80 x1830881265388544/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.515995:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7bb80 with x1830881265388544 ext(2646016->2650111) 00002000:00010000:2.0:1746065217.515999:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7bb80 00000100:00100000:2.0:1746065217.516015:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6249 00000100:00100000:2.0:1746065217.516021:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265388544:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065217.516118:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265388544:12345-192.168.202.27@tcp:3:cat.0 Request processed in 96us (1672us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065217.516123:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6249 00002000:00100000:2.0:1746065217.516128:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2646016->2650111) req@ffff880136a7bb80 x1830881265388544/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/4536 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.516134:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7bb80 with x1830881265388544 ext(2646016->2650111) 00002000:00010000:2.0:1746065217.516137:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7bb80 00000100:00100000:2.0:1746065217.516215:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.516459:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265388672 00000100:00100000:3.0:1746065217.516463:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265388672 00000100:00100000:3.0:1746065217.516482:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17490 00000100:00100000:3.0:1746065217.516486:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2482:x1830881265388672:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065217.516494:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.516505:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93972e expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.516525:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.516531:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065217.516532:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065217.516534:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [5033984->5242879] (req 5033984->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 31 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.516552:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.516560:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:3.0:1746065217.516568:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263985536:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065217.518269:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065217.522052:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263985408:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065217.522077:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.522093:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538800, rc 0) 00000100:00100000:3.0:1746065217.522122:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2494:x1830881265388288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9393us (10319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.522129:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17489 00000100:00100000:0.0:1746065217.522203:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.522291:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.522351:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265388800 00000100:00100000:2.0:1746065217.522357:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265388800 00000100:00100000:3.0:1746065217.523852:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265389056 00000100:00100000:3.0:1746065217.523858:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265389056 00002000:00100000:3.0:1746065217.523885:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3026944->3031039) req@ffff880136a7a300 x1830881265389056/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.523893:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7a300 with x1830881265389056 ext(3026944->3031039) 00010000:00010000:3.0:1746065217.523901:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.523910:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.523916:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a7a300 00000100:00100000:3.0:1746065217.523938:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2057 00000100:00100000:3.0:1746065217.523943:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265389056:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:2.0:1746065217.524308:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (208896->450559) req@ffff880136a79500 x1830881265388800/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.524315:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79500 with x1830881265388800 ext(208896->450559) 00010000:00010000:2.0:1746065217.524320:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 32 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.524327:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 32 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.524332:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a79500 00000100:00100000:2.0:1746065217.524353:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2058 00000100:00100000:2.0:1746065217.524358:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265388800:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065217.525680:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265389056:12345-192.168.202.27@tcp:3:cat.0 Request processed in 1732us (3384us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065217.525691:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2057 00002000:00100000:3.0:1746065217.525698:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3026944->3031039) req@ffff880136a7a300 x1830881265389056/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/4536 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.525705:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7a300 with x1830881265389056 ext(3026944->3031039) 00010000:00010000:3.0:1746065217.525711:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.525719:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.525724:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a7a300 00000100:00100000:3.0:1746065217.544893:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263985536:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065217.544918:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [5033984->5242879] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 33 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.544932:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538a00, rc 0) 00000100:00100000:3.0:1746065217.544964:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2482:x1830881265388672:12345-192.168.202.27@tcp:101:cat.0 Request processed in 28476us (28748us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.544971:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17490 00000100:00100000:0.0:1746065217.552646:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.552744:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.552796:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265389568 00000100:00100000:0.0:1746065217.552804:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265389568 00000100:00100000:0.0:1746065217.552849:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14580 00000100:00100000:0.0:1746065217.552856:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2496:x1830881265389568:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065217.552876:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065217.552892:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1479862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939735 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.552950:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1479869 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.552961:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1479869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.552969:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1479869 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.552979:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc1479870 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.552984:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc1479870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.552988:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc1479870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553058:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc1479877 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553067:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc1479877 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553072:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc1479877 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:0.0:1746065217.553079:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065217.553148:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1479869 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553153:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1479869 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553158:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1479869 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553164:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1479869 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553169:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012fd81e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065217.553172:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1479869 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553177:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1479869 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553186:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065217.553188:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065217.553191:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1479869 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553195:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81e00/0xad6b7ddc1479869 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553216:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc1479870 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553220:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc1479870 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553224:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc1479870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553227:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065217.553229:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc1479870 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553236:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc1479870 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553241:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098c34d00) 00010000:00010000:0.0:1746065217.553243:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065217.553244:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc1479870 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553248:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06600/0xad6b7ddc1479870 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:0.0:1746065217.553278:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd81200/0xad6b7ddc1479862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939735 expref: 43 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.553286:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc1479877 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939735 expref: 42 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.553291:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065217.553293:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065217.553295:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06c00, rc 0) 00000100:00100000:0.0:1746065217.553329:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2496:x1830881265389568:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 474us (586us total) trans 8589937090 rc 0/0 00000100:00100000:0.0:1746065217.553334:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14580 00000100:00100000:3.0:1746065217.553479:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265389312 00000100:00100000:3.0:1746065217.553483:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265389312 00002000:00100000:3.0:1746065217.553504:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2646016->3031039) req@ffff880136a79f80 x1830881265389312/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.553512:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79f80 with x1830881265389312 ext(2646016->3031039) 00010000:00010000:3.0:1746065217.553518:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.553528:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 12 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.553533:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a79f80 00000100:00100000:3.0:1746065217.553547:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2059 00000100:00100000:3.0:1746065217.553552:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265389312:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065217.556523:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265388800:12345-192.168.202.27@tcp:4:cat.0 Request processed in 32158us (34313us total) trans 17179874295 rc 0/0 00000100:00100000:2.0:1746065217.556533:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2058 00002000:00100000:2.0:1746065217.556541:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (208896->450559) req@ffff880136a79500 x1830881265388800/t17179874295(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/448 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.556550:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79500 with x1830881265388800 ext(208896->450559) 00010000:00010000:2.0:1746065217.556559:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 33 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.556569:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 33 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.556576:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a79500 00000100:00100000:3.0:1746065217.560616:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265389312:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7055us (7968us total) trans 17179874296 rc 0/0 00000100:00100000:3.0:1746065217.560627:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2059 00002000:00100000:3.0:1746065217.560637:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2646016->3031039) req@ffff880136a79f80 x1830881265389312/t17179874296(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/448 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.560645:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79f80 with x1830881265389312 ext(2646016->3031039) 00010000:00010000:3.0:1746065217.560655:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 14 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:3.0:1746065217.560666:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 14 pid: 9549 timeout: 913 lvb_type: 0 00002000:00010000:3.0:1746065217.560672:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a79f80 00000100:00100000:0.0:1746065217.561283:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.561333:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.561400:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265389696 00000100:00100000:2.0:1746065217.561407:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265389696 00000100:00100000:2.0:1746065217.561435:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265389824 00000100:00100000:2.0:1746065217.561437:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265389824 00010000:00010000:2.0:1746065217.561446:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 33 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746065217.561459:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8168 00000100:00100000:2.0:1746065217.561465:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265389824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065217.561475:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065217.561489:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 33 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.561498:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 33 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.561515:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc14797e4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 208896->450559) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396ef expref: 33 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.561538:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.561540:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.561546:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.561553:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.561577:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065217.561587:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263985664:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065217.561642:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065217.561687:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 859 00000100:00100000:2.0:1746065217.561692:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881265389696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065217.561700:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065217.561710:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06c00/0xad6b7ddc1479877 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939735 expref: 42 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.561720:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065217.561723:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065217.561741:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265389696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.561745:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 859 00000100:00100000:0.0:1746065217.566089:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263985664:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065217.566110:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065217.566157:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265389824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4690us (4821us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065217.566167:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8168 00000100:00100000:2.0:1746065217.577757:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.577812:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.577891:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265389952 00000100:00100000:0.0:1746065217.577900:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265389952 00010000:00010000:0.0:1746065217.577929:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 14 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:0.0:1746065217.577953:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8169 00000100:00100000:0.0:1746065217.577959:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265389952:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065217.577970:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065217.577984:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 14 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746065217.577994:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 14 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746065217.578012:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a97e00/0xad6b7ddc147980e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2646016->3031039) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396fd expref: 14 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746065217.578027:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065217.578028:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065217.578034:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 31 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.578041:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 31 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.578066:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 31 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065217.578077:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263985792:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065217.578128:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065217.578555:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265390208 00000100:00100000:3.0:1746065217.578559:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265390208 00002000:00100000:3.0:1746065217.578581:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012f09d500 x1830881265390208/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.578588:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d500 with x1830881265390208 ext(0->1048575) 00002000:00010000:3.0:1746065217.578593:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09d500 00000100:00100000:3.0:1746065217.578604:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6250 00000100:00100000:3.0:1746065217.578610:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265390208:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065217.588669:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.588764:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263985792:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065217.588806:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065217.588842:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265389952:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10882us (11093us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.588851:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8169 00000100:00100000:3.0:1746065217.589156:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265390336 00000100:00100000:3.0:1746065217.589162:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265390336 00000100:00100000:3.0:1746065217.589296:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17491 00000100:00100000:3.0:1746065217.589302:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265390336:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065217.589317:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.589330:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc1479885 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93973c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.589357:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.589359:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.589366:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc1479885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93973c expref: 33 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.589379:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc1479885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93973c expref: 33 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.589387:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de4600, rc 0) 00000100:00100000:3.0:1746065217.593183:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265390336:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3872us (4512us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.593193:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17491 00000100:00100000:3.0:1746065217.599520:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2006:x1830881265390208:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20903us (21700us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065217.599529:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6250 00002000:00100000:3.0:1746065217.599538:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012f09d500 x1830881265390208/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.599548:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d500 with x1830881265390208 ext(0->1048575) 00002000:00010000:3.0:1746065217.599553:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09d500 00000100:00100000:0.0:1746065217.610008:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.610056:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.610141:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265390720 00000100:00100000:2.0:1746065217.610149:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265390720 00002000:00100000:2.0:1746065217.610186:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff88009aceed80 x1830881265390720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.610195:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceed80 with x1830881265390720 ext(5033984->5038079) 00002000:00010000:2.0:1746065217.610200:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aceed80 00000100:00100000:2.0:1746065217.610216:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6251 00000100:00100000:2.0:1746065217.610222:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265390720:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065217.610331:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265390720:12345-192.168.202.27@tcp:3:cat.0 Request processed in 108us (273us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065217.610336:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6251 00002000:00100000:2.0:1746065217.610352:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff88009aceed80 x1830881265390720/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/4536 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.610359:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceed80 with x1830881265390720 ext(5033984->5038079) 00002000:00010000:2.0:1746065217.610361:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aceed80 00000100:00100000:3.0:1746065217.610486:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265390464 00000100:00100000:3.0:1746065217.610489:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265390464 00000100:00100000:3.0:1746065217.610619:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17492 00000100:00100000:3.0:1746065217.610624:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2494:x1830881265390464:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065217.610633:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.610644:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147988c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939743 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.610661:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.610663:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.610668:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147988c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939743 expref: 14 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.610678:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147988c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939743 expref: 14 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.610686:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5800, rc 0) 00000100:00100000:3.0:1746065217.610704:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2494:x1830881265390464:12345-192.168.202.27@tcp:101:cat.0 Request processed in 80us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.610708:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17492 00000100:00100000:0.0:1746065217.613839:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.613911:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265390976 00000100:00100000:3.0:1746065217.613917:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265390976 00000100:00100000:1.0:1746065217.617477:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5468 00000100:00100000:1.0:1746065217.617493:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2482:x1830881265390976:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065217.617674:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2482:x1830881265390976:12345-192.168.202.27@tcp:35:cat.0 Request processed in 187us (3839us total) trans 8589937091 rc 0/0 00000100:00100000:1.0:1746065217.617679:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5468 00000100:00100000:0.0:1746065217.663645:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.663764:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265391232 00000100:00100000:2.0:1746065217.663799:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265391232 00002000:00100000:2.0:1746065217.663834:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009aceea00 x1830881265391232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.663842:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceea00 with x1830881265391232 ext(2097152->4194303) 00002000:00010000:2.0:1746065217.663846:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aceea00 00000100:00100000:2.0:1746065217.663865:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6252 00000100:00100000:2.0:1746065217.663870:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265391232:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065217.676833:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.677096:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265391488 00000100:00100000:2.0:1746065217.677104:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265391488 00002000:00100000:2.0:1746065217.677138:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009acece00 x1830881265391488/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.677147:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acece00 with x1830881265391488 ext(2097152->4194303) 00002000:00010000:2.0:1746065217.677152:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acece00 00000100:00100000:2.0:1746065217.677169:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6253 00000100:00100000:2.0:1746065217.677175:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265391488:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065217.708098:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265391232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 44218us (44450us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065217.708109:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6252 00002000:00100000:2.0:1746065217.708118:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009aceea00 x1830881265391232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.708127:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aceea00 with x1830881265391232 ext(2097152->4194303) 00002000:00010000:2.0:1746065217.708132:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aceea00 00000100:00100000:0.0:1746065217.726571:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.726595:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265391744 00000100:00100000:0.0:1746065217.726603:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265391744 00000100:00100000:0.0:1746065217.726635:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14581 00000100:00100000:0.0:1746065217.726641:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2500:x1830881265391744:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065217.726659:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065217.726672:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc1479893 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93974a expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.726726:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdac00/0xad6b7ddc147989a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726737:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdac00/0xad6b7ddc147989a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726745:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdac00/0xad6b7ddc147989a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726755:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14798a1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726760:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14798a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726765:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14798a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726855:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14798a8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726863:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14798a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726868:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14798a8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065217.726875:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065217.726924:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdac00/0xad6b7ddc147989a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726929:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdac00/0xad6b7ddc147989a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726934:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdac00/0xad6b7ddc147989a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726939:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdac00/0xad6b7ddc147989a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726944:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065217.726947:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdac00/0xad6b7ddc147989a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726952:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdac00/0xad6b7ddc147989a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726963:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065217.726966:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065217.726969:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdac00/0xad6b7ddc147989a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726974:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdac00/0xad6b7ddc147989a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726987:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14798a1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726992:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14798a1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726996:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14798a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.726999:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdaa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065217.727001:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14798a1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.727005:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14798a1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.727010:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098c34200) 00010000:00010000:0.0:1746065217.727011:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065217.727013:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14798a1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.727017:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc14798a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065217.727040:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda400/0xad6b7ddc1479893 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93974a expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.727049:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14798a8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93974a expref: 22 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.727054:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065217.727056:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065217.727058:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb800, rc 0) 00000100:00100000:0.0:1746065217.727092:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2500:x1830881265391744:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 450us (528us total) trans 8589937092 rc 0/0 00000100:00100000:0.0:1746065217.727097:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14581 00000100:00100000:3.0:1746065217.727572:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265391488:12345-192.168.202.27@tcp:3:cat.0 Request processed in 50395us (50744us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065217.727582:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6253 00002000:00100000:3.0:1746065217.727589:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009acece00 x1830881265391488/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.727598:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acece00 with x1830881265391488 ext(2097152->4194303) 00002000:00010000:3.0:1746065217.727601:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acece00 00000100:00100000:0.0:1746065217.729368:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.729477:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265391872 00000100:00100000:1.0:1746065217.729483:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265391872 00000100:00100000:1.0:1746065217.729522:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17493 00000100:00100000:1.0:1746065217.729527:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2496:x1830881265391872:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065217.729539:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065217.729551:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939751 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.729571:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 34 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.729578:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147988c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939743 expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.729583:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.729584:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.729587:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3207168->3878911] (req 3207168->3878911) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 34 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.729609:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147988c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939743 expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.729617:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147988c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939743 expref: 13 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.729627:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263985920:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065217.729690:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 34 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.729697:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 34 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.729705:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263986048:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065217.729721:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065217.733961:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.734004:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.734100:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265392128 00000100:00100000:3.0:1746065217.734108:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265392128 00000100:00100000:3.0:1746065217.734145:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5469 00000100:00100000:3.0:1746065217.734152:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4110450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2500:x1830881265392128:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065217.734247:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263985920:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065217.734257:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263986048:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065217.734280:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3207168->3878911] (req 3207168->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 34 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.734293:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d600, rc 0) 00000100:00100000:1.0:1746065217.734329:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+34:2496:x1830881265391872:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4801us (4964us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.734335:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17493 00000100:00100000:3.0:1746065217.735543:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4110450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2500:x1830881265392128:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1387us (1587us total) trans 8589937093 rc 0/0 00000100:00100000:3.0:1746065217.735550:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5469 00000100:00100000:0.0:1746065217.735677:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265392256 00000100:00100000:0.0:1746065217.735682:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265392256 00000100:00100000:0.0:1746065217.735721:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 860 00000100:00100000:0.0:1746065217.735727:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265392256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065217.735737:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065217.735757:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc14798a8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93974a expref: 23 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065217.735794:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065217.735797:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065217.735816:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265392256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (1811us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065217.735822:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 860 00000100:00100000:3.0:1746065217.735972:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.737175:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.737190:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265392384 00000100:00100000:1.0:1746065217.737193:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265392384 00010000:00010000:1.0:1746065217.737212:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147988c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939743 expref: 14 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.737231:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8170 00000100:00100000:1.0:1746065217.737237:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265392384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.737245:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.737261:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147988c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939743 expref: 14 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.737270:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147988c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939743 expref: 14 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.737284:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147988c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939743 expref: 14 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.737298:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.737317:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265392384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.737323:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8170 00000100:00100000:1.0:1746065217.738600:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265392512 00000100:00100000:1.0:1746065217.738605:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265392512 00010000:00010000:1.0:1746065217.738622:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 34 pid: 9549 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.738638:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8171 00000100:00100000:1.0:1746065217.738642:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265392512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.738649:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.738658:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 34 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.738667:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 34 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.738683:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147985b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93972e expref: 34 pid: 9549 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.738692:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.738694:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.738699:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.738705:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.738728:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065217.738736:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263986176:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065217.739514:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065217.740906:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.740974:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265392640 00000100:00100000:2.0:1746065217.740980:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265392640 00000100:00100000:2.0:1746065217.741022:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17494 00000100:00100000:2.0:1746065217.741028:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2494:x1830881265392640:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065217.741041:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065217.741054:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939758 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.741074:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.741083:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065217.741085:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065217.741088:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 14 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.741110:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.741120:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 913 lvb_type: 0 00000100:00100000:2.0:1746065217.741129:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263986304:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065217.741178:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a3edb240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065217.746598:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263986176:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065217.746618:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.746684:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265392512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8040us (9510us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.746694:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8171 00000100:00100000:0.0:1746065217.755475:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.755514:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265392896 00000100:00100000:0.0:1746065217.755521:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265392896 00002000:00100000:0.0:1746065217.755558:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3874816->3878911) req@ffff88009acec700 x1830881265392896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065217.755568:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acec700 with x1830881265392896 ext(3874816->3878911) 00010000:00010000:0.0:1746065217.755576:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746065217.755589:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 913 lvb_type: 0 00002000:00010000:0.0:1746065217.755595:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009acec700 00000100:00100000:0.0:1746065217.755611:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2060 00000100:00100000:0.0:1746065217.755617:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265392896:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065217.755722:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265392896:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 104us (253us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065217.755728:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2060 00002000:00100000:0.0:1746065217.755733:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3874816->3878911) req@ffff88009acec700 x1830881265392896/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/4536 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065217.755740:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acec700 with x1830881265392896 ext(3874816->3878911) 00010000:00010000:0.0:1746065217.755745:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746065217.755754:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 913 lvb_type: 0 00002000:00010000:0.0:1746065217.755764:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009acec700 00000100:00100000:2.0:1746065217.755933:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263986304:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065217.755953:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 14 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.755964:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97600, rc 0) 00000100:00100000:2.0:1746065217.755983:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2494:x1830881265392640:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14956us (15082us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.755989:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17494 00000100:00100000:0.0:1746065217.763026:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.763072:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.763402:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265393152 00000100:00100000:2.0:1746065217.763410:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265393152 00002000:00100000:2.0:1746065217.763444:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3207168->3878911) req@ffff88009acec380 x1830881265393152/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.763459:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acec380 with x1830881265393152 ext(3207168->3878911) 00010000:00010000:2.0:1746065217.763467:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:2.0:1746065217.763479:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 33 pid: 12260 timeout: 913 lvb_type: 0 00002000:00010000:2.0:1746065217.763486:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009acec380 00000100:00100000:2.0:1746065217.763501:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2061 00000100:00100000:2.0:1746065217.763507:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265393152:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065217.763884:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265393408 00000100:00100000:3.0:1746065217.763888:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265393408 00000100:00100000:3.0:1746065217.763909:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5470 00000100:00100000:3.0:1746065217.763913:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2496:x1830881265393408:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065217.764053:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2496:x1830881265393408:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 138us (979us total) trans 8589937094 rc 0/0 00000100:00100000:3.0:1746065217.764058:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5470 00000100:00100000:3.0:1746065217.781987:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1746065217.782007:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263986432:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746065217.782059:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065217.782154:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263986432 00000100:00100000:2.0:1746065217.782162:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263986432 00000100:00100000:2.0:1746065217.782213:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1746065217.782219:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881263986432:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746065217.782238:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1071376704 pending 3006464 free 3906641920 avail 3675119616 00000100:00100000:2.0:1746065217.782272:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881263986432:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.782277:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00080000:2.0:1746065217.782312:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065217.782861:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881263986432:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065217.787314:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265393152:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 23798us (24286us total) trans 17179874297 rc 0/0 00000100:00100000:0.0:1746065217.787326:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2061 00002000:00100000:0.0:1746065217.787336:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3207168->3878911) req@ffff88009acec380 x1830881265393152/t17179874297(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/448 e 0 to 0 dl 1746065228 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065217.787354:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acec380 with x1830881265393152 ext(3207168->3878911) 00010000:00010000:0.0:1746065217.787363:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 35 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:0.0:1746065217.787376:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 35 pid: 12260 timeout: 913 lvb_type: 0 00002000:00010000:0.0:1746065217.787382:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009acec380 00000100:00100000:0.0:1746065217.795659:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.795756:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265393536 00000100:00100000:1.0:1746065217.795765:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265393536 00010000:00010000:1.0:1746065217.795824:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 35 pid: 12260 timeout: 913 lvb_type: 0 00000100:00100000:1.0:1746065217.795866:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8172 00000100:00100000:1.0:1746065217.795873:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265393536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.795885:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.795901:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 35 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.795911:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 35 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.795930:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835d600/0xad6b7ddc14798b6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3207168->3878911) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939751 expref: 35 pid: 12260 timeout: 913 lvb_type: 0 00010000:00010000:1.0:1746065217.795956:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.795959:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065217.795964:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.795972:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.795998:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065217.796008:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263986560:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065217.796072:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065217.799962:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263986560:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065217.799979:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.800023:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265393536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4149us (4372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.800032:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8172 00000100:00100000:0.0:1746065217.802264:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.802324:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265393792 00000100:00100000:2.0:1746065217.802331:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265393792 00002000:00100000:2.0:1746065217.802379:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009acef800 x1830881265393792/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.802388:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef800 with x1830881265393792 ext(3145728->4194303) 00002000:00010000:2.0:1746065217.802392:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009acef800 00000100:00100000:2.0:1746065217.802422:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6254 00000100:00100000:2.0:1746065217.802429:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265393792:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065217.813347:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265393792:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10902us (11072us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065217.813358:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6254 00002000:00100000:2.0:1746065217.813368:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009acef800 x1830881265393792/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.813377:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef800 with x1830881265393792 ext(3145728->4194303) 00002000:00010000:2.0:1746065217.813382:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009acef800 00000100:00100000:0.0:1746065217.841737:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.844422:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265394048 00000100:00100000:2.0:1746065217.844433:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265394048 00002000:00100000:2.0:1746065217.844473:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009aecaa00 x1830881265394048/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.844483:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecaa00 with x1830881265394048 ext(4194304->5038079) 00002000:00010000:2.0:1746065217.844487:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecaa00 00000100:00100000:2.0:1746065217.844523:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6255 00000100:00100000:2.0:1746065217.844529:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265394048:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065217.866374:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265394048:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21810us (24610us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065217.866386:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6255 00002000:00100000:2.0:1746065217.866395:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009aecaa00 x1830881265394048/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065217.866404:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecaa00 with x1830881265394048 ext(4194304->5038079) 00002000:00010000:2.0:1746065217.866410:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aecaa00 00000100:00100000:0.0:1746065217.877240:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.878850:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265394304 00000100:00100000:1.0:1746065217.878860:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265394304 00000100:00100000:1.0:1746065217.878915:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5471 00000100:00100000:1.0:1746065217.878922:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2494:x1830881265394304:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065217.879123:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2494:x1830881265394304:12345-192.168.202.27@tcp:35:cat.0 Request processed in 200us (1888us total) trans 8589937095 rc 0/0 00000100:00100000:1.0:1746065217.879128:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5471 00000100:00100000:0.0:1746065217.902287:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065217.903468:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265394560 00000100:00100000:2.0:1746065217.903476:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265394560 00000100:00100000:2.0:1746065217.903524:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14582 00000100:00100000:2.0:1746065217.903530:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2506:x1830881265394560:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065217.903549:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065217.903562:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93975f expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.903617:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14798cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903627:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14798cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903636:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14798cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903647:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc14798d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903651:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc14798d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903655:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc14798d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903722:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798d9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903728:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903733:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798d9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065217.903740:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065217.903816:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14798cb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903821:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14798cb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903826:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14798cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903832:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14798cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903837:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065217.903841:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14798cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903847:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14798cb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903855:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065217.903857:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065217.903861:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14798cb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903866:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96800/0xad6b7ddc14798cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903890:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc14798d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903895:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc14798d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903903:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc14798d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903906:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065217.903908:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc14798d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903912:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc14798d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903917:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092a25a00) 00010000:00010000:2.0:1746065217.903918:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065217.903920:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc14798d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.903923:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc14798d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.904243:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93975f expref: 46 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.904253:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798d9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93975f expref: 45 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.904259:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065217.904260:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065217.904262:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a96400, rc 0) 00000100:00100000:2.0:1746065217.906227:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2506:x1830881265394560:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2688us (3940us total) trans 8589937096 rc 0/0 00000100:00100000:2.0:1746065217.906237:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14582 00000100:00100000:0.0:1746065217.913587:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.913623:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.913720:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265394688 00000100:00100000:1.0:1746065217.913728:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265394688 00000100:00100000:1.0:1746065217.913798:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 861 00000100:00100000:1.0:1746065217.913806:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881265394688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.913819:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.913841:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798d9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93975f expref: 45 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.913868:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065217.913872:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.913909:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265394688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.913915:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 861 00000100:00100000:2.0:1746065217.914082:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265394816 00000100:00100000:2.0:1746065217.914086:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265394816 00000100:00100000:2.0:1746065217.914118:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17495 00000100:00100000:2.0:1746065217.914123:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265394816:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065217.914135:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065217.914148:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc14798e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939766 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.914163:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.914165:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.914171:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc14798e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939766 expref: 35 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065217.914182:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc14798e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939766 expref: 35 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065217.914189:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00000100:00100000:2.0:1746065217.914222:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265394816:12345-192.168.202.27@tcp:101:cat.0 Request processed in 99us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.914227:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17495 00000100:00100000:0.0:1746065217.928868:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.928915:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.929042:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265395328 00000100:00100000:3.0:1746065217.929050:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265395328 00002000:00100000:3.0:1746065217.929086:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009aec8a80 x1830881265395328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.929094:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8a80 with x1830881265395328 ext(0->1048575) 00002000:00010000:3.0:1746065217.929100:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec8a80 00000100:00100000:3.0:1746065217.929118:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6256 00000100:00100000:3.0:1746065217.929125:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265395328:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065217.929799:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265395072 00000100:00100000:2.0:1746065217.929803:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265395072 00000100:00100000:2.0:1746065217.929828:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14583 00000100:00100000:2.0:1746065217.929833:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2507:x1830881265395072:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065217.929845:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065217.929860:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97e00/0xad6b7ddc14798ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93976d expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.929917:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.929927:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.929936:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.929946:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.929952:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.929956:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930029:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc1479903 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930037:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc1479903 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930043:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc1479903 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065217.930050:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065217.930104:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798f5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930110:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798f5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930117:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930121:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930126:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065217.930129:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930134:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798f5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930143:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065217.930145:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065217.930149:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798f5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930153:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96400/0xad6b7ddc14798f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930173:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930178:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930183:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930187:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a97400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065217.930188:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930196:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930201:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880092a25d00) 00010000:00010000:2.0:1746065217.930203:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065217.930205:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930209:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97400/0xad6b7ddc14798fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065217.930238:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97e00/0xad6b7ddc14798ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93976d expref: 47 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.930247:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc1479903 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93976d expref: 46 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.930253:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065217.930255:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065217.930257:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97200, rc 0) 00000100:00100000:2.0:1746065217.931167:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+46:2507:x1830881265395072:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1331us (2305us total) trans 8589937097 rc 0/0 00000100:00100000:2.0:1746065217.931175:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14583 00000100:00100000:3.0:1746065217.934869:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746065217.934886:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263986688:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1746065217.934936:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065217.935448:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263986688 00000100:00100000:0.0:1746065217.935454:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263986688 00000100:00100000:0.0:1746065217.935494:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1746065217.935500:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263986688:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746065217.935516:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1067357632 pending 1380352 free 3910598656 avail 3679076352 00000100:00100000:0.0:1746065217.935545:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881263986688:12345-0@lo:13:osp-pre-0-1.0 Request processed in 46us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065217.935550:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1746065217.935584:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881263986688:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1746065217.935626:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065217.955119:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265395328:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25985us (26193us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065217.955128:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6256 00002000:00100000:3.0:1746065217.955138:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009aec8a80 x1830881265395328/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.955146:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8a80 with x1830881265395328 ext(0->1048575) 00002000:00010000:3.0:1746065217.955151:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec8a80 00000100:00100000:0.0:1746065217.958432:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065217.961426:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265395456 00000100:00100000:1.0:1746065217.961438:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265395456 00000100:00100000:1.0:1746065217.961506:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 862 00000100:00100000:1.0:1746065217.961512:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+46:2006:x1830881265395456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065217.961525:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065217.961544:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a97200/0xad6b7ddc1479903 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93976d expref: 46 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065217.961571:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065217.961575:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065217.961628:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881265395456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 115us (3203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065217.961634:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 862 00000100:00100000:0.0:1746065217.978978:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.980443:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265395584 00000100:00100000:3.0:1746065217.980452:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265395584 00000100:00100000:3.0:1746065217.980505:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17496 00000100:00100000:3.0:1746065217.980512:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2507:x1830881265395584:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065217.980527:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065217.980542:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939774 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.980567:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc147957c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939567 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.980574:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc1479591 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939591 expref: 26 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.980579:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.980580:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065217.980583:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.980607:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc1479591 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939591 expref: 26 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.980616:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc1479591 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939591 expref: 26 pid: 13375 timeout: 913 lvb_type: 1 00000100:00100000:3.0:1746065217.980627:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263986816:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065217.982278:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc147957c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939567 expref: 11 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065217.982290:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc147957c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939567 expref: 11 pid: 9549 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746065217.982298:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263986944:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065217.983796:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065217.987891:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065217.987933:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.988429:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263986816:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065217.988440:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263986944:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065217.988466:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [2088960->2097151] (req 2088960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065217.988480:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539e00, rc 0) 00000100:00100000:3.0:1746065217.988522:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2507:x1830881265395584:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8009us (9551us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065217.988529:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17496 00000100:00100000:2.0:1746065217.989495:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265395840 00000100:00100000:2.0:1746065217.989502:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265395840 00010000:00010000:2.0:1746065217.989529:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc147957c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939567 expref: 12 pid: 9549 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746065217.989553:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265395712 00000100:00100000:2.0:1746065217.989556:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265395712 00010000:00010000:2.0:1746065217.989564:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc1479591 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939591 expref: 26 pid: 13375 timeout: 913 lvb_type: 1 00000100:00100000:2.0:1746065217.989577:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8173 00000100:00100000:2.0:1746065217.989583:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265395840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065217.989594:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065217.989612:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc147957c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939567 expref: 12 pid: 9549 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746065217.989620:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc147957c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939567 expref: 12 pid: 9549 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746065217.989639:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc147957c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939567 expref: 12 pid: 9549 timeout: 914 lvb_type: 1 00010000:00010000:2.0:1746065217.989653:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065217.989672:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265395840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (1789us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065217.989678:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8173 00000100:00100000:2.0:1746065217.989714:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8174 00000100:00100000:2.0:1746065217.989719:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881265395712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065217.989725:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065217.989731:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc1479591 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939591 expref: 26 pid: 13375 timeout: 913 lvb_type: 1 00010000:00010000:2.0:1746065217.989739:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc1479591 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939591 expref: 26 pid: 13375 timeout: 913 lvb_type: 1 00010000:00010000:2.0:1746065217.989749:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc1479591 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939591 expref: 26 pid: 13375 timeout: 913 lvb_type: 1 00010000:00010000:2.0:1746065217.989757:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.989759:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065217.989765:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.989786:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065217.989810:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 25 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065217.989820:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263987072:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065217.989856:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065217.997732:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065217.997904:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265396096 00000100:00100000:3.0:1746065217.997911:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265396096 00002000:00100000:3.0:1746065217.997944:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88008f7fe680 x1830881265396096/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/0 e 0 to 0 dl 1746065228 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065217.997953:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe680 with x1830881265396096 ext(2097152->4194303) 00002000:00010000:3.0:1746065217.997957:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fe680 00000100:00100000:3.0:1746065217.997980:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6257 00000100:00100000:3.0:1746065217.997985:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265396096:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065218.023352:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.034041:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265396352 00000100:00100000:0.0:1746065218.034054:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265396352 00002000:00100000:1.0:1746065218.034657:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (2088960->2093055) req@ffff88008f7ff100 x1830881265396352/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.034666:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff100 with x1830881265396352 ext(2088960->2093055) 00002000:00010000:1.0:1746065218.034671:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7ff100 00000100:00100000:1.0:1746065218.034695:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6258 00000100:00100000:1.0:1746065218.034701:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265396352:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065218.034837:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265396352:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 136us (11500us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065218.034843:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6258 00002000:00100000:1.0:1746065218.034849:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (2088960->2093055) req@ffff88008f7ff100 x1830881265396352/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.034856:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff100 with x1830881265396352 ext(2088960->2093055) 00002000:00010000:1.0:1746065218.034858:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7ff100 00000100:00100000:3.0:1746065218.038180:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263987072:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065218.038199:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.038250:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881265395712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 48530us (50315us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.038259:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8174 00000100:00100000:0.0:1746065218.048106:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.049492:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265396608 00000100:00100000:2.0:1746065218.049501:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265396608 00000100:00100000:1.0:1746065218.052179:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14584 00000100:00100000:1.0:1746065218.052194:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2510:x1830881265396608:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065218.052218:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.052234:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1479918 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93977b expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.052297:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147991f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052308:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147991f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052318:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147991f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052329:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1479926 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052335:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1479926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052354:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1479926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052433:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147992d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052442:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147992d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052448:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147992d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065218.052454:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065218.052512:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147991f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052518:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147991f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052523:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147991f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052528:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147991f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052533:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065218.052536:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147991f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052541:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147991f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052550:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065218.052552:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065218.052555:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147991f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052559:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147991f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052578:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1479926 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052583:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1479926 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052587:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1479926 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052593:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d9400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065218.052595:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1479926 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052599:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1479926 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052604:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012edbde00) 00010000:00010000:1.0:1746065218.052606:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065218.052608:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1479926 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052612:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc1479926 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.052640:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc1479918 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93977b expref: 26 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.052648:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147992d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93977b expref: 25 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.052653:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065218.052655:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065218.052657:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8a00, rc 0) 00000100:00100000:1.0:1746065218.052699:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2510:x1830881265396608:12345-192.168.202.27@tcp:101:cat.0 Request processed in 510us (4600us total) trans 8589937098 rc 0/0 00000100:00100000:1.0:1746065218.052704:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14584 00000100:00100000:0.0:1746065218.053677:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.053743:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265396736 00000100:00100000:0.0:1746065218.053749:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265396736 00000100:00100000:0.0:1746065218.053770:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17497 00000100:00100000:0.0:1746065218.053790:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2507:x1830881265396736:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065218.053799:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065218.053808:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939782 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.053829:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479567 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93956e expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065218.053836:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489c00/0xad6b7ddc14795a6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939598 expref: 38 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065218.053841:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065218.053843:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065218.053846:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->1331199] (req 1048576->1331199) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.053867:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489c00/0xad6b7ddc14795a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939598 expref: 38 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065218.053877:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c489c00/0xad6b7ddc14795a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939598 expref: 38 pid: 13375 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746065218.053887:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263987200:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065218.053951:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479567 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93956e expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065218.053958:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479567 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93956e expref: 13 pid: 12260 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746065218.053965:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263987328:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065218.053982:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65660c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065218.058523:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265396096:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 60528us (60788us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065218.058532:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6257 00002000:00100000:3.0:1746065218.058541:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88008f7fe680 x1830881265396096/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:133/0 lens 488/440 e 0 to 0 dl 1746065228 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.058550:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fe680 with x1830881265396096 ext(2097152->4194303) 00002000:00010000:3.0:1746065218.058554:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fe680 00000100:00100000:0.0:1746065218.059663:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263987200:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065218.059764:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263987328:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065218.059807:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->1331199] (req 1048576->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 36 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.059821:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdba00, rc 0) 00000100:00100000:0.0:1746065218.059844:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2507:x1830881265396736:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6054us (6169us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065218.059850:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17497 00000100:00100000:0.0:1746065218.059884:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.059939:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.059964:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265396864 00000100:00100000:0.0:1746065218.059969:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265396864 00010000:00010000:0.0:1746065218.059987:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489c00/0xad6b7ddc14795a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939598 expref: 36 pid: 13375 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746065218.060001:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265396992 00000100:00100000:0.0:1746065218.060003:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265396992 00010000:00010000:0.0:1746065218.060010:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479567 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93956e expref: 14 pid: 12260 timeout: 914 lvb_type: 1 00000100:00100000:0.0:1746065218.060023:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8175 00000100:00100000:0.0:1746065218.060028:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881265396864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065218.060037:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065218.060051:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c489c00/0xad6b7ddc14795a6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939598 expref: 36 pid: 13375 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746065218.060060:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c489c00/0xad6b7ddc14795a6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939598 expref: 36 pid: 13375 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746065218.060077:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489c00/0xad6b7ddc14795a6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939598 expref: 36 pid: 13375 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746065218.060089:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065218.060105:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265396864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 77us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065218.060110:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8175 00000100:00100000:0.0:1746065218.060120:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8176 00000100:00100000:0.0:1746065218.060124:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265396992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065218.060130:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065218.060138:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479567 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93956e expref: 14 pid: 12260 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746065218.060145:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479567 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93956e expref: 14 pid: 12260 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746065218.060154:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc1479567 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93956e expref: 14 pid: 12260 timeout: 914 lvb_type: 1 00010000:00010000:0.0:1746065218.060161:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065218.060163:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065218.060168:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 34 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.060176:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 34 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.060197:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 34 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065218.060207:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263987456:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065218.060257:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65660c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.066954:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.066983:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.070013:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.070082:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265397376 00000100:00100000:3.0:1746065218.070091:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265397376 00000100:00100000:3.0:1746065218.070143:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 863 00000100:00100000:3.0:1746065218.070150:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265397376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.070163:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065218.070184:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147992d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93977b expref: 25 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.070200:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065218.070203:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.070239:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881265397376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.070245:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 863 00000100:00100000:2.0:1746065218.070873:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265397120 00000100:00100000:2.0:1746065218.070878:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265397120 00000100:00100000:2.0:1746065218.070912:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265397248 00000100:00100000:2.0:1746065218.070915:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265397248 00000100:00100000:2.0:1746065218.070929:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17498 00000100:00100000:2.0:1746065218.070934:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265397120:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.070945:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.070955:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1479942 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939789 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.070992:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263987584:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065218.071055:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17499 00000100:00100000:3.0:1746065218.071060:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265397248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065218.071067:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065218.071075:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc1479949 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939790 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.071098:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263987712:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065218.071577:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.071665:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263987456:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065218.071679:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065218.071693:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265396992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11568us (11753us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065218.071698:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8176 00000100:00100000:3.0:1746065218.071846:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.076019:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:2.0:1746065218.078598:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065215 -> 1746065218 00002000:00010000:2.0:1746065218.078604:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065215 -> 1746065218 00002000:00010000:2.0:1746065218.078605:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065215 -> 1746065218 00000100:00100000:2.0:1746065218.078622:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263987584:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065218.078650:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1479942 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939789 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.078661:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a97e00/0xad6b7ddc1479942 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939789 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.078675:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97e00, rc 0) 00000100:00100000:2.0:1746065218.078713:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265397120:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7778us (11764us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065218.078719:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17498 00000100:00100000:3.0:1746065218.079130:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265397632 00000100:00100000:3.0:1746065218.079137:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265397632 00002000:00100000:3.0:1746065218.079166:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1327104->1331199) req@ffff88008f7fc000 x1830881265397632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.079174:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fc000 with x1830881265397632 ext(1327104->1331199) 00002000:00010000:3.0:1746065218.079178:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fc000 00002000:00010000:2.0:1746065218.079768:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime: 1746065215 -> 1746065218 00002000:00010000:2.0:1746065218.079785:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065215 -> 1746065218 00002000:00010000:2.0:1746065218.079786:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime: 1746065215 -> 1746065218 00000100:00100000:2.0:1746065218.079796:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263987712:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065218.079813:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc1479949 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939790 expref: 14 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.079821:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6000/0xad6b7ddc1479949 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939790 expref: 14 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.079827:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6000, rc 0) 00000100:00100000:2.0:1746065218.079846:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265397248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8786us (12862us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065218.079851:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17499 00000100:00100000:3.0:1746065218.080897:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6259 00000100:00100000:3.0:1746065218.080907:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265397632:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065218.080992:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265397632:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 88us (4981us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065218.080997:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6259 00002000:00100000:3.0:1746065218.081001:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1327104->1331199) req@ffff88008f7fc000 x1830881265397632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.081008:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fc000 with x1830881265397632 ext(1327104->1331199) 00002000:00010000:3.0:1746065218.081011:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fc000 00000100:00100000:0.0:1746065218.086552:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.086613:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265397888 00000100:00100000:1.0:1746065218.086620:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265397888 00002000:00100000:1.0:1746065218.086655:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88008f7ff800 x1830881265397888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.086663:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff800 with x1830881265397888 ext(4194304->5038079) 00002000:00010000:1.0:1746065218.086668:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7ff800 00000100:00100000:1.0:1746065218.086692:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6260 00000100:00100000:1.0:1746065218.086698:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265397888:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065218.093248:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265397888:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6539us (6692us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746065218.093257:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6260 00002000:00100000:1.0:1746065218.093266:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88008f7ff800 x1830881265397888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.093276:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7ff800 with x1830881265397888 ext(4194304->5038079) 00002000:00010000:1.0:1746065218.093281:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7ff800 00000100:00100000:0.0:1746065218.103105:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.107584:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265398144 00000100:00100000:3.0:1746065218.107595:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265398144 00000100:00100000:0.0:1746065218.112390:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5472 00000100:00100000:0.0:1746065218.112404:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+45:2507:x1830881265398144:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065218.112584:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+46:2507:x1830881265398144:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 184us (9486us total) trans 8589937099 rc 0/0 00000100:00100000:0.0:1746065218.112589:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5472 00000100:00100000:0.0:1746065218.112655:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.112965:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265398272 00000100:00100000:2.0:1746065218.112972:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265398272 00000100:00100000:2.0:1746065218.112997:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17500 00000100:00100000:2.0:1746065218.113002:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2510:x1830881265398272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.113010:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.113022:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939797 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.113041:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 24 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.113048:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.113049:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.113052:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 12 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.113072:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 24 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.113082:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 24 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.113092:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263987840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065218.113132:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065218.114197:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065218.114451:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065218.114610:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265398528 00000100:00100000:2.0:1746065218.114615:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265398528 00000100:00100000:2.0:1746065218.114643:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5473 00000100:00100000:2.0:1746065218.114648:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+46:2506:x1830881265398528:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065218.116054:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+47:2506:x1830881265398528:12345-192.168.202.27@tcp:35:cat.0 Request processed in 1401us (1855us total) trans 8589937100 rc 0/0 00000100:00100000:2.0:1746065218.116062:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5473 00000100:00100000:2.0:1746065218.121948:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263987840:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065218.121974:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 12 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.121988:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5c00, rc 0) 00000100:00100000:2.0:1746065218.122039:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2510:x1830881265398272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9034us (9382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.122046:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17500 00000100:00100000:0.0:1746065218.124261:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.124334:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265398656 00000100:00100000:1.0:1746065218.124349:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265398656 00002000:00100000:1.0:1746065218.124381:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (2088960->2097151) req@ffff880097fabb80 x1830881265398656/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 8680/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.124389:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fabb80 with x1830881265398656 ext(2088960->2097151) 00010000:00010000:1.0:1746065218.124396:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 25 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.124408:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 25 pid: 9549 timeout: 914 lvb_type: 0 00002000:00010000:1.0:1746065218.124418:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fabb80 00000100:00100000:1.0:1746065218.124441:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2062 00000100:00100000:1.0:1746065218.124447:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265398656:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065218.126224:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265398656:12345-192.168.202.27@tcp:4:cat.0 Request processed in 1772us (1965us total) trans 21474841688 rc 0/0 00000100:00100000:1.0:1746065218.126233:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2062 00002000:00100000:1.0:1746065218.126241:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (2088960->2097151) req@ffff880097fabb80 x1830881265398656/t21474841688(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 8680/448 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.126249:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fabb80 with x1830881265398656 ext(2088960->2097151) 00010000:00010000:1.0:1746065218.126257:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 27 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.126269:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 27 pid: 9549 timeout: 914 lvb_type: 0 00002000:00010000:1.0:1746065218.126274:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fabb80 00000100:00100000:0.0:1746065218.132421:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.132630:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265398784 00000100:00100000:2.0:1746065218.132638:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265398784 00000100:00100000:2.0:1746065218.132689:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17501 00000100:00100000:2.0:1746065218.132696:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2500:x1830881265398784:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065218.132713:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.132727:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93979e expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.132751:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.132758:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479846 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939719 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.132764:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.132765:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.132768:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2711552->3145727] (req 2711552->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.132824:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479846 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939719 expref: 13 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.132834:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479846 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939719 expref: 13 pid: 10219 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746065218.132845:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263987968:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065218.132934:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.132942:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 26 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.132954:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263988096:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065218.132972:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.137887:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.138007:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265398912 00000100:00100000:2.0:1746065218.138016:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265398912 00010000:00010000:2.0:1746065218.138047:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 27 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.138210:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8177 00000100:00100000:2.0:1746065218.138218:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265398912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065218.138231:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065218.138248:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 27 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.138260:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 27 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.138278:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc1479911 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2088960->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939774 expref: 27 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.138307:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.138309:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.138315:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.138322:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.138363:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.138374:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263988224:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065218.138450:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.144326:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263987968:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065218.144348:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f09df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881263988096:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065218.144373:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2711552->3145727] (req 2711552->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.144388:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5800, rc 0) 00000100:00100000:0.0:1746065218.144438:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2500:x1830881265398784:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11742us (12025us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065218.144446:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17501 00000100:00100000:0.0:1746065218.156443:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.156645:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acedc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263988224:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065218.156664:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.156700:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265398912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 18483us (18819us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.156709:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8177 00000100:00100000:3.0:1746065218.156731:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265399040 00000100:00100000:3.0:1746065218.156736:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265399040 00010000:00010000:3.0:1746065218.156761:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479846 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939719 expref: 13 pid: 10219 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746065218.156806:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8178 00000100:00100000:3.0:1746065218.156812:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265399040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.156823:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065218.156840:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479846 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939719 expref: 13 pid: 10219 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746065218.156849:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479846 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939719 expref: 13 pid: 10219 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746065218.156866:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479846 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939719 expref: 13 pid: 10219 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746065218.159743:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.159816:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265399040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2999us (3376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.159827:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8178 00000100:00100000:2.0:1746065218.160197:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.160913:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265399168 00000100:00100000:3.0:1746065218.160920:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265399168 00010000:00010000:3.0:1746065218.160941:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 26 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746065218.160971:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8179 00000100:00100000:3.0:1746065218.160976:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac562050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265399168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.160987:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065218.161002:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 26 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.161012:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 26 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.161029:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc14797ba lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9396e1 expref: 26 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.161039:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.161041:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.161046:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.161053:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.161079:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 11 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.161089:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263988352:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065218.162680:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.164279:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.164332:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265399424 00000100:00100000:1.0:1746065218.164348:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265399424 00002000:00100000:1.0:1746065218.164381:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009acedc00 x1830881265399424/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.164389:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acedc00 with x1830881265399424 ext(1048576->2097151) 00002000:00010000:1.0:1746065218.164393:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acedc00 00000100:00100000:1.0:1746065218.164725:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6261 00000100:00100000:1.0:1746065218.164734:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265399424:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065218.166266:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.167223:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881263988352:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065218.167239:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.167281:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac562050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265399168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6305us (7084us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.167289:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8179 00000100:00100000:3.0:1746065218.169000:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265399680 00000100:00100000:3.0:1746065218.169008:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265399680 00002000:00100000:3.0:1746065218.169038:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2711552->2715647) req@ffff88009aecb100 x1830881265399680/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.169047:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb100 with x1830881265399680 ext(2711552->2715647) 00002000:00010000:3.0:1746065218.169051:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aecb100 00000100:00100000:3.0:1746065218.169066:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6262 00000100:00100000:3.0:1746065218.169071:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265399680:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065218.169166:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265399680:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 94us (2904us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065218.169171:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6262 00002000:00100000:3.0:1746065218.169175:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2711552->2715647) req@ffff88009aecb100 x1830881265399680/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.169181:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb100 with x1830881265399680 ext(2711552->2715647) 00002000:00010000:3.0:1746065218.169183:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aecb100 00000100:00100000:0.0:1746065218.178291:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265399424:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 13550us (14010us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065218.178301:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6261 00002000:00100000:0.0:1746065218.178310:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009acedc00 x1830881265399424/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065218.178319:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acedc00 with x1830881265399424 ext(1048576->2097151) 00002000:00010000:0.0:1746065218.178324:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acedc00 00000100:00100000:0.0:1746065218.185233:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.185349:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265399808 00000100:00100000:1.0:1746065218.185357:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265399808 00000100:00100000:1.0:1746065218.185941:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17502 00000100:00100000:1.0:1746065218.185949:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2500:x1830881265399808:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065218.185962:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.185976:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397a5 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.185997:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 14 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.186004:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc14798e7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939766 expref: 34 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065218.186009:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.186010:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.186012:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->3702783] (req 3145728->3702783) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 14 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.186033:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc14798e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939766 expref: 34 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065218.186042:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc14798e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939766 expref: 34 pid: 12260 timeout: 914 lvb_type: 1 00000100:00100000:1.0:1746065218.186050:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263988480:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065218.186106:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 14 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.186113:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 14 pid: 12260 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746065218.186119:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263988608:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065218.186130:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.192456:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.192791:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265399936 00000100:00100000:2.0:1746065218.192798:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265399936 00000100:00100000:2.0:1746065218.192831:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17503 00000100:00100000:2.0:1746065218.192837:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2510:x1830881265399936:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.192851:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.192863:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397ac expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.192884:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 34 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.192890:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.192892:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.192894:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 16 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.192917:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 34 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.192930:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 34 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.192939:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263988736:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065218.193067:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263988480:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065218.193076:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263988608:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065218.193096:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->3702783] (req 3145728->3702783) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.193105:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ae00, rc 0) 00000100:00100000:1.0:1746065218.193124:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2500:x1830881265399808:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7176us (7898us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065218.193129:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17502 00000100:00100000:2.0:1746065218.193440:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.193910:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.193941:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.193992:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265400064 00000100:00100000:3.0:1746065218.193996:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265400064 00010000:00010000:3.0:1746065218.194012:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc14798e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939766 expref: 35 pid: 12260 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746065218.194028:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265400192 00000100:00100000:3.0:1746065218.194030:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265400192 00010000:00010000:3.0:1746065218.194036:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 16 pid: 12260 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746065218.194056:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8180 00000100:00100000:3.0:1746065218.194063:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265400064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.194070:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065218.194084:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc14798e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939766 expref: 35 pid: 12260 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746065218.194092:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc14798e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939766 expref: 35 pid: 12260 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746065218.194107:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc14798e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939766 expref: 35 pid: 12260 timeout: 914 lvb_type: 1 00010000:00010000:3.0:1746065218.194118:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.194137:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265400064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.194142:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8180 00000100:00100000:3.0:1746065218.194151:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8181 00000100:00100000:3.0:1746065218.194156:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265400192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.194161:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065218.194167:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 16 pid: 12260 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.194174:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 16 pid: 12260 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.194183:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a97600/0xad6b7ddc14798bd lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939758 expref: 16 pid: 12260 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.194194:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.194196:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.194200:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.194206:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.194225:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.194232:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263988864:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065218.194265:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.199509:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.199585:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265400320 00000100:00100000:1.0:1746065218.199592:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265400320 00002000:00100000:1.0:1746065218.199627:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1331199) req@ffff880097fab800 x1830881265400320/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.199636:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab800 with x1830881265400320 ext(1048576->1331199) 00010000:00010000:1.0:1746065218.199643:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 34 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.199658:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 34 pid: 9549 timeout: 914 lvb_type: 0 00002000:00010000:1.0:1746065218.199665:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fab800 00000100:00100000:1.0:1746065218.199682:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2063 00000100:00100000:1.0:1746065218.199688:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265400320:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065218.200013:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263988736:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065218.200033:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 15 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.200044:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856c00, rc 0) 00000100:00100000:2.0:1746065218.200066:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2510:x1830881265399936:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7229us (7618us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.200072:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17503 00000100:00100000:3.0:1746065218.205185:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263988864:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065218.205203:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.205238:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265400192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11080us (11294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.205246:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8181 00000100:00100000:2.0:1746065218.231041:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.233305:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265400576 00000100:00100000:1.0:1746065218.233315:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265400576 00002000:00100000:1.0:1746065218.233362:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3698688->3702783) req@ffff88009aec9880 x1830881265400576/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.233371:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9880 with x1830881265400576 ext(3698688->3702783) 00002000:00010000:1.0:1746065218.233376:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec9880 00000100:00100000:1.0:1746065218.233977:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6263 00000100:00100000:1.0:1746065218.233985:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265400576:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065218.234091:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265400576:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 106us (3056us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065218.234096:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6263 00002000:00100000:1.0:1746065218.234101:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3698688->3702783) req@ffff88009aec9880 x1830881265400576/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.234108:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9880 with x1830881265400576 ext(3698688->3702783) 00002000:00010000:1.0:1746065218.234111:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec9880 00000100:00100000:2.0:1746065218.234317:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265400320:12345-192.168.202.27@tcp:4:cat.0 Request processed in 34627us (34814us total) trans 17179874298 rc 0/0 00000100:00100000:2.0:1746065218.234323:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2063 00002000:00100000:2.0:1746065218.234328:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1331199) req@ffff880097fab800 x1830881265400320/t17179874298(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/448 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.234334:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab800 with x1830881265400320 ext(1048576->1331199) 00010000:00010000:2.0:1746065218.234352:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 36 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.234369:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 36 pid: 9549 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746065218.234375:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097fab800 00000100:00100000:0.0:1746065218.252712:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.252808:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265400704 00000100:00100000:3.0:1746065218.252817:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265400704 00010000:00010000:3.0:1746065218.252848:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 36 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746065218.254538:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8182 00000100:00100000:3.0:1746065218.254553:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265400704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.254571:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065218.254590:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 36 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.254603:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 36 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.254628:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc147993b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1331199) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939782 expref: 36 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.254661:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.254663:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.254670:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.254678:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.254710:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.254726:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263988992:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065218.254817:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.264867:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.264955:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881263988992:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065218.264970:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065218.265009:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265400704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10462us (12304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065218.265017:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8182 00000100:00100000:3.0:1746065218.265453:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265400960 00000100:00100000:3.0:1746065218.265460:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265400960 00000100:00100000:3.0:1746065218.265504:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14585 00000100:00100000:3.0:1746065218.265511:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+47:2516:x1830881265400960:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065218.265534:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065218.265548:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7200/0xad6b7ddc147996c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397b3 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.265611:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479973 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265623:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265632:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479973 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265644:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc147997a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265649:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc147997a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265654:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc147997a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265730:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fa00/0xad6b7ddc1479981 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265738:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fa00/0xad6b7ddc1479981 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265744:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fa00/0xad6b7ddc1479981 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065218.265751:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065218.265838:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479973 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265848:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479973 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265853:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479973 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265858:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479973 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265863:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae7600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065218.265866:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479973 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265872:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479973 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265882:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065218.265885:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065218.265888:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479973 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265892:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479973 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265905:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc147997a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265909:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc147997a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265914:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc147997a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265918:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae6c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065218.265920:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc147997a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265925:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc147997a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265930:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5db00) 00010000:00010000:3.0:1746065218.265932:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065218.265934:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc147997a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265938:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc147997a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.265968:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7200/0xad6b7ddc147996c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397b3 expref: 50 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.265978:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fa00/0xad6b7ddc1479981 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397b3 expref: 49 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.265984:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065218.265986:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065218.265988:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fa00, rc 0) 00000100:00100000:3.0:1746065218.266012:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2516:x1830881265400960:12345-192.168.202.27@tcp:101:cat.0 Request processed in 502us (1153us total) trans 8589937101 rc 0/0 00000100:00100000:3.0:1746065218.266017:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14585 00000100:00100000:0.0:1746065218.273082:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.273456:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265401216 00000100:00100000:1.0:1746065218.273464:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265401216 00002000:00100000:1.0:1746065218.273500:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880097fa8380 x1830881265401216/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.273509:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8380 with x1830881265401216 ext(1048576->2097151) 00002000:00010000:1.0:1746065218.273513:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa8380 00000100:00100000:1.0:1746065218.273542:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6264 00000100:00100000:1.0:1746065218.273549:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265401216:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065218.276371:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.277137:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.277159:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.277171:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.277194:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.277214:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265401856 00000100:00100000:0.0:1746065218.277221:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265401856 00000100:00100000:0.0:1746065218.277261:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 864 00000100:00100000:0.0:1746065218.277267:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+49:2004:x1830881265401856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065218.277278:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065218.277298:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fa00/0xad6b7ddc1479981 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397b3 expref: 49 pid: 9571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.281274:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265401344 00000100:00100000:2.0:1746065218.281285:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265401344 00000100:00100000:2.0:1746065218.281330:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265401472 00000100:00100000:2.0:1746065218.281333:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265401472 00000100:00100000:2.0:1746065218.281360:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265401600 00000100:00100000:2.0:1746065218.281363:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265401600 00000100:00100000:2.0:1746065218.281373:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265401728 00000100:00100000:2.0:1746065218.281375:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265401728 00000100:00100000:2.0:1746065218.281390:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17504 00000100:00100000:2.0:1746065218.281398:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265401344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.281413:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.281426:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147998f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397ba expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.281446:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.281448:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.281455:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147998f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ba expref: 27 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.281468:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147998f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ba expref: 27 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.281477:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856200, rc 0) 00000100:00100000:2.0:1746065218.281524:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265401344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 127us (5161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.281529:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17504 00000100:00100000:2.0:1746065218.281543:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17505 00000100:00100000:2.0:1746065218.281547:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265401472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.281553:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.281561:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc1479996 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397c1 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.281571:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.281572:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.281575:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc1479996 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397c1 expref: 37 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.281583:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc1479996 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397c1 expref: 37 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.281589:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857400, rc 0) 00000100:00100000:2.0:1746065218.281604:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265401472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 57us (4469us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.281608:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17505 00000100:00100000:2.0:1746065218.281617:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17506 00000100:00100000:2.0:1746065218.281621:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265401600:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.281626:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.281630:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc147999d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397c8 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.281669:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263989120:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065218.281719:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.281742:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17507 00000100:00100000:2.0:1746065218.281747:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265401728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.281752:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.281757:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d857000/0xad6b7ddc14799a4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397cf expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.281790:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263989248:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065218.281806:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad600 going to sleep for 11 seconds 00010000:00010000:0.0:1746065218.282197:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065218.282202:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065218.282413:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+48:2004:x1830881265401856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5145us (5216us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065218.282423:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 864 00000100:00100000:0.0:1746065218.284256:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.284380:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265401216:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10831us (11304us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065218.284389:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6264 00002000:00100000:0.0:1746065218.284397:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880097fa8380 x1830881265401216/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065218.284405:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8380 with x1830881265401216 ext(1048576->2097151) 00002000:00010000:0.0:1746065218.284409:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa8380 00000100:00100000:1.0:1746065218.284495:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265402112 00000100:00100000:1.0:1746065218.284500:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265402112 00000100:00100000:1.0:1746065218.284542:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14586 00000100:00100000:1.0:1746065218.284547:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+48:2517:x1830881265402112:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065218.284562:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.284575:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14799ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397d6 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.284630:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14799b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284640:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14799b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284647:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14799b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284658:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14799b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284662:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14799b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284670:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14799b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284743:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc14799c0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284751:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc14799c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284756:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc14799c0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065218.284763:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065218.284844:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14799b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284849:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14799b2 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284854:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14799b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284859:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14799b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284863:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1a200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065218.284866:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14799b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284871:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14799b2 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284879:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065218.284881:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065218.284885:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14799b2 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284889:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc14799b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284912:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14799b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284917:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14799b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284921:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14799b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284924:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065218.284927:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14799b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284930:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14799b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284935:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012edbde00) 00010000:00010000:1.0:1746065218.284937:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065218.284939:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14799b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284943:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc14799b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.284970:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc14799ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397d6 expref: 51 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.284978:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc14799c0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397d6 expref: 50 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.284984:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065218.284986:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065218.284988:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ba00, rc 0) 00000100:00100000:1.0:1746065218.285010:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+50:2517:x1830881265402112:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 462us (758us total) trans 8589937102 rc 0/0 00000100:00100000:1.0:1746065218.285015:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14586 00002000:00010000:3.0:1746065218.294518:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746065217 -> 1746065218 00002000:00010000:3.0:1746065218.294524:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065217 -> 1746065218 00002000:00010000:3.0:1746065218.294526:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746065217 -> 1746065218 00000100:00100000:3.0:1746065218.294546:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263989120:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065218.294577:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc147999d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397c8 expref: 37 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.294589:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857a00/0xad6b7ddc147999d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397c8 expref: 37 pid: 9549 timeout: 0 lvb_type: 1 00002000:00010000:1.0:1746065218.294594:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746065217 -> 1746065218 00002000:00010000:1.0:1746065218.294598:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065217 -> 1746065218 00002000:00010000:1.0:1746065218.294600:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746065217 -> 1746065218 00010000:00010000:3.0:1746065218.294602:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857a00, rc 0) 00000100:00100000:1.0:1746065218.294610:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263989248:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065218.294629:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d857000/0xad6b7ddc14799a4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397cf expref: 27 pid: 11461 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065218.294639:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265401600:12345-192.168.202.27@tcp:101:cat.0 Request processed in 13016us (17478us total) trans 0 rc 301/301 00010000:00010000:1.0:1746065218.294639:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d857000/0xad6b7ddc14799a4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397cf expref: 27 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065218.294646:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857000, rc 0) 00000100:00100000:3.0:1746065218.294647:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17506 00000100:00100000:1.0:1746065218.294664:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265401728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 12917us (17491us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065218.294670:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17507 00000100:00100000:3.0:1746065218.311876:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.311908:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265402240 00000100:00100000:0.0:1746065218.311916:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265402240 00000100:00100000:3.0:1746065218.311917:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.311931:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265402368 00000100:00100000:3.0:1746065218.311934:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265402368 00000100:00100000:0.0:1746065218.311952:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17508 00000100:00100000:0.0:1746065218.311958:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+26:2517:x1830881265402240:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:3.0:1746065218.311963:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 865 00000100:00100000:3.0:1746065218.311969:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+50:2006:x1830881265402368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065218.311973:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065218.311981:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065218.311988:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397dd expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.312000:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc14799c0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397d6 expref: 50 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.312008:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 11 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.312015:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc147976d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939694 expref: 27 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.312018:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065218.312021:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065218.312021:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065218.312022:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065218.312026:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 5/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1265664->1425407] (req 1265664->1425407) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.312049:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc147976d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939694 expref: 27 pid: 9549 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065218.312056:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+49:2006:x1830881265402368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (138us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065218.312059:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc147976d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939694 expref: 27 pid: 9549 timeout: 914 lvb_type: 1 00000100:00100000:3.0:1746065218.312062:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 865 00000100:00100000:0.0:1746065218.312069:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263989376:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065218.312107:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065218.312131:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 11 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.312138:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 11 pid: 1880 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746065218.312146:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263989504:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065218.312165:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.312200:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265402752 00000100:00100000:0.0:1746065218.312203:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265402752 00000100:00100000:3.0:1746065218.312218:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:0.0:1746065218.312227:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880091a91f80 x1830881265402752/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 504/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065218.312235:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91f80 with x1830881265402752 ext(2097152->4194303) 00002000:00010000:0.0:1746065218.312239:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a91f80 00000100:00100000:3.0:1746065218.312240:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265402880 00000100:00100000:3.0:1746065218.312244:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265402880 00000100:00100000:0.0:1746065218.312253:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6265 00002000:00100000:3.0:1746065218.312258:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091a90700 x1830881265402880/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 504/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:0.0:1746065218.312258:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265402752:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:3.0:1746065218.312264:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90700 with x1830881265402880 ext(2097152->4194303) 00002000:00010000:3.0:1746065218.312268:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90700 00000100:00100000:3.0:1746065218.312286:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6266 00000100:00100000:3.0:1746065218.312291:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265402880:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065218.332737:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.332771:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.332833:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265403136 00000100:00100000:1.0:1746065218.332839:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265403136 00000100:00100000:0.0:1746065218.332849:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d05500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263989376:192.168.202.27@tcp:104: 00002000:00100000:1.0:1746065218.332870:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880097d04e00 x1830881265403136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.332884:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04e00 with x1830881265403136 ext(1048576->2097151) 00002000:00010000:1.0:1746065218.332888:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d04e00 00000100:00100000:0.0:1746065218.332900:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263989504:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065218.332901:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265403392 00000100:00100000:1.0:1746065218.332904:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265403392 00002000:00100000:1.0:1746065218.332913:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880097d06a00 x1830881265403392/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.332918:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06a00 with x1830881265403392 ext(1048576->2097151) 00002000:00010000:1.0:1746065218.332920:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d06a00 00010000:00010000:0.0:1746065218.332923:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1265664->1425407] (req 1265664->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065218.332930:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6267 00000100:00100000:1.0:1746065218.332935:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265403136:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:0.0:1746065218.332936:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489800, rc 0) 00000100:00100000:0.0:1746065218.332969:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2517:x1830881265402240:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 21011us (21102us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065218.332974:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17508 00000100:00100000:0.0:1746065218.333032:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6268 00000100:00100000:0.0:1746065218.333036:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265403392:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065218.339925:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.342133:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265403520 00000100:00100000:2.0:1746065218.342143:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265403520 00010000:00010000:2.0:1746065218.342176:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 14 pid: 1880 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746065218.342225:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.342595:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265403648 00000100:00100000:2.0:1746065218.342599:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265403648 00010000:00010000:2.0:1746065218.342612:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc147976d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939694 expref: 29 pid: 9549 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746065218.342635:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8183 00000100:00100000:2.0:1746065218.342641:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265403520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065218.342651:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065218.342665:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 14 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.342679:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 14 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.342697:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc14796e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939663 expref: 14 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.342713:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065218.342739:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265403520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (2821us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065218.342812:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8184 00000100:00100000:1.0:1746065218.342819:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265403648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065218.342826:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065218.342833:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc147976d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939694 expref: 29 pid: 9549 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746065218.342842:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc147976d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939694 expref: 29 pid: 9549 timeout: 914 lvb_type: 1 00010000:00010000:1.0:1746065218.342853:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3d600/0xad6b7ddc147976d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939694 expref: 29 pid: 9549 timeout: 914 lvb_type: 1 00000100:00100000:2.0:1746065218.342858:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8183 00010000:00010000:1.0:1746065218.342864:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.342866:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.342871:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.342878:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.342901:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065218.342912:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263989632:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065218.342955:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996033c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065218.342968:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265402752:12345-192.168.202.27@tcp:3:cat.0 Request processed in 30710us (30861us total) trans 0 rc 1540096/1540096 00000100:00100000:1.0:1746065218.342975:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6265 00002000:00100000:1.0:1746065218.342983:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880091a91f80 x1830881265402752/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 504/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1540096/1540096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.342991:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a91f80 with x1830881265402752 ext(2097152->4194303) 00002000:00010000:1.0:1746065218.342995:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091a91f80 00000100:00100000:0.0:1746065218.349203:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.349240:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265403904 00000100:00100000:0.0:1746065218.349247:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265403904 00002000:00100000:0.0:1746065218.349286:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1265664->1269759) req@ffff880097d05500 x1830881265403904/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065218.349295:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05500 with x1830881265403904 ext(1265664->1269759) 00002000:00010000:0.0:1746065218.349300:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d05500 00000100:00100000:0.0:1746065218.349332:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6269 00000100:00100000:0.0:1746065218.349347:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265403904:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065218.349483:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265403904:12345-192.168.202.27@tcp:3:cat.0 Request processed in 135us (287us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065218.349489:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6269 00002000:00100000:3.0:1746065218.349494:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1265664->1269759) req@ffff880097d05500 x1830881265403904/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.349500:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05500 with x1830881265403904 ext(1265664->1269759) 00002000:00010000:3.0:1746065218.349503:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d05500 00000100:00100000:1.0:1746065218.350913:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263989632:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065218.350931:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065218.350961:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265403648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8142us (8736us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065218.350969:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8184 00000100:00100000:3.0:1746065218.358857:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265402880:12345-192.168.202.27@tcp:3:cat.0 Request processed in 46558us (46631us total) trans 0 rc 1662976/1662976 00000100:00100000:3.0:1746065218.358867:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6266 00002000:00100000:3.0:1746065218.358877:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091a90700 x1830881265402880/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 504/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1662976/1662976 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.358885:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a90700 with x1830881265402880 ext(2097152->4194303) 00002000:00010000:3.0:1746065218.358889:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091a90700 00000100:00100000:1.0:1746065218.359506:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265403136:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26568us (26774us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065218.359517:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6267 00002000:00100000:1.0:1746065218.359522:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880097d04e00 x1830881265403136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.359529:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04e00 with x1830881265403136 ext(1048576->2097151) 00002000:00010000:1.0:1746065218.359532:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d04e00 00000100:00100000:1.0:1746065218.361484:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265403392:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28441us (28706us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065218.361492:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6268 00002000:00100000:1.0:1746065218.361500:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880097d06a00 x1830881265403392/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.361507:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06a00 with x1830881265403392 ext(1048576->2097151) 00002000:00010000:1.0:1746065218.361510:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d06a00 00000100:00100000:0.0:1746065218.366479:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.366626:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265404160 00000100:00100000:1.0:1746065218.366634:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265404160 00002000:00100000:1.0:1746065218.366672:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1421312->1425407) req@ffff880097d07800 x1830881265404160/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.366681:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07800 with x1830881265404160 ext(1421312->1425407) 00002000:00010000:1.0:1746065218.366686:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d07800 00000100:00100000:1.0:1746065218.367474:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6270 00000100:00100000:1.0:1746065218.367482:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881265404160:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065218.367686:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881265404160:12345-192.168.202.27@tcp:3:cat.0 Request processed in 204us (1213us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065218.367692:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6270 00002000:00100000:1.0:1746065218.367698:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1421312->1425407) req@ffff880097d07800 x1830881265404160/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.367704:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07800 with x1830881265404160 ext(1421312->1425407) 00002000:00010000:1.0:1746065218.367707:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d07800 00000100:00100000:0.0:1746065218.373440:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.373476:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.373499:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.373532:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.373537:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265404288 00000100:00100000:1.0:1746065218.373544:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265404416 00000100:00100000:3.0:1746065218.373547:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265404288 00000100:00100000:1.0:1746065218.373547:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265404416 00000100:00100000:1.0:1746065218.373579:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265404544 00000100:00100000:1.0:1746065218.373581:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265404544 00000100:00100000:3.0:1746065218.373587:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17509 00000100:00100000:3.0:1746065218.373594:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265404416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065218.373609:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065218.373623:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc14799d5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397eb expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.373640:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17510 00000100:00100000:1.0:1746065218.373646:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17511 00000100:00100000:2.0:1746065218.373647:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265404288:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065218.373651:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265404544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.373656:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.373657:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.373662:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc14799dc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397f2 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.373664:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44c00/0xad6b7ddc14799e3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397e4 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.373665:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263989760:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065218.373681:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263989888:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065218.373685:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263990016:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065218.373725:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065218.373754:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265404800 00000100:00100000:3.0:1746065218.373757:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265404800 00000100:00100000:3.0:1746065218.373797:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5474 00000100:00100000:3.0:1746065218.373802:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+49:2517:x1830881265404800:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065218.373891:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996030c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.373892:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065218.373930:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+50:2517:x1830881265404800:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 128us (397us total) trans 8589937103 rc 0/0 00000100:00100000:3.0:1746065218.373937:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5474 00002000:00010000:3.0:1746065218.375166:0:9549:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065217 -> 1746065218 00002000:00010000:3.0:1746065218.375171:0:9549:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065217 -> 1746065218 00002000:00010000:3.0:1746065218.375172:0:9549:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065217 -> 1746065218 00000100:00100000:1.0:1746065218.375172:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881263989888:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065218.375178:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263989760:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065218.375191:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc14799d5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397eb expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065218.375191:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc14799dc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f2 expref: 27 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.375200:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc14799d5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397eb expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065218.375200:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7200/0xad6b7ddc14799dc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f2 expref: 27 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.375210:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c800, rc 0) 00010000:00010000:1.0:1746065218.375218:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7200, rc 0) 00000100:00100000:3.0:1746065218.375560:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265404416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1964us (2080us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065218.375561:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265404544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1909us (2061us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065218.375566:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17509 00000100:00100000:1.0:1746065218.375569:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17511 00000100:00100000:2.0:1746065218.376174:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263990016:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065218.376193:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44c00/0xad6b7ddc14799e3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397e4 expref: 37 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.376202:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44c00/0xad6b7ddc14799e3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397e4 expref: 37 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.376216:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44c00, rc 0) 00000100:00100000:2.0:1746065218.376246:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265404288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2599us (2814us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065218.376251:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17510 00000100:00100000:0.0:1746065218.378907:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.380250:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.380365:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265404928 00000100:00100000:2.0:1746065218.380374:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265404928 00000100:00100000:2.0:1746065218.380419:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17512 00000100:00100000:2.0:1746065218.380426:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2516:x1830881265404928:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.380439:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.380453:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9397f9 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.380476:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.380482:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.380483:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.380486:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 37 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.380508:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.380518:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 13 pid: 3068 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.380532:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263990144:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065218.380591:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065218.380758:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265405184 00000100:00100000:1.0:1746065218.380762:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265405184 00002000:00100000:1.0:1746065218.380800:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097d06680 x1830881265405184/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.380808:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06680 with x1830881265405184 ext(4194304->5038079) 00010000:00010000:1.0:1746065218.380813:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 14 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.380822:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 14 pid: 3068 timeout: 914 lvb_type: 0 00002000:00010000:1.0:1746065218.380827:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d06680 00000100:00100000:1.0:1746065218.380840:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2064 00000100:00100000:1.0:1746065218.380845:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265405184:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065218.387064:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.387122:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265405312 00000100:00100000:3.0:1746065218.387130:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265405312 00002000:00100000:3.0:1746065218.387164:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3702783) req@ffff880097d06d80 x1830881265405312/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.387172:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06d80 with x1830881265405312 ext(3145728->3702783) 00010000:00010000:3.0:1746065218.387180:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 15 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.387192:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 15 pid: 3068 timeout: 914 lvb_type: 0 00002000:00010000:3.0:1746065218.387198:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d06d80 00000100:00100000:1.0:1746065218.387201:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265405184:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6356us (6954us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746065218.387209:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2064 00002000:00100000:1.0:1746065218.387214:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097d06680 x1830881265405184/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065218.387215:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2065 00000100:00100000:3.0:1746065218.387220:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265405312:12345-192.168.202.27@tcp:4:cat.0 00002000:00100000:1.0:1746065218.387221:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06680 with x1830881265405184 ext(4194304->5038079) 00010000:00010000:1.0:1746065218.387225:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 15 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.387235:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 15 pid: 3068 timeout: 914 lvb_type: 0 00002000:00010000:1.0:1746065218.387240:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d06680 00000100:00100000:2.0:1746065218.387308:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881263990144:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065218.387329:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 37 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.387350:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44600, rc 0) 00000100:00100000:2.0:1746065218.387367:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2516:x1830881265404928:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6942us (8467us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.387374:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17512 00000100:00100000:0.0:1746065218.392831:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.392898:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.392927:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265405440 00000100:00100000:2.0:1746065218.392934:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265405440 00000100:00100000:2.0:1746065218.392963:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265405568 00000100:00100000:2.0:1746065218.392964:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265405568 00000100:00100000:2.0:1746065218.392977:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17513 00000100:00100000:2.0:1746065218.392983:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265405440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.392996:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.393011:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc14799f1 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939800 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.393051:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263990272:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065218.393109:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.393663:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17514 00000100:00100000:2.0:1746065218.393669:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2007:x1830881265405568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.393676:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.393684:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc14799f8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939807 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.393706:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263990400:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065218.393729:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.395187:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265405312:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7962us (8129us total) trans 17179874299 rc 0/0 00000100:00100000:2.0:1746065218.395196:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2065 00002000:00100000:2.0:1746065218.395204:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3702783) req@ffff880097d06d80 x1830881265405312/t17179874299(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/448 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.395212:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d06d80 with x1830881265405312 ext(3145728->3702783) 00010000:00010000:2.0:1746065218.395219:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 18 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.395230:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 18 pid: 3068 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746065218.395236:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d06d80 00000100:00100000:2.0:1746065218.395282:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263990272:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065218.395314:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc14799f1 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939800 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.395323:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abadc00/0xad6b7ddc14799f1 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939800 expref: 12 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.395997:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abadc00, rc 0) 00000100:00100000:2.0:1746065218.396022:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265405440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3039us (3197us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065218.396028:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17513 00000100:00100000:3.0:1746065218.397577:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957da300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263990400:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065218.397603:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc14799f8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939807 expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.397614:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abac800/0xad6b7ddc14799f8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939807 expref: 17 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.397641:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac800, rc 0) 00000100:00100000:3.0:1746065218.397673:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265405568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4003us (4776us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065218.397680:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17514 00000100:00100000:0.0:1746065218.402255:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.402304:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.402367:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265405696 00000100:00100000:3.0:1746065218.402375:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265405696 00000100:00100000:1.0:1746065218.402386:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265405824 00000100:00100000:1.0:1746065218.402391:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265405824 00010000:00010000:1.0:1746065218.402413:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 17 pid: 3068 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746065218.402423:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17515 00000100:00100000:3.0:1746065218.402430:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2510:x1830881265405696:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065218.402436:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8185 00000100:00100000:1.0:1746065218.402442:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265405824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.402443:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.402453:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065218.402454:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93980e expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.402469:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 18 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.402477:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065218.402479:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065218.403221:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [5033984->5242879] (req 5033984->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 18 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.403256:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 18 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.403274:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147995e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3702783) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397a5 expref: 18 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.403297:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.403299:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.403304:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 36 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.403315:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 36 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.403322:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.403323:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.403326:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.403332:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.403368:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065218.403379:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263990528:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065218.403928:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.403937:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6dc00, rc 0) 00000100:00100000:3.0:1746065218.403960:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2510:x1830881265405696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1531us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.403967:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17515 00010000:00010000:1.0:1746065218.404034:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 36 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065218.404351:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263990656:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065218.405180:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996030c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.409591:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.409641:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265406080 00000100:00100000:3.0:1746065218.409649:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265406080 00002000:00100000:3.0:1746065218.409687:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880099ec4e00 x1830881265406080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.409695:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4e00 with x1830881265406080 ext(2097152->3145727) 00002000:00010000:3.0:1746065218.409700:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec4e00 00000100:00100000:3.0:1746065218.409717:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6271 00000100:00100000:3.0:1746065218.409723:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265406080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065218.410353:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263990528:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065218.410364:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881263990656:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065218.410381:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065218.410416:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265405824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7974us (8111us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065218.410425:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8185 00000100:00100000:2.0:1746065218.415467:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.415578:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265406208 00000100:00100000:3.0:1746065218.415586:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265406208 00000100:00100000:3.0:1746065218.415626:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17516 00000100:00100000:3.0:1746065218.415634:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265406208:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065218.415649:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065218.415662:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1479a06 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939815 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.415707:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263990784:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065218.418440:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.419166:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265406080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9439us (9578us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065218.419176:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6271 00002000:00100000:2.0:1746065218.419185:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880099ec4e00 x1830881265406080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.419194:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4e00 with x1830881265406080 ext(2097152->3145727) 00002000:00010000:2.0:1746065218.419198:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec4e00 00000100:00100000:0.0:1746065218.423937:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.424009:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265406336 00000100:00100000:2.0:1746065218.424016:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265406336 00000100:00100000:2.0:1746065218.424048:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17517 00000100:00100000:2.0:1746065218.424054:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2516:x1830881265406336:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.424069:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.424083:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93981c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.424104:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 12 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.424110:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.424112:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.424115:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.424137:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 12 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.424147:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 12 pid: 3068 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.424156:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263990912:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065218.424209:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065218.424506:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263990784:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065218.424526:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1479a06 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939815 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.424536:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6c800/0xad6b7ddc1479a06 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939815 expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.424547:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6c800, rc 0) 00000100:00100000:3.0:1746065218.425866:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265406208:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10227us (10401us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065218.425875:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17516 00000100:00100000:0.0:1746065218.430582:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.430665:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.430733:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265406720 00000100:00100000:2.0:1746065218.430741:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265406720 00002000:00100000:2.0:1746065218.430801:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff880099ec7480 x1830881265406720/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.430812:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7480 with x1830881265406720 ext(5033984->5038079) 00002000:00010000:2.0:1746065218.430816:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec7480 00000100:00100000:2.0:1746065218.430839:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265406592 00000100:00100000:2.0:1746065218.430842:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265406592 00002000:00100000:2.0:1746065218.430854:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2711552->3145727) req@ffff880099ec4a80 x1830881265406592/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.430860:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4a80 with x1830881265406592 ext(2711552->3145727) 00010000:00010000:2.0:1746065218.430866:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 11 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.430879:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 11 pid: 3068 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746065218.430885:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec4a80 00000100:00100000:2.0:1746065218.430898:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2066 00000100:00100000:2.0:1746065218.430904:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265406592:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065218.431040:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263990912:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065218.431061:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 27 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.431073:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70a200, rc 0) 00000100:00100000:2.0:1746065218.431092:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2516:x1830881265406336:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7038us (7162us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.431099:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17517 00000100:00100000:2.0:1746065218.431130:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6272 00000100:00100000:2.0:1746065218.431135:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265406720:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065218.431210:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265406720:12345-192.168.202.27@tcp:3:cat.0 Request processed in 74us (635us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065218.431216:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6272 00002000:00100000:2.0:1746065218.431220:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff880099ec7480 x1830881265406720/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.431226:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec7480 with x1830881265406720 ext(5033984->5038079) 00002000:00010000:2.0:1746065218.431229:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec7480 00000100:00100000:2.0:1746065218.446425:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.446507:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265406976 00000100:00100000:3.0:1746065218.446516:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265406976 00000100:00100000:3.0:1746065218.446551:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5475 00000100:00100000:3.0:1746065218.446557:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4110050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2510:x1830881265406976:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065218.446716:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4110050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2510:x1830881265406976:12345-192.168.202.27@tcp:35:cat.0 Request processed in 158us (297us total) trans 8589937104 rc 0/0 00000100:00100000:3.0:1746065218.446722:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5475 00000100:00100000:2.0:1746065218.448937:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2006:x1830881265406592:12345-192.168.202.27@tcp:4:cat.0 Request processed in 18026us (18265us total) trans 21474841689 rc 0/0 00000100:00100000:2.0:1746065218.448946:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2066 00002000:00100000:2.0:1746065218.448954:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2711552->3145727) req@ffff880099ec4a80 x1830881265406592/t21474841689(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/448 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.448963:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4a80 with x1830881265406592 ext(2711552->3145727) 00010000:00010000:2.0:1746065218.448972:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 13 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.448985:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 13 pid: 3068 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746065218.448992:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec4a80 00000100:00100000:0.0:1746065218.461187:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.461249:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265407104 00000100:00100000:1.0:1746065218.461261:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265407104 00010000:00010000:1.0:1746065218.461292:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 13 pid: 3068 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746065218.461327:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8186 00000100:00100000:1.0:1746065218.461333:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265407104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065218.461352:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065218.461367:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 13 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.461378:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 13 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.461397:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5800/0xad6b7ddc1479957 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2711552->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93979e expref: 13 pid: 3068 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.461425:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.461427:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.461433:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.461440:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.461465:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 26 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065218.461475:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263991040:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065218.462165:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800996030c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065218.469751:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881263991040:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065218.469800:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065218.469839:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265407104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8505us (8658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065218.469848:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8186 00000100:00100000:2.0:1746065218.478930:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.479052:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265407360 00000100:00100000:3.0:1746065218.479060:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265407360 00000100:00100000:3.0:1746065218.479280:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14587 00000100:00100000:3.0:1746065218.479288:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2522:x1830881265407360:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065218.479306:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065218.479320:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1479a14 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939823 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.479393:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a1b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479405:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479413:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a1b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479424:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a22 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479429:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479435:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479503:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1479a29 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479511:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1479a29 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479516:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1479a29 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065218.479523:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065218.479570:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a1b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479576:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a1b lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479581:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a1b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479586:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479590:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abade00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065218.479594:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a1b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479599:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a1b lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479607:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065218.479610:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065218.479613:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a1b lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.479618:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.480200:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a22 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.480206:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a22 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.480211:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.480215:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abadc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065218.480217:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a22 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.480222:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a22 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.480228:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5de00) 00010000:00010000:3.0:1746065218.480230:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065218.480232:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a22 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.480237:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a22 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.480266:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1479a14 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939823 expref: 28 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.480275:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1479a29 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939823 expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.480281:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065218.480283:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065218.480285:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abac800, rc 0) 00000100:00100000:3.0:1746065218.481036:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2522:x1830881265407360:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1748us (2112us total) trans 8589937105 rc 0/0 00000100:00100000:3.0:1746065218.481043:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14587 00000100:00100000:2.0:1746065218.481225:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.481330:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265407616 00000100:00100000:3.0:1746065218.481342:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265407616 00002000:00100000:3.0:1746065218.481367:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8800957da300 x1830881265407616/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.481374:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da300 with x1830881265407616 ext(2097152->4194303) 00002000:00010000:3.0:1746065218.481378:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957da300 00000100:00100000:3.0:1746065218.481391:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6273 00000100:00100000:3.0:1746065218.481396:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265407616:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065218.489860:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.489931:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265407872 00000100:00100000:0.0:1746065218.489939:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265407872 00002000:00100000:0.0:1746065218.489971:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880136a78e00 x1830881265407872/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065218.489981:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78e00 with x1830881265407872 ext(3145728->4194303) 00002000:00010000:0.0:1746065218.489985:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a78e00 00000100:00100000:0.0:1746065218.490011:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6274 00000100:00100000:0.0:1746065218.490017:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265407872:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065218.493935:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.495962:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.496049:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265408256 00000100:00100000:2.0:1746065218.496057:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265408256 00000100:00100000:2.0:1746065218.496099:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 866 00000100:00100000:2.0:1746065218.496105:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265408256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065218.496116:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065218.496137:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc1479a29 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939823 expref: 27 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.496159:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065218.496163:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065218.496210:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265408256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 105us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.496217:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 866 00000100:00100000:1.0:1746065218.497742:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265408128 00000100:00100000:1.0:1746065218.497753:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265408128 00000100:00100000:1.0:1746065218.498305:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5476 00000100:00100000:1.0:1746065218.498313:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2522:x1830881265408128:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065218.498944:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2522:x1830881265408128:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 631us (5014us total) trans 8589937106 rc 0/0 00000100:00100000:1.0:1746065218.498951:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5476 00000100:00100000:3.0:1746065218.507594:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265407616:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26189us (26360us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065218.507604:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6273 00002000:00100000:3.0:1746065218.507612:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff8800957da300 x1830881265407616/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.507621:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da300 with x1830881265407616 ext(2097152->4194303) 00002000:00010000:3.0:1746065218.507627:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957da300 00000100:00100000:0.0:1746065218.512184:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.513391:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265408384 00000100:00100000:2.0:1746065218.513400:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265408384 00000100:00100000:2.0:1746065218.513451:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17518 00000100:00100000:2.0:1746065218.513459:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2522:x1830881265408384:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065218.513474:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.513491:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93982a expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.513515:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 38 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.513522:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.513527:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.513529:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.513531:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 17 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.513555:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.513565:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 17 pid: 1880 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.513576:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263991168:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065218.513656:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 38 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.513663:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 38 pid: 11461 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.513670:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263991296:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065218.513686:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.515467:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265407872:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25445us (25609us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065218.515476:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6274 00002000:00100000:2.0:1746065218.515484:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880136a78e00 x1830881265407872/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.515493:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78e00 with x1830881265407872 ext(3145728->4194303) 00010000:00010000:2.0:1746065218.515501:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 37 pid: 11461 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.515512:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 37 pid: 11461 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746065218.515518:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a78e00 00000100:00100000:0.0:1746065218.517701:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.517762:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265408512 00000100:00100000:1.0:1746065218.517770:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265408512 00010000:00010000:1.0:1746065218.517815:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 18 pid: 1880 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.517816:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263991168:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065218.517825:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263991296:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065218.517846:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.517858:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3200, rc 0) 00000100:00100000:2.0:1746065218.517998:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2522:x1830881265408384:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4539us (5820us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.518004:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17518 00000100:00100000:1.0:1746065218.518416:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8187 00000100:00100000:1.0:1746065218.518424:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2007:x1830881265408512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065218.518435:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065218.518448:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 17 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.518459:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 17 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.518476:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc14799ff lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93980e expref: 17 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.518500:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065218.518519:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265408512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065218.518524:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8187 00000100:00100000:0.0:1746065218.524021:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.524059:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.524118:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265408896 00000100:00100000:3.0:1746065218.524125:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265408896 00000100:00100000:3.0:1746065218.524168:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14588 00000100:00100000:3.0:1746065218.524174:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+50:2524:x1830881265408896:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065218.524192:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065218.524204:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939838 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.524255:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524265:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524274:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524283:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc1479a4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524288:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc1479a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524292:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc1479a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524367:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1479a53 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524374:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1479a53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524379:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1479a53 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065218.524386:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065218.524435:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a45 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524441:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a45 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524446:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524451:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524455:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abade00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065218.524458:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524463:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a45 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524471:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065218.524473:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065218.524476:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a45 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524480:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abade00/0xad6b7ddc1479a45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524493:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc1479a4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524497:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc1479a4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524502:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc1479a4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524509:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abac000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065218.524511:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc1479a4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524515:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc1479a4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524520:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5d800) 00010000:00010000:3.0:1746065218.524521:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065218.524523:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc1479a4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524527:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac000/0xad6b7ddc1479a4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.524551:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc1479a3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939838 expref: 53 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.524560:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1479a53 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939838 expref: 52 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.524565:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065218.524566:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065218.524568:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad600, rc 0) 00000100:00100000:3.0:1746065218.524600:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+52:2524:x1830881265408896:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 426us (540us total) trans 8589937107 rc 0/0 00000100:00100000:3.0:1746065218.524605:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14588 00000100:00100000:2.0:1746065218.526661:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265408640 00000100:00100000:2.0:1746065218.526667:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265408640 00000100:00100000:2.0:1746065218.526697:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17519 00000100:00100000:2.0:1746065218.526702:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265408640:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.526713:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.526723:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1479a61 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939831 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.526740:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.526746:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1479a61 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939831 expref: 38 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.526755:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1479a61 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939831 expref: 38 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.526766:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2200, rc 0) 00000100:00100000:2.0:1746065218.526807:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265408640:12345-192.168.202.27@tcp:101:cat.0 Request processed in 104us (2793us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065218.526812:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17519 00000100:00100000:0.0:1746065218.531286:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.531315:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.531357:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.531421:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265409024 00000100:00100000:1.0:1746065218.531428:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265409024 00010000:00010000:1.0:1746065218.531456:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 37 pid: 11461 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746065218.531475:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265409152 00000100:00100000:1.0:1746065218.531477:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265409152 00000100:00100000:2.0:1746065218.531484:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265409280 00000100:00100000:2.0:1746065218.531488:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265409280 00000100:00100000:1.0:1746065218.531492:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8188 00000100:00100000:1.0:1746065218.531498:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881265409024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065218.531508:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065218.531512:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17520 00000100:00100000:2.0:1746065218.531517:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2516:x1830881265409280:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065218.531525:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 38 pid: 11461 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.531531:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.531536:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 38 pid: 11461 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.531542:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479a68 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93983f expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.531590:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44600/0xad6b7ddc14799ea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397f9 expref: 39 pid: 11461 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.531628:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.531630:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065218.531636:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 867 00010000:00010000:2.0:1746065218.531638:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479a68 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2777088->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93983f expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.531643:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+52:2005:x1830881265409152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.531651:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065218.531651:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479a68 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2777088->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93983f expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.531660:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.531661:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.531662:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc1479a53 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939838 expref: 52 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.531665:0:1880:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 15 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.531671:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 15 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.531674:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065218.531677:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065218.531693:0:1880:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 15 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.531704:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263991424:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065218.531707:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+51:2005:x1830881265409152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.531712:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 867 00000100:00100000:2.0:1746065218.531749:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad840 going to sleep for 11 seconds 00010000:00010000:1.0:1746065218.531845:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065218.531861:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881265409024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 363us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065218.531866:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8188 00000100:00100000:2.0:1746065218.533707:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a79180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263991424:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065218.533725:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2c00, rc 0) 00000100:00100000:2.0:1746065218.533753:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2516:x1830881265409280:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2235us (2395us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.533759:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17520 00000100:00100000:0.0:1746065218.534472:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.534736:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265409536 00000100:00100000:2.0:1746065218.534741:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265409536 00002000:00100000:2.0:1746065218.534770:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2695168->2699263) req@ffff880134b01f80 x1830881265409536/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.534802:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01f80 with x1830881265409536 ext(2695168->2699263) 00002000:00010000:2.0:1746065218.534806:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01f80 00000100:00100000:2.0:1746065218.534904:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6275 00000100:00100000:2.0:1746065218.534910:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265409536:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065218.534998:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265409536:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 88us (528us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065218.535003:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6275 00002000:00100000:2.0:1746065218.535007:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2695168->2699263) req@ffff880134b01f80 x1830881265409536/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.535014:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01f80 with x1830881265409536 ext(2695168->2699263) 00002000:00010000:2.0:1746065218.535017:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b01f80 00000100:00100000:0.0:1746065218.536230:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.536381:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265409792 00000100:00100000:3.0:1746065218.536386:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265409792 00002000:00100000:3.0:1746065218.536406:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880134b00380 x1830881265409792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.536413:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00380 with x1830881265409792 ext(4194304->5038079) 00002000:00010000:3.0:1746065218.536416:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b00380 00000100:00100000:3.0:1746065218.536439:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6276 00000100:00100000:3.0:1746065218.536444:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265409792:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065218.542758:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.544167:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265410048 00000100:00100000:0.0:1746065218.544177:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265410048 00002000:00100000:0.0:1746065218.544211:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2772992->2777087) req@ffff880136a79180 x1830881265410048/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065218.544220:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79180 with x1830881265410048 ext(2772992->2777087) 00002000:00010000:0.0:1746065218.544229:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a79180 00000100:00100000:0.0:1746065218.544250:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6277 00000100:00100000:0.0:1746065218.544257:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265410048:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065218.544381:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265410048:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 124us (1629us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065218.544387:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6277 00002000:00100000:0.0:1746065218.544392:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (2772992->2777087) req@ffff880136a79180 x1830881265410048/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065218.544399:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a79180 with x1830881265410048 ext(2772992->2777087) 00002000:00010000:0.0:1746065218.544401:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a79180 00000100:00100000:3.0:1746065218.545039:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265409792:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8593us (8810us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065218.545045:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6276 00002000:00100000:3.0:1746065218.545050:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880134b00380 x1830881265409792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.545056:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00380 with x1830881265409792 ext(4194304->5038079) 00002000:00010000:3.0:1746065218.545059:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880134b00380 00000100:00100000:0.0:1746065218.550587:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.550666:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265410176 00000100:00100000:2.0:1746065218.550674:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265410176 00000100:00100000:2.0:1746065218.550712:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17521 00000100:00100000:2.0:1746065218.550718:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265410176:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.550736:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.550750:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479a6f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939846 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.550800:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479a6f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939846 expref: 38 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.550810:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479a6f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939846 expref: 38 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.550832:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2000, rc 0) 00000100:00100000:2.0:1746065218.550951:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265410176:12345-192.168.202.27@tcp:101:cat.0 Request processed in 231us (370us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065218.550956:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17521 00000100:00100000:0.0:1746065218.556624:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.556717:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265410304 00000100:00100000:2.0:1746065218.556726:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265410304 00000100:00100000:2.0:1746065218.556763:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17522 00000100:00100000:2.0:1746065218.556770:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265410304:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.556809:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.556825:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479a76 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93984d expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.556854:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479a76 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93984d expref: 38 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.556863:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479a76 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93984d expref: 38 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.556981:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2000, rc 0) 00000100:00100000:2.0:1746065218.557416:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265410304:12345-192.168.202.27@tcp:101:cat.0 Request processed in 645us (798us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065218.557423:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17522 00000100:00100000:0.0:1746065218.562091:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.562231:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265410560 00000100:00100000:1.0:1746065218.562239:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265410560 00000100:00100000:1.0:1746065218.563243:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5477 00000100:00100000:1.0:1746065218.563254:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+51:2516:x1830881265410560:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065218.563448:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+52:2516:x1830881265410560:12345-192.168.202.27@tcp:35:cat.0 Request processed in 195us (1363us total) trans 8589937108 rc 0/0 00000100:00100000:1.0:1746065218.563454:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5477 00000100:00100000:0.0:1746065218.603493:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.605397:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265410688 00000100:00100000:2.0:1746065218.605406:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265410688 00000100:00100000:2.0:1746065218.605834:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17523 00000100:00100000:2.0:1746065218.605843:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2524:x1830881265410688:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065218.605860:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.605878:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939854 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.605903:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479a68 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2777088->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93983f expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.605910:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.605912:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.605914:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3686400->4194303] (req 3686400->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.605939:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479a68 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2777088->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93983f expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.605948:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479a68 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2777088->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93983f expref: 38 pid: 1880 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.605961:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263991552:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065218.608601:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.615253:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.615312:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265410816 00000100:00100000:1.0:1746065218.615318:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265410816 00010000:00010000:1.0:1746065218.615359:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479a68 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2777088->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93983f expref: 39 pid: 1880 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746065218.615384:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8189 00000100:00100000:1.0:1746065218.615391:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881265410816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065218.615403:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065218.615422:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479a68 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2777088->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93983f expref: 39 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.615437:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479a68 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2777088->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93983f expref: 39 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.615457:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.615459:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.615464:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.615471:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.615498:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065218.615507:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263991680:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065218.616125:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479a68 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2777088->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93983f expref: 39 pid: 1880 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.616143:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263991552:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065218.616162:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 38 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.616170:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3800, rc 0) 00000100:00100000:2.0:1746065218.616193:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+38:2524:x1830881265410688:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10353us (12708us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.616201:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17523 00000100:00100000:1.0:1746065218.618531:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.621083:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.622191:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263991680:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065218.622209:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065218.622253:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265410816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6862us (7007us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065218.622263:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8189 00000100:00100000:3.0:1746065218.622688:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265411072 00000100:00100000:3.0:1746065218.622695:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265411072 00002000:00100000:3.0:1746065218.622728:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3686400->3690495) req@ffff88009a6ddc00 x1830881265411072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.622738:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddc00 with x1830881265411072 ext(3686400->3690495) 00002000:00010000:3.0:1746065218.622742:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6ddc00 00000100:00100000:3.0:1746065218.622758:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6278 00000100:00100000:3.0:1746065218.622764:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265411072:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065218.622880:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265411072:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 116us (1804us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065218.622885:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6278 00002000:00100000:3.0:1746065218.622890:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3686400->3690495) req@ffff88009a6ddc00 x1830881265411072/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.622903:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6ddc00 with x1830881265411072 ext(3686400->3690495) 00002000:00010000:3.0:1746065218.622907:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009a6ddc00 00000100:00100000:0.0:1746065218.640182:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.640305:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265411200 00000100:00100000:2.0:1746065218.640313:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265411200 00000100:00100000:2.0:1746065218.640371:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17524 00000100:00100000:2.0:1746065218.640378:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2524:x1830881265411200:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065218.640393:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.640408:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93985b expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.640435:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 28 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.640447:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.640448:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.640451:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->3211263] (req 3145728->3211263) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.640478:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 28 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.640488:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 28 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.640499:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263991808:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065218.640585:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.644501:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263991808:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065218.644527:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->3211263] (req 3145728->3211263) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.644543:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3e00, rc 0) 00000100:00100000:2.0:1746065218.644590:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2524:x1830881265411200:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4211us (4413us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.644597:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17524 00000100:00100000:0.0:1746065218.658016:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.659696:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265411328 00000100:00100000:1.0:1746065218.659706:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265411328 00010000:00010000:1.0:1746065218.659744:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 28 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746065218.659791:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8190 00000100:00100000:1.0:1746065218.659798:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265411328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065218.659811:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065218.659827:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 28 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.659837:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 28 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.659857:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f70a200/0xad6b7ddc1479a0d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93981c expref: 28 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.659887:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.659889:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.659895:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.659902:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.659927:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065218.659938:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263991936:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065218.660020:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.663256:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.663289:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263991936:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065218.663307:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065218.663362:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265411328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3563us (5352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065218.663371:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8190 00000100:00100000:2.0:1746065218.664061:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265411584 00000100:00100000:2.0:1746065218.664068:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265411584 00002000:00100000:2.0:1746065218.664100:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3207168->3211263) req@ffff88009a6dfb80 x1830881265411584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.664113:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dfb80 with x1830881265411584 ext(3207168->3211263) 00002000:00010000:2.0:1746065218.664117:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dfb80 00000100:00100000:2.0:1746065218.664140:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6279 00000100:00100000:2.0:1746065218.664146:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881265411584:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065218.664249:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881265411584:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 102us (999us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065218.664254:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6279 00002000:00100000:2.0:1746065218.664259:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3207168->3211263) req@ffff88009a6dfb80 x1830881265411584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.664265:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dfb80 with x1830881265411584 ext(3207168->3211263) 00002000:00010000:2.0:1746065218.664267:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dfb80 00000100:00100000:0.0:1746065218.670149:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.670234:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265411840 00000100:00100000:1.0:1746065218.670243:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265411840 00000100:00100000:1.0:1746065218.670712:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5478 00000100:00100000:1.0:1746065218.670720:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+52:2524:x1830881265411840:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065218.672743:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+53:2524:x1830881265411840:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 2018us (2595us total) trans 8589937109 rc 0/0 00000100:00100000:1.0:1746065218.672752:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5478 00000100:00100000:0.0:1746065218.682245:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.682594:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265412096 00000100:00100000:1.0:1746065218.682602:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265412096 00000100:00100000:1.0:1746065218.682655:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14589 00000100:00100000:1.0:1746065218.682662:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2533:x1830881265412096:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065218.682682:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.682697:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479a8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939862 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.682758:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479a92 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.682767:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479a92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.682809:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479a92 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.682828:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479a99 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.682833:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.682838:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.682911:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44200/0xad6b7ddc1479aa0 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.682918:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44200/0xad6b7ddc1479aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.682924:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44200/0xad6b7ddc1479aa0 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065218.682931:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065218.682987:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479a92 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.682992:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479a92 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.682997:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479a92 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683002:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479a92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683006:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065218.683010:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479a92 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683017:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479a92 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683025:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065218.683028:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065218.683031:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479a92 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683035:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479a92 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683054:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479a99 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683059:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479a99 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683063:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479a99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683067:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065218.683069:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479a99 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683073:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479a99 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683079:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012edbd500) 00010000:00010000:1.0:1746065218.683080:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065218.683083:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479a99 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683087:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479a99 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.683123:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479a8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939862 expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.683132:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44200/0xad6b7ddc1479aa0 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939862 expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.683137:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065218.683139:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065218.683141:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44200, rc 0) 00000100:00100000:1.0:1746065218.683189:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2533:x1830881265412096:12345-192.168.202.27@tcp:101:cat.0 Request processed in 528us (952us total) trans 8589937110 rc 0/0 00000100:00100000:1.0:1746065218.683195:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14589 00000100:00100000:2.0:1746065218.689718:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.689738:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.692619:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.692945:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.692970:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.692983:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265412608 00000100:00100000:2.0:1746065218.692990:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265412608 00000100:00100000:2.0:1746065218.693029:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 868 00000100:00100000:2.0:1746065218.693036:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2006:x1830881265412608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065218.693047:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065218.693066:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44200/0xad6b7ddc1479aa0 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939862 expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.693085:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065218.693088:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065218.693117:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2006:x1830881265412608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.693122:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 868 00000100:00100000:0.0:1746065218.693255:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265412224 00000100:00100000:0.0:1746065218.693259:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265412224 00000100:00100000:0.0:1746065218.693303:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265412480 00000100:00100000:0.0:1746065218.693305:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265412480 00000100:00100000:0.0:1746065218.693319:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265412352 00000100:00100000:0.0:1746065218.693320:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265412352 00000100:00100000:0.0:1746065218.693342:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17525 00000100:00100000:0.0:1746065218.693346:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265412224:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065218.693357:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065218.693366:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479aae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939869 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065218.693401:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263992064:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065218.693449:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.693460:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17526 00000100:00100000:0.0:1746065218.693463:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265412480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065218.693468:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065218.693473:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c0200/0xad6b7ddc1479ab5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939877 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065218.693488:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263992192:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065218.693502:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065218.693807:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17527 00000100:00100000:3.0:1746065218.693812:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265412352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065218.693839:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065218.693848:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc1479abc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939870 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.693867:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263992320:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065218.693891:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065218.694060:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265412864 00000100:00100000:1.0:1746065218.694064:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265412864 00000100:00100000:1.0:1746065218.694088:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14590 00000100:00100000:1.0:1746065218.694092:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+53:2534:x1830881265412864:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065218.694107:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.694114:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc1479ac3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93987e expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.694165:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479aca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694175:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479aca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694183:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479aca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694196:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479ad1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694201:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694205:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694278:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479ad8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694396:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694403:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479ad8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065218.694410:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065218.694460:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479aca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694465:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479aca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694470:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479aca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694474:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479aca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694478:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d44a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065218.694480:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479aca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694488:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479aca lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694494:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065218.694496:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065218.694499:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479aca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694503:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44a00/0xad6b7ddc1479aca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694724:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479ad1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694729:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479ad1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694734:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694738:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d45e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065218.694740:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479ad1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694744:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479ad1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694750:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012edbdb00) 00010000:00010000:1.0:1746065218.694752:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065218.694754:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479ad1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694758:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d45e00/0xad6b7ddc1479ad1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.694887:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44c00/0xad6b7ddc1479ac3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93987e expref: 56 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.694897:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479ad8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93987e expref: 55 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.694903:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065218.694904:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065218.694906:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44e00, rc 0) 00000100:00100000:1.0:1746065218.695586:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+55:2534:x1830881265412864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1490us (2638us total) trans 8589937111 rc 0/0 00000100:00100000:1.0:1746065218.695592:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14590 00000100:00100000:3.0:1746065218.697551:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263992320:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065218.697578:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc1479abc lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939870 expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.697591:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad600/0xad6b7ddc1479abc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939870 expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.697604:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad600, rc 0) 00000100:00100000:3.0:1746065218.697632:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265412352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3819us (5019us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065218.697639:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17527 00000100:00100000:1.0:1746065218.697704:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263992192:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065218.697720:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999c0200/0xad6b7ddc1479ab5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939877 expref: 15 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065218.697727:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c0200/0xad6b7ddc1479ab5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939877 expref: 15 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065218.697735:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0200, rc 0) 00000100:00100000:1.0:1746065218.697749:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265412480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4285us (8010us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065218.697754:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17526 00000100:00100000:2.0:1746065218.697958:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263992064:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065218.697971:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479aae lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939869 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.697979:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479aae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939869 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.697985:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1400, rc 0) 00000100:00100000:2.0:1746065218.698007:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265412224:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4660us (8296us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065218.698011:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17525 00000100:00100000:2.0:1746065218.698167:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.698247:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265412992 00000100:00100000:3.0:1746065218.698252:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265412992 00000100:00100000:3.0:1746065218.698279:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 869 00000100:00100000:3.0:1746065218.698284:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+55:2007:x1830881265412992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.698294:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065218.698307:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d44e00/0xad6b7ddc1479ad8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93987e expref: 55 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.698316:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065218.698319:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.698344:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+54:2007:x1830881265412992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 60us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.698349:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 869 00000100:00100000:0.0:1746065218.700536:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.700596:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265413120 00000100:00100000:2.0:1746065218.700601:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265413120 00000100:00100000:2.0:1746065218.700694:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17528 00000100:00100000:2.0:1746065218.700700:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265413120:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.700711:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.700722:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc1479ae6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939885 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.700761:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263992448:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065218.701623:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.703893:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263992448:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065218.703921:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc1479ae6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939885 expref: 38 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065218.703934:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2600/0xad6b7ddc1479ae6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939885 expref: 38 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065218.703958:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2600, rc 0) 00000100:00100000:0.0:1746065218.704001:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265413120:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3300us (3469us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065218.704008:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17528 00000100:00100000:0.0:1746065218.709949:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.709997:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.710069:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265413248 00000100:00100000:2.0:1746065218.710076:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265413248 00000100:00100000:2.0:1746065218.710113:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17529 00000100:00100000:2.0:1746065218.710119:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2533:x1830881265413248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.710133:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.710146:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93988c expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.710169:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.710176:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.710178:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.710181:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.710206:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.710216:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 26 pid: 11461 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.710226:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263992576:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065218.710288:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065218.710419:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265413504 00000100:00100000:3.0:1746065218.710423:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265413504 00002000:00100000:3.0:1746065218.710447:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009a6dce00 x1830881265413504/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 504/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.710456:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dce00 with x1830881265413504 ext(1048576->2097151) 00010000:00010000:3.0:1746065218.710463:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 27 pid: 11461 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.710474:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 27 pid: 11461 timeout: 914 lvb_type: 0 00002000:00010000:3.0:1746065218.710479:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6dce00 00000100:00100000:3.0:1746065218.710492:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2067 00000100:00100000:3.0:1746065218.710497:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265413504:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065218.721701:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881263992576:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065218.721729:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.721744:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2a00, rc 0) 00000100:00100000:2.0:1746065218.721794:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2533:x1830881265413248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11674us (11851us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.721801:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17529 00000100:00100000:2.0:1746065218.721913:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.721935:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265413632 00000100:00100000:2.0:1746065218.721940:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265413632 00002000:00100000:2.0:1746065218.721965:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1265664->1425407) req@ffff880091b64700 x1830881265413632/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.721972:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64700 with x1830881265413632 ext(1265664->1425407) 00010000:00010000:2.0:1746065218.721977:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 29 pid: 11461 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.721987:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 29 pid: 11461 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746065218.721993:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091b64700 00000100:00100000:2.0:1746065218.722008:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2068 00000100:00100000:2.0:1746065218.722013:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265413632:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065218.726280:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265413504:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15775us (16274us total) trans 0 rc 888832/888832 00000100:00100000:3.0:1746065218.726290:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2067 00002000:00100000:3.0:1746065218.726307:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009a6dce00 x1830881265413504/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 504/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 888832/888832 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.726315:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dce00 with x1830881265413504 ext(1048576->2097151) 00010000:00010000:3.0:1746065218.726323:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 31 pid: 11461 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.726343:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 31 pid: 11461 timeout: 914 lvb_type: 0 00002000:00010000:3.0:1746065218.726350:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009a6dce00 00000100:00100000:3.0:1746065218.726744:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265413632:12345-192.168.202.27@tcp:4:cat.0 Request processed in 4730us (4831us total) trans 21474841690 rc 0/0 00000100:00100000:3.0:1746065218.726750:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2068 00002000:00100000:3.0:1746065218.726756:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1265664->1425407) req@ffff880091b64700 x1830881265413632/t21474841690(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/448 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.726762:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64700 with x1830881265413632 ext(1265664->1425407) 00010000:00010000:3.0:1746065218.726767:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 29 pid: 11461 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.726787:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 29 pid: 11461 timeout: 914 lvb_type: 0 00002000:00010000:3.0:1746065218.726796:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091b64700 00000100:00100000:0.0:1746065218.733311:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.735095:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265413760 00000100:00100000:2.0:1746065218.735141:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265413760 00010000:00010000:2.0:1746065218.735176:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 29 pid: 11461 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.735216:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8191 00000100:00100000:2.0:1746065218.735223:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265413760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065218.735235:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065218.735252:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 29 pid: 11461 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.735264:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 29 pid: 11461 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.735441:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489800/0xad6b7ddc14799ce lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1265664->1425407) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397dd expref: 29 pid: 11461 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.736115:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.736118:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.736125:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.736133:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.736162:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.736172:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263992704:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065218.736656:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.741286:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.741371:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265413888 00000100:00100000:0.0:1746065218.741379:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265413888 00000100:00100000:0.0:1746065218.741416:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17530 00000100:00100000:0.0:1746065218.741422:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2534:x1830881265413888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065218.741436:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065218.741448:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939893 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.741472:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 15 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.741478:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065218.741480:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065218.741483:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.741506:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 15 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.741516:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 15 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746065218.741525:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263992832:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065218.742015:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.745186:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881263992832:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065218.745211:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 38 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.745224:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f04b600, rc 0) 00000100:00100000:2.0:1746065218.745307:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+38:2534:x1830881265413888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3883us (4027us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.745315:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17530 00000100:00100000:0.0:1746065218.747389:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.747458:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263992704:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065218.747474:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065218.747517:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265413760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 12294us (14214us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.747526:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8191 00000100:00100000:3.0:1746065218.747698:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265414016 00000100:00100000:3.0:1746065218.747704:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265414016 00002000:00100000:3.0:1746065218.747732:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2695168->2777087) req@ffff88009a6dc000 x1830881265414016/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.747741:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881265414016 ext(2695168->2777087) 00010000:00010000:3.0:1746065218.747748:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 16 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.747759:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 16 pid: 9549 timeout: 914 lvb_type: 0 00002000:00010000:3.0:1746065218.747766:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6dc000 00000100:00100000:3.0:1746065218.747794:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2069 00000100:00100000:3.0:1746065218.747800:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265414016:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065218.749128:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.749190:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265414272 00000100:00100000:2.0:1746065218.749194:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265414272 00002000:00100000:2.0:1746065218.749306:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009a6dea00 x1830881265414272/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.749315:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dea00 with x1830881265414272 ext(1048576->2097151) 00002000:00010000:2.0:1746065218.749319:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dea00 00000100:00100000:2.0:1746065218.749350:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6280 00000100:00100000:2.0:1746065218.749356:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265414272:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065218.755262:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265414016:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7454us (7871us total) trans 17179874300 rc 0/0 00000100:00100000:2.0:1746065218.755276:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2069 00002000:00100000:2.0:1746065218.755287:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2695168->2777087) req@ffff88009a6dc000 x1830881265414016/t17179874300(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/448 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.755297:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dc000 with x1830881265414016 ext(2695168->2777087) 00010000:00010000:2.0:1746065218.755306:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 18 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.755319:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 18 pid: 9549 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746065218.755325:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6dc000 00000100:00100000:2.0:1746065218.756712:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265414272:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7350us (7581us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065218.756719:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6280 00002000:00100000:2.0:1746065218.756726:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009a6dea00 x1830881265414272/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.756733:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6dea00 with x1830881265414272 ext(1048576->2097151) 00002000:00010000:2.0:1746065218.756736:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009a6dea00 00000100:00100000:0.0:1746065218.768376:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.768437:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265414400 00000100:00100000:2.0:1746065218.768445:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265414400 00010000:00010000:2.0:1746065218.768477:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 18 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.768514:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8192 00000100:00100000:2.0:1746065218.768520:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265414400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065218.768533:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065218.768552:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 18 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.768562:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 18 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.768584:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479a37 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2695168->2777087] (req 2695168->2777087) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93982a expref: 18 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.768614:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.768616:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.768623:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 37 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.768630:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 37 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.768660:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 37 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.768673:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263992960:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065218.768769:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.771020:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.771298:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.772449:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265414528 00000100:00100000:3.0:1746065218.772463:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265414528 00000100:00100000:3.0:1746065218.772508:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265414656 00000100:00100000:3.0:1746065218.772510:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265414656 00000100:00100000:3.0:1746065218.772530:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17531 00000100:00100000:3.0:1746065218.772537:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265414528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065218.772551:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065218.772565:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc1479afb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93989a expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.772609:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263993088:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065218.772694:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17532 00000100:00100000:2.0:1746065218.772702:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265414656:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.772710:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.772720:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479b02 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398a1 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.772745:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263993216:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065218.775169:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.775511:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.776992:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.777057:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265414912 00000100:00100000:3.0:1746065218.777067:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265414912 00002000:00100000:3.0:1746065218.777118:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012f09f100 x1830881265414912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.777128:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f100 with x1830881265414912 ext(2097152->3145727) 00002000:00010000:3.0:1746065218.777134:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09f100 00000100:00100000:3.0:1746065218.777155:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6281 00000100:00100000:3.0:1746065218.777162:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881265414912:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065218.777543:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.777589:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b67800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263992960:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065218.777599:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265415168 00000100:00100000:1.0:1746065218.777603:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265415168 00010000:00010000:2.0:1746065218.777606:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065218.777620:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88012f09ed80 x1830881265415168/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.777628:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ed80 with x1830881265415168 ext(2097152->3145727) 00002000:00010000:1.0:1746065218.777631:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ed80 00000100:00100000:1.0:1746065218.777641:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6282 00000100:00100000:1.0:1746065218.777646:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265415168:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065218.777696:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265414400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9174us (9327us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.777703:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8192 00000100:00100000:3.0:1746065218.789882:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881263993088:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065218.789910:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc1479afb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93989a expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.789923:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc1479afb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93989a expref: 18 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065218.789948:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0600, rc 0) 00000100:00100000:0.0:1746065218.790590:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263993216:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065218.790606:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479b02 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398a1 expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065218.790614:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479b02 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398a1 expref: 14 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065218.790626:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f04a000, rc 0) 00000100:00100000:0.0:1746065218.793581:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265414656:12345-192.168.202.27@tcp:101:cat.0 Request processed in 20872us (22275us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065218.793592:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17532 00000100:00100000:0.0:1746065218.793790:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.794512:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265414528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 20883us (22405us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065218.794519:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17531 00000100:00100000:3.0:1746065218.794628:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881265414912:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17466us (17644us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065218.794636:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6281 00002000:00100000:3.0:1746065218.794645:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff88012f09f100 x1830881265414912/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.794653:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09f100 with x1830881265414912 ext(2097152->3145727) 00002000:00010000:3.0:1746065218.794659:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09f100 00000100:00100000:1.0:1746065218.794990:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265415424 00000100:00100000:1.0:1746065218.794997:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265415424 00000100:00100000:1.0:1746065218.795042:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14591 00000100:00100000:1.0:1746065218.795048:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2536:x1830881265415424:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065218.795067:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.795081:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b09 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398a8 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.795139:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc1479b10 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795150:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc1479b10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795159:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc1479b10 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795170:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1479b17 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795175:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1479b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795180:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1479b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795257:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1479b1e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795265:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1479b1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795270:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1479b1e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065218.795278:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065218.795347:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc1479b10 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795352:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc1479b10 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795357:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc1479b10 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795363:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc1479b10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795368:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dda00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065218.795372:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc1479b10 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795377:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc1479b10 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795386:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065218.795389:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065218.795392:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc1479b10 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795401:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dda00/0xad6b7ddc1479b10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795415:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1479b17 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795419:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1479b17 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795423:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1479b17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795427:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dce00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065218.795429:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1479b17 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795433:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1479b17 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795438:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012edbd600) 00010000:00010000:1.0:1746065218.795440:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065218.795442:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1479b17 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795447:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dce00/0xad6b7ddc1479b17 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065218.795474:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b09 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398a8 expref: 31 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.795484:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1479b1e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398a8 expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.795494:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065218.795496:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065218.795498:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd600, rc 0) 00000100:00100000:1.0:1746065218.795520:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2536:x1830881265415424:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 472us (1748us total) trans 8589937112 rc 0/0 00000100:00100000:1.0:1746065218.795525:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14591 00000100:00100000:1.0:1746065218.802865:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265415168:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25207us (25310us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065218.802877:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6282 00002000:00100000:1.0:1746065218.802888:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88012f09ed80 x1830881265415168/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.802897:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09ed80 with x1830881265415168 ext(2097152->3145727) 00002000:00010000:1.0:1746065218.802902:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09ed80 00000100:00100000:0.0:1746065218.814903:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.814955:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.814977:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.815003:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.815252:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265416192 00000100:00100000:3.0:1746065218.815260:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265416192 00000100:00100000:2.0:1746065218.815276:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265415936 00000100:00100000:2.0:1746065218.815281:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265415936 00000100:00100000:3.0:1746065218.815308:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5479 00000100:00100000:2.0:1746065218.815314:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 870 00000100:00100000:3.0:1746065218.815315:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2536:x1830881265416192:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065218.815319:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2007:x1830881265415936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065218.815329:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065218.815366:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc1479b1e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398a8 expref: 31 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.815383:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065218.815386:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065218.815461:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2007:x1830881265415936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 141us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.815468:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 870 00000100:00100000:3.0:1746065218.815547:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2536:x1830881265416192:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 232us (568us total) trans 8589937113 rc 0/0 00000100:00100000:3.0:1746065218.815553:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5479 00000100:00100000:3.0:1746065218.815568:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265415808 00000100:00100000:3.0:1746065218.815571:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265415808 00000100:00100000:3.0:1746065218.815589:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14592 00000100:00100000:3.0:1746065218.815594:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c1bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+54:2538:x1830881265415808:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065218.815603:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065218.815605:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265415552 00000100:00100000:2.0:1746065218.815609:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265415552 00010000:00010000:3.0:1746065218.815611:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1200/0xad6b7ddc1479b2c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398b6 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.815629:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17533 00000100:00100000:2.0:1746065218.815634:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2533:x1830881265415552:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.815640:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.815649:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc1479b3a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398af expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.815650:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479b33 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815660:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479b33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065218.815663:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.815665:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.815668:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479b33 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065218.815670:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc1479b3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398af expref: 18 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.815677:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479b41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065218.815680:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc1479b3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398af expref: 18 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.815682:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479b41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815687:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479b41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065218.815687:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:2.0:1746065218.815705:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2533:x1830881265415552:12345-192.168.202.27@tcp:101:cat.0 Request processed in 71us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.815710:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17533 00010000:00010000:3.0:1746065218.815740:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1000/0xad6b7ddc1479b48 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815747:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1000/0xad6b7ddc1479b48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815752:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1000/0xad6b7ddc1479b48 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065218.815759:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065218.815810:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479b33 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815816:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479b33 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815821:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479b33 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815826:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479b33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815831:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c1c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065218.815835:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479b33 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815840:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479b33 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815847:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065218.815849:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065218.815851:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479b33 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815856:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479b33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815862:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479b41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815867:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479b41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815871:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479b41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815875:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c1400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065218.815877:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479b41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815881:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479b41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815886:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5df00) 00010000:00010000:3.0:1746065218.815888:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065218.815890:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479b41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815895:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479b41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065218.815914:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1200/0xad6b7ddc1479b2c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398b6 expref: 57 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.815922:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1000/0xad6b7ddc1479b48 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398b6 expref: 56 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.815927:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065218.815929:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065218.815931:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1000, rc 0) 00000100:00100000:3.0:1746065218.815959:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c1bd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+56:2538:x1830881265415808:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 365us (1003us total) trans 8589937114 rc 0/0 00000100:00100000:3.0:1746065218.815964:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14592 00000100:00100000:0.0:1746065218.823409:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.823454:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.823459:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265416320 00000100:00100000:2.0:1746065218.823467:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265416320 00000100:00100000:2.0:1746065218.823518:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17534 00000100:00100000:2.0:1746065218.823525:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2534:x1830881265416320:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065218.823531:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265416576 00000100:00100000:1.0:1746065218.823535:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265416576 00010000:00010000:2.0:1746065218.823539:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.823554:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398bd expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00100000:1.0:1746065218.823562:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800957d9c00 x1830881265416576/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.823571:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9c00 with x1830881265416576 ext(2097152->3145727) 00002000:00010000:1.0:1746065218.823575:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d9c00 00010000:00010000:2.0:1746065218.823578:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065218.823587:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6283 00010000:00010000:2.0:1746065218.823590:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.823591:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00000100:00100000:1.0:1746065218.823591:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265416576:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065218.823595:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.823619:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.823629:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 39 pid: 1880 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.823639:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263993344:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065218.823713:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065218.848289:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.848323:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.848387:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263993344:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065218.848403:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265416960 00000100:00100000:3.0:1746065218.848410:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265416960 00010000:00010000:2.0:1746065218.848411:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 39 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.848426:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73800, rc 0) 00000100:00100000:3.0:1746065218.848449:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 871 00000100:00100000:3.0:1746065218.848455:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+56:2004:x1830881265416960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065218.848456:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2534:x1830881265416320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 24932us (25056us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065218.848463:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065218.848464:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17534 00010000:00010000:3.0:1746065218.848481:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1000/0xad6b7ddc1479b48 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398b6 expref: 56 pid: 9571 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.848492:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065218.848504:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065218.848507:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.848525:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+55:2004:x1830881265416960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.848530:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 871 00000100:00100000:1.0:1746065218.848537:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265416832 00000100:00100000:1.0:1746065218.848540:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265416832 00000100:00100000:1.0:1746065218.848561:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5480 00000100:00100000:1.0:1746065218.848565:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+55:2538:x1830881265416832:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065218.848808:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+56:2538:x1830881265416832:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 241us (526us total) trans 8589937115 rc 0/0 00000100:00100000:1.0:1746065218.848814:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5480 00000100:00100000:2.0:1746065218.849185:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265417088 00000100:00100000:2.0:1746065218.849189:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265417088 00000100:00100000:2.0:1746065218.849218:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17535 00000100:00100000:2.0:1746065218.849223:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2536:x1830881265417088:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065218.849232:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.849245:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398c4 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.849259:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.849262:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.849269:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065218.849272:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3796992->4128767] (req 3796992->4128767) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.849294:0:9549:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.849303:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3796992->4128767] (req 3796992->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.849309:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d600, rc 0) 00000100:00100000:2.0:1746065218.849323:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2536:x1830881265417088:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 100us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.849328:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17535 00000100:00100000:2.0:1746065218.849385:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.851237:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265417216 00000100:00100000:3.0:1746065218.851244:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265417216 00002000:00100000:3.0:1746065218.851272:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3686400->4194303) req@ffff880099bd7800 x1830881265417216/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.851281:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7800 with x1830881265417216 ext(3686400->4194303) 00010000:00010000:3.0:1746065218.851287:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 39 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.851299:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 39 pid: 1880 timeout: 914 lvb_type: 0 00002000:00010000:3.0:1746065218.851306:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd7800 00000100:00100000:3.0:1746065218.851341:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2070 00000100:00100000:3.0:1746065218.851348:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881265417216:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065218.856963:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265416576:12345-192.168.202.27@tcp:3:cat.0 Request processed in 33363us (33500us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065218.856974:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6283 00002000:00100000:1.0:1746065218.856983:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800957d9c00 x1830881265416576/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.856993:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9c00 with x1830881265416576 ext(2097152->3145727) 00002000:00010000:1.0:1746065218.856998:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d9c00 00000100:00100000:0.0:1746065218.871375:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.871411:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265417344 00000100:00100000:0.0:1746065218.871417:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265417344 00000100:00100000:0.0:1746065218.871448:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17536 00000100:00100000:0.0:1746065218.871454:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2533:x1830881265417344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065218.871469:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065218.871481:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398cb expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.871503:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.871511:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065218.871512:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065218.871515:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 14 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.871542:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.871551:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 27 pid: 1880 timeout: 914 lvb_type: 0 00000100:00100000:0.0:1746065218.871562:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263993600:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065218.871633:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65669c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.876195:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265417216:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 24838us (26799us total) trans 17179874301 rc 0/0 00000100:00100000:0.0:1746065218.876207:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2070 00002000:00100000:0.0:1746065218.876221:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3686400->4194303) req@ffff880099bd7800 x1830881265417216/t17179874301(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/448 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065218.876230:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd7800 with x1830881265417216 ext(3686400->4194303) 00010000:00010000:0.0:1746065218.876240:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 41 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:0.0:1746065218.876251:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 41 pid: 1880 timeout: 914 lvb_type: 0 00002000:00010000:0.0:1746065218.876258:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099bd7800 00000100:00100000:3.0:1746065218.876451:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.876680:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881263993600:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065218.876704:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 14 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065218.876718:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5ce600, rc 0) 00000100:00100000:0.0:1746065218.876737:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2533:x1830881265417344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5283us (5369us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065218.876743:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17536 00000100:00100000:1.0:1746065218.876962:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265417472 00000100:00100000:1.0:1746065218.876967:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265417472 00002000:00100000:1.0:1746065218.876994:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3211263) req@ffff880091a93480 x1830881265417472/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.877001:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93480 with x1830881265417472 ext(3145728->3211263) 00010000:00010000:1.0:1746065218.877006:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 28 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.877014:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 28 pid: 1880 timeout: 914 lvb_type: 0 00002000:00010000:1.0:1746065218.877020:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091a93480 00000100:00100000:1.0:1746065218.877033:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2071 00000100:00100000:1.0:1746065218.877039:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265417472:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065218.882156:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.882225:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265417600 00000100:00100000:3.0:1746065218.882232:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265417600 00010000:00010000:3.0:1746065218.882259:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 41 pid: 1880 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746065218.882291:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8193 00000100:00100000:3.0:1746065218.882297:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265417600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.882306:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065218.882319:0:7192:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065218 -> 1746065219 00002000:00010000:3.0:1746065218.882322:0:7192:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065218 -> 1746065219 00002000:00010000:3.0:1746065218.882324:0:7192:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065218 -> 1746065219 00010000:00010000:3.0:1746065218.882329:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 41 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.882350:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 41 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.882369:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479a7d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3686400->18446744073709551615] (req 3686400->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939854 expref: 41 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.882386:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.882388:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.882394:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.882402:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.882429:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.882437:0:7192:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746065218.882448:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263993728:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065218.882510:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065218.884625:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265417472:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 7580us (8168us total) trans 21474841691 rc 0/0 00000100:00100000:1.0:1746065218.884635:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2071 00002000:00100000:1.0:1746065218.884643:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3211263) req@ffff880091a93480 x1830881265417472/t21474841691(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/448 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.884652:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a93480 with x1830881265417472 ext(3145728->3211263) 00010000:00010000:1.0:1746065218.884659:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 30 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.884671:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 30 pid: 1880 timeout: 914 lvb_type: 0 00002000:00010000:1.0:1746065218.884678:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091a93480 00000100:00100000:0.0:1746065218.890049:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.890138:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263993728:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065218.890425:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.890477:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265417600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8179us (8327us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.890487:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8193 00000100:00100000:1.0:1746065218.891365:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265417856 00000100:00100000:1.0:1746065218.891376:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265417856 00002000:00100000:1.0:1746065218.891410:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff8800957d8000 x1830881265417856/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.891419:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8000 with x1830881265417856 ext(3145728->4194303) 00010000:00010000:1.0:1746065218.891426:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.891437:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 914 lvb_type: 0 00002000:00010000:1.0:1746065218.891445:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957d8000 00000100:00100000:1.0:1746065218.891460:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2072 00000100:00100000:1.0:1746065218.891466:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881265417856:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065218.902471:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.902629:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881265417856:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 11160us (12584us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065218.902638:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2072 00002000:00100000:1.0:1746065218.902647:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff8800957d8000 x1830881265417856/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065218.902656:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8000 with x1830881265417856 ext(3145728->4194303) 00010000:00010000:1.0:1746065218.902665:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:1.0:1746065218.902675:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 914 lvb_type: 0 00002000:00010000:1.0:1746065218.902682:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800957d8000 00000100:00100000:3.0:1746065218.902938:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265417984 00000100:00100000:3.0:1746065218.903015:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265417984 00010000:00010000:3.0:1746065218.903116:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 30 pid: 1880 timeout: 914 lvb_type: 0 00000100:00100000:3.0:1746065218.904020:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8194 00000100:00100000:3.0:1746065218.904029:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265417984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.904039:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065218.904052:0:7192:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065218 -> 1746065219 00002000:00010000:3.0:1746065218.904055:0:7192:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065218 -> 1746065219 00010000:00010000:3.0:1746065218.904059:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 30 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.904071:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 30 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.904090:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3e00/0xad6b7ddc1479a84 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93985b expref: 30 pid: 1880 timeout: 914 lvb_type: 0 00010000:00010000:3.0:1746065218.904112:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.904114:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.904120:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.904128:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.904155:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.904165:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263993856:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065218.905516:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.921312:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.921356:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.921507:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265418112 00000100:00100000:2.0:1746065218.921514:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265418112 00010000:00010000:2.0:1746065218.921546:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:2.0:1746065218.921571:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8195 00000100:00100000:2.0:1746065218.921577:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265418112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065218.921588:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065218.921604:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.921615:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.921634:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73800/0xad6b7ddc1479b56 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398bd expref: 40 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.921651:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.921653:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.921659:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.921667:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.921695:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 18 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.921706:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263993984:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065218.921760:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065218.922157:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881263993856:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065218.922169:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.922199:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265417984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 18172us (19735us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.922206:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8194 00000100:00100000:0.0:1746065218.923630:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.923748:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065218.923768:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265418496 00000100:00100000:0.0:1746065218.923792:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265418496 00000100:00100000:3.0:1746065218.923858:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263993984:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065218.923871:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.923898:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881265418112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2321us (2593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.923907:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8195 00000100:00100000:2.0:1746065218.924022:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265418752 00000100:00100000:2.0:1746065218.924026:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265418752 00002000:00100000:2.0:1746065218.924054:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3796992->3801087) req@ffff880136a7ad80 x1830881265418752/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.924062:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7ad80 with x1830881265418752 ext(3796992->3801087) 00002000:00010000:2.0:1746065218.924065:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7ad80 00000100:00100000:2.0:1746065218.924077:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6284 00000100:00100000:2.0:1746065218.924083:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265418752:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065218.924168:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265418752:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 85us (420us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065218.924174:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6284 00002000:00100000:2.0:1746065218.924178:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3796992->3801087) req@ffff880136a7ad80 x1830881265418752/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.924185:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7ad80 with x1830881265418752 ext(3796992->3801087) 00002000:00010000:2.0:1746065218.924188:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7ad80 00002000:00100000:0.0:1746065218.924253:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880136a78380 x1830881265418496/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065218.924260:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78380 with x1830881265418496 ext(2097152->3145727) 00002000:00010000:0.0:1746065218.924263:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a78380 00000100:00100000:0.0:1746065218.924273:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6285 00000100:00100000:0.0:1746065218.924277:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265418496:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065218.925958:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265418240 00000100:00100000:1.0:1746065218.925965:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265418240 00000100:00100000:1.0:1746065218.925999:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17537 00000100:00100000:1.0:1746065218.926004:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2534:x1830881265418240:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065218.926015:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.926027:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b6b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398d2 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.926043:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.926045:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065218.926051:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d2 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.926063:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d2 expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.926070:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd400, rc 0) 00000100:00100000:1.0:1746065218.927617:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2534:x1830881265418240:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1606us (6255us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065218.927625:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17537 00000100:00100000:0.0:1746065218.930020:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.930092:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265419008 00000100:00100000:3.0:1746065218.930099:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265419008 00002000:00100000:3.0:1746065218.930127:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4124672->4128767) req@ffff880136a7b100 x1830881265419008/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.930135:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b100 with x1830881265419008 ext(4124672->4128767) 00002000:00010000:3.0:1746065218.930140:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7b100 00000100:00100000:3.0:1746065218.930166:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6286 00000100:00100000:3.0:1746065218.930173:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265419008:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065218.930271:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265419008:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 98us (256us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065218.930277:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6286 00002000:00100000:3.0:1746065218.930282:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4124672->4128767) req@ffff880136a7b100 x1830881265419008/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/4536 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065218.930290:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7b100 with x1830881265419008 ext(4124672->4128767) 00002000:00010000:3.0:1746065218.930293:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a7b100 00000100:00100000:2.0:1746065218.937344:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265418496:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 13048us (13700us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065218.937355:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6285 00002000:00100000:2.0:1746065218.937363:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880136a78380 x1830881265418496/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.937372:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78380 with x1830881265418496 ext(2097152->3145727) 00002000:00010000:2.0:1746065218.937377:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a78380 00000100:00100000:0.0:1746065218.964710:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.964903:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265419264 00000100:00100000:2.0:1746065218.964911:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265419264 00002000:00100000:2.0:1746065218.964947:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880136a78000 x1830881265419264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.964957:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78000 with x1830881265419264 ext(3145728->4194303) 00002000:00010000:2.0:1746065218.964962:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a78000 00000100:00100000:2.0:1746065218.964990:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6287 00000100:00100000:2.0:1746065218.964997:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265419264:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065218.970884:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.970986:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265419392 00000100:00100000:1.0:1746065218.970993:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265419392 00000100:00100000:1.0:1746065218.971036:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17538 00000100:00100000:1.0:1746065218.971043:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2533:x1830881265419392:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065218.971057:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.971071:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398d9 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.971075:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265419264:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 6077us (6371us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065218.971083:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6287 00002000:00100000:2.0:1746065218.971091:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880136a78000 x1830881265419264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:134/0 lens 488/440 e 0 to 0 dl 1746065229 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00010000:00010000:1.0:1746065218.971096:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065218.971099:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78000 with x1830881265419264 ext(3145728->4194303) 00002000:00010000:2.0:1746065218.971102:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880136a78000 00010000:00010000:1.0:1746065218.971103:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065218.971105:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065218.971108:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.971133:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.971148:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 20 pid: 9549 timeout: 914 lvb_type: 0 00000100:00100000:1.0:1746065218.971158:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263994112:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065218.971218:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.973051:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.973136:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881263994112:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065218.973162:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065218.973175:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ae00, rc 0) 00000100:00100000:1.0:1746065218.973205:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2533:x1830881265419392:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2162us (2327us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065218.973214:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17538 00000100:00100000:2.0:1746065218.973639:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265419520 00000100:00100000:2.0:1746065218.973644:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265419520 00002000:00100000:2.0:1746065218.973670:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (3796992->4128767) req@ffff880136a7aa00 x1830881265419520/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/0 e 0 to 0 dl 1746065229 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.973679:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7aa00 with x1830881265419520 ext(3796992->4128767) 00010000:00010000:2.0:1746065218.973684:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 20 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.973695:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 20 pid: 9549 timeout: 914 lvb_type: 0 00002000:00010000:2.0:1746065218.973707:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a7aa00 00000100:00100000:2.0:1746065218.974252:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2073 00000100:00100000:2.0:1746065218.974260:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265419520:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065218.985185:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.985209:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265419776 00000100:00100000:1.0:1746065218.985217:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265419776 00000100:00100000:3.0:1746065218.985226:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065218.985246:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265419648 00000100:00100000:1.0:1746065218.985247:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265419648 00000100:00100000:1.0:1746065218.985265:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17539 00000100:00100000:1.0:1746065218.985271:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881265419776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065218.985284:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065218.985298:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1479b79 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398e7 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065218.985326:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17540 00000100:00100000:2.0:1746065218.985344:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265419648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.985352:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065218.985352:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263994240:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065218.985361:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1479b80 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398e0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.985372:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.985373:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065218.985380:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1479b80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398e0 expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.985394:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1479b80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398e0 expref: 31 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065218.985402:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67600, rc 0) 00000100:00100000:2.0:1746065218.985425:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265419648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 82us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.985430:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17540 00000100:00100000:1.0:1746065218.986934:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065218.987514:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263994240:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065218.987534:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1479b79 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398e7 expref: 40 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065218.987543:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ac00/0xad6b7ddc1479b79 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398e7 expref: 40 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065218.987561:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ac00, rc 0) 00000100:00100000:0.0:1746065218.987591:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881265419776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2320us (2415us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065218.987596:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17539 00000100:00100000:2.0:1746065218.988243:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265419520:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 13982us (15194us total) trans 17179874302 rc 0/0 00000100:00100000:2.0:1746065218.988250:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2073 00002000:00100000:2.0:1746065218.988258:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (3796992->4128767) req@ffff880136a7aa00 x1830881265419520/t17179874302(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:134/0 lens 488/448 e 0 to 0 dl 1746065229 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065218.988266:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a7aa00 with x1830881265419520 ext(3796992->4128767) 00010000:00010000:2.0:1746065218.988272:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 22 pid: 9549 timeout: 914 lvb_type: 0 00010000:00010000:2.0:1746065218.988282:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 22 pid: 9549 timeout: 915 lvb_type: 0 00002000:00010000:2.0:1746065218.988288:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880136a7aa00 00000100:00100000:0.0:1746065218.989071:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065218.989177:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265419904 00000100:00100000:2.0:1746065218.989183:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265419904 00000100:00100000:2.0:1746065218.989209:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17541 00000100:00100000:2.0:1746065218.989215:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2534:x1830881265419904:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065218.989227:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065218.989238:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398ee expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.989257:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.989259:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065218.989263:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [4194304->5038079] (req 4194304->5038079) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.989273:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [4194304->5038079] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065218.989281:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66000, rc 0) 00000100:00100000:2.0:1746065218.989516:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2534:x1830881265419904:12345-192.168.202.27@tcp:101:cat.0 Request processed in 299us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065218.989522:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17541 00000100:00100000:0.0:1746065218.991312:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065218.991521:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265420032 00000100:00100000:3.0:1746065218.991527:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265420032 00010000:00010000:3.0:1746065218.991550:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 22 pid: 9549 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065218.991572:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8196 00000100:00100000:3.0:1746065218.991578:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265420032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065218.991587:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065218.991607:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 22 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065218.991618:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 22 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065218.991641:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d600/0xad6b7ddc1479b5d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3796992->18446744073709551615] (req 3796992->4128767) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398c4 expref: 22 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065218.991667:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.991669:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.991674:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.991682:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.991689:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.991690:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065218.991692:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.991699:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065218.991723:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.991733:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263994368:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065218.992408:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 21 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065218.992422:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263994496:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065218.992444:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065218.995401:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263994368:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065218.995412:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881263994496:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065218.995428:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065218.995471:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265420032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3892us (4593us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065218.995480:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8196 00000100:00100000:1.0:1746065219.007651:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.007680:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.007699:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.008007:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265420672 00000100:00100000:0.0:1746065219.008015:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265420672 00002000:00100000:0.0:1746065219.008065:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff8800984db480 x1830881265420672/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.008074:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984db480 with x1830881265420672 ext(3145728->4194303) 00002000:00010000:0.0:1746065219.008079:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984db480 00000100:00100000:0.0:1746065219.008093:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265420800 00000100:00100000:0.0:1746065219.008095:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265420800 00002000:00100000:0.0:1746065219.008107:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800984d9180 x1830881265420800/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.008113:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d9180 with x1830881265420800 ext(3145728->4194303) 00002000:00010000:0.0:1746065219.008116:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d9180 00000100:00100000:0.0:1746065219.008124:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265421056 00000100:00100000:0.0:1746065219.008126:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265421056 00002000:00100000:0.0:1746065219.008137:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800984da300 x1830881265421056/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.008142:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984da300 with x1830881265421056 ext(4194304->5038079) 00002000:00010000:0.0:1746065219.008145:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984da300 00000100:00100000:0.0:1746065219.008168:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6288 00000100:00100000:0.0:1746065219.008175:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265420672:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065219.008318:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6289 00000100:00100000:1.0:1746065219.008325:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265420800:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065219.010584:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00080000:2.0:1746065219.010613:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746065219.010617:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065219.010637:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6290 00000100:00100000:2.0:1746065219.010648:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265421056:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065219.011296:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265420288 00000100:00100000:2.0:1746065219.011302:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265420288 00000100:00100000:2.0:1746065219.011349:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14593 00000100:00100000:2.0:1746065219.011354:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+56:2542:x1830881265420288:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065219.011365:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.011378:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc1479b8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398f5 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.011430:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479b95 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011441:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479b95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011451:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479b95 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011461:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479b9c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011465:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011473:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011544:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479ba3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011551:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011556:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479ba3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:2.0:1746065219.011563:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065219.011618:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479b95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011624:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479b95 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011629:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479b95 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00000100:00080000:3.0:1746065219.011631:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746065219.011634:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479b95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011638:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065219.011642:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479b95 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011647:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479b95 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.011655:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065219.012074:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065219.012080:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479b95 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.012085:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479b95 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.012659:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479b9c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.012665:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479b9c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.012670:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479b9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.012674:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065219.012676:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479b9c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.012681:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479b9c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.012689:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f854500) 00010000:00010000:2.0:1746065219.012691:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065219.012692:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479b9c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.012696:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479b9c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.012729:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67400/0xad6b7ddc1479b8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398f5 expref: 59 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.012738:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479ba3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398f5 expref: 58 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.012744:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065219.012746:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065219.012748:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66a00, rc 0) 00000100:00100000:2.0:1746065219.012790:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+58:2542:x1830881265420288:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1435us (2211us total) trans 8589937116 rc 0/0 00000100:00100000:2.0:1746065219.012796:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14593 00000100:00100000:2.0:1746065219.018180:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265420672:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 9997us (10528us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065219.018190:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6288 00002000:00100000:2.0:1746065219.018200:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff8800984db480 x1830881265420672/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.018209:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984db480 with x1830881265420672 ext(3145728->4194303) 00002000:00010000:2.0:1746065219.018214:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984db480 00000100:00100000:1.0:1746065219.023739:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265420800:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 15407us (16050us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065219.023750:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6289 00002000:00100000:1.0:1746065219.023760:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff8800984d9180 x1830881265420800/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065219.023768:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984d9180 with x1830881265420800 ext(3145728->4194303) 00002000:00010000:1.0:1746065219.023808:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800984d9180 00000100:00100000:0.0:1746065219.032909:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.033000:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265421056:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22352us (25297us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065219.033010:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6290 00002000:00100000:2.0:1746065219.033021:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800984da300 x1830881265421056/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.033029:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800984da300 with x1830881265421056 ext(4194304->5038079) 00002000:00010000:2.0:1746065219.033034:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800984da300 00000100:00100000:2.0:1746065219.033054:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265421312 00000100:00100000:2.0:1746065219.033060:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265421312 00002000:00100000:2.0:1746065219.033084:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880136a78700 x1830881265421312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.033093:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78700 with x1830881265421312 ext(4194304->5038079) 00002000:00010000:2.0:1746065219.033096:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a78700 00000100:00100000:2.0:1746065219.033126:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6291 00000100:00100000:2.0:1746065219.033132:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265421312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065219.033141:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.033158:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265421440 00000100:00100000:3.0:1746065219.033162:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265421440 00000100:00100000:3.0:1746065219.033315:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 872 00000100:00100000:3.0:1746065219.033322:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+58:2005:x1830881265421440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.033342:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.033362:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479ba3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398f5 expref: 58 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.033378:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.033382:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065219.033400:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+57:2005:x1830881265421440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 79us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.033405:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 872 00000100:00100000:2.0:1746065219.047211:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265421312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14070us (14301us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065219.047221:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6291 00002000:00100000:2.0:1746065219.047230:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880136a78700 x1830881265421312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.047238:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880136a78700 with x1830881265421312 ext(4194304->5038079) 00002000:00010000:2.0:1746065219.047243:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880136a78700 00000100:00100000:0.0:1746065219.048277:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.048685:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265421696 00000100:00100000:1.0:1746065219.048691:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265421696 00000100:00100000:1.0:1746065219.048735:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5481 00000100:00100000:1.0:1746065219.048741:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+57:2534:x1830881265421696:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065219.049544:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+58:2534:x1830881265421696:12345-192.168.202.27@tcp:35:cat.0 Request processed in 801us (1266us total) trans 8589937117 rc 0/0 00000100:00100000:1.0:1746065219.049550:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5481 00000100:00100000:0.0:1746065219.057306:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.057466:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265421952 00000100:00100000:1.0:1746065219.057475:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265421952 00000100:00100000:1.0:1746065219.057532:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5482 00000100:00100000:1.0:1746065219.057538:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2533:x1830881265421952:12345-192.168.202.27@tcp:35:cat.0 00000100:00080000:3.0:1746065219.057709:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065219.058195:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2533:x1830881265421952:12345-192.168.202.27@tcp:35:cat.0 Request processed in 656us (897us total) trans 8589937118 rc 0/0 00000100:00100000:1.0:1746065219.058201:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5482 00000100:00100000:0.0:1746065219.107169:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.107279:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265422080 00000100:00100000:2.0:1746065219.107287:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265422080 00000100:00100000:2.0:1746065219.107356:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17542 00000100:00100000:2.0:1746065219.107363:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2542:x1830881265422080:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065219.107377:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.107390:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9398fc expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.107412:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.107418:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b6b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d2 expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.107428:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.107429:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.107432:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3559424->4194303] (req 3559424->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 32 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.107456:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d2 expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.107465:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d2 expref: 32 pid: 3068 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.107475:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263994624:192.168.202.27@tcp:104: 00000100:00080000:3.0:1746065219.107555:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1746065219.107556:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 13 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.107563:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 13 pid: 9549 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.107570:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263994752:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.107586:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065219.115305:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.115316:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263994624:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.115337:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263994752:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065219.115362:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065219.115364:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3559424->4194303] (req 3559424->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 32 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.115385:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67200, rc 0) 00000100:00100000:2.0:1746065219.115423:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2542:x1830881265422080:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8060us (8262us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.115431:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17542 00000100:00100000:1.0:1746065219.115541:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265422208 00000100:00100000:1.0:1746065219.115547:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265422208 00010000:00010000:1.0:1746065219.115569:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d2 expref: 32 pid: 3068 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.115596:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265422336 00000100:00100000:1.0:1746065219.115598:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265422336 00010000:00010000:1.0:1746065219.115607:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 14 pid: 9549 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.115620:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8197 00000100:00100000:1.0:1746065219.115625:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265422208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065219.115635:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065219.115647:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8198 00010000:00010000:1.0:1746065219.115651:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b6b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d2 expref: 32 pid: 3068 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.115653:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265422336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.115659:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065219.115660:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b6b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d2 expref: 32 pid: 3068 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.115667:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 14 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.115676:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd400/0xad6b7ddc1479b6b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d2 expref: 32 pid: 3068 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.116046:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 14 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.116054:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065219.116060:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a5ce600/0xad6b7ddc1479b64 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398cb expref: 14 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.116070:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.116071:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065219.116073:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265422208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 448us (777us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065219.116076:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 31 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065219.116079:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8197 00010000:00010000:3.0:1746065219.116083:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 31 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.116107:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065219.116118:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263994880:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065219.116862:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b900 going to sleep for 11 seconds 00010000:00010000:2.0:1746065219.117609:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065219.118958:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.119041:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265422592 00000100:00100000:2.0:1746065219.119047:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265422592 00002000:00100000:2.0:1746065219.119079:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3559424->3563519) req@ffff88009077dc00 x1830881265422592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.119089:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077dc00 with x1830881265422592 ext(3559424->3563519) 00002000:00010000:2.0:1746065219.119092:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077dc00 00000100:00100000:2.0:1746065219.119119:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6292 00000100:00100000:2.0:1746065219.119125:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265422592:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065219.119237:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265422592:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 112us (283us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065219.119243:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6292 00002000:00100000:2.0:1746065219.119248:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3559424->3563519) req@ffff88009077dc00 x1830881265422592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/4536 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.119254:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077dc00 with x1830881265422592 ext(3559424->3563519) 00002000:00010000:2.0:1746065219.119257:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077dc00 00000100:00100000:3.0:1746065219.119338:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881263994880:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065219.119352:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065219.119374:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac561050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265422336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3721us (4012us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.119381:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8198 00000100:00100000:2.0:1746065219.129259:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.129622:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265422720 00000100:00100000:0.0:1746065219.129629:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265422720 00000100:00100000:0.0:1746065219.129974:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17543 00000100:00100000:0.0:1746065219.129983:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2542:x1830881265422720:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065219.129997:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.130176:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939903 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.130204:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.130211:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.130218:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.130220:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.130223:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [4194304->4198399] (req 4194304->4198399) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.130249:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.130259:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 41 pid: 1880 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746065219.130271:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263995008:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065219.130363:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 20 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.130371:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 20 pid: 9549 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746065219.130377:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263995136:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065219.130395:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65669c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065219.132610:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263995008:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.132620:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881263995136:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.132643:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [4194304->4198399] (req 4194304->4198399) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.132655:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129fe9000, rc 0) 00000100:00100000:2.0:1746065219.132683:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2542:x1830881265422720:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2702us (3433us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.132690:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17543 00000100:00100000:0.0:1746065219.134323:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.134563:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265422848 00000100:00100000:3.0:1746065219.134569:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265422848 00010000:00010000:3.0:1746065219.134595:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 21 pid: 9549 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.134628:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8199 00000100:00100000:3.0:1746065219.134634:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265422848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.134643:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.134659:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 21 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.134668:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 21 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.134686:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84ae00/0xad6b7ddc1479b72 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398d9 expref: 21 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.134720:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065219.134761:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265422848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 124us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.134767:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8199 00000100:00100000:0.0:1746065219.134869:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.134984:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265422976 00000100:00100000:1.0:1746065219.134988:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265422976 00010000:00010000:1.0:1746065219.135002:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 41 pid: 1880 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.135018:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8200 00000100:00100000:1.0:1746065219.135023:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265422976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065219.135029:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065219.135035:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 41 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.135043:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 41 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.136130:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f66000/0xad6b7ddc1479b87 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398ee expref: 41 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.136154:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.136156:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.136162:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.136169:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.136197:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065219.136208:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263995264:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065219.136268:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065219.140055:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.140109:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265423232 00000100:00100000:2.0:1746065219.140117:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265423232 00002000:00100000:2.0:1746065219.140159:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4198399) req@ffff88009077d880 x1830881265423232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.140168:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d880 with x1830881265423232 ext(4194304->4198399) 00002000:00010000:2.0:1746065219.140172:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077d880 00000100:00100000:2.0:1746065219.140203:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6293 00000100:00100000:2.0:1746065219.140210:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265423232:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065219.140336:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265423232:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 118us (279us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065219.140342:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6293 00002000:00100000:2.0:1746065219.140347:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4198399) req@ffff88009077d880 x1830881265423232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/4536 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065219.140349:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881263995264:192.168.202.27@tcp:105: 00002000:00100000:2.0:1746065219.140354:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077d880 with x1830881265423232 ext(4194304->4198399) 00002000:00010000:2.0:1746065219.140356:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077d880 00010000:00010000:1.0:1746065219.140364:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065219.140384:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265422976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5361us (5515us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.140391:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8200 00000100:00100000:0.0:1746065219.143562:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.144232:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265423488 00000100:00100000:1.0:1746065219.144239:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265423488 00000100:00100000:1.0:1746065219.144279:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5483 00000100:00100000:1.0:1746065219.144285:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+58:2542:x1830881265423488:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065219.144720:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+59:2542:x1830881265423488:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 434us (1163us total) trans 8589937119 rc 0/0 00000100:00100000:1.0:1746065219.144726:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5483 00000100:00100000:0.0:1746065219.162698:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.162811:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265423616 00000100:00100000:2.0:1746065219.162818:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265423616 00000100:00100000:2.0:1746065219.162874:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14594 00000100:00100000:2.0:1746065219.162880:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+6:2546:x1830881265423616:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065219.162899:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.162915:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479bbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93990a expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.162965:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc1479bc6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.162975:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc1479bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.162984:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc1479bc6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.162995:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc1479bcd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.162999:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc1479bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.163003:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc1479bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.163055:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.163063:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939552 expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.163068:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.163091:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939552 expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.163101:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939552 expref: 30 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.163111:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263995392:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.163187:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad840 going to sleep for 11 seconds 00000100:00080000:3.0:1746065219.163243:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065219.166534:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.166588:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265423872 00000100:00100000:0.0:1746065219.166595:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265423872 00000100:00100000:0.0:1746065219.166636:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5484 00000100:00100000:0.0:1746065219.166643:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:30398:x1830881265423872:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1746065219.166922:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263995392:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.166940:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000100:00100000:0.0:1746065219.167688:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:30398:x1830881265423872:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 1044us (1158us total) trans 8589937120 rc 0/0 00000100:00100000:0.0:1746065219.167694:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5484 00000100:00100000:0.0:1746065219.169668:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.170678:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265424000 00000100:00100000:1.0:1746065219.170684:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265424000 00010000:00010000:1.0:1746065219.170712:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939552 expref: 32 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.170745:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8201 00000100:00100000:1.0:1746065219.170752:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2006:x1830881265424000:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065219.170763:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065219.170768:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939552 expref: 32 pid: 7205 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.170800:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939552 expref: 32 pid: 7205 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.170817:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc1479560 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939552 expref: 32 pid: 7205 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.171224:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065219.171230:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065219.171237:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065219.171242:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065219.171295:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065219.171341:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2006:x1830881265424000:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 578us (1665us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.171347:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8201 00010000:00010000:3.0:1746065219.172276:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172287:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065219.172342:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065219.172346:0:9571:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065219.172361:0:9571:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172369:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172378:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc1479bc6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172383:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc1479bc6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172387:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc1479bc6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172392:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc1479bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172395:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f66000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065219.172398:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc1479bc6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172403:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc1479bc6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172410:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065219.172412:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065219.172414:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc1479bc6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172419:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66000/0xad6b7ddc1479bc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172432:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc1479bcd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172436:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc1479bcd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172439:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc1479bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172443:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f67a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065219.172444:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc1479bcd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172448:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc1479bcd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172452:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012f854600) 00010000:00010000:3.0:1746065219.172454:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065219.172455:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc1479bcd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172459:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67a00/0xad6b7ddc1479bcd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.172484:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479bbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93990a expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.172492:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93990a expref: 7 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.172501:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.172502:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065219.172504:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67000, rc 0) 00000100:00100000:3.0:1746065219.172539:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+7:2546:x1830881265423616:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 9659us (9849us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.172545:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14594 00000100:00100000:0.0:1746065219.178919:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.178944:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.178966:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.178979:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.178990:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.179027:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.179047:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265424128 00000100:00100000:0.0:1746065219.179054:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265424128 00000100:00100000:0.0:1746065219.179092:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265424256 00000100:00100000:0.0:1746065219.179094:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265424256 00000100:00100000:0.0:1746065219.179106:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265424384 00000100:00100000:0.0:1746065219.179108:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265424384 00000100:00100000:0.0:1746065219.179115:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265424512 00000100:00100000:0.0:1746065219.179117:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265424512 00000100:00100000:0.0:1746065219.179124:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265424640 00000100:00100000:0.0:1746065219.179126:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265424640 00000100:00100000:0.0:1746065219.179134:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265424768 00000100:00100000:0.0:1746065219.179135:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265424768 00000100:00100000:0.0:1746065219.179144:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17544 00000100:00100000:0.0:1746065219.179151:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265424128:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065219.179165:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.179179:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1479bdb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939911 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.179198:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.179199:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.179206:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1479bdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939911 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.179219:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1479bdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939911 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.179228:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44600, rc 0) 00000100:00100000:0.0:1746065219.179259:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265424128:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 109us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.179265:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17544 00000100:00100000:0.0:1746065219.179277:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17545 00000100:00100000:0.0:1746065219.179282:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265424256:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065219.179288:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.179295:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45600/0xad6b7ddc1479be2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939918 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.179304:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.179305:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.179309:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45600/0xad6b7ddc1479be2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939918 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.179318:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f45600/0xad6b7ddc1479be2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939918 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.179336:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45600, rc 0) 00000100:00100000:0.0:1746065219.179348:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265424256:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 66us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.179352:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17545 00000100:00100000:0.0:1746065219.179360:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17546 00000100:00100000:0.0:1746065219.179364:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265424384:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065219.179369:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.179374:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc1479be9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93991f expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.179382:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.179384:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.179387:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc1479be9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93991f expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.179396:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc1479be9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93991f expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.179401:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44400, rc 0) 00000100:00100000:0.0:1746065219.179414:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265424384:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 49us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.179418:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17546 00000100:00100000:0.0:1746065219.179426:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17547 00000100:00100000:0.0:1746065219.179430:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265424512:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065219.179437:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.179442:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1479bf0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939926 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.179451:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.179452:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.179455:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1479bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939926 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.179462:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1479bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939926 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.179467:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44000, rc 0) 00000100:00100000:0.0:1746065219.179479:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265424512:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 48us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.179483:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17547 00000100:00100000:0.0:1746065219.179491:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17548 00000100:00100000:0.0:1746065219.179495:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265424640:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065219.179499:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.179503:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc1479bf7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93992d expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.179534:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263995520:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065219.179584:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a6566180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065219.179603:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17549 00000100:00100000:0.0:1746065219.179608:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265424768:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065219.179614:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.179620:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1479bfe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939934 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.179637:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263995648:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065219.179654:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00080000:3.0:1746065219.179864:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1746065219.179867:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065219.183642:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263995520:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065219.183675:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc1479bf7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93992d expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.183688:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45a00/0xad6b7ddc1479bf7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93992d expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.184096:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45a00, rc 0) 00000100:00100000:1.0:1746065219.184713:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265424640:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4883us (5388us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065219.184723:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17548 00002000:00010000:1.0:1746065219.184970:0:9548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746065218 -> 1746065219 00000100:00100000:1.0:1746065219.184982:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881263995648:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065219.184999:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1479bfe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939934 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.185013:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45e00/0xad6b7ddc1479bfe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939934 expref: 11 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.185020:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45e00, rc 0) 00000100:00100000:1.0:1746065219.185402:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265424768:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 5792us (6373us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065219.185408:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17549 00000100:00100000:0.0:1746065219.189616:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.189800:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265425024 00000100:00100000:3.0:1746065219.189808:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265425024 00000100:00100000:3.0:1746065219.189839:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14595 00000100:00100000:3.0:1746065219.189845:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+7:2546:x1830881265425024:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065219.189861:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.189874:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479c05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93993b expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.189953:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479c0c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.189965:0:9571:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93990a expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.189971:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479c0c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.189996:0:9571:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93990a expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.190008:0:9571:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93990a expref: 8 pid: 9571 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.190019:0:9571:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263995776:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065219.199224:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.199289:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265425152 00000100:00100000:1.0:1746065219.199296:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265425152 00010000:00010000:1.0:1746065219.199324:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 6/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93990a expref: 9 pid: 9571 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.199360:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8202 00000100:00100000:1.0:1746065219.199367:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265425152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065219.199380:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065219.199384:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 6/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93990a expref: 9 pid: 9571 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.199394:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93990a expref: 9 pid: 9571 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.199412:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065219.199417:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479c0c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065219.199424:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479c0c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065219.199431:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479c0c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50290000000000 pid: 9571 initiator: MDT0 00010000:00010000:1.0:1746065219.199445:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065219.199479:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265425152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 112us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.199485:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8202 00000100:00100000:3.0:1746065219.200908:0:9571:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065219.200935:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67000/0xad6b7ddc1479bd4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93990a expref: 8 pid: 9571 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.200956:0:9571:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9571:1830881263995776:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065219.200971:0:9571:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479c0c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.200978:0:9571:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479c0c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.200981:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479c0c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065219.200996:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065219.201095:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1400/0xad6b7ddc1479c05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93993b expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.201106:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479c0c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93993b expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.201113:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.201115:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065219.201118:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1c00, rc 0) 00000100:00100000:3.0:1746065219.201158:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2546:x1830881265425024:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 11312us (11549us total) trans 8589937121 rc 0/0 00000100:00100000:3.0:1746065219.201164:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14595 00000100:00100000:0.0:1746065219.203003:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.203075:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265425408 00000100:00100000:3.0:1746065219.203081:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265425408 00000100:00100000:3.0:1746065219.203114:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14596 00000100:00100000:3.0:1746065219.203120:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2546:x1830881265425408:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065219.203135:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.203137:0:9571:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065219.203153:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1c00/0xad6b7ddc1479c0c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93993b expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.203165:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.203167:0:9571:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065219.203176:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1000/0xad6b7ddc1479c1a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939942 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.203240:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479c21 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.203250:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479c21 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.203257:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479c21 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065219.203264:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065219.203342:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c1000/0xad6b7ddc1479c1a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939942 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.203355:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479c21 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939942 expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.203360:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.203362:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065219.203363:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f66a00, rc 0) 00000100:00100000:3.0:1746065219.203670:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2546:x1830881265425408:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 548us (669us total) trans 8589937122 rc 0/0 00000100:00100000:3.0:1746065219.203675:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14596 00000100:00100000:0.0:1746065219.204886:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.204970:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265425536 00000100:00100000:3.0:1746065219.204974:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265425536 00000100:00100000:3.0:1746065219.204996:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14597 00000100:00100000:3.0:1746065219.205002:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2546:x1830881265425536:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065219.205013:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.205020:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479c2f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939949 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.205046:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479c2f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939949 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.205055:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479c2f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939949 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.205066:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.205068:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065219.205070:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67800, rc 0) 00000100:00100000:3.0:1746065219.205093:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2546:x1830881265425536:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 91us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.205098:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14597 00000100:00100000:0.0:1746065219.209245:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.211657:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.212070:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265425664 00000100:00100000:1.0:1746065219.212077:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265425664 00000100:00100000:1.0:1746065219.212119:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17550 00000100:00100000:1.0:1746065219.212125:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265425664:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065219.212157:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.212172:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 19 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.212180:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1479bdb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939911 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.212186:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc1479885 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93973c expref: 39 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.212191:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.212193:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.212195:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.212222:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc1479885 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93973c expref: 39 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.212232:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc1479885 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93973c expref: 39 pid: 9549 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.212243:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263995904:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065219.212309:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1479bdb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939911 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.212317:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1479bdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939911 expref: 10 pid: 3067 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.212324:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263996032:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065219.212352:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 19 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.212360:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 19 pid: 12260 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.212366:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263996160:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065219.212378:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065219.212919:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.212939:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.212951:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.212972:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.213015:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265425792 00000100:00100000:3.0:1746065219.213019:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265425792 00000100:00100000:3.0:1746065219.213035:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265426048 00000100:00100000:3.0:1746065219.213037:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265426048 00000100:00100000:3.0:1746065219.213045:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265426304 00000100:00100000:3.0:1746065219.213046:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265426304 00000100:00100000:3.0:1746065219.213054:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265425920 00000100:00100000:3.0:1746065219.213055:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265425920 00000100:00100000:3.0:1746065219.213063:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265426176 00000100:00100000:3.0:1746065219.213064:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265426176 00000100:00100000:3.0:1746065219.213073:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17551 00000100:00100000:3.0:1746065219.213077:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265425792:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065219.213094:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213104:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213111:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f45600/0xad6b7ddc1479be2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939918 expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213117:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1479b80 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398e0 expref: 30 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213122:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.213124:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.213126:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 6/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213141:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1479b80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398e0 expref: 30 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213148:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1479b80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398e0 expref: 30 pid: 12260 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746065219.213157:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263996288:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065219.213194:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f45600/0xad6b7ddc1479be2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939918 expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213201:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f45600/0xad6b7ddc1479be2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939918 expref: 12 pid: 3067 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746065219.213208:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263996416:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065219.213225:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213232:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 12 pid: 12260 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.213239:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263996544:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065219.213250:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065219.213262:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17552 00000100:00100000:3.0:1746065219.213267:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265426048:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065219.213279:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213288:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213294:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1479bf0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939926 expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213300:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc1479996 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397c1 expref: 39 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213305:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.213306:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.213308:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213319:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc1479996 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397c1 expref: 39 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213325:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc1479996 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397c1 expref: 39 pid: 9549 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746065219.213342:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263996672:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065219.213362:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1479bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939926 expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213373:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1479bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939926 expref: 12 pid: 3067 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746065219.213379:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263996800:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065219.213397:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 19 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213404:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 19 pid: 9549 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.213411:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263996928:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065219.213422:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065219.213435:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17553 00000100:00100000:3.0:1746065219.213440:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265426304:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065219.213452:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213460:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213466:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065219.213467:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065219.213469:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 4/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213485:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213492:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 30 pid: 1880 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.213498:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263997056:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065219.213510:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065219.213521:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17554 00000100:00100000:3.0:1746065219.213525:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265425920:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065219.213536:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213545:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 12 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213551:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc1479be9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93991f expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213557:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147998f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ba expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213562:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.213563:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.213565:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213576:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147998f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ba expref: 30 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213583:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147998f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ba expref: 30 pid: 9549 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746065219.213589:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263997184:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065219.213605:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc1479be9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93991f expref: 12 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.213611:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc1479be9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93991f expref: 12 pid: 3067 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746065219.213618:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263997312:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065219.213630:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 12 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.213637:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 12 pid: 3068 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.213644:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263997440:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065219.213660:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065219.213795:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17555 00000100:00100000:2.0:1746065219.213801:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265426176:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065219.213815:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.213823:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.213830:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 39 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.213836:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc1479b3a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398af expref: 19 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.213841:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746065219.213842:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 3 00010000:00010000:2.0:1746065219.213845:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.213858:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc1479b3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398af expref: 19 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.213865:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc1479b3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398af expref: 19 pid: 3068 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.213873:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263997568:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.213900:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 39 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.213907:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 39 pid: 12260 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.213913:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263997696:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.213927:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 39 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.213934:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 39 pid: 1880 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.213940:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263997824:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.213948:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065219.227291:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.227319:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.227344:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.227364:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265426560 00000100:00100000:0.0:1746065219.227371:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265426560 00010000:00010000:0.0:1746065219.227398:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 20 pid: 12260 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746065219.227424:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265426432 00000100:00100000:0.0:1746065219.227426:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265426432 00010000:00010000:0.0:1746065219.227434:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1479bdb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939911 expref: 13 pid: 3067 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746065219.227443:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265426688 00000100:00100000:0.0:1746065219.227445:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265426688 00010000:00010000:0.0:1746065219.227452:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc1479885 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93973c expref: 40 pid: 9549 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746065219.227464:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8203 00000100:00100000:0.0:1746065219.227470:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265426560:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065219.227479:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.227495:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 20 pid: 12260 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746065219.227504:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 20 pid: 12260 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746065219.227524:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065219.227556:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265426560:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.227564:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8203 00000100:00100000:0.0:1746065219.227577:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8204 00000100:00100000:0.0:1746065219.227581:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265426432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065219.227586:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.227592:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1479bdb lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939911 expref: 13 pid: 3067 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.227599:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1479bdb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939911 expref: 13 pid: 3067 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.227608:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065219.227620:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265426432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 39us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.227624:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8204 00000100:00100000:0.0:1746065219.227631:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8205 00000100:00100000:0.0:1746065219.227635:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265426688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065219.227639:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.227645:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc1479885 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93973c expref: 40 pid: 9549 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.227651:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc1479885 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93973c expref: 40 pid: 9549 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.227660:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.227661:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.227665:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.227672:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.227686:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065219.227699:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265426688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 63us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.227704:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8205 00000100:00100000:0.0:1746065219.227831:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.227841:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265426944 00000100:00100000:0.0:1746065219.227844:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265426944 00010000:00010000:0.0:1746065219.227854:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc1479be9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93991f expref: 13 pid: 3067 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746065219.227866:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8206 00010000:00010000:1.0:1746065219.227868:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880090de4600/0xad6b7ddc1479885 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93973c expref: 39 pid: 9549 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746065219.227870:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265426944:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065219.227875:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.227884:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc1479be9 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93991f expref: 13 pid: 3067 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.227887:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263995904:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065219.227892:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc1479be9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93991f expref: 13 pid: 3067 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746065219.227895:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44600/0xad6b7ddc1479bdb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939911 expref: 12 pid: 3067 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.227902:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263996032:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065219.227903:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065219.227909:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc1479854 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939727 expref: 19 pid: 12260 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.227916:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881263996160:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065219.227917:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265426944:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.227924:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8206 00010000:00010000:1.0:1746065219.227932:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.227940:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.227943:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065219.227946:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.227951:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265426816 00000100:00100000:0.0:1746065219.227952:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265426816 00010000:00010000:0.0:1746065219.227960:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147998f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ba expref: 31 pid: 9549 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746065219.227971:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.227971:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8207 00000100:00100000:0.0:1746065219.227976:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265426816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065219.227977:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.227981:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.227986:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147998f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ba expref: 31 pid: 9549 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746065219.227988:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.227993:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147998f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ba expref: 31 pid: 9549 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746065219.227994:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dd400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065219.227997:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.228001:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065219.228003:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.228011:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265426816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 36us (68us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065219.228012:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.228016:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8207 00010000:00010000:1.0:1746065219.228017:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc1479c36 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.228042:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.228049:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265425664:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 15925us (18811us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.228051:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265427072 00000100:00100000:0.0:1746065219.228053:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265427072 00000100:00100000:1.0:1746065219.228055:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17550 00010000:00010000:0.0:1746065219.228061:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 13 pid: 3068 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746065219.228070:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8208 00000100:00100000:0.0:1746065219.228075:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265427072:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065219.228078:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.228084:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 13 pid: 3068 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746065219.228091:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 13 pid: 3068 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746065219.228100:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.228102:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.228104:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.228617:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.228629:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065219.228644:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265427072:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 569us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.228649:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8208 00000100:00100000:0.0:1746065219.228810:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.228931:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263997568:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.228939:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263997696:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.228946:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881263997824:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.228959:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065219.228999:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263996288:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065219.229001:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263996672:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.229006:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263996416:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065219.229007:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263996800:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.229012:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881263996544:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065219.229014:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a79c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881263996928:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.229025:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.229025:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065219.229040:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881263997056:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.229046:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065219.229064:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265427968 00000100:00100000:2.0:1746065219.229066:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265427968 00002000:00100000:2.0:1746065219.229088:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3559424->4194303) req@ffff8800907bd880 x1830881265427968/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.229095:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd880 with x1830881265427968 ext(3559424->4194303) 00010000:00010000:2.0:1746065219.229100:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 31 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746065219.229107:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 31 pid: 1880 timeout: 915 lvb_type: 0 00002000:00010000:2.0:1746065219.229113:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800907bd880 00000100:00100000:2.0:1746065219.229126:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2074 00000100:00100000:2.0:1746065219.229130:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265427968:12345-192.168.202.27@tcp:4:multiop.0 00010000:00010000:2.0:1746065219.229253:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856200/0xad6b7ddc147998f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ba expref: 32 pid: 9549 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746065219.229264:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263997184:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.229272:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc1479be9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93991f expref: 12 pid: 3067 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746065219.229279:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263997312:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.229287:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc1479950 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939797 expref: 12 pid: 3068 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.229293:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881263997440:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.229303:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.229309:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.229313:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.229339:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.229346:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.229351:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.229356:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b61800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065219.229358:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.229363:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.229372:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.229376:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc1479c52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065219.229404:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265425920:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 15878us (16452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.229409:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17554 00000100:00100000:1.0:1746065219.232450:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.232496:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265427200 00000100:00100000:2.0:1746065219.232503:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265427200 00010000:00010000:2.0:1746065219.232530:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1479b80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398e0 expref: 32 pid: 12260 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.232726:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.234409:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265427456 00000100:00100000:2.0:1746065219.234414:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265427456 00000100:00100000:1.0:1746065219.234423:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065219.234433:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 12 pid: 12260 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.234437:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265427712 00000100:00100000:1.0:1746065219.234440:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265427712 00010000:00010000:1.0:1746065219.234452:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1479bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939926 expref: 11 pid: 3067 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746065219.234453:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8209 00000100:00100000:2.0:1746065219.234459:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265427200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065219.234464:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8210 00000100:00100000:1.0:1746065219.234468:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265427456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065219.234469:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065219.234472:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065219.234483:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1479b80 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398e0 expref: 32 pid: 12260 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746065219.234483:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 12 pid: 12260 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746065219.234492:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1479b80 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398e0 expref: 32 pid: 12260 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746065219.234985:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8211 00000100:00100000:3.0:1746065219.234992:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265427712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.235000:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.235011:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1479bf0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939926 expref: 11 pid: 3067 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746065219.235018:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1479bf0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939926 expref: 11 pid: 3067 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746065219.235033:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f44000/0xad6b7ddc1479bf0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939926 expref: 11 pid: 3067 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746065219.235047:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065219.235073:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265427712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.235078:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8211 00000100:00100000:3.0:1746065219.235116:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.235128:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265427328 00000100:00100000:3.0:1746065219.235130:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265427328 00010000:00010000:3.0:1746065219.235141:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45600/0xad6b7ddc1479be2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939918 expref: 11 pid: 3067 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746065219.235150:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8212 00000100:00100000:3.0:1746065219.235153:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265427328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.235159:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065219.235288:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 12 pid: 12260 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746065219.235309:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f67600/0xad6b7ddc1479b80 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398e0 expref: 32 pid: 12260 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746065219.235317:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065219.235343:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265427200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 884us (2899us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.235348:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8209 00010000:00010000:3.0:1746065219.235934:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f45600/0xad6b7ddc1479be2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939918 expref: 11 pid: 3067 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746065219.235937:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc1479aed lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93988c expref: 12 pid: 12260 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.235946:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f45600/0xad6b7ddc1479be2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939918 expref: 11 pid: 3067 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746065219.235956:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45600/0xad6b7ddc1479be2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939918 expref: 11 pid: 3067 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746065219.235956:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.235958:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.235961:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.235968:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.236029:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065219.236048:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265427328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 892us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.236053:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8212 00000100:00100000:3.0:1746065219.236094:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.236104:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265427584 00000100:00100000:3.0:1746065219.236107:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265427584 00010000:00010000:3.0:1746065219.236117:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc1479996 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397c1 expref: 39 pid: 9549 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746065219.236129:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8213 00000100:00100000:3.0:1746065219.236134:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881265427584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065219.236137:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065219.236139:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.236146:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc1479996 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397c1 expref: 39 pid: 9549 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.236151:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265427456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1683us (3426us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065219.236153:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc1479996 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397c1 expref: 39 pid: 9549 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.236157:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8210 00010000:00010000:3.0:1746065219.236166:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857400/0xad6b7ddc1479996 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397c1 expref: 39 pid: 9549 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746065219.236173:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065219.236184:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881265427584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (90us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.236188:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8213 00010000:00010000:3.0:1746065219.236237:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.236244:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.236258:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.236264:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.236270:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.236275:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f04a000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065219.236279:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.236289:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.236296:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.236301:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f04a000/0xad6b7ddc1479c3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065219.236349:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265425792:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 23271us (24697us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.236356:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17551 00000100:00100000:0.0:1746065219.238822:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.238852:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.239611:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265428096 00000100:00100000:3.0:1746065219.239618:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265428096 00010000:00010000:3.0:1746065219.239641:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 38 pid: 12260 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.239660:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265428352 00000100:00100000:3.0:1746065219.239661:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265428352 00010000:00010000:3.0:1746065219.239669:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc1479b3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398af expref: 19 pid: 3068 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.239681:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8214 00000100:00100000:3.0:1746065219.239686:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881265428096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.239694:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.239708:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 38 pid: 12260 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.239718:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 38 pid: 12260 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.239734:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc1479af4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939893 expref: 38 pid: 12260 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.239745:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065219.239787:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265428096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.239793:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8214 00000100:00100000:3.0:1746065219.239805:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8215 00000100:00100000:3.0:1746065219.239809:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265428352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.239815:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.239820:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc1479b3a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398af expref: 19 pid: 3068 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.239828:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc1479b3a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398af expref: 19 pid: 3068 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.239838:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc1479b3a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398af expref: 19 pid: 3068 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.239845:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065219.239855:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265428352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.239863:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8215 00000100:00100000:2.0:1746065219.240436:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.240639:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265427840 00000100:00100000:0.0:1746065219.240643:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265427840 00010000:00010000:0.0:1746065219.240656:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 18 pid: 9549 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746065219.240675:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8216 00000100:00100000:0.0:1746065219.240680:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265427840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065219.240685:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.240692:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 18 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746065219.240698:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 18 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746065219.240709:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d856c00/0xad6b7ddc1479965 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9397ac expref: 18 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746065219.240729:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.240731:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.240735:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.240741:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.240759:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065219.240792:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2006:x1830881265427840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 111us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.240797:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8216 00010000:00010000:2.0:1746065219.241826:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.241841:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.241857:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.241863:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.241870:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.241876:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577a200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065219.241879:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.241885:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.241895:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.241901:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577a200/0xad6b7ddc1479c44 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065219.241941:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265426048:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 28672us (29022us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.241949:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17552 00000100:00100000:0.0:1746065219.242650:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.244102:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265428224 00000100:00100000:1.0:1746065219.244109:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265428224 00002000:00100000:1.0:1746065219.244133:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4198399) req@ffff8800907bdf80 x1830881265428224/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 4584/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065219.244141:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdf80 with x1830881265428224 ext(4194304->4198399) 00010000:00010000:1.0:1746065219.244147:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 37 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.244157:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 37 pid: 1880 timeout: 915 lvb_type: 0 00002000:00010000:1.0:1746065219.244162:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bdf80 00000100:00100000:1.0:1746065219.244184:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2075 00000100:00100000:1.0:1746065219.244189:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265428224:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065219.245769:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881265428224:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 1576us (3115us total) trans 17179874303 rc 0/0 00000100:00100000:1.0:1746065219.245793:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2075 00002000:00100000:1.0:1746065219.245801:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4198399) req@ffff8800907bdf80 x1830881265428224/t17179874303(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 4584/448 e 0 to 0 dl 1746065230 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065219.245809:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bdf80 with x1830881265428224 ext(4194304->4198399) 00010000:00010000:1.0:1746065219.245816:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 39 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.245825:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 39 pid: 1880 timeout: 915 lvb_type: 0 00002000:00010000:1.0:1746065219.245830:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bdf80 00000100:00100000:3.0:1746065219.246135:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265427968:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 17003us (17324us total) trans 21474841692 rc 0/0 00000100:00100000:3.0:1746065219.246141:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2074 00002000:00100000:3.0:1746065219.246146:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3559424->4194303) req@ffff8800907bd880 x1830881265427968/t21474841692(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/448 e 0 to 0 dl 1746065230 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.246152:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bd880 with x1830881265427968 ext(3559424->4194303) 00010000:00010000:3.0:1746065219.246156:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 31 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.246164:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 31 pid: 1880 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746065219.246168:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8800907bd880 00000100:00100000:0.0:1746065219.248626:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.248971:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.249008:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265428608 00000100:00100000:2.0:1746065219.249014:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265428608 00010000:00010000:2.0:1746065219.249040:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 39 pid: 1880 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.249045:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265428480 00000100:00100000:1.0:1746065219.249049:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265428480 00000100:00100000:2.0:1746065219.249061:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8217 00010000:00010000:1.0:1746065219.249061:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 31 pid: 1880 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.249067:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2007:x1830881265428608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065219.249077:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065219.249083:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8218 00000100:00100000:1.0:1746065219.249087:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265428480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065219.249092:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 39 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.249094:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065219.249101:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 39 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.249102:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 31 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.249109:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 31 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746065219.249118:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9000/0xad6b7ddc1479bb8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [4194304->18446744073709551615] (req 4194304->4198399) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939903 expref: 39 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.249118:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f67200/0xad6b7ddc1479bb1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3559424->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9398fc expref: 31 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746065219.249133:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.249135:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.249139:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.249145:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.249163:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065219.249192:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881265428608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 125us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.249198:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8217 00010000:00010000:2.0:1746065219.249223:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.249230:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.249244:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.249251:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.249257:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.249264:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065219.249266:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.249273:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.249282:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.249291:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129fe9c00/0xad6b7ddc1479c59 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.249350:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.249351:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.249354:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.249365:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.249378:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065219.249415:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.249421:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.249432:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.249437:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.249442:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.249446:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577a400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065219.249448:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.249453:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.249462:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.249467:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577a400/0xad6b7ddc1479c4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065219.250467:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881265426176:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 36661us (37489us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.250476:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17555 00000100:00100000:1.0:1746065219.250588:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265428480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1498us (1615us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.250594:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8218 00000100:00100000:0.0:1746065219.250725:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881265426304:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 37283us (37783us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.250732:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17553 00000100:00100000:0.0:1746065219.253146:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.253375:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265428864 00000100:00100000:2.0:1746065219.253382:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265428864 00000100:00100000:2.0:1746065219.253424:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14598 00000100:00100000:2.0:1746065219.253430:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2546:x1830881265428864:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:2.0:1746065219.253467:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065219.253484:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67800/0xad6b7ddc1479c2f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939949 expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.253496:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065219.253499:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065219.253517:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.253527:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147961d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395f3 expref: 58 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.253534:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479640 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395fa expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.253539:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395b4 expref: 58 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.253549:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.253555:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc14795d7 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c2 expref: 58 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.253561:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.253583:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc14795d7 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c2 expref: 58 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.253593:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc14795d7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c2 expref: 58 pid: 7231 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.253604:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263997952:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.254922:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.254933:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 30 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.254942:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263998080:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.254992:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395b4 expref: 58 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.254998:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395b4 expref: 58 pid: 7231 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.255005:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263998208:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.255024:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479640 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395fa expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.255031:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479640 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395fa expref: 30 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.255036:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263998336:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.255052:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147961d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395f3 expref: 58 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.255057:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147961d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395f3 expref: 58 pid: 9571 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.255063:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263998464:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.255887:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065219.256717:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.256791:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265428992 00000100:00100000:0.0:1746065219.256796:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265428992 00010000:00010000:0.0:1746065219.256818:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc14795d7 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c2 expref: 59 pid: 7231 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746065219.256839:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8219 00000100:00100000:0.0:1746065219.256845:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+59:2004:x1830881265428992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065219.256854:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.256858:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc14795d7 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c2 expref: 59 pid: 7231 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746065219.256868:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc14795d7 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c2 expref: 59 pid: 7231 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746065219.256883:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065219.256888:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065219.256895:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065219.256928:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+59:2004:x1830881265428992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.256934:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8219 00010000:00010000:2.0:1746065219.257019:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc14795d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395c2 expref: 58 pid: 7231 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.257029:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263997952:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.260192:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263998080:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.260202:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263998208:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.260208:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263998336:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.260217:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881263998464:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.260240:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065219.260608:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.261103:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.261126:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.261187:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.261365:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265429248 00000100:00100000:3.0:1746065219.261371:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265429248 00010000:00010000:3.0:1746065219.261394:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395b4 expref: 58 pid: 7231 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.261413:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265429504 00000100:00100000:3.0:1746065219.261414:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265429504 00010000:00010000:3.0:1746065219.261420:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147961d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395f3 expref: 59 pid: 9571 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.261428:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265429120 00000100:00100000:3.0:1746065219.261429:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265429120 00010000:00010000:3.0:1746065219.261436:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 31 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.261442:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265429376 00000100:00100000:3.0:1746065219.261443:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265429376 00010000:00010000:3.0:1746065219.261448:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479640 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395fa expref: 32 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.261456:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8220 00000100:00100000:3.0:1746065219.261461:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+59:2005:x1830881265429248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.261469:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.261473:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395b4 expref: 59 pid: 7231 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.261479:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395b4 expref: 59 pid: 7231 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.261494:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc14795c9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395b4 expref: 59 pid: 7231 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.261499:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8221 00010000:00010000:3.0:1746065219.261506:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00000100:00100000:1.0:1746065219.261507:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+58:2005:x1830881265429504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.261511:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065219.261515:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.261518:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065219.261520:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147961d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395f3 expref: 58 pid: 9571 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.261528:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147961d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395f3 expref: 58 pid: 9571 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.261539:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147961d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395f3 expref: 58 pid: 9571 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.261548:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+57:2005:x1830881265429248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (941us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065219.261551:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065219.261554:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:3.0:1746065219.261555:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8220 00010000:00010000:1.0:1746065219.261560:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065219.261566:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8222 00000100:00100000:3.0:1746065219.261570:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2005:x1830881265429120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.261576:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065219.261576:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+56:2005:x1830881265429504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (474us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065219.261580:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 32 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.261582:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8221 00010000:00010000:3.0:1746065219.261587:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 32 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.261593:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8223 00000100:00100000:1.0:1746065219.261597:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+32:2005:x1830881265429376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.261598:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131046800/0xad6b7ddc14795d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395bb expref: 32 pid: 7205 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.261603:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.261605:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065219.261606:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479640 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395fa expref: 31 pid: 7205 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.261607:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.261612:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065219.261615:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479640 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395fa expref: 31 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.261624:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+31:2005:x1830881265429120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (497us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065219.261624:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc1479640 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9395fa expref: 31 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.261628:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8222 00010000:00010000:1.0:1746065219.261631:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065219.261634:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065219.261640:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065219.261645:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065219.261658:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065219.261671:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2005:x1830881265429376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 74us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.261675:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8223 00010000:00010000:1.0:1746065219.261688:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065219.261693:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000040:00080000:1.0:1746065219.262369:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1065, 88 off101560 00000004:00080000:1.0:1746065219.262377:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815280603171ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065219.262435:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1080, 88 off102880 00000004:00080000:1.0:1746065219.262441:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815280667112ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065219.262463:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1081, 88 off102968 00000004:00080000:1.0:1746065219.262465:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815280691842ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065219.262474:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1066, 88 off101648 00000004:00080000:1.0:1746065219.262476:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815280702469ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065219.262483:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1067, 88 off101736 00000004:00080000:1.0:1746065219.262485:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815280711920ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065219.262492:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1082, 88 off103056 00000004:00080000:1.0:1746065219.262495:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815280721142ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065219.262501:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1083, 88 off103144 00000004:00080000:1.0:1746065219.262504:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815280730140ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065219.262510:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1084, 88 off103232 00000004:00080000:1.0:1746065219.262513:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815280739485ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065219.262521:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1068, 88 off101824 00000004:00080000:1.0:1746065219.262523:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815280749681ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065219.262530:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1085, 88 off103320 00000004:00080000:1.0:1746065219.262532:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815280758962ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065219.262540:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1069, 88 off101912 00000004:00080000:1.0:1746065219.262542:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815280768311ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065219.262549:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1086, 88 off103408 00000004:00080000:1.0:1746065219.262552:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815280778914ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065219.262559:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1070, 88 off102000 00000004:00080000:1.0:1746065219.262561:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815280787080ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065219.262567:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1071, 88 off102088 00000004:00080000:1.0:1746065219.262568:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815280795037ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065219.262575:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1072, 88 off102176 00000004:00080000:1.0:1746065219.262577:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815280803912ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065219.262584:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1073, 88 off102264 00000004:00080000:1.0:1746065219.262586:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815280812301ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065219.262592:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1087, 88 off103496 00000004:00080000:1.0:1746065219.262594:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815280820597ns, next at 761143559853ns, rc = 0 00000001:00080000:1.0:1746065219.266081:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937123 is committed 00000004:00080000:1.0:1746065219.266089:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1066 committed 00000004:00080000:1.0:1746065219.266622:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1054 committed 00000004:00080000:1.0:1746065219.266637:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1053 committed 00000004:00080000:1.0:1746065219.266639:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1052 committed 00000004:00080000:1.0:1746065219.266641:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1051 committed 00000004:00080000:1.0:1746065219.266642:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1065 committed 00000004:00080000:1.0:1746065219.266644:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1050 committed 00000004:00080000:1.0:1746065219.266645:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1064 committed 00000004:00080000:1.0:1746065219.266646:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1049 committed 00000004:00080000:1.0:1746065219.266648:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1063 committed 00000004:00080000:1.0:1746065219.266649:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1062 committed 00000004:00080000:1.0:1746065219.266651:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1061 committed 00000004:00080000:1.0:1746065219.266652:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1048 committed 00000004:00080000:1.0:1746065219.266653:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1047 committed 00000004:00080000:1.0:1746065219.266655:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1060 committed 00000004:00080000:1.0:1746065219.266656:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1059 committed 00000004:00080000:1.0:1746065219.266657:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1046 committed 00000001:00080000:1.0:1746065219.266666:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937120 is committed 00000001:00080000:1.0:1746065219.266669:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937119 is committed 00000004:00010000:1.0:1746065219.266761:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800907bc380 reply state ffff880099cc6000 transno 8589937123 ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065219.266799:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065219.266807:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065219.266810:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065219.266814:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746065219.266890:0:7205:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065219.266907:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2546:x1830881265428864:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 13474us (13762us total) trans 8589937123 rc 0/0 00000100:00100000:1.0:1746065219.266915:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14598 00010000:00010000:3.0:1746065219.267256:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.267265:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.267271:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.267275:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065219.267279:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.267288:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.267296:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.267299:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065219.267307:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.267312:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b7400/0xad6b7ddc1479c60 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00000100:00100000:3.0:1746065219.267343:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263998720:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.267390:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.267423:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263999232:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.267436:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.267449:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065219.267452:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263998848:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.267462:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.267470:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263999360:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.267479:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.267668:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263998720 00000100:00100000:3.0:1746065219.267674:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263998720 00000100:00100000:2.0:1746065219.267686:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263998976:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.267706:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263999232 00000100:00100000:3.0:1746065219.267708:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263999232 00000100:00100000:2.0:1746065219.267709:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.268054:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263999488:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.268159:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263998848 00000100:00100000:3.0:1746065219.268163:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263998848 00000100:00100000:3.0:1746065219.268175:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263999360 00000100:00100000:3.0:1746065219.268177:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263999360 00000100:00100000:3.0:1746065219.268185:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263998976 00000100:00100000:3.0:1746065219.268187:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263998976 00000100:00100000:3.0:1746065219.268197:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17556 00000100:00100000:3.0:1746065219.268201:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881263998720:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065219.268236:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.268252:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065219.268257:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263998592:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065219.268271:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.268278:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012edac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263999104:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065219.268287:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.268305:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263999488 00000100:00100000:2.0:1746065219.268307:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263999488 00000100:00100000:2.0:1746065219.268319:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263998592 00000100:00100000:2.0:1746065219.268321:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263998592 00000100:00100000:2.0:1746065219.268338:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263999104 00000100:00100000:2.0:1746065219.268340:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263999104 00000100:00100000:2.0:1746065219.268348:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17557 00000100:00100000:2.0:1746065219.268352:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263999232:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065219.268627:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17558 00000100:00100000:1.0:1746065219.268632:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263998848:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065219.268694:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17559 00000100:00100000:0.0:1746065219.268701:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+15:3759:x1830881263999360:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065219.268746:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065219.268749:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065219.268750:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065219.268752:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065219.268754:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:3.0:1746065219.269715:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+16:3759:x1830881263998720:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1511us (2323us total) trans 17179874304 rc 0/0 00000100:00100000:2.0:1746065219.269715:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3759:x1830881263999232:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1361us (2276us total) trans 17179874305 rc 0/0 00000100:00100000:2.0:1746065219.269721:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17557 00000100:00100000:3.0:1746065219.269724:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17556 00000100:00100000:2.0:1746065219.269735:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17560 00000100:00100000:3.0:1746065219.269738:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17561 00000100:00100000:2.0:1746065219.269739:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881263998976:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.269744:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881263999488:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065219.269802:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:3.0:1746065219.269805:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065219.269806:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065219.269808:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00000100:00100000:2.0:1746065219.269808:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+16:3761:x1830881263998976:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (2098us total) trans 17179874308 rc 0/0 00002000:00010000:3.0:1746065219.269809:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:2.0:1746065219.269813:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17560 00000100:00100000:2.0:1746065219.269821:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17562 00000100:00100000:2.0:1746065219.269824:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3761:x1830881263998592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.269829:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3761:x1830881263999488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (1592us total) trans 17179874309 rc 0/0 00000100:00100000:3.0:1746065219.269834:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17561 00000100:00100000:3.0:1746065219.269844:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17563 00000100:00100000:3.0:1746065219.269848:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3761:x1830881263999104:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065219.269862:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+15:3761:x1830881263998592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 38us (1590us total) trans 17179874310 rc 0/0 00000100:00100000:2.0:1746065219.269867:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17562 00002000:00010000:3.0:1746065219.269881:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065219.269883:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065219.269885:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065219.269886:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065219.269888:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065219.269905:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+15:3761:x1830881263999104:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (1616us total) trans 17179874311 rc 0/0 00000100:00100000:3.0:1746065219.269910:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17563 00000100:00080000:3.0:1746065219.269928:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065219.270106:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263999744:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065219.270129:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065219.270141:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3759:x1830881263999360:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1441us (2660us total) trans 17179874307 rc 0/0 00000100:00100000:0.0:1746065219.270148:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17559 00000100:00100000:0.0:1746065219.270157:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263999744 00000100:00100000:3.0:1746065219.270159:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874289 gen 2 00000100:00100000:0.0:1746065219.270160:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263999744 00000004:00080000:3.0:1746065219.270163:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa5c00, transno 17179874272 00000100:00100000:2.0:1746065219.270165:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264000000:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065219.270168:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa5880, transno 17179874273 00000004:00080000:3.0:1746065219.270170:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa4380, transno 17179874274 00000004:00080000:3.0:1746065219.270173:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa6680, transno 17179874275 00000004:00080000:3.0:1746065219.270175:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa5180, transno 17179874276 00000004:00080000:3.0:1746065219.270177:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa7b80, transno 17179874277 00000004:00080000:3.0:1746065219.270178:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091aa4000, transno 17179874278 00000004:00080000:3.0:1746065219.270180:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3e300, transno 17179874279 00000100:00100000:0.0:1746065219.270180:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17564 00000004:00080000:3.0:1746065219.270182:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d9f80, transno 17179874280 00000100:00100000:2.0:1746065219.270183:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065219.270184:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6de300, transno 17179874281 00000100:00100000:0.0:1746065219.270184:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881263999744:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065219.270186:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8e00, transno 17179874282 00000004:00080000:3.0:1746065219.270188:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aeca300, transno 17179874283 00000004:00080000:3.0:1746065219.270190:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615ea00, transno 17179874284 00000004:00080000:3.0:1746065219.270192:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dd500, transno 17179874285 00000004:00080000:3.0:1746065219.270194:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8000, transno 17179874286 00000100:00100000:2.0:1746065219.270194:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264000512:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065219.270196:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6a00, transno 17179874287 00000004:00080000:3.0:1746065219.270198:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dc380, transno 17179874288 00000004:00080000:3.0:1746065219.270200:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009aec8380, transno 17179874289 00000100:00100000:3.0:1746065219.270205:0:3759:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88012edae680 x1830881263999360/t17179874307(17179874307) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065235 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000100:00100000:2.0:1746065219.270206:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065219.270213:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edae680/2, rc 0, transno 17179874307 00000100:00100000:3.0:1746065219.270217:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263999360:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065219.270221:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077c000/2, rc 0, transno 17179874310 00000100:00100000:2.0:1746065219.270225:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263998592:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065219.270227:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077d180/2, rc 0, transno 17179874304 00000100:00100000:3.0:1746065219.270230:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263998720:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065219.270231:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edac000/2, rc 0, transno 17179874311 00000100:00100000:2.0:1746065219.270234:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263999104:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065219.270236:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edaea00/2, rc 0, transno 17179874305 00000100:00100000:3.0:1746065219.270239:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263999232:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065219.270241:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edaca80/2, rc 0, transno 17179874308 00000100:00100000:2.0:1746065219.270243:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263998976:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065219.270245:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881263999744:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (116us total) trans 21474841693 rc 0/0 00000100:00100000:3.0:1746065219.270247:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264000256:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065219.270249:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012edad500/2, rc 0, transno 17179874309 00000100:00100000:0.0:1746065219.270250:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17564 00000100:00100000:2.0:1746065219.270251:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012edad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263999488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065219.270257:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065219.270259:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264000000 00000100:00100000:3.0:1746065219.270261:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.270261:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263999616:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065219.270261:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264000000 00000100:00100000:0.0:1746065219.270268:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264000512 00000100:00100000:0.0:1746065219.270269:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264000512 00000100:00100000:0.0:1746065219.270274:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264000256 00000100:00100000:2.0:1746065219.270275:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065219.270276:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4e00/2, rc 0, transno 21474841693 00000100:00100000:0.0:1746065219.270276:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264000256 00000100:00100000:3.0:1746065219.270278:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263999744:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065219.270281:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263999616 00000100:00100000:3.0:1746065219.270283:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065219.270283:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263999616 00000100:00100000:2.0:1746065219.270284:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264000128:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065219.270286:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263999872:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065219.270289:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17565 00000100:00100000:0.0:1746065219.270293:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+25:3761:x1830881264000000:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065219.270297:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.270299:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.270306:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264000384:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065219.270310:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264000128 00000100:00100000:2.0:1746065219.270313:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264000128 00000100:00100000:3.0:1746065219.270315:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.270324:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881263999872 00000100:00100000:3.0:1746065219.270325:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264000384 00000100:00100000:2.0:1746065219.270325:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881263999872 00000100:00100000:3.0:1746065219.270338:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264000384 00002000:00010000:0.0:1746065219.270342:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065219.270344:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065219.270346:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746065219.270347:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17566 00002000:00010000:0.0:1746065219.270348:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065219.270349:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:3.0:1746065219.270350:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17567 00000100:00100000:2.0:1746065219.270351:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881264000512:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065219.270354:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881264000256:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065219.270370:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881264000000:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (186us total) trans 21474841694 rc 0/0 00000100:00100000:0.0:1746065219.270375:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17565 00000100:00100000:0.0:1746065219.270383:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17568 00000100:00100000:0.0:1746065219.270387:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881263999616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065219.270389:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:3.0:1746065219.270391:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:3.0:1746065219.270393:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065219.270394:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:3.0:1746065219.270396:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:3.0:1746065219.270412:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3759:x1830881264000256:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (150us total) trans 21474841695 rc 0/0 00000100:00100000:3.0:1746065219.270416:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17567 00000100:00100000:3.0:1746065219.270424:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17569 00000100:00100000:3.0:1746065219.270428:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+30:3761:x1830881264000128:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065219.270431:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+30:3761:x1830881263999616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 43us (154us total) trans 21474841696 rc 0/0 00000100:00100000:0.0:1746065219.270436:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17568 00000100:00100000:2.0:1746065219.270440:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3761:x1830881264000512:12345-0@lo:2:osp-syn-0-0.0 Request processed in 89us (233us total) trans 21474841697 rc 0/0 00000100:00100000:2.0:1746065219.270445:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17566 00000100:00100000:0.0:1746065219.270447:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17570 00000100:00100000:2.0:1746065219.270451:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17571 00000100:00100000:0.0:1746065219.270451:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881263999872:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065219.270454:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00000100:00100000:2.0:1746065219.270455:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881264000384:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065219.270456:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065219.270457:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065219.270459:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065219.270460:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:3.0:1746065219.270475:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881264000128:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (177us total) trans 21474841698 rc 0/0 00000100:00100000:3.0:1746065219.270479:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17569 00000100:00080000:3.0:1746065219.270491:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065219.270497:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+30:3759:x1830881264000384:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (181us total) trans 21474841699 rc 0/0 00000100:00100000:2.0:1746065219.270501:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17571 00000004:00080000:3.0:1746065219.270502:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a90000/2, rc 0, transno 21474841699 00000100:00100000:3.0:1746065219.270505:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264000384:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065219.270508:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881263999872:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (207us total) trans 21474841700 rc 0/0 00000004:00080000:3.0:1746065219.270512:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a91180/2, rc 0, transno 21474841695 00000100:00100000:0.0:1746065219.270512:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17570 00000100:00100000:3.0:1746065219.270514:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264000256:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065219.270520:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4700/2, rc 0, transno 21474841696 00000004:00080000:3.0:1746065219.270521:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd6d80/2, rc 0, transno 21474841700 00000100:00100000:2.0:1746065219.270523:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881263999616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065219.270524:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263999872:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065219.270530:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a90380/2, rc 0, transno 21474841698 00000100:00100000:2.0:1746065219.270533:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264000128:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065219.270538:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4380/2, rc 0, transno 21474841694 00000100:00100000:2.0:1746065219.270541:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264000000:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065219.270546:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a92d80/2, rc 0, transno 21474841697 00000100:00100000:2.0:1746065219.270548:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264000512:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065219.270570:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+13:3759:x1830881263998848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1939us (3107us total) trans 17179874306 rc 0/0 00000100:00100000:1.0:1746065219.270576:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17558 00000004:00080000:3.0:1746065219.270623:0:8154:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 1 in flight, 18 done 00000004:00080000:3.0:1746065219.270648:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077df80/2, rc 0, transno 17179874306 00000100:00100000:3.0:1746065219.270651:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881263998848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065219.270680:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264000640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065219.270696:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065219.270715:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264000640 00000100:00100000:1.0:1746065219.270717:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264000640 00000100:00100000:1.0:1746065219.270733:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17572 00000100:00100000:1.0:1746065219.270737:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881264000640:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065219.270803:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881264000640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (106us total) trans 17179874312 rc 0/0 00000100:00100000:1.0:1746065219.270810:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17572 00000004:00080000:1.0:1746065219.270829:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd8700/2, rc 0, transno 17179874312 00000100:00100000:1.0:1746065219.270832:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264000640:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065219.275323:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.275392:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265429632 00000100:00100000:0.0:1746065219.275399:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265429632 00000100:00100000:0.0:1746065219.275449:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14599 00000100:00100000:0.0:1746065219.275455:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+7:2546:x1830881265429632:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065219.275473:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.275489:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc1479c67 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939950 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.275535:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc1479c67 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939950 expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.275546:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc1479c67 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939950 expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.275560:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065219.275562:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065219.275565:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44a00, rc 0) 00000100:00100000:0.0:1746065219.275904:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2546:x1830881265429632:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 448us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.275910:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14599 00000100:00100000:0.0:1746065219.280165:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.280220:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265429760 00000100:00100000:2.0:1746065219.280227:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265429760 00000100:00100000:2.0:1746065219.280280:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 873 00000100:00100000:2.0:1746065219.280287:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2546:x1830881265429760:12345-192.168.202.27@tcp:103:mirror_io.0 00010000:00010000:2.0:1746065219.280298:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065219.280318:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f66a00/0xad6b7ddc1479c21 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939942 expref: 8 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.280350:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065219.280354:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065219.280917:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+7:2546:x1830881265429760:12345-192.168.202.27@tcp:103:mirror_io.0 Request processed in 629us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.280924:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 873 00000100:00100000:0.0:1746065219.283166:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.283367:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265430016 00000100:00100000:1.0:1746065219.283373:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265430016 00000100:00100000:1.0:1746065219.283413:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5485 00000100:00100000:1.0:1746065219.283419:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2546:x1830881265430016:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065219.283586:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2546:x1830881265430016:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 166us (423us total) trans 8589937124 rc 0/0 00000100:00100000:1.0:1746065219.283592:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5485 00000100:00100000:0.0:1746065219.285639:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.285688:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265430272 00000100:00100000:2.0:1746065219.285693:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265430272 00000100:00100000:2.0:1746065219.285729:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5486 00000100:00100000:2.0:1746065219.285735:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2546:x1830881265430272:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065219.285887:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2546:x1830881265430272:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 151us (251us total) trans 8589937125 rc 0/0 00000100:00100000:2.0:1746065219.285893:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5486 00000100:00100000:0.0:1746065219.315454:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.315507:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.315598:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265430784 00000100:00100000:3.0:1746065219.315605:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265430784 00000100:00100000:2.0:1746065219.315631:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265430528 00000100:00100000:2.0:1746065219.315635:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265430528 00000100:00100000:3.0:1746065219.315647:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14600 00000100:00100000:2.0:1746065219.315660:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14601 00000100:00100000:2.0:1746065219.315665:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2557:x1830881265430528:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065219.315672:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2558:x1830881265430784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065219.315685:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.315685:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.315700:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc1479c6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93995e expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.315704:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479c75 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939957 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.315759:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc1479c7c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.315759:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc1479c83 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.315768:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc1479c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.316363:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc1479c7c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.316376:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc1479c8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.316382:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc1479c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.316387:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc1479c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.316466:0:9571:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1479c91 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.316473:0:9571:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1479c91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.316479:0:9571:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1479c91 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00000004:00200000:3.0:1746065219.316486:0:9571:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065219.316546:0:9571:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc1479c7c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.317720:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc1479c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317731:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc1479c83 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.317732:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc1479c7c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.317740:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479c9f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.317741:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc1479c7c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.317745:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.317747:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc1479c7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.317750:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.317751:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065219.317754:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc1479c7c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.317761:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc1479c7c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.317770:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065219.317782:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065219.317785:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc1479c7c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.317789:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc1479c7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:2.0:1746065219.317813:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479ca6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317820:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317825:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479ca6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065219.317831:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065219.317866:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc1479c83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317870:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc1479c83 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317876:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc1479c83 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317880:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc1479c83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317883:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae6c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065219.317885:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc1479c83 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317889:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc1479c83 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317895:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065219.317896:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065219.317898:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc1479c83 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317902:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6c00/0xad6b7ddc1479c83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317913:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479c9f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317918:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479c9f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317922:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479c9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317926:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091ae6000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065219.317927:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479c9f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317935:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479c9f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317940:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5db00) 00010000:00010000:2.0:1746065219.317942:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065219.317944:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479c9f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317948:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479c9f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.317992:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc1479c75 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939957 expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.318002:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939957 expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.318007:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065219.318009:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065219.318011:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7600, rc 0) 00000100:00100000:2.0:1746065219.318066:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2557:x1830881265430528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2401us (2558us total) trans 8589937127 rc 0/0 00000100:00100000:2.0:1746065219.318074:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14601 00010000:00010000:3.0:1746065219.318636:0:9571:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc1479c8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.318643:0:9571:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc1479c8a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.318648:0:9571:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc1479c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.318652:0:9571:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065219.318654:0:9571:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc1479c8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.318663:0:9571:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc1479c8a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.318669:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5db00) 00010000:00010000:3.0:1746065219.318671:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065219.318673:0:9571:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc1479c8a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.318677:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc1479c8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9571 initiator: MDT0 00010000:00010000:3.0:1746065219.318705:0:9571:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc1479c6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93995e expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.318713:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1479c91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93995e expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.318718:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.318720:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065219.318721:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1e00, rc 0) 00000100:00100000:3.0:1746065219.319869:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2558:x1830881265430784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4209us (4416us total) trans 8589937126 rc 0/0 00000100:00100000:3.0:1746065219.319877:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14600 00000100:00100000:0.0:1746065219.327153:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.327190:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.327218:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265430912 00000100:00100000:1.0:1746065219.327226:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265430912 00000100:00100000:0.0:1746065219.327230:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.327257:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265431040 00000100:00100000:1.0:1746065219.327260:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265431040 00000100:00100000:1.0:1746065219.327270:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265431168 00000100:00100000:1.0:1746065219.327272:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265431168 00000100:00100000:1.0:1746065219.327281:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17573 00000100:00100000:1.0:1746065219.327292:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881265430912:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065219.327308:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065219.327325:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a6556e00/0xad6b7ddc1479cb4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939965 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065219.327352:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d741, atime: 0x6812d741, ctime: 0x6812d741, blocks: 0x778 00010000:00010000:1.0:1746065219.327369:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.327371:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.327379:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6556e00/0xad6b7ddc1479cb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939965 expref: 39 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.327397:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a6556e00/0xad6b7ddc1479cb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939965 expref: 39 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.327406:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a6556e00, rc 0) 00000100:00100000:1.0:1746065219.327454:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881265430912:12345-192.168.202.27@tcp:101:cat.0 Request processed in 166us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.329362:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17574 00000100:00100000:1.0:1746065219.329373:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17573 00000100:00100000:0.0:1746065219.329374:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265431040:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065219.329385:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065219.329394:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17575 00010000:00010000:0.0:1746065219.329396:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93996c expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065219.329400:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265431168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065219.329405:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065219.329411:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1479cc2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939973 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065219.329415:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d742, atime: 0x6812d741, ctime: 0x6812d742, blocks: 0x800 00002000:00010000:1.0:1746065219.329418:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d742, atime: 0x6812d73f, ctime: 0x6812d742, blocks: 0x808 00010000:00010000:1.0:1746065219.329425:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.329425:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.329427:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.329427:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.329431:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1479cc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939973 expref: 33 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.329431:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 33 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.329441:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1479cc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939973 expref: 33 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.329441:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 33 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.329449:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090684400, rc 0) 00010000:00010000:0.0:1746065219.329449:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45c00, rc 0) 00000100:00100000:1.0:1746065219.329471:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265431168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 71us (2240us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.329476:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17575 00000100:00100000:1.0:1746065219.329721:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.329758:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.329807:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265431424 00000100:00100000:1.0:1746065219.329812:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265431424 00000100:00100000:1.0:1746065219.329835:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265431808 00000100:00100000:1.0:1746065219.329837:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265431808 00000100:00100000:0.0:1746065219.329849:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265431040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 478us (2658us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.329854:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14602 00000100:00100000:0.0:1746065219.329854:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17574 00000100:00100000:1.0:1746065219.329859:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2554:x1830881265431424:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065219.329869:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065219.329878:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1479cc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939981 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.329950:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065219.329961:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1479c91 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93995e expref: 9 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.329968:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479ca6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939957 expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.329973:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065219.329995:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939957 expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.330004:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939957 expref: 29 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.330015:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264000768:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065219.330191:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14603 00000100:00100000:0.0:1746065219.330197:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2555:x1830881265431808:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065219.330207:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.330213:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc1479cd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93998f expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.330254:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065219.330260:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065219.330266:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065219.330478:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.331085:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265431552 00000100:00100000:0.0:1746065219.331089:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265431552 00000100:00100000:0.0:1746065219.331166:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17576 00000100:00100000:0.0:1746065219.331173:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265431552:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065219.331181:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.331190:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc1479ce5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939988 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.331202:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.331204:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.331209:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc1479ce5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939988 expref: 18 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.331411:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1479c91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93995e expref: 10 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.331420:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1479c91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93995e expref: 10 pid: 9571 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.331429:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264000896:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.331520:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.331552:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265431936 00000100:00100000:3.0:1746065219.331555:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265431936 00010000:00010000:0.0:1746065219.331591:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc1479ce5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939988 expref: 18 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.331599:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f45e00, rc 0) 00000100:00100000:1.0:1746065219.331602:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2353840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065219.331616:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265431552:12345-192.168.202.27@tcp:101:cat.0 Request processed in 444us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.331621:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17576 00000100:00100000:2.0:1746065219.331925:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.331938:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265432192 00000100:00100000:2.0:1746065219.331941:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265432192 00000100:00100000:2.0:1746065219.331968:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17577 00000100:00100000:2.0:1746065219.331974:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265431936:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.331981:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.331988:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1479cec lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939996 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.331998:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.331999:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.332003:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1479cec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939996 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.332011:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1479cec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939996 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.332018:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61400, rc 0) 00000100:00100000:2.0:1746065219.332033:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265431936:12345-192.168.202.27@tcp:101:cat.0 Request processed in 59us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.332038:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17577 00000100:00100000:2.0:1746065219.332048:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17578 00000100:00100000:2.0:1746065219.332052:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265432192:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.332057:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.332062:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc1479cf3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93999d expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.332071:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.332072:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.332076:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc1479cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93999d expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.332088:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc1479cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93999d expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.332094:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72400, rc 0) 00000100:00100000:2.0:1746065219.332108:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265432192:12345-192.168.202.27@tcp:101:cat.0 Request processed in 56us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.332112:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17578 00000100:00100000:2.0:1746065219.333600:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.333631:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.333650:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.333662:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.334278:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.334633:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265432064 00000100:00100000:0.0:1746065219.334640:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265432064 00000100:00100000:1.0:1746065219.334862:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265432320 00000100:00100000:1.0:1746065219.334865:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265432320 00000100:00100000:3.0:1746065219.335010:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265432448 00000100:00100000:3.0:1746065219.335014:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265432448 00000100:00100000:3.0:1746065219.335035:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265432576 00000100:00100000:3.0:1746065219.335037:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265432576 00000100:00100000:3.0:1746065219.335047:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265432704 00000100:00100000:3.0:1746065219.335049:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265432704 00000100:00100000:3.0:1746065219.335061:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17579 00000100:00100000:3.0:1746065219.335067:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265432064:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065219.335080:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.335093:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1479cfa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93997a expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065219.335112:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d742, atime: 0x6812d73f, ctime: 0x6812d742, blocks: 0x808 00010000:00010000:3.0:1746065219.335127:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.335128:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.335135:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1479cfa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93997a expref: 41 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.335146:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1479cfa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93997a expref: 41 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.335153:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1200, rc 0) 00000100:00100000:3.0:1746065219.335182:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265432064:12345-192.168.202.27@tcp:101:cat.0 Request processed in 116us (1586us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.335188:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17579 00000100:00100000:3.0:1746065219.335201:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17580 00000100:00100000:3.0:1746065219.335204:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265432320:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065219.335209:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.335214:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1479d01 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399a4 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.335223:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.335224:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.335228:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1479d01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399a4 expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.335236:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1479d01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399a4 expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.335242:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1c00, rc 0) 00000100:00100000:3.0:1746065219.335255:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265432320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 49us (1623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.335259:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17580 00000100:00100000:3.0:1746065219.335270:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17581 00000100:00100000:3.0:1746065219.335274:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265432448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065219.335280:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.335286:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1479d08 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399b2 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065219.335294:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 5034592, mtime: 0x6812d743, atime: 0x6812d743, ctime: 0x6812d743, blocks: 0x1678 00000100:00100000:2.0:1746065219.335565:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17582 00000100:00100000:2.0:1746065219.335571:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265432576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.335579:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.335588:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1479d0f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399b9 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065219.335599:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d743, atime: 0x6812d743, ctime: 0x6812d743, blocks: 0x1008 00010000:00010000:2.0:1746065219.335607:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.335608:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.335612:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1479d0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b9 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.335620:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1479d0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b9 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.335627:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72a00, rc 0) 00000100:00100000:2.0:1746065219.335642:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265432576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (1980us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.335647:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17582 00000100:00100000:2.0:1746065219.335658:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17583 00000100:00100000:2.0:1746065219.335662:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265432704:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.335666:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.335671:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399ab expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065219.335737:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.335750:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265432832 00000100:00100000:2.0:1746065219.335753:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265432832 00000100:00100000:2.0:1746065219.335790:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17584 00000100:00100000:2.0:1746065219.335795:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265432832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.335801:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.335806:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1479d1d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399c0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.335814:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.335815:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.335819:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1479d1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c0 expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.335826:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1479d1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c0 expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.335832:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72600, rc 0) 00000100:00100000:2.0:1746065219.335846:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265432832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.335850:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17584 00010000:00010000:3.0:1746065219.336630:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.336632:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.336636:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 41 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.336645:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 41 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.336652:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73400, rc 0) 00000100:00100000:3.0:1746065219.336897:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265432704:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1008us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.336903:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17583 00010000:00010000:3.0:1746065219.336918:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.336919:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.336923:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1479d08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b2 expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.336932:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1479d08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b2 expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.337534:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0a00, rc 0) 00000100:00100000:3.0:1746065219.337558:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265432448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2282us (3906us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.337563:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17581 00000100:00100000:1.0:1746065219.337686:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264000768:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065219.337730:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.337791:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265433088 00000100:00100000:3.0:1746065219.337795:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.337795:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265433088 00010000:00010000:0.0:1746065219.337816:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939957 expref: 30 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746065219.337833:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265432960 00000100:00100000:0.0:1746065219.337835:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265432960 00000100:00100000:1.0:1746065219.337843:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264000896:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065219.337843:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1479c91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93995e expref: 11 pid: 9571 timeout: 915 lvb_type: 0 00000100:00100000:0.0:1746065219.337853:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8224 00000100:00100000:0.0:1746065219.337858:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265433088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065219.337859:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065219.337866:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.337870:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479ca6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939957 expref: 30 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.337875:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8225 00010000:00010000:0.0:1746065219.337878:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479ca6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939957 expref: 30 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.337879:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265432960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065219.337884:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065219.337886:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1479c91 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93995e expref: 11 pid: 9571 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746065219.337892:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479ca6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939957 expref: 30 pid: 7205 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.337893:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1479c91 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93995e expref: 11 pid: 9571 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.337907:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc1479c91 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93995e expref: 11 pid: 9571 timeout: 915 lvb_type: 0 00010000:00010000:0.0:1746065219.337907:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065219.337910:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065219.337917:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065219.337995:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065219.338001:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065219.338006:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065219.338013:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065219.338257:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065219.338260:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065219.338287:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac560050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265432960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 407us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.338316:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8225 00010000:00010000:0.0:1746065219.338377:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065219.338395:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265433088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 536us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.338401:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8224 00010000:00010000:1.0:1746065219.338464:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065219.338470:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065219.338484:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065219.338497:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065219.338502:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065219.338510:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065219.338573:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44800/0xad6b7ddc1479cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93998f expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.338573:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a400/0xad6b7ddc1479cc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939981 expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.338583:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939981 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.338584:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93998f expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.338589:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065219.338591:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065219.338592:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a200, rc 0) 00000100:00100000:1.0:1746065219.338611:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2554:x1830881265431424:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8751us (8890us total) trans 8589937128 rc 0/0 00000100:00100000:1.0:1746065219.338616:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14602 00010000:00010000:2.0:1746065219.338837:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065219.338840:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065219.338842:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44e00, rc 0) 00000100:00100000:2.0:1746065219.338872:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2555:x1830881265431808:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8674us (9112us total) trans 8589937129 rc 0/0 00000100:00100000:2.0:1746065219.338880:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14603 00000100:00100000:0.0:1746065219.340405:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.340476:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.340576:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265433216 00000100:00100000:2.0:1746065219.340582:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265433216 00000100:00100000:2.0:1746065219.340610:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265433344 00000100:00100000:2.0:1746065219.340611:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265433344 00000100:00100000:2.0:1746065219.340732:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14604 00000100:00100000:2.0:1746065219.340739:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2558:x1830881265433216:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.340754:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.340768:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1479d32 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399c7 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.340833:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1479d32 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c7 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.340844:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1479d32 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c7 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.340856:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065219.340859:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065219.340861:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73e00, rc 0) 00000100:00100000:0.0:1746065219.340991:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14605 00000100:00100000:0.0:1746065219.341000:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2557:x1830881265433344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065219.341014:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.341022:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc1479d39 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399ce expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.341050:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc1479d39 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ce expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.341059:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc1479d39 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ce expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.341070:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065219.341072:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065219.341074:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44600, rc 0) 00000100:00100000:2.0:1746065219.341526:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2558:x1830881265433216:12345-192.168.202.27@tcp:101:cat.0 Request processed in 785us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.341531:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14604 00000100:00100000:0.0:1746065219.341589:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2557:x1830881265433344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 591us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.341594:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14605 00000100:00100000:0.0:1746065219.353505:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.353556:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.353630:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265433600 00000100:00100000:3.0:1746065219.353637:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265433600 00002000:00100000:3.0:1746065219.353675:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009577ce00 x1830881265433600/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.353684:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ce00 with x1830881265433600 ext(0->1048575) 00002000:00010000:3.0:1746065219.353689:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577ce00 00000100:00100000:3.0:1746065219.353703:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265433856 00000100:00100000:3.0:1746065219.353705:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265433856 00002000:00100000:3.0:1746065219.353716:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009577f480 x1830881265433856/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.353728:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f480 with x1830881265433856 ext(1048576->2097151) 00002000:00010000:3.0:1746065219.353731:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577f480 00000100:00100000:3.0:1746065219.353754:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6294 00000100:00100000:3.0:1746065219.353761:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265433600:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065219.354362:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6295 00000100:00100000:2.0:1746065219.354369:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265433856:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065219.363069:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.363099:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.363121:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.363143:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.363155:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.363174:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265434112 00000100:00100000:0.0:1746065219.363181:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265434112 00002000:00100000:0.0:1746065219.363216:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009577f800 x1830881265434112/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.363226:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f800 with x1830881265434112 ext(1048576->2097151) 00002000:00010000:0.0:1746065219.363230:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577f800 00000100:00100000:0.0:1746065219.363242:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265434368 00000100:00100000:0.0:1746065219.363244:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265434368 00002000:00100000:0.0:1746065219.363254:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009577e300 x1830881265434368/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.363260:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577e300 with x1830881265434368 ext(1048576->2097151) 00002000:00010000:0.0:1746065219.363262:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577e300 00000100:00100000:0.0:1746065219.363269:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265434624 00000100:00100000:0.0:1746065219.363270:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265434624 00002000:00100000:0.0:1746065219.363278:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009577d180 x1830881265434624/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.363284:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d180 with x1830881265434624 ext(0->1048575) 00002000:00010000:0.0:1746065219.363287:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577d180 00000100:00100000:0.0:1746065219.363294:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265434880 00000100:00100000:0.0:1746065219.363296:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265434880 00002000:00100000:0.0:1746065219.363304:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009577f100 x1830881265434880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.363310:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f100 with x1830881265434880 ext(1048576->2097151) 00002000:00010000:0.0:1746065219.363312:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577f100 00000100:00100000:0.0:1746065219.363319:0:20324:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265435136 00000100:00100000:0.0:1746065219.363321:0:20324:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265435136 00002000:00100000:0.0:1746065219.363343:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009577c000 x1830881265435136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.363348:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577c000 with x1830881265435136 ext(1048576->2097151) 00002000:00010000:0.0:1746065219.363351:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577c000 00000100:00100000:0.0:1746065219.363362:0:20324:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6296 00000100:00100000:0.0:1746065219.363368:0:20324:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265434112:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065219.363946:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6297 00000100:00100000:0.0:1746065219.363952:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265434368:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065219.364455:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.365264:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265435392 00000100:00100000:3.0:1746065219.365270:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265435392 00002000:00100000:3.0:1746065219.365294:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009577e680 x1830881265435392/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.365301:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577e680 with x1830881265435392 ext(1048576->2097151) 00002000:00010000:3.0:1746065219.365305:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577e680 00000100:00100000:3.0:1746065219.365315:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6298 00000100:00100000:3.0:1746065219.365320:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265434624:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065219.365873:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6299 00000100:00100000:3.0:1746065219.365879:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265434880:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065219.367409:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6300 00000100:00100000:1.0:1746065219.367422:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265435136:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065219.368379:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6301 00000100:00100000:1.0:1746065219.368388:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265435392:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065219.377063:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265433600:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23295us (23559us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065219.377074:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6294 00002000:00100000:2.0:1746065219.377083:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009577ce00 x1830881265433600/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.377092:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ce00 with x1830881265433600 ext(0->1048575) 00002000:00010000:2.0:1746065219.377097:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577ce00 00000100:00100000:2.0:1746065219.383089:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265433856:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28712us (29524us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065219.383099:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6295 00002000:00100000:2.0:1746065219.383107:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009577f480 x1830881265433856/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.383115:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f480 with x1830881265433856 ext(1048576->2097151) 00002000:00010000:2.0:1746065219.383120:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577f480 00000100:00100000:1.0:1746065219.389668:0:20324:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265434112:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26291us (26597us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065219.389677:0:20324:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6296 00002000:00100000:1.0:1746065219.389687:0:20324:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009577f800 x1830881265434112/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065219.389694:0:20324:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f800 with x1830881265434112 ext(1048576->2097151) 00002000:00010000:1.0:1746065219.389700:0:20324:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577f800 00000100:00100000:0.0:1746065219.390846:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.391138:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265435648 00000100:00100000:2.0:1746065219.391145:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265435648 00000100:00100000:2.0:1746065219.391864:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14606 00000100:00100000:2.0:1746065219.391871:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2554:x1830881265435648:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065219.391886:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.391888:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065219.391909:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44600/0xad6b7ddc1479d39 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ce expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.392587:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065219.392592:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065219.392603:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc1479d40 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399d5 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.392641:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.392651:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc1479c67 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939950 expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.392657:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1479d32 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c7 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.392663:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.392686:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1479d32 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c7 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.392696:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1479d32 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c7 expref: 10 pid: 7203 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.392709:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264001024:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.392868:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc1479c67 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939950 expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.392875:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc1479c67 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939950 expref: 8 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.392881:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264001152:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.392897:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065219.403764:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265434368:12345-192.168.202.27@tcp:3:cat.0 Request processed in 39802us (40653us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065219.403791:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6297 00002000:00100000:1.0:1746065219.403803:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009577e300 x1830881265434368/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065219.403812:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577e300 with x1830881265434368 ext(1048576->2097151) 00002000:00010000:1.0:1746065219.403818:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577e300 00000100:00100000:2.0:1746065219.409650:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.409725:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265435776 00000100:00100000:2.0:1746065219.409732:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265435776 00010000:00010000:2.0:1746065219.409761:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1479d32 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c7 expref: 11 pid: 7203 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.409801:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8226 00000100:00100000:2.0:1746065219.409808:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265435776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065219.409820:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065219.409826:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1479d32 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c7 expref: 11 pid: 7203 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746065219.409836:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1479d32 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c7 expref: 11 pid: 7203 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746065219.409854:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065219.409858:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.409864:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065219.409869:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065219.409901:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265435776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.409908:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8226 00010000:00010000:3.0:1746065219.410299:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73e00/0xad6b7ddc1479d32 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c7 expref: 10 pid: 7203 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.410318:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b66d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264001024:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065219.410345:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b65880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264001152:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065219.410362:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065219.413825:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.413854:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.416840:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265434624:12345-192.168.202.27@tcp:3:cat.0 Request processed in 51511us (53710us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065219.416852:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6298 00002000:00100000:2.0:1746065219.416861:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009577d180 x1830881265434624/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.416868:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577d180 with x1830881265434624 ext(0->1048575) 00002000:00010000:2.0:1746065219.416873:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577d180 00000100:00100000:3.0:1746065219.417103:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265435904 00000100:00100000:3.0:1746065219.417110:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265435904 00010000:00010000:3.0:1746065219.417134:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc1479c67 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939950 expref: 9 pid: 7205 timeout: 915 lvb_type: 0 00000100:00100000:3.0:1746065219.417154:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8227 00000100:00100000:3.0:1746065219.417160:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265435904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.417171:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.417176:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc1479c67 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939950 expref: 9 pid: 7205 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.417187:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc1479c67 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939950 expref: 9 pid: 7205 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.417204:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44a00/0xad6b7ddc1479c67 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939950 expref: 9 pid: 7205 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.417215:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.417219:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.417227:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.417232:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.417248:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065219.417260:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.417265:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000040:00080000:3.0:1746065219.417459:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1074, 88 off102352 00000004:00080000:3.0:1746065219.417464:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815435690293ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065219.417489:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1088, 88 off103584 00000004:00080000:3.0:1746065219.417492:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815435718206ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065219.417500:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1089, 88 off103672 00000004:00080000:3.0:1746065219.417503:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815435729163ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065219.417579:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1075, 88 off102440 00000004:00080000:3.0:1746065219.417583:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815435809139ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065219.417594:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1076, 88 off102528 00000004:00080000:3.0:1746065219.417596:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815435822748ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065219.417605:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1090, 88 off103760 00000004:00080000:3.0:1746065219.417608:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815435835012ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065219.417615:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1091, 88 off103848 00000004:00080000:3.0:1746065219.417617:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815435844077ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065219.417625:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1092, 88 off103936 00000004:00080000:3.0:1746065219.417627:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815435853207ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065219.417633:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1077, 88 off102616 00000004:00080000:3.0:1746065219.417636:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815435862252ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065219.417642:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1093, 88 off104024 00000004:00080000:3.0:1746065219.417644:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815435870593ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065219.417650:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1078, 88 off102704 00000004:00080000:3.0:1746065219.417652:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815435878508ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065219.417659:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1094, 88 off104112 00000004:00080000:3.0:1746065219.417661:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815435887502ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065219.417668:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1079, 88 off102792 00000004:00080000:3.0:1746065219.417670:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815435896534ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065219.417677:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1080, 88 off102880 00000004:00080000:3.0:1746065219.417679:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815435905978ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065219.417686:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1081, 88 off102968 00000004:00080000:3.0:1746065219.417690:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815435916466ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065219.417696:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1082, 88 off103056 00000004:00080000:3.0:1746065219.417699:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815435925268ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065219.417705:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1095, 88 off104200 00000004:00080000:3.0:1746065219.417708:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 815435934113ns, next at 761143559853ns, rc = 0 00000100:00100000:3.0:1746065219.417804:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881265435904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 642us (3947us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.417810:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8227 00000100:00100000:0.0:1746065219.418359:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265436032 00000100:00100000:0.0:1746065219.418364:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265436032 00000100:00100000:0.0:1746065219.418387:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14607 00000100:00100000:0.0:1746065219.418391:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2558:x1830881265436032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065219.418405:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.418415:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399dc expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.418447:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065219.418455:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 4/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.418466:0:7203:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065219.418476:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.418484:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065219.418486:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065219.418489:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.418494:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06800, rc 0) 00000100:00100000:0.0:1746065219.418515:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2558:x1830881265436032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 124us (4698us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.418520:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14607 00000100:00100000:3.0:1746065219.423286:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265434880:12345-192.168.202.27@tcp:3:cat.0 Request processed in 57398us (60133us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065219.423297:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6299 00002000:00100000:3.0:1746065219.423307:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009577f100 x1830881265434880/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.423315:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577f100 with x1830881265434880 ext(1048576->2097151) 00002000:00010000:3.0:1746065219.423320:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577f100 00000100:00100000:2.0:1746065219.424381:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.424505:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265435136:12345-192.168.202.27@tcp:3:cat.0 Request processed in 57085us (61348us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065219.424514:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6300 00002000:00100000:1.0:1746065219.424522:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009577c000 x1830881265435136/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065219.424529:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577c000 with x1830881265435136 ext(1048576->2097151) 00002000:00010000:1.0:1746065219.424533:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577c000 00000100:00100000:1.0:1746065219.424554:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265436160 00000100:00100000:1.0:1746065219.424560:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265436160 00000100:00100000:1.0:1746065219.424589:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14608 00000100:00100000:1.0:1746065219.424594:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2557:x1830881265436160:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065219.424610:0:9571:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065219.424625:0:9571:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399e3 expref: -99 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.424668:0:9571:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 33 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.424678:0:9571:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 33 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.424689:0:9571:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065219.424691:0:9571:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065219.424694:0:9571:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.424700:0:9571:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b400, rc 0) 00000100:00100000:1.0:1746065219.424714:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2557:x1830881265436160:12345-192.168.202.27@tcp:101:cat.0 Request processed in 120us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.424719:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14608 00000001:00080000:1.0:1746065219.427605:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937130 is committed 00000004:00080000:1.0:1746065219.427613:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1074 committed 00000004:00080000:1.0:1746065219.428677:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1063 committed 00000004:00080000:1.0:1746065219.428784:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1062 committed 00000004:00080000:1.0:1746065219.428786:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1061 committed 00000004:00080000:1.0:1746065219.428788:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1060 committed 00000004:00080000:1.0:1746065219.428790:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1073 committed 00000004:00080000:1.0:1746065219.428791:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1059 committed 00000004:00080000:1.0:1746065219.428793:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1072 committed 00000004:00080000:1.0:1746065219.428794:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1058 committed 00000004:00080000:1.0:1746065219.428796:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1071 committed 00000004:00080000:1.0:1746065219.428797:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1070 committed 00000004:00080000:1.0:1746065219.428798:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1069 committed 00000004:00080000:1.0:1746065219.428800:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1057 committed 00000004:00080000:1.0:1746065219.428801:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1056 committed 00000004:00080000:1.0:1746065219.428803:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1068 committed 00000004:00080000:1.0:1746065219.428804:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1067 committed 00000004:00080000:1.0:1746065219.428805:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1055 committed 00000001:00080000:1.0:1746065219.428813:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937129 is committed 00000001:00080000:1.0:1746065219.428819:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937125 is committed 00000100:00100000:1.0:1746065219.428842:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264001408:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065219.428888:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.429008:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264001280:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746065219.429070:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399d5 expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.429080:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.429083:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065219.429086:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.429099:0:7205:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.429104:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.429109:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.429114:0:7205:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.429119:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.429138:0:7205:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 30 pid: 9571 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065219.429146:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264002432:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065219.429209:0:7205:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065219.429216:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dda680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264002560:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065219.429233:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065219.429407:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264001920:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065219.429424:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065219.429445:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264001664:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065219.429461:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065219.429472:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264002176:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065219.429484:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065219.429495:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746065219.429499:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264001536:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065219.429511:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065219.429532:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264002048:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065219.429548:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065219.429621:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265435392:12345-192.168.202.27@tcp:3:cat.0 Request processed in 61234us (65165us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065219.429629:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6301 00002000:00100000:1.0:1746065219.429637:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009577e680 x1830881265435392/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065219.429645:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577e680 with x1830881265435392 ext(1048576->2097151) 00002000:00010000:1.0:1746065219.429648:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577e680 00000100:00100000:1.0:1746065219.429671:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264001408 00000100:00100000:1.0:1746065219.429677:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264001408 00000100:00100000:1.0:1746065219.429705:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264001920 00000100:00100000:1.0:1746065219.429707:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264001920 00000100:00100000:1.0:1746065219.429718:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264001664 00000100:00100000:1.0:1746065219.429720:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264001664 00000100:00100000:1.0:1746065219.429729:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264002176 00000100:00100000:1.0:1746065219.429730:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264002176 00000100:00100000:1.0:1746065219.429738:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264001536 00000100:00100000:1.0:1746065219.429739:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264001536 00000100:00100000:1.0:1746065219.429746:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264002048 00000100:00100000:1.0:1746065219.429747:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264002048 00000100:00100000:1.0:1746065219.429754:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17585 00000100:00100000:1.0:1746065219.429758:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3760:x1830881264001408:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065219.429876:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065219.429879:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065218 -> 1746065218 00002000:00010000:1.0:1746065219.429880:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065215 -> 1746065215 00002000:00010000:1.0:1746065219.429882:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065218 -> 1746065218 00002000:00010000:1.0:1746065219.429884:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065219.429908:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881264001408:12345-0@lo:2:osp-syn-0-0.0 Request processed in 149us (1020us total) trans 21474841701 rc 0/0 00000100:00100000:1.0:1746065219.429914:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17585 00000100:00100000:1.0:1746065219.429925:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17586 00000100:00100000:1.0:1746065219.429930:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3760:x1830881264001920:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065219.429967:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746065219.429969:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065219.429971:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065219.429972:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065219.429974:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:1.0:1746065219.429990:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881264001920:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (565us total) trans 21474841702 rc 0/0 00000100:00100000:1.0:1746065219.429996:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17586 00000100:00100000:1.0:1746065219.430005:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17587 00000100:00100000:1.0:1746065219.430009:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881264001664:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065219.430057:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065219.430059:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065217 -> 1746065217 00002000:00010000:1.0:1746065219.430061:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065217 -> 1746065217 00002000:00010000:1.0:1746065219.430063:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065217 -> 1746065217 00002000:00010000:1.0:1746065219.430064:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 1912 -> 1912 00000100:00100000:1.0:1746065219.430084:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+15:3762:x1830881264001664:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (622us total) trans 17179874313 rc 0/0 00000100:00100000:1.0:1746065219.430089:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17587 00000100:00100000:1.0:1746065219.430098:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17588 00000100:00100000:1.0:1746065219.430103:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3762:x1830881264002176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065219.430151:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3762:x1830881264002176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (665us total) trans 21474841703 rc 0/0 00000100:00100000:1.0:1746065219.430156:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17588 00000100:00100000:1.0:1746065219.430165:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17589 00000100:00100000:1.0:1746065219.430169:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3762:x1830881264001536:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065219.430203:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065219.430205:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065219 -> 1746065219 00002000:00010000:1.0:1746065219.430206:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065219 -> 1746065219 00002000:00010000:1.0:1746065219.430208:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065219 -> 1746065219 00002000:00010000:1.0:1746065219.430209:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746065219.430225:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3762:x1830881264001536:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (713us total) trans 21474841704 rc 0/0 00000100:00100000:1.0:1746065219.430230:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17589 00000100:00100000:1.0:1746065219.430239:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17590 00000100:00100000:1.0:1746065219.430242:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+33:3762:x1830881264002048:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065219.430276:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:1.0:1746065219.430278:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065219.430280:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065219.430281:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065219.430283:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:1.0:1746065219.430299:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+34:3762:x1830881264002048:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (751us total) trans 21474841705 rc 0/0 00000100:00100000:1.0:1746065219.430304:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17590 00000004:00080000:1.0:1746065219.430351:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd9180/2, rc 0, transno 21474841704 00000100:00100000:1.0:1746065219.430356:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264001536:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065219.430365:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd9c00/2, rc 0, transno 21474841705 00000100:00100000:1.0:1746065219.430368:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264002048:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065219.430375:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f0000/2, rc 0, transno 17179874313 00000100:00100000:1.0:1746065219.430378:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264001664:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065219.430385:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dda300/2, rc 0, transno 21474841703 00000100:00100000:1.0:1746065219.430387:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dda300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264002176:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065219.430400:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098ddaa00/2, rc 0, transno 21474841702 00000100:00100000:1.0:1746065219.430402:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264001920:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065219.430409:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd8a80/2, rc 0, transno 21474841701 00000100:00100000:1.0:1746065219.430412:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264001408:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065219.430899:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264002816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065219.430923:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.430937:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264003328:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065219.430950:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.430961:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065219.430965:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264002944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065219.430977:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.430987:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264003456:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065219.430999:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.431016:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264002816 00000100:00100000:2.0:1746065219.431019:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264002816 00000100:00100000:2.0:1746065219.431036:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264003328 00000100:00100000:2.0:1746065219.431037:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264003328 00000100:00100000:2.0:1746065219.431045:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264002944 00000100:00100000:2.0:1746065219.431046:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264002944 00000100:00100000:2.0:1746065219.431052:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264003456 00000100:00100000:2.0:1746065219.431054:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264003456 00000100:00100000:2.0:1746065219.431060:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17591 00000100:00100000:2.0:1746065219.431064:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881264002816:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065219.431107:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00002000:00010000:2.0:1746065219.431109:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065219 -> 1746065219 00002000:00010000:2.0:1746065219.431111:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065219 -> 1746065219 00002000:00010000:2.0:1746065219.431112:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065219 -> 1746065219 00002000:00010000:2.0:1746065219.431114:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00000100:00100000:0.0:1746065219.431261:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17592 00000100:00100000:0.0:1746065219.431267:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881264003328:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065219.431294:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881264002816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 229us (370us total) trans 17179874314 rc 0/0 00000100:00100000:2.0:1746065219.431300:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17591 00002000:00010000:0.0:1746065219.431308:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:2.0:1746065219.431310:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17593 00002000:00010000:0.0:1746065219.431310:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065219.431312:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746065219.431314:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881264002944:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065219.431314:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065219.431316:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:0.0:1746065219.431349:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881264003328:12345-0@lo:2:osp-syn-1-0.0 Request processed in 82us (397us total) trans 17179874315 rc 0/0 00000100:00100000:2.0:1746065219.431371:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3761:x1830881264002944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (393us total) trans 17179874316 rc 0/0 00000100:00100000:2.0:1746065219.431375:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17593 00000100:00100000:2.0:1746065219.431384:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17594 00000100:00100000:2.0:1746065219.431388:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881264003456:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065219.431420:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:2.0:1746065219.431422:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065219.431424:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065219.431425:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065219.431427:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:0.0:1746065219.431429:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17592 00000100:00100000:2.0:1746065219.431442:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881264003456:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (442us total) trans 17179874317 rc 0/0 00000100:00100000:2.0:1746065219.431446:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17594 00000004:00080000:2.0:1746065219.431468:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3b80/2, rc 0, transno 17179874316 00000100:00100000:2.0:1746065219.431471:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264002944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065219.431476:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1880/2, rc 0, transno 17179874317 00000100:00100000:2.0:1746065219.431478:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264003456:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065219.431484:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f0e00/2, rc 0, transno 17179874314 00000100:00100000:2.0:1746065219.431486:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264002816:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065219.431491:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f2d80/2, rc 0, transno 17179874315 00000100:00100000:2.0:1746065219.431493:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264003328:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.431928:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.431955:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264001792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065219.431975:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.431986:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264002304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065219.431998:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.432010:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264003072:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.432023:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.432032:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264003584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.432043:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.432053:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065219.432056:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264002688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.432070:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.432080:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264003200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.432091:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.432107:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264001280 00000100:00100000:3.0:1746065219.432110:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264001280 00000100:00100000:3.0:1746065219.432137:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264001792 00000100:00100000:3.0:1746065219.432139:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264001792 00000100:00100000:3.0:1746065219.432147:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264002304 00000100:00100000:3.0:1746065219.432148:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264002304 00000100:00100000:3.0:1746065219.432153:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264003072 00000100:00100000:3.0:1746065219.432154:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264003072 00000100:00100000:3.0:1746065219.432159:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264003584 00000100:00100000:3.0:1746065219.432161:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264003584 00000100:00100000:3.0:1746065219.432166:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264002688 00000100:00100000:3.0:1746065219.432168:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264002688 00000100:00100000:3.0:1746065219.432173:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264003200 00000100:00100000:3.0:1746065219.432174:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264003200 00000100:00100000:3.0:1746065219.432180:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17595 00000100:00100000:3.0:1746065219.432184:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881264001280:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065219.432207:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17596 00000100:00100000:0.0:1746065219.432211:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881264001792:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065219.432234:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065219.432237:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065218 -> 1746065218 00002000:00010000:3.0:1746065219.432238:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065217 -> 1746065217 00002000:00010000:3.0:1746065219.432240:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065218 -> 1746065218 00002000:00010000:0.0:1746065219.432240:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065219.432242:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:0.0:1746065219.432242:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065219.432244:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065219.432245:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065219.432247:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:3.0:1746065219.432263:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+38:3759:x1830881264001280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 78us (335us total) trans 21474841706 rc 0/0 00000100:00100000:0.0:1746065219.432263:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3759:x1830881264001792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (286us total) trans 21474841707 rc 0/0 00000100:00100000:0.0:1746065219.432267:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17596 00000004:00080000:0.0:1746065219.432288:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098ddb800/2, rc 0, transno 21474841706 00000100:00100000:0.0:1746065219.432291:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264001280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065219.432297:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd9880/2, rc 0, transno 21474841707 00000100:00100000:0.0:1746065219.432299:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264001792:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065219.432434:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17595 00000100:00100000:3.0:1746065219.432445:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17597 00000100:00100000:3.0:1746065219.432450:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881264002304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065219.432513:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3759:x1830881264002304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (513us total) trans 21474841708 rc 0/0 00000100:00100000:3.0:1746065219.432517:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17597 00000100:00100000:3.0:1746065219.432526:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17598 00000100:00100000:3.0:1746065219.432530:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881264003072:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065219.432565:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065219.432567:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065219.432569:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065219.432571:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065219.432572:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065219.432588:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881264003072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (565us total) trans 17179874318 rc 0/0 00000100:00100000:3.0:1746065219.432593:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17598 00000100:00100000:3.0:1746065219.432602:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17599 00000100:00100000:3.0:1746065219.432606:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881264003584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.432654:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881264003584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (609us total) trans 17179874319 rc 0/0 00000100:00100000:3.0:1746065219.432659:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17599 00000100:00100000:3.0:1746065219.432667:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17600 00000100:00100000:3.0:1746065219.432671:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881264002688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065219.432705:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065219.432707:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065218 -> 1746065218 00002000:00010000:3.0:1746065219.432709:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065215 -> 1746065215 00002000:00010000:3.0:1746065219.432711:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065218 -> 1746065218 00002000:00010000:3.0:1746065219.432712:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065219.432728:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881264002688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (656us total) trans 17179874320 rc 0/0 00000100:00100000:3.0:1746065219.432733:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17600 00000100:00100000:3.0:1746065219.432741:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17601 00000100:00100000:3.0:1746065219.432744:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881264003200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065219.432811:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881264003200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (719us total) trans 17179874321 rc 0/0 00000100:00100000:3.0:1746065219.432816:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17601 00000004:00080000:0.0:1746065219.433031:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1f80/2, rc 0, transno 17179874320 00000100:00100000:0.0:1746065219.433035:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264002688:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065219.433042:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f0a80/2, rc 0, transno 17179874321 00000100:00100000:0.0:1746065219.433044:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264003200:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065219.433049:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1500/2, rc 0, transno 17179874318 00000100:00100000:0.0:1746065219.433052:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264003072:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065219.433057:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3100/2, rc 0, transno 17179874319 00000100:00100000:0.0:1746065219.433059:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264003584:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065219.433065:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd9f80/2, rc 0, transno 21474841708 00000100:00100000:0.0:1746065219.433068:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264002304:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065219.434963:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.435003:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265436288 00000100:00100000:0.0:1746065219.435009:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265436288 00000100:00100000:3.0:1746065219.435038:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264002432:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065219.435047:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dda680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264002560:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065219.435048:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5487 00000100:00100000:0.0:1746065219.435053:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2557:x1830881265436288:12345-192.168.202.27@tcp:49:cat.0 00010000:00010000:3.0:1746065219.435075:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d600/0xad6b7ddc1479d40 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399d5 expref: 31 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065219.435101:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399d5 expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.435116:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ca00, rc 0) 00000100:00100000:0.0:1746065219.435128:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2557:x1830881265436288:12345-192.168.202.27@tcp:49:cat.0 Request processed in 74us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.435130:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2554:x1830881265435648:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 43260us (44287us total) trans 8589937130 rc 0/0 00000100:00100000:0.0:1746065219.435133:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5487 00000100:00100000:3.0:1746065219.435135:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14606 00000100:00100000:0.0:1746065219.438113:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.438168:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265436416 00000100:00100000:2.0:1746065219.438175:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265436416 00000100:00100000:2.0:1746065219.438220:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5488 00000100:00100000:2.0:1746065219.438227:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2558:x1830881265436416:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:2.0:1746065219.438324:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2558:x1830881265436416:12345-192.168.202.27@tcp:49:cat.0 Request processed in 97us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.438337:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5488 00000100:00100000:0.0:1746065219.452598:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.456287:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265436544 00000100:00100000:2.0:1746065219.456297:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265436544 00000100:00100000:2.0:1746065219.456347:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17602 00000100:00100000:2.0:1746065219.456353:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2554:x1830881265436544:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065219.456367:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.456379:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399ea expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.456403:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 34 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.456410:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1479cec lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939996 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.456415:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.456417:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.456419:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 5/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1695744->2080767] (req 1695744->2080767) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 34 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.456442:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1479cec lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939996 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.456455:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1479cec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939996 expref: 13 pid: 9548 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746065219.456465:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264003712:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.456556:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 34 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.456565:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 34 pid: 9549 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746065219.456572:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264003840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.456589:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065219.462967:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.463004:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.463030:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.463063:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.463091:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.463155:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265436800 00000100:00100000:2.0:1746065219.463162:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265436800 00002000:00100000:2.0:1746065219.463195:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009577ca80 x1830881265436800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.463204:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ca80 with x1830881265436800 ext(1048576->2097151) 00010000:00010000:2.0:1746065219.463211:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 35 pid: 9549 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746065219.463221:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 35 pid: 9549 timeout: 915 lvb_type: 1 00002000:00010000:2.0:1746065219.463228:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009577ca80 00000100:00100000:2.0:1746065219.463251:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265436928 00000100:00100000:2.0:1746065219.463253:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265436928 00002000:00100000:2.0:1746065219.463264:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009577dc00 x1830881265436928/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.463271:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577dc00 with x1830881265436928 ext(1048576->2097151) 00002000:00010000:2.0:1746065219.463274:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577dc00 00000100:00100000:2.0:1746065219.463282:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265437312 00000100:00100000:2.0:1746065219.463285:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265437312 00002000:00100000:2.0:1746065219.463297:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012edaf100 x1830881265437312/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.463303:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf100 with x1830881265437312 ext(1048576->2097151) 00002000:00010000:2.0:1746065219.463305:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf100 00000100:00100000:2.0:1746065219.463314:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265437568 00000100:00100000:2.0:1746065219.463316:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265437568 00002000:00100000:2.0:1746065219.463334:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012edac380 x1830881265437568/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.463341:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac380 with x1830881265437568 ext(1048576->2097151) 00002000:00010000:2.0:1746065219.463343:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac380 00000100:00100000:2.0:1746065219.463355:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2076 00000100:00100000:2.0:1746065219.463361:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265436800:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065219.463932:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6302 00000100:00100000:2.0:1746065219.463938:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265436928:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065219.464437:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6303 00000100:00100000:2.0:1746065219.464442:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265437312:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065219.464591:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6304 00000100:00100000:3.0:1746065219.464598:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265437568:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065219.467143:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265437696 00000100:00100000:1.0:1746065219.467153:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265437696 00010000:00010000:1.0:1746065219.467185:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1479cec lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939996 expref: 14 pid: 9548 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.467225:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8228 00000100:00100000:1.0:1746065219.467231:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265437696:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065219.467242:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065219.467256:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1479cec lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939996 expref: 14 pid: 9548 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746065219.467266:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1479cec lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939996 expref: 14 pid: 9548 timeout: 915 lvb_type: 1 00010000:00010000:1.0:1746065219.467286:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065219.467339:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265437696:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (4247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.467345:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8228 00010000:00010000:1.0:1746065219.467404:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc1479cec lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939996 expref: 13 pid: 9548 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.467418:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264003712:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065219.467429:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264003840:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065219.467449:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1695744->2080767] (req 1695744->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 38 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.467458:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31400, rc 0) 00000100:00100000:1.0:1746065219.467475:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2554:x1830881265436544:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11122us (14887us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.467481:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17602 00000100:00100000:2.0:1746065219.481123:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265436800:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 17754us (18156us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065219.481133:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2076 00002000:00100000:2.0:1746065219.481143:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009577ca80 x1830881265436800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.481151:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577ca80 with x1830881265436800 ext(1048576->2097151) 00010000:00010000:2.0:1746065219.481159:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 36 pid: 9549 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746065219.481171:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 36 pid: 9549 timeout: 915 lvb_type: 1 00002000:00010000:2.0:1746065219.481177:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009577ca80 00000100:00100000:1.0:1746065219.503987:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.504060:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265437824 00000100:00100000:3.0:1746065219.504068:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265437824 00010000:00010000:3.0:1746065219.504096:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 36 pid: 9549 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746065219.504232:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8229 00000100:00100000:3.0:1746065219.504241:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265437824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.504252:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.504269:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 36 pid: 9549 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746065219.504280:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 36 pid: 9549 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746065219.504299:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f45c00/0xad6b7ddc1479cbb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93996c expref: 36 pid: 9549 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746065219.504337:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.504340:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065219.504346:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 35 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.504353:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 35 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.504378:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 35 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065219.504387:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264003968:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065219.504453:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065219.504801:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265436928:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 40861us (41794us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065219.504809:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6302 00002000:00100000:2.0:1746065219.504816:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009577dc00 x1830881265436928/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.504825:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577dc00 with x1830881265436928 ext(1048576->2097151) 00002000:00010000:2.0:1746065219.504829:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009577dc00 00000100:00100000:3.0:1746065219.509151:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265437568:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 44546us (46079us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065219.509161:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6304 00002000:00100000:3.0:1746065219.509171:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012edac380 x1830881265437568/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.509179:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac380 with x1830881265437568 ext(1048576->2097151) 00002000:00010000:3.0:1746065219.509183:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac380 00000100:00100000:2.0:1746065219.512825:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265437312:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 48374us (49785us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065219.512835:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6303 00002000:00100000:2.0:1746065219.512844:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012edaf100 x1830881265437312/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.512852:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf100 with x1830881265437312 ext(1048576->2097151) 00002000:00010000:2.0:1746065219.512857:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf100 00000100:00100000:3.0:1746065219.513588:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264003968:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065219.513604:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065219.513897:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265437824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9657us (9916us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.513905:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8229 00000100:00100000:0.0:1746065219.514182:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.514296:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265438080 00000100:00100000:3.0:1746065219.514302:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265438080 00002000:00100000:3.0:1746065219.514336:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1695744->1699839) req@ffff88009834c000 x1830881265438080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.514344:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834c000 with x1830881265438080 ext(1695744->1699839) 00002000:00010000:3.0:1746065219.514347:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834c000 00000100:00100000:3.0:1746065219.514369:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6305 00000100:00100000:3.0:1746065219.514375:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265438080:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065219.514469:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265438080:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 93us (287us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065219.514474:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6305 00002000:00100000:3.0:1746065219.514479:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1695744->1699839) req@ffff88009834c000 x1830881265438080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/4536 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.514486:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834c000 with x1830881265438080 ext(1695744->1699839) 00002000:00010000:3.0:1746065219.514488:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834c000 00000100:00100000:0.0:1746065219.521010:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.521062:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.521145:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.521180:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265438208 00000100:00100000:0.0:1746065219.521194:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265438208 00000100:00100000:0.0:1746065219.521252:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265438592 00000100:00100000:0.0:1746065219.521254:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265438592 00000100:00100000:0.0:1746065219.521269:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17603 00000100:00100000:0.0:1746065219.521287:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265438208:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065219.521319:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.521348:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc1479d63 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399f1 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.521389:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264004096:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065219.521455:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b22040c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065219.521471:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17604 00000100:00100000:0.0:1746065219.521475:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2555:x1830881265438592:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065219.521481:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.521488:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399f8 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.521502:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1479cfa lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93997a expref: 40 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.521509:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1479d01 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399a4 expref: 21 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.521514:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.521516:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.521519:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [2052096->2097151] (req 2052096->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.521535:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1479d01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399a4 expref: 21 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.521544:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1479d01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399a4 expref: 21 pid: 11461 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746065219.521553:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264004224:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065219.521579:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1479cfa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93997a expref: 40 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.521586:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1479cfa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93997a expref: 40 pid: 11461 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746065219.521593:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264004352:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065219.521608:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065219.521700:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265438464 00000100:00100000:2.0:1746065219.521705:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265438464 00002000:00100000:2.0:1746065219.521728:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (2076672->2080767) req@ffff88009834fb80 x1830881265438464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.521736:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834fb80 with x1830881265438464 ext(2076672->2080767) 00002000:00010000:2.0:1746065219.521739:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834fb80 00000100:00100000:2.0:1746065219.521750:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6306 00000100:00100000:2.0:1746065219.521755:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265438464:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065219.521876:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265438464:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 119us (813us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065219.521882:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6306 00002000:00100000:2.0:1746065219.521886:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (2076672->2080767) req@ffff88009834fb80 x1830881265438464/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/4536 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.521892:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834fb80 with x1830881265438464 ext(2076672->2080767) 00002000:00010000:2.0:1746065219.521895:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834fb80 00000100:00100000:2.0:1746065219.525742:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264004224:192.168.202.27@tcp:104: 00002000:00010000:1.0:1746065219.526031:0:13375:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065218 -> 1746065219 00002000:00010000:1.0:1746065219.526034:0:13375:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065217 -> 1746065219 00002000:00010000:1.0:1746065219.526036:0:13375:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065218 -> 1746065219 00000100:00100000:1.0:1746065219.526048:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264004096:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065219.526099:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065219.526176:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc1479d63 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f1 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.526187:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc1479d63 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f1 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.526205:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f400, rc 0) 00000100:00100000:3.0:1746065219.526291:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265438720 00000100:00100000:3.0:1746065219.526297:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265438720 00010000:00010000:3.0:1746065219.526320:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1479d01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399a4 expref: 22 pid: 11461 timeout: 915 lvb_type: 1 00000100:00100000:3.0:1746065219.526377:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8230 00000100:00100000:3.0:1746065219.526384:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265438720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065219.526394:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065219.526405:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1479d01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399a4 expref: 22 pid: 11461 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746065219.526413:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1479d01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399a4 expref: 22 pid: 11461 timeout: 915 lvb_type: 1 00010000:00010000:3.0:1746065219.526428:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1c00/0xad6b7ddc1479d01 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399a4 expref: 22 pid: 11461 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746065219.526468:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264004352:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.526483:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [2052096->2097151] (req 2052096->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.526497:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fc00, rc 0) 00010000:00010000:3.0:1746065219.526543:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065219.526582:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265438208:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5296us (5580us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065219.526588:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17603 00000100:00100000:0.0:1746065219.526889:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.526910:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.526920:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265438976 00000100:00100000:0.0:1746065219.526923:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265438976 00010000:00010000:0.0:1746065219.526934:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1479cfa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93997a expref: 41 pid: 11461 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746065219.526952:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8231 00000100:00100000:0.0:1746065219.526956:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265438976:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065219.526961:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.526967:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1479cfa lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93997a expref: 41 pid: 11461 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.526974:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1479cfa lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93997a expref: 41 pid: 11461 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.526985:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc1479cfa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93997a expref: 41 pid: 11461 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.526995:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.526996:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.527001:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.527007:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.527028:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.527036:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264004480:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065219.527113:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265438848 00000100:00100000:1.0:1746065219.527116:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265438848 00000100:00100000:1.0:1746065219.527295:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17605 00000100:00100000:1.0:1746065219.527301:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+41:2557:x1830881265438848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065219.527310:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065219.527318:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd9399ff expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.527339:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.527343:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065219.527344:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065219.527346:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.527360:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.527367:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 6/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 21 pid: 1880 timeout: 915 lvb_type: 0 00000100:00100000:1.0:1746065219.527379:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881264004608:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065219.528060:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065219.528117:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2555:x1830881265438592:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6639us (6970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.528123:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17604 00000100:00100000:3.0:1746065219.528856:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265438720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2471us (2756us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.528863:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8230 00000100:00100000:1.0:1746065219.529239:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065219.531762:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264004480:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065219.531877:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065219.532809:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265438976:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5848us (5893us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.532818:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8231 00000100:00100000:3.0:1746065219.533247:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.533274:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265439232 00000100:00100000:3.0:1746065219.533280:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265439232 00002000:00100000:3.0:1746065219.533312:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (2052096->2056191) req@ffff88009a6df100 x1830881265439232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.533320:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df100 with x1830881265439232 ext(2052096->2056191) 00010000:00010000:3.0:1746065219.533337:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 20 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.533349:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 20 pid: 1880 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746065219.533355:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6df100 00000100:00100000:3.0:1746065219.533369:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2077 00000100:00100000:3.0:1746065219.533375:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265439232:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065219.533512:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265439232:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 137us (266us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065219.533521:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2077 00002000:00100000:3.0:1746065219.533526:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (2052096->2056191) req@ffff88009a6df100 x1830881265439232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/4536 e 0 to 0 dl 1746065230 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.533532:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009a6df100 with x1830881265439232 ext(2052096->2056191) 00010000:00010000:3.0:1746065219.533537:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 20 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.533546:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 20 pid: 1880 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746065219.533551:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009a6df100 00000100:00100000:1.0:1746065219.534284:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881264004608:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065219.534304:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 41 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.534316:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd600, rc 0) 00000100:00100000:1.0:1746065219.534348:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+41:2557:x1830881265438848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7047us (7459us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.534355:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17605 00000100:00100000:0.0:1746065219.538847:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.538931:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265439488 00000100:00100000:3.0:1746065219.538938:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265439488 00002000:00100000:3.0:1746065219.538972:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (2052096->2097151) req@ffff88009834f480 x1830881265439488/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.538981:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f480 with x1830881265439488 ext(2052096->2097151) 00010000:00010000:3.0:1746065219.538989:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 20 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.539001:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 20 pid: 1880 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746065219.539007:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009834f480 00000100:00100000:3.0:1746065219.539026:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2078 00000100:00100000:3.0:1746065219.539033:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265439488:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065219.546858:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265439488:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7816us (8008us total) trans 17179874322 rc 0/0 00000100:00100000:3.0:1746065219.546869:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2078 00002000:00100000:3.0:1746065219.546879:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (2052096->2097151) req@ffff88009834f480 x1830881265439488/t17179874322(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/448 e 0 to 0 dl 1746065230 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.546888:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f480 with x1830881265439488 ext(2052096->2097151) 00010000:00010000:3.0:1746065219.546897:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 22 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:3.0:1746065219.546912:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 22 pid: 1880 timeout: 915 lvb_type: 0 00002000:00010000:3.0:1746065219.546918:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009834f480 00000100:00100000:0.0:1746065219.550694:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.550803:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265439616 00000100:00100000:2.0:1746065219.550810:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265439616 00010000:00010000:2.0:1746065219.550840:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 22 pid: 1880 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.550877:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8232 00000100:00100000:2.0:1746065219.550884:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265439616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065219.550895:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065219.550907:0:7192:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065218 -> 1746065219 00002000:00010000:2.0:1746065219.550910:0:7192:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065218 -> 1746065219 00010000:00010000:2.0:1746065219.550915:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 22 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746065219.550925:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 22 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746065219.550950:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc1479d6a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2052096->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399f8 expref: 22 pid: 1880 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746065219.550969:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.550971:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.550976:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 40 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.550983:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 40 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.551009:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 40 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065219.551019:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264004736:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065219.551090:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065219.556110:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264004736:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065219.556127:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065219.556168:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265439616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5284us (5480us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.556177:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8232 00000100:00100000:1.0:1746065219.556446:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.557183:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265439872 00000100:00100000:3.0:1746065219.557189:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265439872 00002000:00100000:3.0:1746065219.557219:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009077f100 x1830881265439872/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.557228:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f100 with x1830881265439872 ext(2097152->4194303) 00002000:00010000:3.0:1746065219.557232:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077f100 00000100:00100000:3.0:1746065219.557431:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6307 00000100:00100000:3.0:1746065219.557438:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265439872:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065219.559984:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.560045:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265440128 00000100:00100000:0.0:1746065219.560050:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265440128 00002000:00100000:0.0:1746065219.560078:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009077ca80 x1830881265440128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.560086:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ca80 with x1830881265440128 ext(2097152->4194303) 00002000:00010000:0.0:1746065219.560090:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077ca80 00000100:00100000:0.0:1746065219.560113:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6308 00000100:00100000:0.0:1746065219.560118:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265440128:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065219.575463:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.582049:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265440384 00000100:00100000:3.0:1746065219.582059:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265440384 00002000:00100000:3.0:1746065219.582096:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009077e300 x1830881265440384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.582111:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077e300 with x1830881265440384 ext(1048576->2097151) 00002000:00010000:3.0:1746065219.582115:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077e300 00000100:00100000:3.0:1746065219.582135:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6309 00000100:00100000:3.0:1746065219.582140:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265440384:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065219.593216:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265439872:12345-192.168.202.27@tcp:3:cat.0 Request processed in 35771us (36763us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065219.593227:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6307 00002000:00100000:3.0:1746065219.593237:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009077f100 x1830881265439872/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.593245:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077f100 with x1830881265439872 ext(2097152->4194303) 00002000:00010000:3.0:1746065219.593250:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077f100 00000100:00100000:2.0:1746065219.601331:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265440128:12345-192.168.202.27@tcp:3:cat.0 Request processed in 41196us (41337us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065219.601341:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6308 00002000:00100000:2.0:1746065219.601351:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009077ca80 x1830881265440128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.601360:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ca80 with x1830881265440128 ext(2097152->4194303) 00002000:00010000:2.0:1746065219.601365:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009077ca80 00000100:00100000:3.0:1746065219.604006:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265440384:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 21858us (28543us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065219.604016:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6309 00002000:00100000:3.0:1746065219.604025:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009077e300 x1830881265440384/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.604032:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077e300 with x1830881265440384 ext(1048576->2097151) 00002000:00010000:3.0:1746065219.604036:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077e300 00000100:00100000:0.0:1746065219.609078:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.615547:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265440512 00000100:00100000:1.0:1746065219.615559:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265440512 00000100:00100000:1.0:1746065219.615620:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17606 00000100:00100000:1.0:1746065219.615628:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2555:x1830881265440512:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065219.615644:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065219.615659:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a06 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.615685:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 40 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.615696:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1479d08 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b2 expref: 22 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.615701:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.615703:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065219.615706:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.615731:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1479d08 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b2 expref: 22 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.615742:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1479d08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b2 expref: 22 pid: 11461 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.615753:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881264004864:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065219.615862:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 40 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065219.615869:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 40 pid: 9548 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.615876:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881264004992:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065219.615897:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065219.624098:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.624129:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.624158:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.624193:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.624230:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265440640 00000100:00100000:0.0:1746065219.624237:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265440640 00000100:00100000:0.0:1746065219.624266:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265440768 00000100:00100000:0.0:1746065219.624268:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265440768 00000100:00100000:0.0:1746065219.624277:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265440896 00000100:00100000:0.0:1746065219.624279:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265440896 00000100:00100000:0.0:1746065219.624291:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17607 00000100:00100000:0.0:1746065219.624298:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265440640:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065219.624314:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.624336:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1479d7f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a0d expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.624378:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264005120:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065219.624438:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065219.624451:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265441024 00000100:00100000:0.0:1746065219.624453:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265441024 00010000:00010000:0.0:1746065219.624465:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1479d08 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b2 expref: 25 pid: 11461 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746065219.624480:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8233 00000100:00100000:0.0:1746065219.624484:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265441024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065219.624494:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.624509:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1479d08 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b2 expref: 25 pid: 11461 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.624518:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1479d08 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b2 expref: 25 pid: 11461 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.624534:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065219.624550:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2007:x1830881265441024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 65us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.624556:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8233 00000100:00100000:0.0:1746065219.624627:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17608 00000100:00100000:0.0:1746065219.624632:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881265440768:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065219.624638:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.624645:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc1479d86 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a14 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.624655:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.624657:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.624662:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc1479d86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a14 expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.624672:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc1479d86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a14 expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.624679:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f400, rc 0) 00000100:00100000:0.0:1746065219.624698:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265440768:12345-192.168.202.27@tcp:101:cat.0 Request processed in 66us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.624704:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17608 00000100:00100000:0.0:1746065219.624715:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17609 00000100:00100000:0.0:1746065219.624719:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881265440896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065219.624725:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.624729:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc1479d8d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a1b expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.624738:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.624743:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc1479d8d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a1b expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.624750:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc1479d8d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a1b expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.624763:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fe00, rc 0) 00000100:00100000:0.0:1746065219.624802:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881265440896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 82us (644us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065219.624807:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17609 00010000:00010000:1.0:1746065219.624948:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc1479d08 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b2 expref: 23 pid: 11461 timeout: 915 lvb_type: 1 00000100:00100000:1.0:1746065219.624965:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881264004864:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065219.624975:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881264004992:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065219.624992:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.625000:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3ddc00, rc 0) 00000100:00100000:1.0:1746065219.625018:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2555:x1830881265440512:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9391us (15950us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.625023:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17606 00000100:00100000:2.0:1746065219.627400:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264005120:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065219.627426:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1479d7f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a0d expref: 14 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.627436:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc1479d7f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a0d expref: 14 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.627461:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fc00, rc 0) 00000100:00100000:2.0:1746065219.627501:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265440640:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3203us (3410us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065219.627508:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17607 00000100:00100000:0.0:1746065219.629736:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.629810:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265441152 00000100:00100000:2.0:1746065219.629816:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265441152 00000100:00100000:2.0:1746065219.629863:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17610 00000100:00100000:2.0:1746065219.629870:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2558:x1830881265441152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.629884:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.629896:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc1479d94 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a22 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.629915:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.629918:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.629924:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc1479d94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2670592->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a22 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.629940:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc1479d94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2670592->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a22 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.629948:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdac00, rc 0) 00000100:00100000:2.0:1746065219.629978:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2558:x1830881265441152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 109us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.629984:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17610 00000100:00100000:0.0:1746065219.633981:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.634062:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265441408 00000100:00100000:3.0:1746065219.634070:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265441408 00002000:00100000:3.0:1746065219.634104:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009834f100 x1830881265441408/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.634112:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f100 with x1830881265441408 ext(4194304->5038079) 00002000:00010000:3.0:1746065219.634117:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834f100 00000100:00100000:3.0:1746065219.634512:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6310 00000100:00100000:3.0:1746065219.634519:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265441408:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065219.640021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.640648:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.640734:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265441792 00000100:00100000:2.0:1746065219.640742:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265441792 00002000:00100000:2.0:1746065219.640799:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009834e300 x1830881265441792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.640808:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834e300 with x1830881265441792 ext(2097152->4194303) 00002000:00010000:2.0:1746065219.640813:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834e300 00000100:00100000:2.0:1746065219.640832:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265441920 00000100:00100000:2.0:1746065219.640835:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265441920 00002000:00100000:2.0:1746065219.640849:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009834ed80 x1830881265441920/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.640855:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834ed80 with x1830881265441920 ext(2097152->4194303) 00010000:00010000:2.0:1746065219.640861:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 41 pid: 9548 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746065219.640873:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 41 pid: 9548 timeout: 915 lvb_type: 1 00002000:00010000:2.0:1746065219.640879:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009834ed80 00000100:00100000:2.0:1746065219.640892:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2079 00000100:00100000:2.0:1746065219.640899:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265441920:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065219.641951:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6311 00000100:00100000:2.0:1746065219.641959:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265441792:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065219.655270:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265441408:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20742us (21288us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065219.655282:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6310 00002000:00100000:3.0:1746065219.655294:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009834f100 x1830881265441408/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.655303:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834f100 with x1830881265441408 ext(4194304->5038079) 00002000:00010000:3.0:1746065219.655308:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834f100 00000100:00100000:2.0:1746065219.668310:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265441920:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27403us (27655us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065219.668320:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2079 00002000:00100000:2.0:1746065219.668338:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88009834ed80 x1830881265441920/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:H/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.668348:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834ed80 with x1830881265441920 ext(2097152->4194303) 00010000:00010000:2.0:1746065219.668356:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 41 pid: 9548 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746065219.668368:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 41 pid: 9548 timeout: 915 lvb_type: 1 00002000:00010000:2.0:1746065219.668374:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009834ed80 00000100:00100000:3.0:1746065219.668482:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.668544:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.668565:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265442048 00000100:00100000:3.0:1746065219.668571:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265442048 00000100:00100000:3.0:1746065219.668597:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265442176 00000100:00100000:3.0:1746065219.668599:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265442176 00000100:00100000:3.0:1746065219.669975:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17611 00000100:00100000:3.0:1746065219.669988:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265442048:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065219.670004:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.670021:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479d9b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a29 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065219.670068:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264005248:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065219.670473:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17612 00000100:00100000:2.0:1746065219.670482:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265442176:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.670490:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.670499:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479da2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a30 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.670516:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.670525:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479da2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a30 expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.670533:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479da2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a30 expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.670547:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda400, rc 0) 00000100:00100000:3.0:1746065219.671263:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065219.671437:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265442176:12345-192.168.202.27@tcp:101:cat.0 Request processed in 954us (2888us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065219.671444:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17612 00000100:00100000:2.0:1746065219.674998:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265441792:12345-192.168.202.27@tcp:3:cat.0 Request processed in 33032us (34976us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065219.675009:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6311 00002000:00100000:2.0:1746065219.675019:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009834e300 x1830881265441792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.675026:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834e300 with x1830881265441792 ext(2097152->4194303) 00002000:00010000:2.0:1746065219.675032:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834e300 00000100:00100000:3.0:1746065219.675767:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264005248:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065219.675817:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479d9b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a29 expref: 14 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.675828:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479d9b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a29 expref: 14 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.675850:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c285e00, rc 0) 00000100:00100000:3.0:1746065219.675882:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265442048:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5898us (7400us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065219.675888:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17611 00000100:00100000:0.0:1746065219.680638:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.680670:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.680692:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.680717:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265442560 00000100:00100000:2.0:1746065219.680725:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265442560 00000100:00100000:2.0:1746065219.680758:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265442304 00000100:00100000:2.0:1746065219.680760:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265442304 00000100:00100000:2.0:1746065219.680802:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265442432 00000100:00100000:2.0:1746065219.680805:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265442432 00000100:00100000:2.0:1746065219.680820:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17613 00000100:00100000:2.0:1746065219.680825:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2557:x1830881265442560:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065219.680830:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17614 00000100:00100000:0.0:1746065219.680836:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265442304:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.680839:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.680841:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.680852:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479db0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a45 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.680852:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1479da9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a37 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.680870:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.680872:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.680879:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479db0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a45 expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.680890:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479db0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a45 expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.680891:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264005376:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065219.680899:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda400, rc 0) 00000100:00100000:2.0:1746065219.680932:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2557:x1830881265442560:12345-192.168.202.27@tcp:101:cat.0 Request processed in 107us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.680938:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17613 00000100:00100000:2.0:1746065219.680950:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17615 00000100:00100000:2.0:1746065219.680954:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265442432:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.680959:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.680964:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1479db7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a3e expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.680973:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.680979:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1479db7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a3e expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.680986:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdb000/0xad6b7ddc1479db7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a3e expref: 24 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.680997:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb000, rc 0) 00000100:00100000:2.0:1746065219.681589:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265442432:12345-192.168.202.27@tcp:101:cat.0 Request processed in 632us (894us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065219.681595:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17615 00000100:00100000:1.0:1746065219.681653:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.682009:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065219.682202:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265442688 00000100:00100000:1.0:1746065219.682205:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265442688 00010000:00010000:1.0:1746065219.682224:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 42 pid: 9548 timeout: 915 lvb_type: 1 00000100:00100000:0.0:1746065219.682386:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8234 00000100:00100000:0.0:1746065219.682393:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265442688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065219.682400:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.682415:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 42 pid: 9548 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.682424:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 42 pid: 9548 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.682437:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f73400/0xad6b7ddc1479d16 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ab expref: 42 pid: 9548 timeout: 915 lvb_type: 1 00010000:00010000:0.0:1746065219.682458:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.682460:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065219.682464:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.682471:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.682495:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 22 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065219.682502:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264005504:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065219.683207:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065219.683279:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.683343:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265442944 00000100:00100000:3.0:1746065219.683347:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265442944 00000100:00100000:3.0:1746065219.683386:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14609 00000100:00100000:3.0:1746065219.683392:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2561:x1830881265442944:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065219.683407:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.683418:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc1479dbe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a4c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.683468:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479dc5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683477:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683485:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479dc5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683496:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1479dcc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683504:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1479dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683509:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1479dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683621:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc1479dd3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683629:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc1479dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683635:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc1479dd3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065219.683641:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065219.683699:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479dc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683704:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479dc5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683709:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479dc5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683713:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683718:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c285e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065219.683722:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479dc5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683727:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479dc5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683738:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065219.683741:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065219.683744:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479dc5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683749:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479dc5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683795:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1479dcc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683800:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1479dcc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683804:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1479dcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683809:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099524200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065219.683810:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1479dcc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683815:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1479dcc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683821:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5d500) 00010000:00010000:3.0:1746065219.683823:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065219.683825:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1479dcc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683829:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099524200/0xad6b7ddc1479dcc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.683859:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc1479dbe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a4c expref: 32 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.683869:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc1479dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a4c expref: 31 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.683875:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.683876:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065219.683878:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524000, rc 0) 00000100:00100000:3.0:1746065219.683911:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2561:x1830881265442944:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 519us (632us total) trans 8589937131 rc 0/0 00000100:00100000:3.0:1746065219.683917:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14609 00000100:00100000:2.0:1746065219.687449:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264005376:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065219.687480:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1479da9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a37 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.687491:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb2c00/0xad6b7ddc1479da9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a37 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.687511:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2c00, rc 0) 00000100:00100000:2.0:1746065219.687559:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265442304:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6721us (6886us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065219.687567:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17614 00000100:00100000:0.0:1746065219.691370:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.691395:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265443200 00000100:00100000:1.0:1746065219.691399:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264005504:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065219.691400:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265443200 00010000:00010000:1.0:1746065219.691414:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065219.691445:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5489 00000100:00100000:0.0:1746065219.691452:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2561:x1830881265443200:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065219.691507:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265442688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9114us (9854us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.691514:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8234 00000100:00100000:1.0:1746065219.691550:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.691995:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.692217:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2561:x1830881265443200:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 135us (225us total) trans 8589937132 rc 0/0 00000100:00100000:0.0:1746065219.692223:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5489 00000100:00100000:2.0:1746065219.692454:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265443456 00000100:00100000:2.0:1746065219.692458:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265443456 00000100:00100000:2.0:1746065219.692466:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265443840 00000100:00100000:2.0:1746065219.692467:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265443840 00002000:00100000:2.0:1746065219.692490:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2666496->2670591) req@ffff88009077ce00 x1830881265443840/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.692499:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ce00 with x1830881265443840 ext(2666496->2670591) 00002000:00010000:2.0:1746065219.692503:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ce00 00000100:00100000:2.0:1746065219.692532:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6312 00000100:00100000:2.0:1746065219.692538:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265443840:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065219.692623:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265443840:12345-192.168.202.27@tcp:3:cat.0 Request processed in 84us (628us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065219.692632:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6312 00002000:00100000:2.0:1746065219.692637:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2666496->2670591) req@ffff88009077ce00 x1830881265443840/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/4536 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.692643:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ce00 with x1830881265443840 ext(2666496->2670591) 00002000:00010000:2.0:1746065219.692646:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ce00 00002000:00100000:2.0:1746065219.693289:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009077ea00 x1830881265443456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.693297:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ea00 with x1830881265443456 ext(3145728->4194303) 00002000:00010000:2.0:1746065219.693300:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ea00 00000100:00100000:2.0:1746065219.693320:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6313 00000100:00100000:2.0:1746065219.693335:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265443456:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065219.706475:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.706522:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265443968 00000100:00100000:2.0:1746065219.706530:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265443968 00000100:00100000:2.0:1746065219.706577:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5490 00000100:00100000:2.0:1746065219.706583:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2558:x1830881265443968:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065219.706760:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2558:x1830881265443968:12345-192.168.202.27@tcp:35:cat.0 Request processed in 176us (292us total) trans 8589937133 rc 0/0 00000100:00100000:2.0:1746065219.706766:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5490 00000100:00100000:2.0:1746065219.722733:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265443456:12345-192.168.202.27@tcp:3:cat.0 Request processed in 29398us (31172us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065219.722744:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6313 00002000:00100000:2.0:1746065219.722755:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009077ea00 x1830881265443456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.722768:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077ea00 with x1830881265443456 ext(3145728->4194303) 00002000:00010000:2.0:1746065219.722785:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077ea00 00000100:00100000:0.0:1746065219.735818:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.735901:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265444096 00000100:00100000:2.0:1746065219.735909:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265444096 00000100:00100000:2.0:1746065219.735959:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17616 00000100:00100000:2.0:1746065219.735966:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265444096:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.735983:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.735999:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479de1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a53 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.736027:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479de1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a53 expref: 42 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.736037:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479de1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a53 expref: 42 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.736055:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdba00, rc 0) 00000100:00100000:2.0:1746065219.736095:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265444096:12345-192.168.202.27@tcp:101:cat.0 Request processed in 129us (284us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065219.736101:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17616 00000100:00100000:0.0:1746065219.739284:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.739343:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265444352 00000100:00100000:2.0:1746065219.739351:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265444352 00002000:00100000:2.0:1746065219.739385:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009834ce00 x1830881265444352/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.739394:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834ce00 with x1830881265444352 ext(4194304->5038079) 00002000:00010000:2.0:1746065219.739398:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834ce00 00000100:00100000:2.0:1746065219.739424:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6314 00000100:00100000:2.0:1746065219.739430:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265444352:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065219.759096:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265444352:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19657us (19809us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065219.759107:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6314 00002000:00100000:2.0:1746065219.759117:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009834ce00 x1830881265444352/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.759126:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834ce00 with x1830881265444352 ext(4194304->5038079) 00002000:00010000:2.0:1746065219.759131:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009834ce00 00000100:00100000:0.0:1746065219.761930:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.761984:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265444480 00000100:00100000:2.0:1746065219.761991:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265444480 00000100:00100000:2.0:1746065219.762034:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17617 00000100:00100000:2.0:1746065219.762041:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265444480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.762057:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.762070:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1479de8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a5a expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.762094:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1479de8 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a5a expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.762102:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc1479de8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a5a expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.762825:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdae00, rc 0) 00000100:00100000:2.0:1746065219.763068:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265444480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1024us (1142us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065219.763075:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17617 00000100:00100000:0.0:1746065219.765520:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.765748:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265444608 00000100:00100000:2.0:1746065219.765757:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265444608 00000100:00100000:2.0:1746065219.765820:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17618 00000100:00100000:2.0:1746065219.765827:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265444608:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.765840:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.765853:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479def lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a61 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.765883:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479def lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a61 expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.765894:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdba00/0xad6b7ddc1479def lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a61 expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.765903:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdba00, rc 0) 00000100:00100000:2.0:1746065219.766645:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265444608:12345-192.168.202.27@tcp:101:cat.0 Request processed in 814us (1129us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065219.766652:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17618 00000100:00100000:0.0:1746065219.771001:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.771096:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265444864 00000100:00100000:2.0:1746065219.771104:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265444864 00000100:00100000:2.0:1746065219.771214:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5491 00000100:00100000:2.0:1746065219.771222:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2557:x1830881265444864:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065219.772100:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2557:x1830881265444864:12345-192.168.202.27@tcp:35:cat.0 Request processed in 876us (1103us total) trans 8589937134 rc 0/0 00000100:00100000:2.0:1746065219.772107:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5491 00000100:00100000:0.0:1746065219.789170:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065219.789194:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264005632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065219.789261:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.789648:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264005632 00000100:00100000:3.0:1746065219.789656:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264005632 00000100:00100000:3.0:1746065219.789700:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1746065219.789707:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881264005632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1746065219.789734:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:3.0:1746065219.789884:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3759:x1830881264005632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 176us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.789890:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00100000:0.0:1746065219.790136:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264005632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1746065219.821043:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881264006144:0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.821096:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.821138:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3760:1830881264006656:0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.821158:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.821177:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746065219.821182:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3760:1830881264006016:0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.821196:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.821208:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3760:1830881264006528:0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.821223:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.821245:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264006656 00000100:00100000:3.0:1746065219.821251:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264006656 00000100:00100000:3.0:1746065219.821285:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264006016 00000100:00100000:3.0:1746065219.821287:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264006016 00000100:00100000:3.0:1746065219.821297:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264006528 00000100:00100000:3.0:1746065219.821298:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264006528 00000100:00100000:3.0:1746065219.821312:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1746065219.821317:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3760:x1830881264006656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.821364:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3760:x1830881264006656:12345-0@lo:400:kworker.0 Request processed in 46us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.821370:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1746065219.821382:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1746065219.821386:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3760:x1830881264006016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.821404:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3760:x1830881264006016:12345-0@lo:400:kworker.0 Request processed in 18us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.821408:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:3.0:1746065219.821415:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1746065219.821419:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3760:x1830881264006528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.821437:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3760:x1830881264006528:12345-0@lo:400:kworker.0 Request processed in 17us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.821441:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00080000:3.0:1746065219.821453:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1746065219.821455:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065219.821473:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3760:1830881264006016:0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.821480:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3760:1830881264006528:0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.821488:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3760:1830881264006656:0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.821515:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264006144 00000100:00100000:3.0:1746065219.821517:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264006144 00000100:00100000:3.0:1746065219.821540:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:3.0:1746065219.821544:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881264006144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.821567:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881264006144:12345-0@lo:400:kworker.0 Request processed in 23us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.821571:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00080000:3.0:1746065219.821581:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1746065219.821594:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881264006144:0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821668:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ceddf226-8ddf-479f-9953-8a74c62285a9:3761:1830881264005760:0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821691:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.821716:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881264006272:0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821729:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.821737:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3761:1830881264006784:0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821747:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.821756:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1746065219.821760:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881264005888:0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821790:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.821800:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3761:1830881264006400:0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821811:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.821819:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3761:1830881264006912:0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821830:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.821842:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264006784 00000100:00100000:2.0:1746065219.821844:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264006784 00000100:00100000:2.0:1746065219.821860:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264006400 00000100:00100000:2.0:1746065219.821861:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264006400 00000100:00100000:2.0:1746065219.821869:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264006912 00000100:00100000:2.0:1746065219.821870:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264006912 00000100:00100000:2.0:1746065219.821878:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:2.0:1746065219.821881:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3761:x1830881264006784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821900:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3761:x1830881264006784:12345-0@lo:400:kworker.0 Request processed in 18us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.821904:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:2.0:1746065219.821912:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:2.0:1746065219.821915:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3761:x1830881264006400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821927:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3761:x1830881264006400:12345-0@lo:400:kworker.0 Request processed in 12us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.821931:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:2.0:1746065219.821935:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1746065219.821938:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3761:x1830881264006912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821949:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3761:x1830881264006912:12345-0@lo:400:kworker.0 Request processed in 11us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.821953:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00080000:2.0:1746065219.821961:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1746065219.821962:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1746065219.821972:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3761:1830881264006400:0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821978:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3761:1830881264006912:0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.821984:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3761:1830881264006784:0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.822001:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264005888 00000100:00100000:2.0:1746065219.822002:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264005888 00000100:00100000:2.0:1746065219.822015:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1746065219.822019:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881264005888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.822038:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3761:x1830881264005888:12345-0@lo:400:kworker.0 Request processed in 19us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.822042:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:2.0:1746065219.822055:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881264005888:0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.822103:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264006272 00000100:00100000:3.0:1746065219.822106:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264006272 00000100:00100000:3.0:1746065219.822124:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1746065219.822128:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3761:x1830881264006272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.822150:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3761:x1830881264006272:12345-0@lo:400:kworker.0 Request processed in 22us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.822153:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1746065219.822172:0:8144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264005760 00000100:00100000:3.0:1746065219.822174:0:8144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264005760 00000100:00100000:3.0:1746065219.822190:0:8144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1746065219.822194:0:8144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c72a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3761:x1830881264005760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065219.822214:0:8144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c72a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3761:x1830881264005760:12345-0@lo:400:kworker.0 Request processed in 20us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.822219:0:8144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00080000:2.0:1746065219.822513:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065219.822528:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ceddf226-8ddf-479f-9953-8a74c62285a9:3761:1830881264005760:0@lo:400:kworker.0 00000100:00100000:2.0:1746065219.822536:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3761:1830881264006272:0@lo:400:kworker.0 00000100:00100000:0.0:1746065219.853711:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.853978:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265445120 00000100:00100000:3.0:1746065219.853986:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265445120 00000100:00100000:3.0:1746065219.854030:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14610 00000100:00100000:3.0:1746065219.854037:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2567:x1830881265445120:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065219.854057:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.854073:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc1479df6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a68 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.854132:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc1479dfd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854142:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc1479dfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854152:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc1479dfd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854162:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc1479e04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854166:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc1479e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854170:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc1479e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854244:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc1479e0b lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854253:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc1479e0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854259:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc1479e0b lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065219.854266:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065219.854320:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc1479dfd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854357:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc1479dfd lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854362:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc1479dfd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854367:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc1479dfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854371:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993f200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065219.854375:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc1479dfd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854380:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc1479dfd lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854389:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065219.854392:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065219.854394:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc1479dfd lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854399:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f200/0xad6b7ddc1479dfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854425:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc1479e04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854430:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc1479e04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854434:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc1479e04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854441:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009993e200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065219.854443:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc1479e04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854447:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc1479e04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854453:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008ec47900) 00010000:00010000:3.0:1746065219.854455:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065219.854457:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc1479e04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854461:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e200/0xad6b7ddc1479e04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.854490:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993e600/0xad6b7ddc1479df6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a68 expref: 13 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.854500:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc1479e0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a68 expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.854505:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.854507:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065219.854509:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f800, rc 0) 00000100:00100000:3.0:1746065219.854545:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2567:x1830881265445120:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 509us (842us total) trans 8589937135 rc 0/0 00000100:00100000:3.0:1746065219.854552:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14610 00000100:00100000:0.0:1746065219.861086:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.861176:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265445376 00000100:00100000:2.0:1746065219.861184:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265445376 00000100:00100000:2.0:1746065219.861226:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5492 00000100:00100000:2.0:1746065219.861232:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2567:x1830881265445376:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065219.861420:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2567:x1830881265445376:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 187us (340us total) trans 8589937136 rc 0/0 00000100:00100000:2.0:1746065219.861426:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5492 00000100:00100000:0.0:1746065219.868993:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881264007040:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065219.869051:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065219.869315:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264007040 00000100:00100000:2.0:1746065219.869331:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264007040 00000100:00100000:2.0:1746065219.869509:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1746065219.869516:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881264007040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1746065219.869542:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445560320 avail 1316098048 00000100:00100000:2.0:1746065219.869622:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881264007040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.869629:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1746065219.869683:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881264007040:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746065219.878609:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.878700:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265445632 00000100:00100000:0.0:1746065219.878708:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265445632 00000100:00100000:0.0:1746065219.878748:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14611 00000100:00100000:0.0:1746065219.878755:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2569:x1830881265445632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065219.878787:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.878803:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131beec00/0xad6b7ddc1479e19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a6f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.878861:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1479e20 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.878872:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1479e20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.878880:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1479e20 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.878890:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1479e27 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.878895:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1479e27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.878900:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1479e27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.878977:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1479e2e lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.878986:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1479e2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.878991:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1479e2e lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:0.0:1746065219.878999:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065219.879051:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1479e20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879056:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1479e20 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879060:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1479e20 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879065:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1479e20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879069:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bef400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065219.879072:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1479e20 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879076:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1479e20 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879084:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065219.879086:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065219.879089:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1479e20 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879092:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bef400/0xad6b7ddc1479e20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879105:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1479e27 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879113:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1479e27 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879117:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1479e27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879121:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131bee800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065219.879123:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1479e27 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879126:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1479e27 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879131:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ef2aa00) 00010000:00010000:0.0:1746065219.879132:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065219.879134:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1479e27 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879138:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee800/0xad6b7ddc1479e27 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065219.879167:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131beec00/0xad6b7ddc1479e19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a6f expref: 16 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.879177:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1479e2e lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a6f expref: 15 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.879184:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065219.879185:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1746065219.879188:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131bee600, rc 0) 00000100:00100000:0.0:1746065219.879232:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2569:x1830881265445632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 477us (631us total) trans 8589937137 rc 0/0 00000100:00100000:0.0:1746065219.879239:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14611 00000100:00100000:0.0:1746065219.902965:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.902998:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.903047:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265445888 00000100:00100000:3.0:1746065219.903056:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265445888 00000100:00100000:0.0:1746065219.903076:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.903099:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265446016 00000100:00100000:3.0:1746065219.903102:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265446016 00000100:00100000:3.0:1746065219.903114:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17619 00000100:00100000:3.0:1746065219.903120:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265445888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065219.903135:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.903150:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc1479e3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a76 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065219.903193:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264007168:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065219.903636:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065219.904487:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265445760 00000100:00100000:1.0:1746065219.904494:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265445760 00000100:00100000:1.0:1746065219.904537:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 874 00000100:00100000:1.0:1746065219.904545:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265445760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065219.904557:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065219.904580:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee600/0xad6b7ddc1479e2e lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a6f expref: 15 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065219.904602:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065219.904606:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065219.904641:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265445760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (1683us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065219.904648:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 874 00000100:00100000:3.0:1746065219.907049:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264007296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746065219.907104:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.907154:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264007296 00000100:00100000:3.0:1746065219.907161:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264007296 00000100:00100000:3.0:1746065219.907200:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1746065219.907208:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3760:x1830881264007296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746065219.907227:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 409600 granted 1068651968 pending 2805760 free 3910598656 avail 3679076352 00000100:00100000:3.0:1746065219.907269:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+37:3760:x1830881264007296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.907275:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1746065219.907317:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264007296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065219.907584:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17620 00000100:00100000:3.0:1746065219.907869:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265446016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065219.907883:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.907898:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc1479e43 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a7d expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.907930:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc1479e43 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a7d expref: 24 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.907941:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099524200/0xad6b7ddc1479e43 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a7d expref: 24 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065219.907976:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524200, rc 0) 00000100:00100000:3.0:1746065219.908017:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265446016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 423us (4938us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065219.908023:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17620 00000100:00100000:0.0:1746065219.911573:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264007168:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065219.911601:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc1479e3c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a76 expref: 14 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.911613:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc1479e3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a76 expref: 14 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.911626:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fc00, rc 0) 00000100:00100000:0.0:1746065219.911671:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265445888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8550us (8671us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065219.911679:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17619 00000100:00100000:1.0:1746065219.923366:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065219.923435:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265446272 00000100:00100000:3.0:1746065219.923442:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265446272 00000100:00100000:3.0:1746065219.923480:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14612 00000100:00100000:3.0:1746065219.923486:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2573:x1830881265446272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065219.923504:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065219.923519:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc1479e4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a84 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.923575:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc1479e51 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923586:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc1479e51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923594:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc1479e51 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923604:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479e58 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923610:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923615:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923686:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0xad6b7ddc1479e5f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923695:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0xad6b7ddc1479e5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923700:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0xad6b7ddc1479e5f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065219.923709:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065219.923762:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc1479e51 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923768:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc1479e51 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923790:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc1479e51 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923795:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc1479e51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923800:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c284a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065219.923802:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc1479e51 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923807:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc1479e51 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923819:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065219.923821:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065219.923824:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc1479e51 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923828:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc1479e51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923849:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479e58 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923854:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479e58 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923857:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479e58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923861:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c285e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065219.923862:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479e58 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923866:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479e58 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923872:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88008ec47700) 00010000:00010000:3.0:1746065219.923874:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065219.923875:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479e58 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923879:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285e00/0xad6b7ddc1479e58 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065219.923907:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c285800/0xad6b7ddc1479e4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a84 expref: 36 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.923916:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0xad6b7ddc1479e5f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a84 expref: 35 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.923922:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065219.923923:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065219.923925:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa51600, rc 0) 00000100:00100000:3.0:1746065219.923959:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2573:x1830881265446272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 472us (601us total) trans 8589937138 rc 0/0 00000100:00100000:3.0:1746065219.923964:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14612 00000100:00100000:0.0:1746065219.929649:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.929686:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.929714:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.929732:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265446784 00000100:00100000:0.0:1746065219.929738:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265446784 00000100:00100000:0.0:1746065219.929787:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17621 00000100:00100000:0.0:1746065219.929794:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265446784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065219.929808:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065219.929822:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993fe00/0xad6b7ddc1479e6d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a8b expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.929848:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993fe00/0xad6b7ddc1479e6d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a8b expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.929857:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993fe00/0xad6b7ddc1479e6d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a8b expref: 42 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065219.929866:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fe00, rc 0) 00000100:00100000:0.0:1746065219.929900:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265446784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 107us (185us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065219.929905:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17621 00000100:00100000:0.0:1746065219.930003:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265446656 00000100:00100000:0.0:1746065219.930007:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265446656 00000100:00100000:0.0:1746065219.930030:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 875 00000100:00100000:0.0:1746065219.930035:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265446656:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065219.930043:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065219.930058:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009aa51600/0xad6b7ddc1479e5f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a84 expref: 35 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065219.930069:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065219.930072:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065219.930090:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265446656:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065219.930095:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 875 00000100:00100000:0.0:1746065219.930150:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265446528 00000100:00100000:0.0:1746065219.930153:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265446528 00002000:00100000:0.0:1746065219.930172:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012f1a7100 x1830881265446528/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.930180:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7100 with x1830881265446528 ext(0->1048575) 00002000:00010000:0.0:1746065219.930184:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7100 00000100:00100000:0.0:1746065219.930195:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6315 00000100:00100000:0.0:1746065219.930199:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265446528:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065219.931566:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065219.931581:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264007424:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065219.931618:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065219.932429:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264007424 00000100:00100000:3.0:1746065219.932435:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264007424 00000100:00100000:3.0:1746065219.932466:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:3.0:1746065219.932472:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3762:x1830881264007424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1746065219.932490:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 598016 granted 1073359168 pending 4988928 free 3906641920 avail 3675119616 00000100:00100000:3.0:1746065219.932536:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3762:x1830881264007424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.932542:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1746065219.934339:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264007424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1746065219.936648:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.936715:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265446912 00000100:00100000:2.0:1746065219.936721:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265446912 00000100:00100000:2.0:1746065219.936755:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17622 00000100:00100000:2.0:1746065219.936761:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2561:x1830881265446912:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065219.936797:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.936810:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a92 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.936835:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1479cc2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939973 expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.936843:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc1479cf3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93999d expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.936849:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.936850:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.936853:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [2027520->2097151] (req 2027520->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.936878:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc1479cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93999d expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.936888:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc1479cf3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93999d expref: 12 pid: 9548 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746065219.936898:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264007552:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.936972:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1479cc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939973 expref: 34 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065219.936978:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1479cc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939973 expref: 34 pid: 9550 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746065219.936986:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264007680:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.937001:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065219.950694:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264007552:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065219.950711:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264007680:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065219.950741:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [2027520->2097151] (req 2027520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065219.950758:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8e00, rc 0) 00000100:00100000:3.0:1746065219.950836:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2561:x1830881265446912:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 14071us (14190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.950846:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17622 00000100:00100000:2.0:1746065219.951135:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265446528:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20931us (21488us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065219.951146:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6315 00002000:00100000:2.0:1746065219.951155:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012f1a7100 x1830881265446528/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065219.951163:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7100 with x1830881265446528 ext(0->1048575) 00002000:00010000:2.0:1746065219.951168:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a7100 00000100:00100000:0.0:1746065219.955650:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.955707:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.955759:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.955855:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.955888:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265447552 00000100:00100000:0.0:1746065219.955896:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265447552 00002000:00100000:0.0:1746065219.955939:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099cf0e00 x1830881265447552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 504/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.955948:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0e00 with x1830881265447552 ext(1048576->2097151) 00002000:00010000:0.0:1746065219.955953:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0e00 00000100:00100000:0.0:1746065219.955972:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265447680 00000100:00100000:0.0:1746065219.955976:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265447680 00002000:00100000:0.0:1746065219.955992:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880099cf0380 x1830881265447680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065219.955998:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0380 with x1830881265447680 ext(0->1048575) 00002000:00010000:0.0:1746065219.956001:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf0380 00000100:00100000:0.0:1746065219.956020:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6316 00000100:00100000:0.0:1746065219.956028:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265447552:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065219.956397:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265447168 00000100:00100000:2.0:1746065219.956401:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265447168 00010000:00010000:2.0:1746065219.956417:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1479cc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939973 expref: 36 pid: 9550 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746065219.956434:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265447040 00000100:00100000:2.0:1746065219.956436:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265447040 00010000:00010000:2.0:1746065219.956444:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc1479cf3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93999d expref: 13 pid: 9548 timeout: 915 lvb_type: 1 00000100:00100000:2.0:1746065219.956456:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8235 00000100:00100000:2.0:1746065219.956460:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265447168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065219.956468:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065219.956482:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1479cc2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939973 expref: 36 pid: 9550 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746065219.956490:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1479cc2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939973 expref: 36 pid: 9550 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746065219.956509:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090684400/0xad6b7ddc1479cc2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939973 expref: 36 pid: 9550 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746065219.956531:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065219.956564:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265447168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.956570:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8235 00000100:00100000:2.0:1746065219.956583:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8236 00000100:00100000:2.0:1746065219.956588:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265447040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065219.956593:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065219.956600:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc1479cf3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93999d expref: 13 pid: 9548 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746065219.956608:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc1479cf3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93999d expref: 13 pid: 9548 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746065219.956621:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc1479cf3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93999d expref: 13 pid: 9548 timeout: 915 lvb_type: 1 00010000:00010000:2.0:1746065219.956629:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.956631:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065219.956637:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.956645:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.956670:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065219.956682:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264007808:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065219.956738:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065219.956757:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6317 00000100:00100000:2.0:1746065219.956764:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265447680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065219.965300:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.965374:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265447808 00000100:00100000:2.0:1746065219.965382:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265447808 00000100:00100000:2.0:1746065219.965417:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17623 00000100:00100000:2.0:1746065219.965423:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2569:x1830881265447808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.965438:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.965455:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939a99 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.965481:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 34 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.965487:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065219.965489:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065219.965492:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 14 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.965517:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 34 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.965527:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 34 pid: 9549 timeout: 915 lvb_type: 0 00000100:00100000:2.0:1746065219.965543:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264007936:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065219.968588:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065219.972211:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264007808:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065219.972234:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065219.972283:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265447040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 15691us (16573us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065219.972292:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8236 00000100:00100000:1.0:1746065219.972463:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265447552:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16436us (16704us total) trans 0 rc 663552/663552 00000100:00100000:1.0:1746065219.972470:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6316 00002000:00100000:1.0:1746065219.972479:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099cf0e00 x1830881265447552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 504/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 663552/663552 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065219.972487:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0e00 with x1830881265447552 ext(1048576->2097151) 00010000:00010000:1.0:1746065219.972496:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 33 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.972508:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 33 pid: 9549 timeout: 915 lvb_type: 0 00002000:00010000:1.0:1746065219.972513:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cf0e00 00000100:00100000:3.0:1746065219.972725:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265447680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15961us (16871us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065219.972731:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6317 00002000:00100000:3.0:1746065219.972736:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880099cf0380 x1830881265447680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.972743:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0380 with x1830881265447680 ext(0->1048575) 00002000:00010000:3.0:1746065219.972746:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf0380 00000100:00100000:2.0:1746065219.973350:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264007936:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065219.973366:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 13 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.973378:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800929fac00, rc 0) 00000100:00100000:2.0:1746065219.973403:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2569:x1830881265447808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7980us (8110us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.973408:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17623 00000100:00100000:0.0:1746065219.973715:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065219.973751:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065219.973859:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265448064 00000100:00100000:1.0:1746065219.973864:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265448064 00002000:00100000:1.0:1746065219.973889:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (2027520->2031615) req@ffff880099cf0a80 x1830881265448064/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065219.973896:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0a80 with x1830881265448064 ext(2027520->2031615) 00002000:00010000:1.0:1746065219.973899:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0a80 00000100:00100000:1.0:1746065219.973920:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265448192 00000100:00100000:1.0:1746065219.973922:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265448192 00002000:00100000:1.0:1746065219.973933:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1695744->2080767) req@ffff880099cf1880 x1830881265448192/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065219.973939:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1880 with x1830881265448192 ext(1695744->2080767) 00010000:00010000:1.0:1746065219.973943:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 34 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:1.0:1746065219.973951:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 34 pid: 9549 timeout: 915 lvb_type: 0 00002000:00010000:1.0:1746065219.973956:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cf1880 00000100:00100000:1.0:1746065219.973965:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2080 00000100:00100000:1.0:1746065219.973970:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265448192:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065219.974651:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6318 00000100:00100000:3.0:1746065219.974657:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265448064:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065219.974737:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265448064:12345-192.168.202.27@tcp:3:cat.0 Request processed in 80us (1022us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065219.974743:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6318 00002000:00100000:3.0:1746065219.974747:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (2027520->2031615) req@ffff880099cf0a80 x1830881265448064/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/4536 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.974754:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf0a80 with x1830881265448064 ext(2027520->2031615) 00002000:00010000:3.0:1746065219.974757:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf0a80 00000100:00100000:2.0:1746065219.986928:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.992073:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065219.992103:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265448576 00000100:00100000:2.0:1746065219.992122:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265448576 00000100:00100000:2.0:1746065219.992174:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17624 00000100:00100000:2.0:1746065219.992180:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2573:x1830881265448576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065219.992203:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065219.992239:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939aa0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.992271:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065219.992276:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 36 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.992286:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 36 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065219.992297:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d856c00, rc 0) 00000100:00100000:2.0:1746065219.992358:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2573:x1830881265448576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 178us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065219.992364:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17624 00000100:00100000:3.0:1746065219.992487:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265448448 00000100:00100000:3.0:1746065219.992495:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265448448 00002000:00100000:3.0:1746065219.992527:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880091aa6d80 x1830881265448448/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 504/0 e 0 to 0 dl 1746065230 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065219.992536:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6d80 with x1830881265448448 ext(1048576->2097151) 00002000:00010000:3.0:1746065219.992541:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091aa6d80 00000100:00100000:3.0:1746065219.992616:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6319 00000100:00100000:3.0:1746065219.992624:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265448448:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065220.003708:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881265448192:12345-192.168.202.27@tcp:4:cat.0 Request processed in 29728us (29947us total) trans 21474841709 rc 0/0 00000100:00100000:2.0:1746065220.003719:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2080 00002000:00100000:2.0:1746065220.003729:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1695744->2080767) req@ffff880099cf1880 x1830881265448192/t21474841709(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 488/448 e 0 to 0 dl 1746065230 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.003738:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1880 with x1830881265448192 ext(1695744->2080767) 00010000:00010000:2.0:1746065220.003746:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 38 pid: 9549 timeout: 915 lvb_type: 0 00010000:00010000:2.0:1746065220.003758:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 38 pid: 9549 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746065220.003764:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cf1880 00000100:00100000:2.0:1746065220.005643:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265448448:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13010us (18715us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746065220.005653:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6319 00002000:00100000:2.0:1746065220.005664:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880091aa6d80 x1830881265448448/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:135/0 lens 504/440 e 0 to 0 dl 1746065230 ref 1 fl Complete:/200/0 rc 1044480/1044480 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.005672:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6d80 with x1830881265448448 ext(1048576->2097151) 00002000:00010000:2.0:1746065220.005677:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091aa6d80 00000100:00100000:0.0:1746065220.009136:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.009426:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265448704 00000100:00100000:3.0:1746065220.009434:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265448704 00010000:00010000:3.0:1746065220.009463:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 36 pid: 9549 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.011054:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8237 00000100:00100000:1.0:1746065220.011066:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881265448704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065220.011079:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065220.011094:0:7191:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065219 -> 1746065220 00010000:00010000:1.0:1746065220.011100:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 36 pid: 9549 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.011111:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 36 pid: 9549 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.011131:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc1479d5c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1695744->2080767) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ea expref: 36 pid: 9549 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.011158:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065220.011159:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065220.011166:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 12 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.011172:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 12 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.011179:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065220.011180:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065220.011182:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 35 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.011187:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 35 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.011212:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 35 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065220.011222:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264008064:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065220.011305:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 12 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065220.011313:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264008192:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065220.011340:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.017491:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.017739:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265448832 00000100:00100000:1.0:1746065220.017748:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265448832 00000100:00100000:1.0:1746065220.017821:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17625 00000100:00100000:1.0:1746065220.017829:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2561:x1830881265448832:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065220.017844:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.017857:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939aa7 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.017880:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.017888:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc1479d86 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a14 expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065220.017893:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065220.017895:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065220.017899:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->1851391] (req 1048576->1851391) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.017923:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc1479d86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a14 expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065220.017933:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc1479d86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a14 expref: 22 pid: 10219 timeout: 916 lvb_type: 1 00000100:00100000:1.0:1746065220.017943:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264008320:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065220.018020:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 42 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.018027:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 42 pid: 13375 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.018035:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264008448:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065220.018052:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065220.025159:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264008448:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065220.025613:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264008192:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065220.025626:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264008064:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065220.025646:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065220.025690:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265448704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 14627us (16559us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.025699:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8237 00000100:00100000:0.0:1746065220.031097:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.031171:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265449216 00000100:00100000:1.0:1746065220.031178:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265449216 00010000:00010000:1.0:1746065220.031203:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 43 pid: 13375 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.031223:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8238 00000100:00100000:1.0:1746065220.031228:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881265449216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065220.031238:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065220.031253:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 43 pid: 13375 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.031261:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 43 pid: 13375 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.031279:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd600/0xad6b7ddc1479d71 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399ff expref: 43 pid: 13375 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.031301:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065220.031338:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881265449216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 110us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.031343:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8238 00000100:00100000:0.0:1746065220.033038:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.033597:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.033649:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.033710:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265449344 00000100:00100000:1.0:1746065220.033717:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265449344 00000100:00100000:2.0:1746065220.033812:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265449088 00000100:00100000:2.0:1746065220.033818:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265449088 00002000:00100000:2.0:1746065220.033851:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099cf3b80 x1830881265449088/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.033860:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3b80 with x1830881265449088 ext(1048576->2097151) 00002000:00010000:2.0:1746065220.033865:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf3b80 00000100:00100000:2.0:1746065220.033887:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6320 00000100:00100000:2.0:1746065220.033895:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265449088:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065220.036012:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264008320:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.036046:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->1851391] (req 1048576->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.036063:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a400, rc 0) 00000100:00100000:3.0:1746065220.036107:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+41:2561:x1830881265448832:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 18277us (18621us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.036116:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17625 00000100:00100000:0.0:1746065220.036296:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.038670:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14613 00000100:00100000:1.0:1746065220.038687:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+6:2574:x1830881265449344:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065220.038711:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.038730:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1479e90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939aae expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.038819:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1479e97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065220.038833:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1479e97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065220.038844:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1479e97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065220.038858:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc1479e9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065220.038864:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc1479e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065220.038869:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc1479e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065220.038998:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065220.039010:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939981 expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.039016:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93998f expref: 13 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.039023:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065220.039052:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93998f expref: 13 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.039069:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93998f expref: 13 pid: 7203 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.039080:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264008576:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065220.039180:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939981 expref: 33 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.039189:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939981 expref: 33 pid: 7231 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.039197:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264008704:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065220.039224:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065220.039433:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265449472 00000100:00100000:3.0:1746065220.039441:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265449472 00010000:00010000:3.0:1746065220.039469:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc1479d86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a14 expref: 23 pid: 10219 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746065220.039515:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8239 00000100:00100000:3.0:1746065220.039523:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265449472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065220.039533:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065220.039550:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc1479d86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a14 expref: 23 pid: 10219 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746065220.039560:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc1479d86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a14 expref: 23 pid: 10219 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746065220.039577:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552f400/0xad6b7ddc1479d86 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a14 expref: 23 pid: 10219 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746065220.039599:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.039601:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.039608:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.039615:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.039639:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.039650:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264008832:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065220.039680:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065220.040218:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265449728 00000100:00100000:2.0:1746065220.040224:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265449728 00002000:00100000:2.0:1746065220.040255:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099cf3480 x1830881265449728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.040265:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3480 with x1830881265449728 ext(1048576->2097151) 00002000:00010000:2.0:1746065220.040269:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf3480 00000100:00100000:0.0:1746065220.042010:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6321 00000100:00100000:0.0:1746065220.042023:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265449728:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065220.067010:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264008576:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065220.067023:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264008704:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065220.067041:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:2.0:1746065220.070297:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265449088:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36392us (37252us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065220.070310:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6320 00002000:00100000:2.0:1746065220.070332:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099cf3b80 x1830881265449088/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.070340:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3b80 with x1830881265449088 ext(1048576->2097151) 00002000:00010000:2.0:1746065220.070345:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf3b80 00000100:00100000:3.0:1746065220.073265:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264008832:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065220.073283:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065220.075024:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265449472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 35496us (41371us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.075034:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8239 00000100:00100000:3.0:1746065220.075105:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.076095:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.076370:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265449856 00000100:00100000:0.0:1746065220.076377:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265449856 00010000:00010000:0.0:1746065220.076405:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939981 expref: 34 pid: 7231 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746065220.076426:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265449984 00000100:00100000:0.0:1746065220.076427:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265449984 00010000:00010000:0.0:1746065220.076435:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93998f expref: 14 pid: 7203 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.078144:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8240 00000100:00100000:2.0:1746065220.078161:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8241 00000100:00100000:2.0:1746065220.078170:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265449984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065220.078184:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065220.078192:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93998f expref: 14 pid: 7203 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.078202:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93998f expref: 14 pid: 7203 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.078219:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc1479cde lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93998f expref: 14 pid: 7203 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.078242:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065220.078247:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078255:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078260:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078265:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065220.078310:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265449984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 143us (2215us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.078316:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8241 00000100:00100000:2.0:1746065220.078356:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265449856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065220.078357:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065220.078363:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065220.078367:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939981 expref: 34 pid: 7231 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.078376:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939981 expref: 34 pid: 7231 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.078387:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a200/0xad6b7ddc1479cd0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939981 expref: 34 pid: 7231 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.078395:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065220.078398:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078405:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078411:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078428:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065220.078443:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265449856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 290us (3338us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.078448:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8240 00000100:00100000:2.0:1746065220.078465:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265450240 00000100:00100000:2.0:1746065220.078469:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265450240 00002000:00100000:2.0:1746065220.078495:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1847296->1851391) req@ffff880099cf2680 x1830881265450240/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.078504:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2680 with x1830881265450240 ext(1847296->1851391) 00002000:00010000:2.0:1746065220.078508:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf2680 00000100:00100000:2.0:1746065220.078522:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6322 00000100:00100000:2.0:1746065220.078527:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265450240:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065220.078622:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265450240:12345-192.168.202.27@tcp:3:cat.0 Request processed in 95us (266us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065220.078628:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6322 00002000:00100000:2.0:1746065220.078632:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1847296->1851391) req@ffff880099cf2680 x1830881265450240/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/4536 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.078639:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2680 with x1830881265450240 ext(1847296->1851391) 00002000:00010000:2.0:1746065220.078642:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf2680 00000100:00100000:0.0:1746065220.078687:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265449728:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36666us (42391us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065220.078694:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6321 00010000:00010000:2.0:1746065220.078726:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078733:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065220.078798:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:2.0:1746065220.078802:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065220.078818:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078827:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078838:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1479e97 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078843:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1479e97 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078848:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1479e97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078853:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1479e97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078859:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065220.078862:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1479e97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078867:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1479e97 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078874:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065220.078877:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065220.078880:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1479e97 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078884:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b000/0xad6b7ddc1479e97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078894:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc1479e9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078899:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc1479e9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078903:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc1479e9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078907:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065220.078909:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc1479e9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078913:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc1479e9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078919:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88006dc83600) 00010000:00010000:2.0:1746065220.078921:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065220.078924:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc1479e9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078928:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1aa00/0xad6b7ddc1479e9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065220.078955:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc1479e90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aae expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065220.078956:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099cf3480 x1830881265449728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065220.078965:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aae expref: 7 pid: 7204 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065220.078966:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3480 with x1830881265449728 ext(1048576->2097151) 00010000:00010000:2.0:1746065220.078970:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00002000:00010000:0.0:1746065220.078970:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099cf3480 00010000:00010000:2.0:1746065220.078972:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065220.078974:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a800, rc 0) 00000100:00100000:2.0:1746065220.078995:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2574:x1830881265449344:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 40316us (45400us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.079000:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14613 00000100:00100000:0.0:1746065220.084834:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.085042:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265450368 00000100:00100000:3.0:1746065220.085050:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265450368 00000100:00100000:3.0:1746065220.085096:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17626 00000100:00100000:3.0:1746065220.085103:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2569:x1830881265450368:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.085118:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.085132:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ab5 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.085155:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.085162:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065220.085164:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065220.085167:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 14 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.085188:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 34 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.085197:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 34 pid: 12258 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.085207:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264008960:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065220.085274:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.088080:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.088174:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.088189:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.088211:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.088223:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.088235:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.088255:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265450496 00000100:00100000:0.0:1746065220.088260:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265450496 00000100:00100000:0.0:1746065220.088290:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265450752 00000100:00100000:0.0:1746065220.088291:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265450752 00000100:00100000:0.0:1746065220.088301:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265451008 00000100:00100000:0.0:1746065220.088303:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265451008 00000100:00100000:0.0:1746065220.088310:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265450624 00000100:00100000:0.0:1746065220.088311:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265450624 00000100:00100000:0.0:1746065220.088318:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265450880 00000100:00100000:0.0:1746065220.088329:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265450880 00000100:00100000:1.0:1746065220.088334:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265451136 00000100:00100000:1.0:1746065220.088338:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265451136 00000100:00100000:0.0:1746065220.088339:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17627 00000100:00100000:0.0:1746065220.088345:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265450496:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:1.0:1746065220.088351:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17628 00000100:00100000:1.0:1746065220.088354:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265450752:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065220.088361:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065220.088361:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.088374:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc1479eb3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939aca expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065220.088374:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1479eba lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939abc expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065220.088392:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065220.088393:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065220.088401:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1479eba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939abc expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065220.088412:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264009088:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065220.088412:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1479eba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939abc expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065220.088420:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2a00, rc 0) 00000100:00100000:0.0:1746065220.088458:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265450496:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 113us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065220.088464:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17627 00000100:00100000:0.0:1746065220.088476:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17629 00000100:00100000:0.0:1746065220.088480:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265451008:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065220.088485:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065220.088490:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1479ec1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ad8 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065220.088504:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1479ec1 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ad8 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065220.088510:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2c00/0xad6b7ddc1479ec1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ad8 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065220.088517:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb2c00, rc 0) 00000100:00100000:2.0:1746065220.088713:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17630 00000100:00100000:2.0:1746065220.088719:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265450624:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065220.088726:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065220.088732:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1479ec8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ac3 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.088741:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.088742:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.088747:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1479ec8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ac3 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065220.088755:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1479ec8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ac3 expref: 12 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065220.088762:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46200, rc 0) 00000100:00100000:3.0:1746065220.088833:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17631 00000100:00100000:3.0:1746065220.088840:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265450880:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065220.088846:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.088852:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1479ecf lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ad1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.088874:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264009216:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065220.090137:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.090141:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265451008:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1657us (1948us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065220.090148:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17629 00000100:00100000:1.0:1746065220.090160:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17632 00000100:00100000:1.0:1746065220.090166:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265451136:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065220.090176:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.090184:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f01e00/0xad6b7ddc1479ed6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939adf expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.090195:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065220.090196:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065220.090197:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065220.090201:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01e00/0xad6b7ddc1479ed6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939adf expref: 13 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065220.090210:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f01e00/0xad6b7ddc1479ed6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939adf expref: 13 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065220.090216:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01e00, rc 0) 00000100:00100000:0.0:1746065220.090216:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265451392 00000100:00100000:0.0:1746065220.090220:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265451392 00000100:00100000:1.0:1746065220.090233:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265451136:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 69us (1997us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.090238:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17632 00000100:00100000:0.0:1746065220.090242:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5493 00000100:00100000:0.0:1746065220.090246:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2561:x1830881265451392:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065220.090309:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265450624:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1589us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.090314:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17630 00000100:00100000:2.0:1746065220.090398:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.090428:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.090577:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2561:x1830881265451392:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 329us (379us total) trans 8589937139 rc 0/0 00000100:00100000:0.0:1746065220.090582:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5493 00000100:00100000:0.0:1746065220.090837:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265451648 00000100:00100000:0.0:1746065220.090840:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265451648 00002000:00100000:0.0:1746065220.090861:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1851392->2097151) req@ffff880091aa6300 x1830881265451648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065220.090870:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6300 with x1830881265451648 ext(1851392->2097151) 00002000:00010000:0.0:1746065220.090873:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa6300 00000100:00100000:0.0:1746065220.091715:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6323 00000100:00100000:0.0:1746065220.091723:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265451648:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065220.091742:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.091808:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265451776 00000100:00100000:3.0:1746065220.091811:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265451776 00000100:00100000:3.0:1746065220.091873:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17633 00000100:00100000:3.0:1746065220.091878:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2567:x1830881265451776:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065220.091885:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.091894:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ae6 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.091913:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.091920:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc1479d94 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2670592->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a22 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.091926:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065220.091927:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065220.091930:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 23 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.091956:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc1479d94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2670592->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a22 expref: 23 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.091966:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc1479d94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2670592->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a22 expref: 23 pid: 12258 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.091976:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264009344:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.092017:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 23 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.092025:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 23 pid: 13375 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.092032:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264009472:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065220.092047:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065220.093792:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.093812:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265451904 00000100:00100000:2.0:1746065220.093816:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265451904 00002000:00100000:2.0:1746065220.093845:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (2027520->2097151) req@ffff880091aa5f80 x1830881265451904/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.093855:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa5f80 with x1830881265451904 ext(2027520->2097151) 00010000:00010000:2.0:1746065220.093861:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 35 pid: 12258 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.093873:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 35 pid: 12258 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746065220.093878:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091aa5f80 00002000:00010000:3.0:1746065220.093913:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime: 1746065219 -> 1746065220 00002000:00010000:3.0:1746065220.093917:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065215 -> 1746065220 00002000:00010000:3.0:1746065220.093919:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime: 1746065219 -> 1746065220 00000100:00100000:3.0:1746065220.093930:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264009216:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065220.093954:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1479ecf lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ad1 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.093963:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71be00/0xad6b7ddc1479ecf lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ad1 expref: 10 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.093981:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71be00, rc 0) 00000100:00100000:3.0:1746065220.094008:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265450880:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 5168us (5783us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065220.094015:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17631 00000100:00100000:3.0:1746065220.094046:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264008960:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.094058:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 14 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065220.094061:0:12260:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065218 -> 1746065220 00002000:00010000:0.0:1746065220.094064:0:12260:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065215 -> 1746065220 00002000:00010000:0.0:1746065220.094065:0:12260:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065218 -> 1746065220 00010000:00010000:3.0:1746065220.094165:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71ae00, rc 0) 00000100:00100000:0.0:1746065220.094165:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264009088:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065220.094179:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc1479eb3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aca expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065220.094185:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2569:x1830881265450368:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9083us (9359us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065220.094186:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc1479eb3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aca expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065220.094190:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17626 00010000:00010000:0.0:1746065220.094198:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00000, rc 0) 00000100:00100000:0.0:1746065220.094212:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265450752:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 5857us (6038us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065220.094216:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17628 00000100:00100000:3.0:1746065220.094260:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2081 00000100:00100000:3.0:1746065220.094267:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265451904:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065220.097096:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.097258:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264009344:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065220.097269:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264009472:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.097290:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 23 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.097305:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7e00, rc 0) 00000100:00100000:3.0:1746065220.097353:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2567:x1830881265451776:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5474us (5609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.097364:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17633 00000100:00100000:0.0:1746065220.097835:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.097885:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265451648:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6162us (7485us total) trans 0 rc 245760/245760 00000100:00100000:1.0:1746065220.097892:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6323 00002000:00100000:1.0:1746065220.097900:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1851392->2097151) req@ffff880091aa6300 x1830881265451648/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 245760/245760 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065220.097908:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6300 with x1830881265451648 ext(1851392->2097151) 00002000:00010000:1.0:1746065220.097912:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa6300 00000100:00100000:3.0:1746065220.097980:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265452288 00000100:00100000:3.0:1746065220.097986:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265452288 00000100:00100000:3.0:1746065220.098025:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17634 00000100:00100000:3.0:1746065220.098032:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2573:x1830881265452288:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.098044:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.098056:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939aed expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.098074:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065220.098078:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 38 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.098087:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 38 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.098094:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7a00, rc 0) 00000100:00100000:3.0:1746065220.098110:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2573:x1830881265452288:12345-192.168.202.27@tcp:101:cat.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.098115:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17634 00000100:00100000:2.0:1746065220.098151:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265452032 00000100:00100000:2.0:1746065220.098156:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265452032 00010000:00010000:2.0:1746065220.098176:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc1479d94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2670592->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a22 expref: 23 pid: 12258 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.098208:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8242 00000100:00100000:2.0:1746065220.098213:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265452032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065220.098222:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065220.098234:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc1479d94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2670592->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a22 expref: 23 pid: 12258 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.098244:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc1479d94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2670592->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a22 expref: 23 pid: 12258 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.098260:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc1479d94 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2670592->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a22 expref: 23 pid: 12258 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.098272:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065220.098288:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265452032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (1199us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.098292:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8242 00000100:00100000:0.0:1746065220.103272:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.103335:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265452160 00000100:00100000:1.0:1746065220.103343:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265452160 00002000:00100000:1.0:1746065220.103375:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2670591) req@ffff880099e10e00 x1830881265452160/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065220.103384:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e10e00 with x1830881265452160 ext(2097152->2670591) 00010000:00010000:1.0:1746065220.103391:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 22 pid: 13375 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.103400:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 22 pid: 13375 timeout: 916 lvb_type: 0 00002000:00010000:1.0:1746065220.103406:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099e10e00 00000100:00100000:1.0:1746065220.103434:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2082 00000100:00100000:1.0:1746065220.103439:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265452160:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065220.107727:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.108690:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265452544 00000100:00100000:3.0:1746065220.108697:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265452544 00000100:00100000:3.0:1746065220.108731:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14614 00000100:00100000:3.0:1746065220.108737:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2574:x1830881265452544:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065220.108752:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.108765:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc1479eeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939af4 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.108863:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479ef2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.108874:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aae expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.108880:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479ef2 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.108901:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aae expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.108910:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aae expref: 8 pid: 7204 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.108921:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264009600:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065220.108974:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065220.110597:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+38:2005:x1830881265451904:12345-192.168.202.27@tcp:4:cat.0 Request processed in 16326us (16820us total) trans 21474841710 rc 0/0 00000100:00100000:3.0:1746065220.110605:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2081 00002000:00100000:3.0:1746065220.110615:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (2027520->2097151) req@ffff880091aa5f80 x1830881265451904/t21474841710(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/448 e 0 to 0 dl 1746065231 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.110623:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa5f80 with x1830881265451904 ext(2027520->2097151) 00010000:00010000:3.0:1746065220.110630:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 38 pid: 12258 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.110641:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 38 pid: 12258 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746065220.110647:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091aa5f80 00000100:00100000:0.0:1746065220.117608:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.118490:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.118506:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265452672 00000100:00100000:3.0:1746065220.118513:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265452672 00000100:00100000:3.0:1746065220.118547:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264009600:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.118564:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479ef2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.118601:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 38 pid: 12258 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.118622:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8243 00000100:00100000:3.0:1746065220.118627:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881265452672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065220.118636:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065220.118651:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 38 pid: 12258 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.118659:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 38 pid: 12258 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.118676:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc1479e74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2027520->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a92 expref: 38 pid: 12258 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.118690:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.118691:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.118697:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 13 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.118708:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 13 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.118714:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.118715:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.118718:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 37 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.118723:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 37 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.118762:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 37 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.118786:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264009728:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065220.118844:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 13 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.118850:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264009856:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065220.118863:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065220.119429:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265452800 00000100:00100000:3.0:1746065220.119433:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265452800 00010000:00010000:3.0:1746065220.119447:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aae expref: 9 pid: 7204 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.119462:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8244 00000100:00100000:3.0:1746065220.119467:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265452800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065220.119473:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065220.119476:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aae expref: 9 pid: 7204 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.119483:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aae expref: 9 pid: 7204 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.119493:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a800/0xad6b7ddc1479ea5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aae expref: 9 pid: 7204 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.119501:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065220.119505:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479ef2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.119512:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.119518:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479ef2 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.119528:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065220.120029:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065220.120760:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265452800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1287us (2267us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.120768:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8244 00010000:00010000:3.0:1746065220.120810:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.120816:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479ef2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:3.0:1746065220.120834:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065220.120934:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc1479eeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939af4 expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.120945:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479ef2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939af4 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.120951:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065220.120953:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065220.120956:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6200, rc 0) 00000100:00100000:2.0:1746065220.121063:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2006:x1830881265452160:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 17622us (17797us total) trans 17179874323 rc 0/0 00000100:00100000:2.0:1746065220.121072:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2082 00002000:00100000:2.0:1746065220.121082:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2670591) req@ffff880099e10e00 x1830881265452160/t17179874323(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/448 e 0 to 0 dl 1746065231 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.121090:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e10e00 with x1830881265452160 ext(2097152->2670591) 00010000:00010000:2.0:1746065220.121098:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 24 pid: 13375 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.121109:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 24 pid: 13375 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746065220.121120:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099e10e00 00000100:00100000:3.0:1746065220.121418:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2574:x1830881265452544:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 12679us (13697us total) trans 8589937140 rc 0/0 00000100:00100000:3.0:1746065220.121425:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14614 00000100:00100000:3.0:1746065220.128999:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264009728:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065220.129013:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264009856:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065220.129029:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065220.129077:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265452672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10448us (11476us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.129086:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8243 00000100:00100000:0.0:1746065220.129641:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.129689:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.130173:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.130209:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.130286:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265453184 00000100:00100000:3.0:1746065220.130292:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265453184 00002000:00100000:3.0:1746065220.130334:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099e13100 x1830881265453184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.130343:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13100 with x1830881265453184 ext(1048576->2097151) 00002000:00010000:3.0:1746065220.130347:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e13100 00000100:00100000:3.0:1746065220.130361:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265453312 00000100:00100000:3.0:1746065220.130363:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265453312 00002000:00100000:3.0:1746065220.130374:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099e11c00 x1830881265453312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.130380:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11c00 with x1830881265453312 ext(1048576->2097151) 00002000:00010000:3.0:1746065220.130382:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e11c00 00000100:00100000:3.0:1746065220.130393:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6324 00000100:00100000:3.0:1746065220.130398:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265453184:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065220.130954:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6325 00000100:00100000:3.0:1746065220.130959:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265453312:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065220.132717:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265453696 00000100:00100000:3.0:1746065220.132724:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265453696 00000100:00100000:3.0:1746065220.133833:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14615 00000100:00100000:3.0:1746065220.133842:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2574:x1830881265453696:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065220.133860:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.133863:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065220.133884:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479ef2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939af4 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.133901:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065220.133904:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065220.133913:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479f00 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939afb expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.133987:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f07 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.134002:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f07 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.134009:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f07 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.134018:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f07 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.134023:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f07 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.134028:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f07 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.134032:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065220.134035:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f07 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.134040:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f07 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.134045:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065220.134047:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065220.134050:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f07 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.134054:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f07 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.134071:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479f00 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939afb expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.134081:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc1479f00 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939afb expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.134087:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a000, rc 0) 00000100:00100000:3.0:1746065220.134141:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2574:x1830881265453696:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 301us (4452us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065220.134146:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14615 00000100:00100000:2.0:1746065220.134263:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265453440 00000100:00100000:2.0:1746065220.134267:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265453440 00010000:00010000:2.0:1746065220.134290:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 24 pid: 13375 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.134307:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8245 00000100:00100000:2.0:1746065220.134311:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2007:x1830881265453440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065220.134328:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065220.134340:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 24 pid: 13375 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.134348:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 24 pid: 13375 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.134361:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc1479d78 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->2670591] (req 2097152->2670591) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a06 expref: 24 pid: 13375 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.134374:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.134376:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.134381:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 23 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.134387:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 23 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.134415:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 23 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065220.134424:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264009984:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065220.134484:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065220.143590:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa6a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264009984:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065220.143610:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065220.144565:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265453440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10250us (14353us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.144575:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8245 00000100:00100000:2.0:1746065220.147656:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265453184:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17251us (18010us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065220.147666:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6324 00002000:00100000:2.0:1746065220.147677:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099e13100 x1830881265453184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.147686:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13100 with x1830881265453184 ext(1048576->2097151) 00002000:00010000:2.0:1746065220.147691:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e13100 00000100:00100000:0.0:1746065220.147823:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.147864:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265453952 00000100:00100000:2.0:1746065220.147869:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265453952 00002000:00100000:2.0:1746065220.147970:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2625536->2629631) req@ffff880099e10380 x1830881265453952/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.147977:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e10380 with x1830881265453952 ext(2625536->2629631) 00002000:00010000:2.0:1746065220.147980:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e10380 00000100:00100000:2.0:1746065220.147993:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6326 00000100:00100000:2.0:1746065220.147998:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265453952:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065220.148074:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265453952:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 76us (252us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065220.148078:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6326 00002000:00100000:2.0:1746065220.148082:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2625536->2629631) req@ffff880099e10380 x1830881265453952/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/4536 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.148088:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e10380 with x1830881265453952 ext(2625536->2629631) 00002000:00010000:2.0:1746065220.148090:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e10380 00000100:00100000:0.0:1746065220.151198:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.152752:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265454208 00000100:00100000:2.0:1746065220.152764:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265454208 00000100:00100000:2.0:1746065220.152821:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5494 00000100:00100000:2.0:1746065220.152829:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2574:x1830881265454208:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065220.152997:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2574:x1830881265454208:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 167us (1804us total) trans 8589937141 rc 0/0 00000100:00100000:2.0:1746065220.153004:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5494 00000100:00100000:3.0:1746065220.155760:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265453312:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 24795us (25581us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065220.155785:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6325 00002000:00100000:3.0:1746065220.155795:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099e11c00 x1830881265453312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.155804:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11c00 with x1830881265453312 ext(1048576->2097151) 00002000:00010000:3.0:1746065220.155809:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e11c00 00000100:00100000:0.0:1746065220.160056:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.160172:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265454336 00000100:00100000:3.0:1746065220.160180:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265454336 00000100:00100000:3.0:1746065220.160235:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17635 00000100:00100000:3.0:1746065220.160242:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2567:x1830881265454336:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065220.160257:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.160272:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b02 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.160298:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1479d0f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b9 expref: 15 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.160310:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01e00/0xad6b7ddc1479ed6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939adf expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.160316:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1479d1d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c0 expref: 36 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.160336:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.160338:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.160341:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->2478079] (req 2097152->2478079) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.160367:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1479d1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c0 expref: 36 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.160378:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1479d1d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c0 expref: 36 pid: 3068 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746065220.160388:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264010112:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.160858:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f01e00/0xad6b7ddc1479ed6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939adf expref: 9 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.160868:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f01e00/0xad6b7ddc1479ed6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939adf expref: 9 pid: 9549 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746065220.160876:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264010240:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.161171:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1479d0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b9 expref: 15 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.161179:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1479d0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b9 expref: 15 pid: 9548 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746065220.161187:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264010368:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065220.161208:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.164889:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.164956:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.165045:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265454464 00000100:00100000:1.0:1746065220.165053:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265454464 00000100:00100000:1.0:1746065220.165090:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17636 00000100:00100000:1.0:1746065220.165097:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+41:2573:x1830881265454464:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065220.165112:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.165125:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b09 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.165153:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 22 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.165160:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065220.165161:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065220.165164:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.165190:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 22 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.165199:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 22 pid: 9548 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.165210:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264010496:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065220.165272:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065220.165366:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264010112:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065220.165428:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265454592 00000100:00100000:2.0:1746065220.165432:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265454592 00010000:00010000:2.0:1746065220.165450:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1479d1d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c0 expref: 37 pid: 3068 timeout: 916 lvb_type: 1 00000100:00100000:2.0:1746065220.165468:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8246 00000100:00100000:2.0:1746065220.165473:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881265454592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065220.165480:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065220.165496:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1479d1d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c0 expref: 37 pid: 3068 timeout: 916 lvb_type: 1 00010000:00010000:2.0:1746065220.165504:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1479d1d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c0 expref: 37 pid: 3068 timeout: 916 lvb_type: 1 00010000:00010000:2.0:1746065220.165520:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72600/0xad6b7ddc1479d1d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399c0 expref: 37 pid: 3068 timeout: 916 lvb_type: 1 00010000:00010000:2.0:1746065220.165534:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065220.165553:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2006:x1830881265454592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 80us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.165559:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8246 00000100:00100000:3.0:1746065220.170417:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264010240:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065220.170429:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264010368:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.170455:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->2478079] (req 2097152->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 15 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.170469:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6200, rc 0) 00000100:00100000:3.0:1746065220.170509:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2567:x1830881265454336:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10267us (10460us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.170517:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17635 00000100:00100000:1.0:1746065220.171761:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264010496:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065220.171796:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 42 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.171808:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047000, rc 0) 00000100:00100000:1.0:1746065220.171840:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+42:2573:x1830881265454464:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6743us (6959us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.171847:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17636 00000100:00100000:0.0:1746065220.173312:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.173354:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.173392:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.173569:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265454976 00000100:00100000:3.0:1746065220.173575:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265454976 00002000:00100000:3.0:1746065220.173608:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2625536->3145727) req@ffff880090dd8380 x1830881265454976/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.173617:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8380 with x1830881265454976 ext(2625536->3145727) 00010000:00010000:3.0:1746065220.173623:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 23 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.173634:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 23 pid: 9548 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746065220.173640:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090dd8380 00000100:00100000:3.0:1746065220.173658:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2083 00000100:00100000:3.0:1746065220.173665:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265454976:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065220.173807:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265454848 00000100:00100000:3.0:1746065220.173810:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265454848 00010000:00010000:3.0:1746065220.173825:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1479d0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b9 expref: 15 pid: 9548 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746065220.173840:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265454720 00000100:00100000:3.0:1746065220.173842:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265454720 00010000:00010000:3.0:1746065220.173851:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01e00/0xad6b7ddc1479ed6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939adf expref: 10 pid: 9549 timeout: 916 lvb_type: 1 00000100:00100000:3.0:1746065220.173869:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8247 00000100:00100000:3.0:1746065220.173874:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265454848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065220.173882:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065220.173897:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1479d0f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b9 expref: 15 pid: 9548 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746065220.173906:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1479d0f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b9 expref: 15 pid: 9548 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746065220.173927:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72a00/0xad6b7ddc1479d0f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399b9 expref: 15 pid: 9548 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746065220.173941:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065220.173959:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265454848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.173965:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8247 00000100:00100000:3.0:1746065220.173976:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8248 00000100:00100000:3.0:1746065220.173980:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265454720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065220.173986:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065220.173992:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f01e00/0xad6b7ddc1479ed6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939adf expref: 10 pid: 9549 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746065220.173999:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f01e00/0xad6b7ddc1479ed6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939adf expref: 10 pid: 9549 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746065220.174009:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f01e00/0xad6b7ddc1479ed6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939adf expref: 10 pid: 9549 timeout: 916 lvb_type: 1 00010000:00010000:3.0:1746065220.174016:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.174017:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.174023:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 13 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.174030:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 13 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.174056:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 13 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.174066:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264010624:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065220.174109:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.176166:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.176218:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265455104 00000100:00100000:1.0:1746065220.176224:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265455104 00000100:00100000:1.0:1746065220.176256:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17637 00000100:00100000:1.0:1746065220.176261:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2569:x1830881265455104:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065220.176272:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.176284:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b10 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.176302:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.176308:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065220.176310:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065220.176312:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.176342:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.176349:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 41 pid: 1880 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.176357:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264010752:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065220.177552:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065220.190455:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264010752:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065220.190478:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065220.190482:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264010624:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065220.190493:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065220.190497:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047400, rc 0) 00000100:00100000:2.0:1746065220.190531:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265454720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 16548us (17175us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.190541:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8248 00000100:00100000:1.0:1746065220.190917:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2569:x1830881265455104:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14654us (14755us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.190924:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17637 00000100:00100000:2.0:1746065220.190932:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.190957:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265455360 00000100:00100000:2.0:1746065220.190963:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265455360 00002000:00100000:2.0:1746065220.190989:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2473984->2478079) req@ffff880091aa6a00 x1830881265455360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.190998:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6a00 with x1830881265455360 ext(2473984->2478079) 00002000:00010000:2.0:1746065220.191002:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091aa6a00 00000100:00100000:2.0:1746065220.191021:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6327 00000100:00100000:2.0:1746065220.191028:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265455360:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065220.191121:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265455360:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 93us (189us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065220.191127:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6327 00002000:00100000:2.0:1746065220.191132:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2473984->2478079) req@ffff880091aa6a00 x1830881265455360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/4536 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.191139:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa6a00 with x1830881265455360 ext(2473984->2478079) 00002000:00010000:2.0:1746065220.191141:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091aa6a00 00000100:00100000:0.0:1746065220.195372:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.196221:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265455488 00000100:00100000:2.0:1746065220.196229:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265455488 00002000:00100000:2.0:1746065220.196257:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1851391) req@ffff880090dda680 x1830881265455488/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.196267:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dda680 with x1830881265455488 ext(1048576->1851391) 00010000:00010000:2.0:1746065220.196275:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 42 pid: 1880 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.196284:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 42 pid: 1880 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746065220.196290:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090dda680 00000100:00100000:2.0:1746065220.196310:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2084 00000100:00100000:2.0:1746065220.196316:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265455488:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065220.199602:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265454976:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 25928us (26201us total) trans 17179874324 rc 0/0 00000100:00100000:0.0:1746065220.199614:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2083 00002000:00100000:0.0:1746065220.199624:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2625536->3145727) req@ffff880090dd8380 x1830881265454976/t17179874324(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/448 e 0 to 0 dl 1746065231 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065220.199632:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8380 with x1830881265454976 ext(2625536->3145727) 00010000:00010000:0.0:1746065220.199641:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 26 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746065220.199652:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 26 pid: 9548 timeout: 916 lvb_type: 0 00002000:00010000:0.0:1746065220.199658:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090dd8380 00000100:00100000:0.0:1746065220.201499:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.202000:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265455744 00000100:00100000:3.0:1746065220.202008:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265455744 00000100:00100000:3.0:1746065220.202042:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5495 00000100:00100000:3.0:1746065220.202048:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2567:x1830881265455744:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065220.202211:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2567:x1830881265455744:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 163us (719us total) trans 8589937142 rc 0/0 00000100:00100000:3.0:1746065220.202217:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5495 00000100:00100000:0.0:1746065220.204918:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.205163:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265455872 00000100:00100000:2.0:1746065220.205170:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265455872 00010000:00010000:2.0:1746065220.205197:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 26 pid: 9548 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.205225:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8249 00000100:00100000:2.0:1746065220.205230:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265455872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065220.205241:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065220.205254:0:7191:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065219 -> 1746065220 00002000:00010000:2.0:1746065220.205257:0:7191:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065219 -> 1746065220 00010000:00010000:2.0:1746065220.205261:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 26 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.205270:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 26 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.205290:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479edd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2625536->3145727] (req 2625536->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ae6 expref: 26 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.205612:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.205615:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.205622:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 43 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.205630:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 43 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.205660:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 43 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065220.205677:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264010880:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065220.206096:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065220.217561:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264010880:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065220.217581:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065220.217622:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265455872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 12390us (12711us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.217631:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8249 00000100:00100000:0.0:1746065220.219637:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.220504:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265456128 00000100:00100000:2.0:1746065220.220512:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265456128 00002000:00100000:2.0:1746065220.220548:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880090dd8a80 x1830881265456128/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.220557:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8a80 with x1830881265456128 ext(2097152->3145727) 00002000:00010000:2.0:1746065220.220561:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090dd8a80 00000100:00100000:2.0:1746065220.220594:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6328 00000100:00100000:2.0:1746065220.220600:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265456128:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065220.230117:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265455488:12345-192.168.202.27@tcp:4:cat.0 Request processed in 33793us (34744us total) trans 17179874325 rc 0/0 00000100:00100000:2.0:1746065220.230128:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2084 00002000:00100000:2.0:1746065220.230137:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1851391) req@ffff880090dda680 x1830881265455488/t17179874325(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/448 e 0 to 0 dl 1746065231 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.230146:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dda680 with x1830881265455488 ext(1048576->1851391) 00010000:00010000:2.0:1746065220.230155:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 46 pid: 1880 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.230168:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 46 pid: 1880 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746065220.230174:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880090dda680 00000100:00100000:2.0:1746065220.237961:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265456128:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17352us (18321us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065220.237976:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6328 00002000:00100000:2.0:1746065220.237985:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880090dd8a80 x1830881265456128/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.237993:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd8a80 with x1830881265456128 ext(2097152->3145727) 00002000:00010000:2.0:1746065220.237998:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090dd8a80 00000100:00100000:0.0:1746065220.239541:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.239605:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265456256 00000100:00100000:3.0:1746065220.239613:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265456256 00010000:00010000:3.0:1746065220.239642:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 44 pid: 1880 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.239678:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8250 00000100:00100000:3.0:1746065220.239685:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+44:2006:x1830881265456256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065220.239696:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065220.239712:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 44 pid: 1880 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.239722:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 44 pid: 1880 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.239742:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a400/0xad6b7ddc1479e89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1851391) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa7 expref: 44 pid: 1880 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.239791:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.239793:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.239799:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.239808:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.239835:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.239845:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264011008:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065220.239916:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.241707:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.241853:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265456512 00000100:00100000:2.0:1746065220.241859:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265456512 00000100:00100000:2.0:1746065220.241901:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14616 00000100:00100000:2.0:1746065220.241908:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2578:x1830881265456512:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065220.241924:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065220.241937:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3de00/0xad6b7ddc1479f23 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b17 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.241992:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1479f2a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242002:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1479f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242011:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1479f2a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242021:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1479f31 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242026:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1479f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242031:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1479f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242104:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3dc00/0xad6b7ddc1479f38 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242112:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3dc00/0xad6b7ddc1479f38 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242117:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3dc00/0xad6b7ddc1479f38 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065220.242124:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065220.242179:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1479f2a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242185:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1479f2a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242189:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1479f2a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242194:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1479f2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242199:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3d200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065220.242202:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1479f2a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242210:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1479f2a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242219:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065220.242221:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065220.242224:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1479f2a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242228:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d200/0xad6b7ddc1479f2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242250:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1479f31 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242254:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1479f31 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242259:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1479f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242262:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012ef3c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065220.242264:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1479f31 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242268:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1479f31 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242272:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095561000) 00010000:00010000:2.0:1746065220.242274:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065220.242276:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1479f31 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242280:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3c600/0xad6b7ddc1479f31 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.242306:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3de00/0xad6b7ddc1479f23 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b17 expref: 37 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.242314:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3dc00/0xad6b7ddc1479f38 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b17 expref: 36 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.242327:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065220.242329:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065220.242330:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3dc00, rc 0) 00000100:00100000:2.0:1746065220.242365:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2578:x1830881265456512:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 457us (663us total) trans 8589937143 rc 0/0 00000100:00100000:2.0:1746065220.242370:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14616 00000100:00100000:0.0:1746065220.247639:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.248075:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264011008:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065220.248092:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065220.248139:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265456256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8454us (8602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.248149:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8250 00000100:00100000:3.0:1746065220.248264:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265456768 00000100:00100000:3.0:1746065220.248270:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265456768 00002000:00100000:3.0:1746065220.248300:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880090dd9500 x1830881265456768/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.248308:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9500 with x1830881265456768 ext(1048576->2097151) 00002000:00010000:3.0:1746065220.248311:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090dd9500 00000100:00100000:3.0:1746065220.249108:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6329 00000100:00100000:3.0:1746065220.249116:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265456768:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065220.263531:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.263693:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265456896 00000100:00100000:0.0:1746065220.263701:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265456896 00000100:00100000:1.0:1746065220.264358:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17638 00000100:00100000:1.0:1746065220.264367:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2573:x1830881265456896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065220.264381:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.264394:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b1e expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.264418:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 13 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.264425:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065220.264426:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065220.264429:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 37 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.264452:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 13 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.264461:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 13 pid: 9548 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.264477:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264011136:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065220.264542:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065220.269271:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265456768:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 20147us (21631us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065220.269281:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6329 00002000:00100000:3.0:1746065220.269292:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880090dd9500 x1830881265456768/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.269300:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9500 with x1830881265456768 ext(1048576->2097151) 00002000:00010000:3.0:1746065220.269307:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090dd9500 00000100:00100000:0.0:1746065220.271085:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.271154:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264011136:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065220.271177:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 37 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.271191:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047600, rc 0) 00000100:00100000:1.0:1746065220.271215:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2573:x1830881265456896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6850us (7692us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.271222:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17638 00000100:00100000:3.0:1746065220.271276:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265457024 00000100:00100000:3.0:1746065220.271281:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265457024 00002000:00100000:3.0:1746065220.271307:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2478079) req@ffff880090ddb100 x1830881265457024/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.271314:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddb100 with x1830881265457024 ext(2097152->2478079) 00010000:00010000:3.0:1746065220.271344:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 14 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.271355:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 14 pid: 9548 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746065220.271361:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090ddb100 00000100:00100000:3.0:1746065220.271382:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2085 00000100:00100000:3.0:1746065220.271387:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265457024:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:0.0:1746065220.289520:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.289857:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265457152 00000100:00100000:1.0:1746065220.289865:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265457152 00000100:00100000:1.0:1746065220.289917:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17639 00000100:00100000:1.0:1746065220.289924:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2569:x1830881265457152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065220.289940:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.289955:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1479f4d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b25 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.289976:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065220.289978:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065220.289984:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1479f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b25 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.289997:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1479f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b25 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.290011:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046400, rc 0) 00000100:00100000:1.0:1746065220.290051:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2569:x1830881265457152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 127us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.290056:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17639 00000100:00100000:0.0:1746065220.299495:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265457024:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 28096us (28403us total) trans 21474841711 rc 0/0 00000100:00100000:0.0:1746065220.299509:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2085 00002000:00100000:0.0:1746065220.299521:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2478079) req@ffff880090ddb100 x1830881265457024/t21474841711(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/448 e 0 to 0 dl 1746065231 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065220.299536:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddb100 with x1830881265457024 ext(2097152->2478079) 00010000:00010000:0.0:1746065220.299546:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 16 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746065220.299562:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 16 pid: 9548 timeout: 916 lvb_type: 0 00002000:00010000:0.0:1746065220.299568:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090ddb100 00000100:00100000:0.0:1746065220.301019:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.301398:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265457280 00000100:00100000:3.0:1746065220.301407:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265457280 00000100:00100000:3.0:1746065220.302100:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17640 00000100:00100000:3.0:1746065220.302108:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2578:x1830881265457280:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065220.302123:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.302139:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b2c expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.302166:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.302172:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.302174:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.302177:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1282048->1667071] (req 1282048->1667071) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.302203:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.302212:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 25 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.302223:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264011264:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065220.304538:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.305138:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065220.305276:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265457536 00000100:00100000:1.0:1746065220.305283:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265457536 00002000:00100000:1.0:1746065220.305314:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880091bc0000 x1830881265457536/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065220.305331:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc0000 with x1830881265457536 ext(2097152->3145727) 00002000:00010000:1.0:1746065220.305334:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc0000 00000100:00100000:1.0:1746065220.305800:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6330 00000100:00100000:1.0:1746065220.305807:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265457536:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065220.314381:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.314452:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.314536:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264011264:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.314559:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1282048->1667071] (req 1282048->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.314572:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6e00, rc 0) 00000100:00100000:3.0:1746065220.314612:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+44:2578:x1830881265457280:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 12502us (13594us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.314619:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17640 00000100:00100000:2.0:1746065220.314678:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265457664 00000100:00100000:2.0:1746065220.314683:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265457664 00010000:00010000:2.0:1746065220.314704:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 16 pid: 9548 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.314719:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265457792 00000100:00100000:2.0:1746065220.314721:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265457792 00010000:00010000:2.0:1746065220.314727:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 28 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.314741:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8251 00000100:00100000:2.0:1746065220.314746:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265457664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065220.314755:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065220.314766:0:7191:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065219 -> 1746065220 00002000:00010000:2.0:1746065220.314768:0:7191:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065219 -> 1746065220 00010000:00010000:2.0:1746065220.314786:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 16 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.314794:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 16 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.314811:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f0e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2478079) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b02 expref: 16 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.314823:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.314824:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.314830:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 36 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.314837:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 36 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.314923:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8252 00000100:00100000:3.0:1746065220.314929:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265457792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065220.314937:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065220.314948:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 28 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.314958:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 28 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.314969:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047400/0xad6b7ddc1479f1c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b10 expref: 28 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.315109:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 36 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065220.315124:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264011392:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065220.315164:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435000 going to sleep for 11 seconds 00010000:00010000:3.0:1746065220.315339:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.315340:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.315345:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 43 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.315351:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 43 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.315365:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 43 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.315371:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264011520:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065220.315387:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b180 going to sleep for 11 seconds 00000100:00100000:1.0:1746065220.323701:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265457536:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17885us (19160us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065220.323712:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6330 00002000:00100000:1.0:1746065220.323722:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880091bc0000 x1830881265457536/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065220.323730:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc0000 with x1830881265457536 ext(2097152->3145727) 00002000:00010000:1.0:1746065220.323735:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc0000 00000100:00100000:2.0:1746065220.323911:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264011392:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065220.323927:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065220.323946:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac525050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265457664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9199us (9571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.323953:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8251 00000100:00100000:3.0:1746065220.324293:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264011520:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065220.324303:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065220.324327:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265457792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9389us (9866us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.324333:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8252 00000100:00100000:0.0:1746065220.325915:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.328409:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265458048 00000100:00100000:1.0:1746065220.328418:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265458048 00002000:00100000:1.0:1746065220.328454:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1282048->1286143) req@ffff880091bc2a00 x1830881265458048/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065220.328469:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc2a00 with x1830881265458048 ext(1282048->1286143) 00002000:00010000:1.0:1746065220.328474:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc2a00 00000100:00100000:1.0:1746065220.328495:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6331 00000100:00100000:1.0:1746065220.328501:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265458048:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065220.328603:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265458048:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 102us (2693us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065220.328609:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6331 00002000:00100000:1.0:1746065220.328614:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1282048->1286143) req@ffff880091bc2a00 x1830881265458048/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/4536 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065220.328621:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc2a00 with x1830881265458048 ext(1282048->1286143) 00002000:00010000:1.0:1746065220.328623:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc2a00 00000100:00100000:0.0:1746065220.334713:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.334805:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265458304 00000100:00100000:2.0:1746065220.334812:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265458304 00002000:00100000:2.0:1746065220.334847:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091bc1180 x1830881265458304/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.334856:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1180 with x1830881265458304 ext(2097152->4194303) 00002000:00010000:2.0:1746065220.334860:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc1180 00000100:00100000:2.0:1746065220.334890:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6332 00000100:00100000:2.0:1746065220.334897:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265458304:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065220.341495:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.342265:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.342886:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265458688 00000100:00100000:0.0:1746065220.342894:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265458688 00002000:00100000:0.0:1746065220.342928:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1662976->1667071) req@ffff880091bc1f80 x1830881265458688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065220.342937:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1f80 with x1830881265458688 ext(1662976->1667071) 00002000:00010000:0.0:1746065220.342943:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc1f80 00000100:00100000:0.0:1746065220.342968:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6333 00000100:00100000:0.0:1746065220.342975:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265458688:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065220.343058:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265458432 00000100:00100000:2.0:1746065220.343062:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265458432 00000100:00100000:2.0:1746065220.343084:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17641 00000100:00100000:2.0:1746065220.343088:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2569:x1830881265458432:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065220.343097:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065220.343110:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1479f5b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b33 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.343132:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.343133:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.343139:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1479f5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b33 expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.343151:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1479f5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b33 expref: 16 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.343160:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3ce00, rc 0) 00000100:00100000:2.0:1746065220.343194:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2569:x1830881265458432:12345-192.168.202.27@tcp:101:cat.0 Request processed in 104us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.343199:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17641 00000100:00100000:0.0:1746065220.344025:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265458688:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 1049us (1759us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065220.344032:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6333 00002000:00100000:0.0:1746065220.344037:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1662976->1667071) req@ffff880091bc1f80 x1830881265458688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/4536 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065220.344044:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1f80 with x1830881265458688 ext(1662976->1667071) 00002000:00010000:0.0:1746065220.344047:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc1f80 00000100:00100000:0.0:1746065220.358126:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.358316:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265458944 00000100:00100000:3.0:1746065220.358332:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265458944 00000100:00100000:3.0:1746065220.358380:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14617 00000100:00100000:3.0:1746065220.358387:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2581:x1830881265458944:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065220.358408:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.358421:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc1479f62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b3a expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.358476:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f69 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358487:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358495:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f69 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358506:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358510:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358515:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358583:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f77 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358591:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358596:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f77 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:3.0:1746065220.358603:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065220.358659:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f69 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358664:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f69 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358669:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f69 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358673:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358677:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065220.358680:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f69 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358686:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f69 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358694:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065220.358696:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065220.358699:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f69 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358703:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358716:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358723:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f70 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358727:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358730:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065220.358732:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358736:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f70 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358740:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5d500) 00010000:00010000:3.0:1746065220.358742:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065220.358743:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f70 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358747:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7c00/0xad6b7ddc1479f70 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065220.358786:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc1479f62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b3a expref: 17 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.358795:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b3a expref: 16 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.358800:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065220.358801:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065220.358803:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6200, rc 0) 00000100:00100000:3.0:1746065220.358837:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2581:x1830881265458944:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 451us (719us total) trans 8589937144 rc 0/0 00000100:00100000:3.0:1746065220.358843:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14617 00000100:00100000:0.0:1746065220.359480:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.363662:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.365794:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265459200 00000100:00100000:1.0:1746065220.365804:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265459200 00002000:00100000:1.0:1746065220.365840:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091bc3b80 x1830881265459200/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065220.365849:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc3b80 with x1830881265459200 ext(2097152->4194303) 00002000:00010000:1.0:1746065220.365854:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc3b80 00000100:00100000:1.0:1746065220.365877:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265459456 00000100:00100000:1.0:1746065220.365880:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265459456 00002000:00100000:1.0:1746065220.365891:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091bc0a80 x1830881265459456/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065220.365898:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc0a80 with x1830881265459456 ext(3145728->4194303) 00002000:00010000:1.0:1746065220.365900:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc0a80 00000100:00100000:1.0:1746065220.365911:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6334 00000100:00100000:1.0:1746065220.365917:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265459200:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065220.368515:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6335 00000100:00100000:1.0:1746065220.368528:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265459456:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065220.372506:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265458304:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 37602us (37794us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065220.372517:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6332 00002000:00100000:3.0:1746065220.372526:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091bc1180 x1830881265458304/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.372534:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1180 with x1830881265458304 ext(2097152->4194303) 00002000:00010000:3.0:1746065220.372539:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc1180 00000100:00100000:0.0:1746065220.373042:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.373085:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265459712 00000100:00100000:2.0:1746065220.373093:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265459712 00000100:00100000:2.0:1746065220.373139:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5496 00000100:00100000:2.0:1746065220.373145:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2578:x1830881265459712:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065220.373330:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2578:x1830881265459712:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 185us (288us total) trans 8589937145 rc 0/0 00000100:00100000:2.0:1746065220.373336:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5496 00000100:00100000:1.0:1746065220.406407:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265459200:12345-192.168.202.27@tcp:3:cat.0 Request processed in 40481us (46920us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065220.406416:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6334 00002000:00100000:1.0:1746065220.406427:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880091bc3b80 x1830881265459200/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065220.406436:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc3b80 with x1830881265459200 ext(2097152->4194303) 00002000:00010000:1.0:1746065220.406441:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc3b80 00000100:00100000:0.0:1746065220.426746:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.426817:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265459968 00000100:00100000:3.0:1746065220.426825:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265459968 00000100:00100000:3.0:1746065220.426861:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5497 00000100:00100000:3.0:1746065220.426868:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+37:2573:x1830881265459968:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065220.427033:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2573:x1830881265459968:12345-192.168.202.27@tcp:35:cat.0 Request processed in 165us (293us total) trans 8589937146 rc 0/0 00000100:00100000:3.0:1746065220.427039:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5497 00000100:00100000:1.0:1746065220.427965:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265459456:12345-192.168.202.27@tcp:3:cat.0 Request processed in 59439us (64308us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065220.427973:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6335 00002000:00100000:1.0:1746065220.427981:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091bc0a80 x1830881265459456/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065220.427991:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc0a80 with x1830881265459456 ext(3145728->4194303) 00002000:00010000:1.0:1746065220.427995:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc0a80 00000100:00100000:0.0:1746065220.438366:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.441599:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265460096 00000100:00100000:2.0:1746065220.441610:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265460096 00000100:00100000:2.0:1746065220.441667:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17642 00000100:00100000:2.0:1746065220.441675:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2581:x1830881265460096:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065220.441690:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065220.441705:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b41 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.441731:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 36 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.441739:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1479f5b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b33 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.441745:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.441747:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.441750:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3887104->4194303] (req 3887104->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 17 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.441790:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1479f5b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b33 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.441801:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1479f5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b33 expref: 17 pid: 9548 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.441812:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264011648:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065220.441898:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 36 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.441906:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 36 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.441913:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264011776:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065220.441933:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.451586:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.451617:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.451641:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.451673:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265460224 00000100:00100000:0.0:1746065220.451680:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265460224 00010000:00010000:0.0:1746065220.451712:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 37 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746065220.451732:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265460480 00000100:00100000:0.0:1746065220.451734:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265460480 00010000:00010000:0.0:1746065220.451743:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1479f5b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b33 expref: 18 pid: 9548 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746065220.451755:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8253 00000100:00100000:0.0:1746065220.451761:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881265460224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065220.451850:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8254 00000100:00100000:1.0:1746065220.451858:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265460480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065220.451865:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065220.451882:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1479f5b lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b33 expref: 18 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.451896:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1479f5b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b33 expref: 18 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.451915:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065220.451947:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265460480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 90us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.451952:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8254 00000100:00100000:1.0:1746065220.452041:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265460352 00000100:00100000:1.0:1746065220.452043:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265460352 00000100:00100000:1.0:1746065220.452061:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17643 00000100:00100000:1.0:1746065220.452065:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2569:x1830881265460352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065220.452076:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.452085:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b48 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.452095:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065220.452100:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3887104->4194303] (req 3887104->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 19 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.452104:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065220.452107:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.452133:0:9548:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3887104->4194303] (req 3887104->4194303) gid 0 flags: 0x60000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 19 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.452147:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.452154:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:1.0:1746065220.452173:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2569:x1830881265460352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 107us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.452177:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17643 00010000:00010000:2.0:1746065220.452334:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ce00/0xad6b7ddc1479f5b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b33 expref: 18 pid: 9548 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.452349:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264011648:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065220.452358:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264011776:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065220.452371:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3887104->4194303] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 17 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.452377:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3c000, rc 0) 00000100:00100000:2.0:1746065220.452394:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2581:x1830881265460096:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10722us (14037us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.452399:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17642 00010000:00010000:0.0:1746065220.452445:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065220.452455:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 37 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746065220.452462:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 37 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746065220.452472:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131047600/0xad6b7ddc1479f46 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b1e expref: 37 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746065220.452599:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065220.452601:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065220.452607:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065220.452614:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.452703:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.452714:0:7191:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 16 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.452724:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264012032:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065220.452796:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.459200:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.459271:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265460736 00000100:00100000:2.0:1746065220.459279:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265460736 00002000:00100000:2.0:1746065220.459335:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3887104->3891199) req@ffff88009856dc00 x1830881265460736/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.459344:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856dc00 with x1830881265460736 ext(3887104->3891199) 00010000:00010000:2.0:1746065220.459351:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 17 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.459362:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 17 pid: 12260 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746065220.459369:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009856dc00 00000100:00100000:2.0:1746065220.459397:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2086 00000100:00100000:2.0:1746065220.459404:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265460736:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065220.461134:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265460736:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 1725us (1936us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065220.461143:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2086 00002000:00100000:2.0:1746065220.461149:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3887104->3891199) req@ffff88009856dc00 x1830881265460736/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/4536 e 0 to 0 dl 1746065231 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.461157:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856dc00 with x1830881265460736 ext(3887104->3891199) 00010000:00010000:2.0:1746065220.461164:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 17 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.461175:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 17 pid: 12260 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746065220.461180:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009856dc00 00000100:00100000:0.0:1746065220.467617:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.467645:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.467701:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265461120 00000100:00100000:3.0:1746065220.467708:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265461120 00000100:00100000:3.0:1746065220.467748:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17644 00000100:00100000:3.0:1746065220.467754:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2581:x1830881265461120:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065220.467768:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.467793:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b4f expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.467817:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 43 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.467825:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1479f4d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b25 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.467831:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479db0 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a45 expref: 43 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.467835:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065220.467837:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065220.467839:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->4349951] (req 4194304->4349951) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.467862:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479db0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a45 expref: 43 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.467870:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479db0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a45 expref: 43 pid: 1880 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.467879:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264012160:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.467934:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1479f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b25 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.467941:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1479f4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b25 expref: 26 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.467948:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264012288:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.467970:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 43 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.467977:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 43 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.467984:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264012416:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065220.467996:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065220.468337:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265460992 00000100:00100000:2.0:1746065220.468341:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265460992 00002000:00100000:2.0:1746065220.468362:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3887104->4194303) req@ffff88009856ea00 x1830881265460992/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.468370:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856ea00 with x1830881265460992 ext(3887104->4194303) 00010000:00010000:2.0:1746065220.468375:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 17 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.468383:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 17 pid: 12260 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746065220.468393:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009856ea00 00000100:00100000:2.0:1746065220.468413:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2087 00000100:00100000:2.0:1746065220.468417:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265460992:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065220.468739:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264012032:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065220.468752:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065220.468787:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881265460224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 17011us (17194us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.468795:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8253 00000100:00100000:0.0:1746065220.481837:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.482198:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264012160:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065220.482211:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264012288:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065220.482219:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264012416:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.482247:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [4194304->4349951] (req 4194304->4349951) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.482261:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3800, rc 0) 00000100:00100000:3.0:1746065220.482920:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2581:x1830881265461120:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 15162us (15270us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.482928:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17644 00000100:00100000:1.0:1746065220.486634:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265461248 00000100:00100000:1.0:1746065220.486651:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265461248 00010000:00010000:1.0:1746065220.486719:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479db0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a45 expref: 44 pid: 1880 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.486786:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8255 00000100:00100000:1.0:1746065220.486800:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265461248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065220.486819:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065220.486842:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479db0 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a45 expref: 44 pid: 1880 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.486854:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479db0 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a45 expref: 44 pid: 1880 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.486875:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fda400/0xad6b7ddc1479db0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a45 expref: 44 pid: 1880 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.486904:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065220.486979:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265461248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 180us (5153us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.486986:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8255 00000100:00100000:2.0:1746065220.487304:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.487801:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.491219:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265461504 00000100:00100000:1.0:1746065220.491230:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265461504 00010000:00010000:1.0:1746065220.491266:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 43 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746065220.491351:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265461376 00000100:00100000:0.0:1746065220.491355:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265461376 00010000:00010000:0.0:1746065220.491370:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1479f4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b25 expref: 26 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:0.0:1746065220.491393:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8256 00000100:00100000:0.0:1746065220.491400:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265461504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065220.491411:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065220.491427:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 43 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746065220.491437:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 43 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746065220.491455:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc1479f15 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b09 expref: 43 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746065220.491473:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065220.491516:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881265461504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 116us (4219us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065220.491521:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8256 00000100:00100000:0.0:1746065220.491535:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8257 00000100:00100000:0.0:1746065220.491540:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2005:x1830881265461376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065220.491545:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065220.491552:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1479f4d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b25 expref: 26 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746065220.491559:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1479f4d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b25 expref: 26 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746065220.491568:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc1479f4d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b25 expref: 26 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:0.0:1746065220.491580:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065220.491582:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065220.491587:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065220.491593:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065220.491618:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 25 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065220.491628:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264012544:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065220.491680:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065220.500279:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265460992:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 31853us (32660us total) trans 21474841712 rc 0/0 00000100:00100000:3.0:1746065220.500291:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2087 00002000:00100000:3.0:1746065220.500301:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (3887104->4194303) req@ffff88009856ea00 x1830881265460992/t21474841712(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/448 e 0 to 0 dl 1746065231 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.500310:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856ea00 with x1830881265460992 ext(3887104->4194303) 00010000:00010000:3.0:1746065220.500331:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 19 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.500344:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 19 pid: 12260 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746065220.500350:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009856ea00 00000100:00100000:3.0:1746065220.500408:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.500423:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265461760 00000100:00100000:3.0:1746065220.500429:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265461760 00002000:00100000:3.0:1746065220.500456:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4345856->4349951) req@ffff88012dc3d500 x1830881265461760/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.500463:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d500 with x1830881265461760 ext(4345856->4349951) 00002000:00010000:3.0:1746065220.500466:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3d500 00000100:00100000:3.0:1746065220.500479:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6336 00000100:00100000:3.0:1746065220.500485:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265461760:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065220.500565:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265461760:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 79us (156us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065220.500570:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6336 00002000:00100000:3.0:1746065220.500575:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4345856->4349951) req@ffff88012dc3d500 x1830881265461760/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/4536 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.500581:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3d500 with x1830881265461760 ext(4345856->4349951) 00002000:00010000:3.0:1746065220.500584:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3d500 00000100:00100000:2.0:1746065220.500743:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264012544:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065220.500757:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065220.500786:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2005:x1830881265461376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9246us (12986us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.500792:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8257 00000100:00100000:0.0:1746065220.508029:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.508100:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265461888 00000100:00100000:2.0:1746065220.508108:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265461888 00010000:00010000:2.0:1746065220.508139:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 19 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.508173:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8258 00000100:00100000:2.0:1746065220.508180:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2007:x1830881265461888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065220.508191:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065220.508207:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 19 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.508218:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 19 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.508242:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3c000/0xad6b7ddc1479f85 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3887104->4194303) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b41 expref: 19 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.508267:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.508269:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.508275:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 18 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.508281:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 18 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.508311:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 18 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065220.508332:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264012672:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065220.510584:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.510725:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265462144 00000100:00100000:3.0:1746065220.510732:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265462144 00000100:00100000:3.0:1746065220.510804:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5498 00000100:00100000:3.0:1746065220.510813:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2581:x1830881265462144:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065220.510991:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2581:x1830881265462144:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 178us (413us total) trans 8589937147 rc 0/0 00000100:00100000:3.0:1746065220.510997:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5498 00000100:00100000:2.0:1746065220.519378:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065220.519418:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264012672:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065220.519435:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065220.519486:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2007:x1830881265461888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11305us (11463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.519495:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8258 00000100:00100000:0.0:1746065220.521894:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.525757:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265462400 00000100:00100000:3.0:1746065220.525769:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265462400 00002000:00100000:3.0:1746065220.525823:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88009856d180 x1830881265462400/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.525831:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d180 with x1830881265462400 ext(3145728->4194303) 00002000:00010000:3.0:1746065220.525836:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856d180 00000100:00100000:3.0:1746065220.526023:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6337 00000100:00100000:3.0:1746065220.526030:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265462400:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065220.537030:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265462400:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 10992us (15134us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065220.537040:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6337 00002000:00100000:3.0:1746065220.537049:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88009856d180 x1830881265462400/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.537057:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856d180 with x1830881265462400 ext(3145728->4194303) 00002000:00010000:3.0:1746065220.537062:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009856d180 00000100:00100000:0.0:1746065220.550143:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.550245:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265462528 00000100:00100000:3.0:1746065220.550253:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265462528 00000100:00100000:3.0:1746065220.550481:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17645 00000100:00100000:3.0:1746065220.550489:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265462528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.550616:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.550634:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f9a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b56 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.550724:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264012800:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065220.551649:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.553506:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.553828:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264012800:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065220.553853:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f9a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b56 expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.553864:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf7e00/0xad6b7ddc1479f9a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b56 expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.553888:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7e00, rc 0) 00000100:00100000:2.0:1746065220.553924:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265462784 00000100:00100000:2.0:1746065220.553929:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265462784 00000100:00100000:3.0:1746065220.553934:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265462528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3446us (3797us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065220.553941:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17645 00000100:00100000:2.0:1746065220.553965:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14618 00000100:00100000:2.0:1746065220.553970:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+38:2587:x1830881265462784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065220.553986:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065220.554000:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479fa1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b5d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.554074:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479fa8 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.554085:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.554094:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479fa8 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065220.554103:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065220.554178:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc1479fa1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b5d expref: 41 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.554192:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b5d expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.554198:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065220.554201:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1746065220.554203:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6000, rc 0) 00000100:00100000:2.0:1746065220.554222:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2587:x1830881265462784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 252us (721us total) trans 8589937148 rc 0/0 00000100:00100000:2.0:1746065220.554227:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14618 00000100:00100000:1.0:1746065220.559977:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.560391:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.560451:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265462912 00000100:00100000:3.0:1746065220.560459:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265462912 00000100:00100000:3.0:1746065220.560501:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265463040 00000100:00100000:3.0:1746065220.560503:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265463040 00000100:00100000:3.0:1746065220.560524:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17646 00000100:00100000:3.0:1746065220.560531:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881265462912:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.560546:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.560559:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1479fb6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b64 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.560607:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264012928:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065220.560672:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065220.560686:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17647 00000100:00100000:3.0:1746065220.560691:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881265463040:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.560697:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.560706:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1479fbd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b6b expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.560717:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.560719:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.560726:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1479fbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b6b expref: 37 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.560738:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1479fbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b6b expref: 37 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.560746:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3c00, rc 0) 00000100:00100000:3.0:1746065220.560764:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881265463040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 73us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.560769:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17647 00000100:00100000:0.0:1746065220.561704:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.561768:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265463296 00000100:00100000:3.0:1746065220.561793:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265463296 00002000:00100000:3.0:1746065220.561818:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4349952->5038079) req@ffff88009856f480 x1830881265463296/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.561827:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f480 with x1830881265463296 ext(4349952->5038079) 00002000:00010000:3.0:1746065220.561831:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856f480 00000100:00100000:3.0:1746065220.561843:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6338 00000100:00100000:3.0:1746065220.561849:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265463296:12345-192.168.202.27@tcp:3:cat.0 00002000:00010000:3.0:1746065220.571198:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065219 -> 1746065220 00000100:00100000:3.0:1746065220.571217:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264012928:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065220.571244:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1479fb6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b64 expref: 43 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.571257:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2200/0xad6b7ddc1479fb6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b64 expref: 43 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065220.571829:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265463296:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9977us (10125us total) trans 0 rc 688128/688128 00000100:00100000:2.0:1746065220.571837:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6338 00002000:00100000:2.0:1746065220.571846:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4349952->5038079) req@ffff88009856f480 x1830881265463296/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 688128/688128 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.571855:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856f480 with x1830881265463296 ext(4349952->5038079) 00002000:00010000:2.0:1746065220.571858:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856f480 00010000:00010000:3.0:1746065220.573267:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2200, rc 0) 00000100:00100000:3.0:1746065220.573307:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881265462912:12345-192.168.202.27@tcp:101:cat.0 Request processed in 12773us (13334us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065220.573314:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17646 00000100:00100000:0.0:1746065220.580309:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.580407:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265463424 00000100:00100000:3.0:1746065220.580414:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265463424 00000100:00100000:3.0:1746065220.580448:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17648 00000100:00100000:3.0:1746065220.580454:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265463424:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.580469:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.580482:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479fc4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b72 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.580521:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264013056:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065220.580596:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065220.583468:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264013056:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065220.583493:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479fc4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b72 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.583505:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc1479fc4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b72 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.583561:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3200, rc 0) 00000100:00100000:3.0:1746065220.584325:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265463424:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3858us (4010us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065220.584333:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17648 00000100:00100000:0.0:1746065220.587287:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.587400:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265463808 00000100:00100000:3.0:1746065220.587407:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265463808 00000100:00100000:3.0:1746065220.587442:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17649 00000100:00100000:3.0:1746065220.587448:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265463808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.587461:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.587475:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479fcb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b79 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.587517:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264013184:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065220.588528:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.589479:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.589549:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265463680 00000100:00100000:2.0:1746065220.589555:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265463680 00002000:00100000:2.0:1746065220.589586:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009856e680 x1830881265463680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 504/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.589594:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856e680 with x1830881265463680 ext(1048576->2097151) 00002000:00010000:2.0:1746065220.589597:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856e680 00000100:00100000:2.0:1746065220.589612:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6339 00000100:00100000:2.0:1746065220.589617:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881265463680:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065220.593822:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264013184:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065220.593853:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479fcb lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b79 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.593866:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2c00/0xad6b7ddc1479fcb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b79 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.593893:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2c00, rc 0) 00000100:00100000:3.0:1746065220.593932:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265463808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6483us (6649us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065220.593940:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17649 00000100:00100000:3.0:1746065220.595874:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+42:2007:x1830881265463680:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6250us (6390us total) trans 0 rc 663552/663552 00000100:00100000:3.0:1746065220.595884:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6339 00002000:00100000:3.0:1746065220.595893:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009856e680 x1830881265463680/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 504/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 663552/663552 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.595902:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856e680 with x1830881265463680 ext(1048576->2097151) 00002000:00010000:3.0:1746065220.595906:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009856e680 00000100:00100000:2.0:1746065220.604218:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.604300:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265464064 00000100:00100000:3.0:1746065220.604309:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265464064 00000100:00100000:3.0:1746065220.604355:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5499 00000100:00100000:3.0:1746065220.604361:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2569:x1830881265464064:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065220.606122:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2569:x1830881265464064:12345-192.168.202.27@tcp:35:cat.0 Request processed in 1755us (1907us total) trans 8589937149 rc 0/0 00000100:00100000:3.0:1746065220.606131:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5499 00000100:00100000:0.0:1746065220.610286:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.610728:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265464192 00000100:00100000:3.0:1746065220.610735:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265464192 00000100:00100000:3.0:1746065220.611976:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17650 00000100:00100000:3.0:1746065220.611988:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+42:2587:x1830881265464192:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.612004:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.612020:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b80 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.612045:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.612051:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065220.612053:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065220.612056:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 43 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.612081:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 24 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.612091:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 24 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.612102:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264013312:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065220.613442:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.626239:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.626305:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264013312:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065220.626337:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 43 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.626352:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2000, rc 0) 00000100:00100000:3.0:1746065220.626387:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+43:2587:x1830881265464192:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14403us (16107us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.626395:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17650 00000100:00100000:2.0:1746065220.627884:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265464320 00000100:00100000:2.0:1746065220.627890:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265464320 00002000:00100000:2.0:1746065220.627919:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4349951) req@ffff88009856c000 x1830881265464320/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.627927:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c000 with x1830881265464320 ext(4194304->4349951) 00010000:00010000:2.0:1746065220.627933:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 25 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.627944:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 25 pid: 12260 timeout: 916 lvb_type: 0 00002000:00010000:2.0:1746065220.627949:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856c000 00000100:00100000:2.0:1746065220.631058:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2088 00000100:00100000:2.0:1746065220.631072:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265464320:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065220.639908:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.642821:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265464576 00000100:00100000:2.0:1746065220.642832:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265464576 00000100:00100000:2.0:1746065220.642881:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14619 00000100:00100000:2.0:1746065220.642888:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2589:x1830881265464576:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065220.642907:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065220.642923:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ee00/0xad6b7ddc1479fd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b87 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.642999:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.643012:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3dc00/0xad6b7ddc1479f38 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b17 expref: 41 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.643019:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f77 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b3a expref: 17 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.643026:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.643053:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f77 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b3a expref: 17 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.643062:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b3a expref: 17 pid: 7204 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.643073:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264013440:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065220.643148:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3dc00/0xad6b7ddc1479f38 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b17 expref: 41 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.643156:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3dc00/0xad6b7ddc1479f38 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b17 expref: 41 pid: 7205 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.643163:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264013568:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065220.643182:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065220.646116:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2004:x1830881265464320:12345-192.168.202.27@tcp:4:cat.0 Request processed in 15038us (19872us total) trans 17179874326 rc 0/0 00000100:00100000:3.0:1746065220.646127:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2088 00002000:00100000:3.0:1746065220.646138:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4349951) req@ffff88009856c000 x1830881265464320/t17179874326(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/448 e 0 to 0 dl 1746065231 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.646147:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009856c000 with x1830881265464320 ext(4194304->4349951) 00010000:00010000:3.0:1746065220.646157:0:29492:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 27 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.646168:0:29492:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 27 pid: 12260 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746065220.646174:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009856c000 00000100:00100000:0.0:1746065220.647714:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.648618:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.648693:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265464832 00000100:00100000:1.0:1746065220.648701:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265464832 00010000:00010000:1.0:1746065220.648731:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3dc00/0xad6b7ddc1479f38 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b17 expref: 42 pid: 7205 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.648753:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265464704 00000100:00100000:1.0:1746065220.648755:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265464704 00010000:00010000:1.0:1746065220.648763:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f77 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b3a expref: 18 pid: 7204 timeout: 916 lvb_type: 0 00000100:00100000:1.0:1746065220.648789:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8259 00000100:00100000:1.0:1746065220.648796:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881265464832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065220.648807:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065220.648813:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3dc00/0xad6b7ddc1479f38 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b17 expref: 42 pid: 7205 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.648822:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3dc00/0xad6b7ddc1479f38 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b17 expref: 42 pid: 7205 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.648841:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065220.648845:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065220.648852:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065220.648856:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065220.648893:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881265464832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.648899:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8259 00000100:00100000:1.0:1746065220.648912:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8260 00000100:00100000:1.0:1746065220.648917:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265464704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065220.648923:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065220.648927:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f77 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b3a expref: 18 pid: 7204 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.648933:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f77 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b3a expref: 18 pid: 7204 timeout: 916 lvb_type: 0 00010000:00010000:1.0:1746065220.648943:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065220.648946:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065220.648951:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065220.648956:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065220.648968:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065220.648981:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265464704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 64us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.648986:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8260 00010000:00010000:2.0:1746065220.649476:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc1479f77 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b3a expref: 17 pid: 7204 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.649494:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264013440:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065220.649506:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3dc00/0xad6b7ddc1479f38 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b17 expref: 41 pid: 7205 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.649513:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264013568:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065220.649529:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.649536:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.649541:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065220.649556:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065220.649666:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ee00/0xad6b7ddc1479fd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b87 expref: 42 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.649681:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b87 expref: 41 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.649686:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065220.649689:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065220.649690:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656e600, rc 0) 00000100:00100000:2.0:1746065220.649716:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2589:x1830881265464576:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6828us (9817us total) trans 8589937150 rc 0/0 00000100:00100000:2.0:1746065220.649721:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14619 00000100:00100000:0.0:1746065220.651940:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.652350:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265464960 00000100:00100000:3.0:1746065220.652357:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265464960 00010000:00010000:3.0:1746065220.652383:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 27 pid: 12260 timeout: 916 lvb_type: 0 00000100:00100000:3.0:1746065220.652406:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8261 00000100:00100000:3.0:1746065220.652412:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2006:x1830881265464960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065220.652422:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065220.652437:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 27 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.652447:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 27 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.652468:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc1479f93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4349951) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b4f expref: 27 pid: 12260 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.652483:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.652484:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.652490:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.652497:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.652522:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 42 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.652532:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264013696:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065220.652583:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065220.664916:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264013696:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065220.664936:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065220.664985:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2006:x1830881265464960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 12572us (13049us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.664994:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8261 00000100:00100000:0.0:1746065220.674679:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.674724:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.687710:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265465216 00000100:00100000:2.0:1746065220.687722:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265465216 00002000:00100000:2.0:1746065220.687764:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880097a6ed80 x1830881265465216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.687794:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ed80 with x1830881265465216 ext(2097152->4194303) 00002000:00010000:2.0:1746065220.687798:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6ed80 00000100:00100000:2.0:1746065220.687819:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265465472 00000100:00100000:2.0:1746065220.687822:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265465472 00002000:00100000:2.0:1746065220.687836:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097a6dc00 x1830881265465472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.687842:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6dc00 with x1830881265465472 ext(2097152->4194303) 00002000:00010000:2.0:1746065220.687844:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6dc00 00000100:00100000:2.0:1746065220.687863:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6340 00000100:00100000:2.0:1746065220.687870:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265465216:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065220.688873:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6341 00000100:00100000:2.0:1746065220.688880:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881265465472:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065220.719170:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265465216:12345-192.168.202.27@tcp:3:cat.0 Request processed in 31293us (44491us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065220.719181:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6340 00002000:00100000:2.0:1746065220.719192:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880097a6ed80 x1830881265465216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.719200:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ed80 with x1830881265465216 ext(2097152->4194303) 00002000:00010000:2.0:1746065220.719205:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6ed80 00000100:00100000:2.0:1746065220.730394:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+37:2006:x1830881265465472:12345-192.168.202.27@tcp:3:cat.0 Request processed in 41506us (55660us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065220.730404:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6341 00002000:00100000:2.0:1746065220.730413:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097a6dc00 x1830881265465472/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.730421:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6dc00 with x1830881265465472 ext(2097152->4194303) 00002000:00010000:2.0:1746065220.730426:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097a6dc00 00000100:00100000:0.0:1746065220.753946:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.756330:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265465728 00000100:00100000:2.0:1746065220.756340:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265465728 00002000:00100000:2.0:1746065220.756378:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097a6ce00 x1830881265465728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065220.756391:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ce00 with x1830881265465728 ext(4194304->5038079) 00002000:00010000:2.0:1746065220.756398:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6ce00 00000100:00100000:3.0:1746065220.759132:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6342 00000100:00100000:3.0:1746065220.759150:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265465728:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065220.764298:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.765614:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265465984 00000100:00100000:2.0:1746065220.765623:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265465984 00000100:00100000:2.0:1746065220.765675:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14620 00000100:00100000:2.0:1746065220.765682:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2593:x1830881265465984:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065220.765703:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065220.765718:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479fee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b8e expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.765795:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1479ff5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.765806:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1479ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.765814:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1479ff5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.765826:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc1479ffc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.765831:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc1479ffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.765835:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc1479ffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.765910:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc147a003 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.765919:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc147a003 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.765925:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc147a003 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065220.765932:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065220.765990:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1479ff5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.765999:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1479ff5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.766004:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1479ff5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.766009:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1479ff5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.766013:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009d358800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065220.766016:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1479ff5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.766021:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1479ff5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.766030:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065220.766032:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065220.766035:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1479ff5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.766039:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358800/0xad6b7ddc1479ff5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.767564:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc1479ffc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.767575:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc1479ffc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.767580:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc1479ffc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.767585:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065220.767588:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc1479ffc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.767593:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc1479ffc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.767602:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095561800) 00010000:00010000:2.0:1746065220.767604:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065220.767607:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc1479ffc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.767610:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538c00/0xad6b7ddc1479ffc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065220.767655:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656ec00/0xad6b7ddc1479fee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b8e expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.767666:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc147a003 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b8e expref: 19 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.767672:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065220.767674:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065220.767676:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539800, rc 0) 00000100:00100000:2.0:1746065220.771110:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2593:x1830881265465984:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5420us (6810us total) trans 8589937151 rc 0/0 00000100:00100000:2.0:1746065220.771119:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14620 00000100:00100000:3.0:1746065220.775107:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265465728:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15957us (21161us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065220.775117:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6342 00002000:00100000:3.0:1746065220.775126:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097a6ce00 x1830881265465728/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.775135:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6ce00 with x1830881265465728 ext(4194304->5038079) 00002000:00010000:3.0:1746065220.775140:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097a6ce00 00000100:00100000:0.0:1746065220.788127:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.788257:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265466112 00000100:00100000:3.0:1746065220.788267:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265466112 00000100:00100000:3.0:1746065220.788355:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 876 00000100:00100000:3.0:1746065220.788365:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265466112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065220.788381:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065220.788408:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc147a003 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b8e expref: 19 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.799437:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065220.799445:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065220.799520:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265466112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11152us (11399us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.799530:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 876 00000100:00100000:0.0:1746065220.849030:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.849959:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265466368 00000100:00100000:3.0:1746065220.849970:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265466368 00000100:00100000:3.0:1746065220.850044:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14621 00000100:00100000:3.0:1746065220.850054:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2597:x1830881265466368:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.850077:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.850096:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc147a011 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b95 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.850173:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a018 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850186:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a018 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850196:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a018 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850208:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc147a01f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850214:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc147a01f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850219:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc147a01f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850307:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6400/0xad6b7ddc147a026 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850588:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6400/0xad6b7ddc147a026 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850598:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6400/0xad6b7ddc147a026 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065220.850609:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065220.850687:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a018 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850694:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a018 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850702:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a018 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850708:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a018 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850712:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065220.850716:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a018 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850721:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a018 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850732:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065220.850735:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065220.850739:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a018 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.850743:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a018 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.853550:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc147a01f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.853561:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc147a01f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.853567:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc147a01f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.853571:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065220.853575:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc147a01f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.853584:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc147a01f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.853597:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5d200) 00010000:00010000:3.0:1746065220.853599:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065220.853603:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc147a01f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.853607:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7e00/0xad6b7ddc147a01f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065220.853665:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae7600/0xad6b7ddc147a011 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b95 expref: 21 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.853679:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6400/0xad6b7ddc147a026 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b95 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.853685:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065220.853687:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1746065220.853689:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6400, rc 0) 00000100:00100000:3.0:1746065220.853762:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2597:x1830881265466368:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3707us (4739us total) trans 8589937152 rc 0/0 00000100:00100000:3.0:1746065220.853769:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14621 00000100:00100000:0.0:1746065220.864954:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.865564:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.866204:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265466496 00000100:00100000:3.0:1746065220.866214:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265466496 00000100:00100000:1.0:1746065220.867452:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17651 00000100:00100000:1.0:1746065220.867466:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881265466496:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065220.867485:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.867501:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147a034 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939b9c expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065220.867554:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264013824:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065220.867642:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065220.869571:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265466624 00000100:00100000:2.0:1746065220.869582:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265466624 00000100:00100000:2.0:1746065220.869656:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 877 00000100:00100000:2.0:1746065220.869665:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265466624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065220.869680:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065220.869704:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6400/0xad6b7ddc147a026 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b95 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.869726:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065220.869730:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065220.869799:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881265466624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (4208us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.869808:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 877 00000100:00100000:1.0:1746065220.871149:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.871259:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265466752 00000100:00100000:3.0:1746065220.871265:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265466752 00000100:00100000:3.0:1746065220.871297:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17652 00000100:00100000:3.0:1746065220.871303:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2007:x1830881265466752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.871325:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.871339:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc147a03b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ba3 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.871357:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.871359:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065220.871368:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc147a03b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ba3 expref: 29 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.871381:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc147a03b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ba3 expref: 29 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.871390:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7600, rc 0) 00000100:00100000:3.0:1746065220.871426:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2007:x1830881265466752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 122us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.871432:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17652 00000100:00100000:0.0:1746065220.882257:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264013824:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065220.882286:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147a034 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b9c expref: 28 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065220.882299:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147a034 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b9c expref: 28 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065220.882310:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1a00, rc 0) 00000100:00100000:0.0:1746065220.882360:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2007:x1830881265466496:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14898us (17415us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065220.882368:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17651 00000100:00100000:0.0:1746065220.902684:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.902806:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265466880 00000100:00100000:2.0:1746065220.902816:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265466880 00000100:00100000:2.0:1746065220.902866:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17653 00000100:00100000:2.0:1746065220.902873:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2597:x1830881265466880:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065220.902888:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065220.902902:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939baa expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.902925:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.902931:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065220.902933:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065220.902936:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.902963:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.902977:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 42 pid: 9548 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.902989:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264013952:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065220.903071:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065220.928116:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264013952:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065220.928141:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 28 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.928153:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538000, rc 0) 00000100:00100000:2.0:1746065220.928185:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2597:x1830881265466880:12345-192.168.202.27@tcp:101:cat.0 Request processed in 25312us (25508us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065220.928192:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17653 00000100:00100000:0.0:1746065220.939221:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.939297:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.939386:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265467008 00000100:00100000:3.0:1746065220.939387:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265467136 00000100:00100000:3.0:1746065220.939394:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265467136 00000100:00100000:2.0:1746065220.939394:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265467008 00002000:00100000:3.0:1746065220.939432:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1282048->1667071) req@ffff880097a6c000 x1830881265467136/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065220.939440:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17654 00002000:00100000:3.0:1746065220.939441:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6c000 with x1830881265467136 ext(1282048->1667071) 00000100:00100000:2.0:1746065220.939447:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881265467008:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.939448:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 44 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.939457:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.939459:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 44 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.939467:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc147a049 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939bb1 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065220.939468:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a6c000 00000100:00100000:3.0:1746065220.939481:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2089 00000100:00100000:3.0:1746065220.939485:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265467136:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065220.939504:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264014080:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065220.939567:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00002000:00010000:3.0:1746065220.954248:0:1880:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065220 -> 1746065221 00000100:00100000:3.0:1746065220.954268:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264014080:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065220.954295:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc147a049 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb1 expref: 46 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.954307:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc147a049 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb1 expref: 46 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.954342:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538600, rc 0) 00000100:00100000:3.0:1746065220.954389:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881265467008:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14940us (15177us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065220.954396:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17654 00000100:00100000:3.0:1746065220.960430:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265467136:12345-192.168.202.27@tcp:4:cat.0 Request processed in 20935us (21123us total) trans 17179874327 rc 0/0 00000100:00100000:3.0:1746065220.960441:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2089 00002000:00100000:3.0:1746065220.960451:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1282048->1667071) req@ffff880097a6c000 x1830881265467136/t17179874327(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:136/0 lens 488/448 e 0 to 0 dl 1746065231 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.960460:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097a6c000 with x1830881265467136 ext(1282048->1667071) 00010000:00010000:3.0:1746065220.960469:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 45 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.960487:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 45 pid: 9548 timeout: 916 lvb_type: 0 00002000:00010000:3.0:1746065220.960494:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097a6c000 00000100:00100000:0.0:1746065220.961275:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.961339:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265467264 00000100:00100000:3.0:1746065220.961345:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265467264 00000100:00100000:1.0:1746065220.963141:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17655 00000100:00100000:1.0:1746065220.963154:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+45:2589:x1830881265467264:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065220.963169:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.963185:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939bb8 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.963206:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065220.963211:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.963217:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:1.0:1746065220.963220:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1191936->2097151] (req 1191936->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 46 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.963249:0:9548:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.963260:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1191936->2097151] (req 1191936->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 46 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.963269:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0600, rc 0) 00000100:00100000:1.0:1746065220.963311:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+46:2589:x1830881265467264:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 162us (2038us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065220.963324:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17655 00000100:00100000:0.0:1746065220.982075:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065220.982161:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265467392 00000100:00100000:3.0:1746065220.982168:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265467392 00000100:00100000:3.0:1746065220.982825:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17656 00000100:00100000:3.0:1746065220.982832:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+46:2007:x1830881265467392:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065220.982848:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065220.982863:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc147a057 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939bbf expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065220.982907:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264014336:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065220.982984:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065220.985406:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065220.985458:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265467520 00000100:00100000:2.0:1746065220.985464:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265467520 00010000:00010000:2.0:1746065220.985490:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 48 pid: 9548 timeout: 916 lvb_type: 0 00000100:00100000:2.0:1746065220.985513:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8262 00000100:00100000:2.0:1746065220.985518:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+48:2005:x1830881265467520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065220.985529:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065220.985545:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 48 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.985554:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 48 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:3.0:1746065220.985560:0:1880:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff88012dc3c000 x1830881264014336) - normal race ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x40001400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 48 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.985574:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.985576:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065220.985581:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.985588:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065220.985598:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6e00/0xad6b7ddc1479f54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1282048->1667071) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b2c expref: 48 pid: 9548 timeout: 916 lvb_type: 0 00010000:00010000:2.0:1746065220.985610:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065220.985619:0:8352:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 27 pid: 1880 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746065220.985629:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264014464:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065220.985641:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264014336:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065220.985662:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc147a057 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bbf expref: 47 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.985679:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae6c00/0xad6b7ddc147a057 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bbf expref: 47 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065220.985687:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6c00, rc 0) 00000100:00100000:2.0:1746065220.985740:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065220.985752:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+46:2007:x1830881265467392:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2920us (3684us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065220.985758:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17656 00000100:00100000:3.0:1746065220.990283:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264014464:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065220.990301:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065220.990376:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881265467520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4856us (4975us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065220.990385:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8262 00000100:00100000:0.0:1746065220.991564:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065220.992191:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065220.992269:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265467648 00000100:00100000:1.0:1746065220.992277:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265467648 00000100:00100000:1.0:1746065220.992345:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17657 00000100:00100000:1.0:1746065220.992352:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881265467648:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065220.992368:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065220.992383:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a05e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939bc6 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065220.992405:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065220.992413:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a05e lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bc6 expref: 46 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065220.992421:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a05e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bc6 expref: 46 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065220.992441:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0c00, rc 0) 00000100:00100000:1.0:1746065220.992478:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881265467648:12345-192.168.202.27@tcp:101:cat.0 Request processed in 126us (920us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065220.992483:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17657 00000100:00100000:3.0:1746065220.993699:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265467904 00000100:00100000:3.0:1746065220.993706:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265467904 00002000:00100000:3.0:1746065220.993743:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008c459c00 x1830881265467904/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/0 e 0 to 0 dl 1746065231 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065220.993753:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459c00 with x1830881265467904 ext(1048576->2097151) 00010000:00010000:3.0:1746065220.993763:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 28 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065220.993792:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 28 pid: 1880 timeout: 917 lvb_type: 0 00002000:00010000:3.0:1746065220.993799:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c459c00 00000100:00100000:3.0:1746065220.993831:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2090 00000100:00100000:3.0:1746065220.993837:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265467904:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065221.025310:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265467904:12345-192.168.202.27@tcp:3:cat.0 Request processed in 31456us (33103us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065221.025326:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2090 00002000:00100000:3.0:1746065221.025336:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008c459c00 x1830881265467904/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:136/0 lens 488/440 e 0 to 0 dl 1746065231 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065221.025345:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459c00 with x1830881265467904 ext(1048576->2097151) 00010000:00010000:3.0:1746065221.025354:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 28 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.025366:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 28 pid: 1880 timeout: 917 lvb_type: 0 00002000:00010000:3.0:1746065221.025372:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008c459c00 00000100:00100000:0.0:1746065221.031707:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.031807:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265468032 00000100:00100000:1.0:1746065221.031816:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265468032 00000100:00100000:1.0:1746065221.031883:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17658 00000100:00100000:1.0:1746065221.031890:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2593:x1830881265468032:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065221.031905:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065221.031920:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939bcd expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.031945:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a6556e00/0xad6b7ddc1479cb4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939965 expref: 44 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.031956:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1479eba lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939abc expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.031962:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc1479ce5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939988 expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.031967:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.031969:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.031971:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 29 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.031999:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc1479ce5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939988 expref: 29 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.032008:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc1479ce5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939988 expref: 29 pid: 9549 timeout: 917 lvb_type: 1 00000100:00100000:1.0:1746065221.032017:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264014592:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065221.032097:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1479eba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939abc expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.032104:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1479eba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939abc expref: 8 pid: 10219 timeout: 917 lvb_type: 1 00000100:00100000:1.0:1746065221.032111:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264014720:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065221.032137:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a6556e00/0xad6b7ddc1479cb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939965 expref: 44 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.032144:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a6556e00/0xad6b7ddc1479cb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939965 expref: 44 pid: 9550 timeout: 917 lvb_type: 1 00000100:00100000:1.0:1746065221.032152:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264014848:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065221.032169:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00080000:2.0:1746065221.032384:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065221.034579:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.034642:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265468160 00000100:00100000:3.0:1746065221.034650:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265468160 00010000:00010000:3.0:1746065221.034682:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 30 pid: 1880 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.034721:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8263 00000100:00100000:3.0:1746065221.034728:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2006:x1830881265468160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065221.034741:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065221.034759:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 30 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.034804:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 30 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.034828:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538000/0xad6b7ddc147a042 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939baa expref: 30 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.034843:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.034845:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.034850:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.034857:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.034884:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065221.034894:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264014976:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065221.034962:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065221.040202:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264014592:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065221.041764:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.041807:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065221.041809:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265468416 00000100:00100000:2.0:1746065221.041815:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265468416 00010000:00010000:2.0:1746065221.041843:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc1479ce5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939988 expref: 30 pid: 9549 timeout: 917 lvb_type: 1 00000100:00100000:2.0:1746065221.041872:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265468544 00000100:00100000:2.0:1746065221.041874:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265468544 00000100:00100000:1.0:1746065221.042113:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264014720:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065221.042127:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8264 00000100:00100000:1.0:1746065221.042134:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+30:2006:x1830881265468416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065221.042145:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065221.042161:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc1479ce5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939988 expref: 30 pid: 9549 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746065221.042172:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc1479ce5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939988 expref: 30 pid: 9549 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746065221.042191:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f45e00/0xad6b7ddc1479ce5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939988 expref: 30 pid: 9549 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746065221.042207:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065221.042236:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2006:x1830881265468416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.042244:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8264 00000100:00100000:1.0:1746065221.042263:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264014848:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065221.042283:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 28 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.042291:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0c00, rc 0) 00000100:00100000:1.0:1746065221.042304:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2593:x1830881265468032:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10416us (10607us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.042309:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17658 00010000:00010000:2.0:1746065221.042459:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a6556e00/0xad6b7ddc1479cb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939965 expref: 45 pid: 9550 timeout: 917 lvb_type: 1 00000100:00100000:2.0:1746065221.042474:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8265 00000100:00100000:2.0:1746065221.042479:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265468544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065221.042486:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065221.042493:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a6556e00/0xad6b7ddc1479cb4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939965 expref: 45 pid: 9550 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746065221.042500:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a6556e00/0xad6b7ddc1479cb4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939965 expref: 45 pid: 9550 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746065221.042510:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a6556e00/0xad6b7ddc1479cb4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939965 expref: 45 pid: 9550 timeout: 917 lvb_type: 1 00010000:00010000:2.0:1746065221.042520:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065221.042535:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265468544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 56us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065221.042540:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8265 00000100:00080000:3.0:1746065221.042591:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065221.042618:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.042630:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265468288 00000100:00100000:3.0:1746065221.042633:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265468288 00010000:00010000:3.0:1746065221.042654:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1479eba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939abc expref: 9 pid: 10219 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746065221.042667:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8266 00000100:00100000:3.0:1746065221.042671:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265468288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065221.042677:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065221.042683:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1479eba lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939abc expref: 9 pid: 10219 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746065221.042691:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1479eba lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939abc expref: 9 pid: 10219 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746065221.042701:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb2a00/0xad6b7ddc1479eba lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939abc expref: 9 pid: 10219 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746065221.042721:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.042723:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.042728:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.042734:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.042760:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 27 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065221.042770:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264015104:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065221.042826:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2ba80 going to sleep for 11 seconds 00000100:00080000:3.0:1746065221.042833:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065221.044054:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.044071:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264014976:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065221.044084:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065221.044124:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2006:x1830881265468160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9395us (9555us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.044131:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8263 00000100:00100000:0.0:1746065221.047078:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.047744:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.047927:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265468800 00000100:00100000:3.0:1746065221.047935:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265468800 00002000:00100000:3.0:1746065221.047969:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1191936->1196031) req@ffff88008c45aa00 x1830881265468800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:137/0 lens 488/0 e 0 to 0 dl 1746065232 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065221.047978:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45aa00 with x1830881265468800 ext(1191936->1196031) 00002000:00010000:3.0:1746065221.047983:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45aa00 00000100:00100000:3.0:1746065221.047996:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265469056 00000100:00100000:3.0:1746065221.047998:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265469056 00002000:00100000:3.0:1746065221.048006:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88008c459f80 x1830881265469056/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/0 e 0 to 0 dl 1746065232 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065221.048012:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459f80 with x1830881265469056 ext(2097152->4194303) 00002000:00010000:3.0:1746065221.048015:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c459f80 00000100:00100000:3.0:1746065221.048034:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6343 00000100:00100000:3.0:1746065221.048040:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265468800:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065221.048149:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265468800:12345-192.168.202.27@tcp:3:cat.0 Request processed in 109us (4098us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065221.048155:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6343 00002000:00100000:3.0:1746065221.048160:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x77:0x0] (1191936->1196031) req@ffff88008c45aa00 x1830881265468800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:137/0 lens 488/4536 e 0 to 0 dl 1746065232 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065221.048167:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c45aa00 with x1830881265468800 ext(1191936->1196031) 00002000:00010000:3.0:1746065221.048169:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c45aa00 00000100:00100000:3.0:1746065221.048181:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6344 00000100:00100000:3.0:1746065221.048186:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265469056:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065221.049437:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065221.049532:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265469312 00000100:00100000:2.0:1746065221.049537:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265469312 00002000:00100000:2.0:1746065221.049574:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff8800907bca80 x1830881265469312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/0 e 0 to 0 dl 1746065232 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065221.049582:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bca80 with x1830881265469312 ext(2097152->3145727) 00002000:00010000:2.0:1746065221.049585:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bca80 00000100:00100000:2.0:1746065221.049594:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265469568 00000100:00100000:2.0:1746065221.049596:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265469568 00002000:00100000:2.0:1746065221.049604:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (4096->8191) req@ffff8800907bea00 x1830881265469568/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/0 e 0 to 0 dl 1746065232 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065221.049610:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bea00 with x1830881265469568 ext(4096->8191) 00002000:00010000:2.0:1746065221.049612:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bea00 00000100:00100000:2.0:1746065221.049620:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6345 00000100:00100000:2.0:1746065221.049624:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265469312:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065221.050154:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6346 00000100:00100000:2.0:1746065221.050159:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2005:x1830881265469568:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065221.050211:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2005:x1830881265469568:12345-192.168.202.27@tcp:3:cat.0 Request processed in 52us (776us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065221.050216:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6346 00002000:00100000:2.0:1746065221.050220:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (4096->8191) req@ffff8800907bea00 x1830881265469568/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/4536 e 0 to 0 dl 1746065232 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065221.050227:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bea00 with x1830881265469568 ext(4096->8191) 00002000:00010000:2.0:1746065221.050229:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800907bea00 00000100:00100000:2.0:1746065221.050269:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264015104:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065221.050282:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065221.050298:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881265468288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7626us (7681us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065221.050305:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8266 00000100:00080000:0.0:1746065221.052528:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065221.063150:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265469312:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13515us (15397us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065221.063162:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6345 00002000:00100000:2.0:1746065221.063174:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff8800907bca80 x1830881265469312/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/440 e 0 to 0 dl 1746065232 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065221.063183:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bca80 with x1830881265469312 ext(2097152->3145727) 00002000:00010000:2.0:1746065221.063188:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800907bca80 00000100:00100000:3.0:1746065221.070277:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265469056:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22082us (23198us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065221.070287:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6344 00002000:00100000:3.0:1746065221.070295:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88008c459f80 x1830881265469056/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/440 e 0 to 0 dl 1746065232 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065221.070304:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008c459f80 with x1830881265469056 ext(2097152->4194303) 00002000:00010000:3.0:1746065221.070309:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008c459f80 00000100:00100000:0.0:1746065221.072639:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.072681:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.072756:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265469696 00000100:00100000:1.0:1746065221.072763:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265469696 00000100:00100000:1.0:1746065221.072831:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265469824 00000100:00100000:1.0:1746065221.072834:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265469824 00000100:00100000:1.0:1746065221.072848:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17659 00000100:00100000:1.0:1746065221.072855:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2593:x1830881265469696:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065221.072874:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065221.072888:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939bd4 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065221.072895:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17660 00000100:00100000:3.0:1746065221.072900:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+44:2589:x1830881265469824:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065221.072906:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065221.072910:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 19 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.072914:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939bdb expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.072917:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1479ec8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ac3 expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065221.072926:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 45 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.072928:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 36 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.072933:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc147a03b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ba3 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.072933:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.072935:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.072937:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.072938:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.072938:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.072940:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2121727] (req 2097152->2121727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 45 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.072959:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc147a03b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ba3 expref: 26 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.072959:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 36 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.072968:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc147a03b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ba3 expref: 26 pid: 3067 timeout: 917 lvb_type: 1 00010000:00010000:1.0:1746065221.072968:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 36 pid: 12258 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.072978:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264015360:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065221.072978:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264015232:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.073132:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 45 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.073140:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 45 pid: 3067 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.073215:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1479ec8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ac3 expref: 8 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.073222:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1479ec8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ac3 expref: 8 pid: 11461 timeout: 917 lvb_type: 1 00000100:00100000:1.0:1746065221.073230:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264015616:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065221.073253:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 19 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.073263:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 19 pid: 12258 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.073270:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264015744:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065221.073281:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065221.073447:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264015488:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065221.073470:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065221.082243:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065221.082343:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265469952 00000100:00100000:2.0:1746065221.082351:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265469952 00000100:00100000:2.0:1746065221.082388:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17661 00000100:00100000:2.0:1746065221.082394:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2004:x1830881265469952:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065221.082410:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065221.082423:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc147a07a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939be2 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065221.082467:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264015872:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065221.082545:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d640c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065221.088072:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.088171:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264015232:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065221.088182:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264015616:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065221.088190:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264015744:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065221.088217:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1048576->1056767] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.088231:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e600, rc 0) 00000100:00100000:1.0:1746065221.088267:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2593:x1830881265469696:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 15412us (15634us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.088274:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17659 00000100:00100000:3.0:1746065221.088407:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264015360:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065221.088416:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264015488:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.088431:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->2121727] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 45 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.088440:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be200, rc 0) 00000100:00100000:3.0:1746065221.088455:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+45:2589:x1830881265469824:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 15555us (15777us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.088461:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17660 00000100:00100000:0.0:1746065221.088521:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265470080 00000100:00100000:0.0:1746065221.088527:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265470080 00010000:00010000:0.0:1746065221.088547:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc147a03b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ba3 expref: 29 pid: 3067 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746065221.088568:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8267 00000100:00100000:0.0:1746065221.088574:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2004:x1830881265470080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065221.088583:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065221.088598:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc147a03b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ba3 expref: 29 pid: 3067 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746065221.089207:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc147a03b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ba3 expref: 29 pid: 3067 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746065221.089226:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091ae7600/0xad6b7ddc147a03b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ba3 expref: 29 pid: 3067 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746065221.089248:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065221.089266:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2004:x1830881265470080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 693us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065221.089271:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8267 00000100:00100000:0.0:1746065221.089302:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.089328:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265470464 00000100:00100000:0.0:1746065221.089331:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265470464 00010000:00010000:0.0:1746065221.089348:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 37 pid: 12258 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746065221.089371:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8268 00000100:00100000:0.0:1746065221.089376:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265470464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065221.089384:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065221.089393:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 37 pid: 12258 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.089400:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 37 pid: 12258 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.089412:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d856c00/0xad6b7ddc1479e82 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aa0 expref: 37 pid: 12258 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.089420:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065221.089434:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265470464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065221.089442:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8268 00000100:00080000:0.0:1746065221.089454:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065221.089487:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.089498:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265470336 00000100:00100000:0.0:1746065221.089500:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265470336 00010000:00010000:0.0:1746065221.089510:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 19 pid: 12258 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.089849:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.091442:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265470208 00000100:00100000:0.0:1746065221.091448:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265470208 00000100:00100000:3.0:1746065221.091449:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8269 00000100:00100000:3.0:1746065221.091458:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881265470336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065221.091468:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065221.091470:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1479ec8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ac3 expref: 9 pid: 11461 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746065221.091480:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 19 pid: 12258 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.091488:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 19 pid: 12258 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.091502:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929fac00/0xad6b7ddc1479e7b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a99 expref: 19 pid: 12258 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.091516:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065221.091538:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265470336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 82us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.091544:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8269 00000100:00100000:3.0:1746065221.091557:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8270 00000100:00100000:3.0:1746065221.091562:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265470208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065221.091568:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065221.091574:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1479ec8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ac3 expref: 9 pid: 11461 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746065221.091581:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1479ec8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ac3 expref: 9 pid: 11461 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746065221.091591:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46200/0xad6b7ddc1479ec8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ac3 expref: 9 pid: 11461 timeout: 917 lvb_type: 1 00010000:00010000:3.0:1746065221.091602:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.091603:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.091608:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.091615:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.091636:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065221.091645:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264016000:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065221.091680:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b600 going to sleep for 11 seconds 00000100:00100000:1.0:1746065221.092038:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.092051:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265470592 00000100:00100000:1.0:1746065221.092053:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265470592 00010000:00010000:1.0:1746065221.092067:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 45 pid: 3067 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.092081:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8271 00000100:00100000:1.0:1746065221.092086:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881265470592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065221.092095:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065221.092104:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 45 pid: 3067 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.092112:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 45 pid: 3067 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.092124:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc1479fd2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b80 expref: 45 pid: 3067 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.092136:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.092138:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.092141:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.092148:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.092164:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065221.092171:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264016128:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065221.092201:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00080000:0.0:1746065221.092541:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1746065221.093062:0:12260:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime: 1746065220 -> 1746065221 00002000:00010000:2.0:1746065221.093066:0:12260:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime: 1746065220 -> 1746065221 00000100:00100000:2.0:1746065221.093075:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264015872:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065221.093094:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc147a07a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be2 expref: 27 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.093110:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c5c5c00/0xad6b7ddc147a07a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be2 expref: 27 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.093121:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c5c5c00, rc 0) 00000100:00100000:2.0:1746065221.093765:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265469952:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11369us (11526us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065221.093796:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17661 00000100:00100000:3.0:1746065221.095177:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264016000:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065221.095190:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065221.095212:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2006:x1830881265470208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3649us (5362us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.095219:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8270 00000100:00100000:1.0:1746065221.095352:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264016128:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065221.095363:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065221.095378:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881265470592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3292us (3342us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.095384:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8271 00000100:00100000:0.0:1746065221.096364:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.096402:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.096587:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265470976 00000100:00100000:2.0:1746065221.096587:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265471104 00000100:00100000:3.0:1746065221.096593:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265470976 00000100:00100000:2.0:1746065221.096593:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265471104 00002000:00100000:3.0:1746065221.096623:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2117632->2121727) req@ffff880135221880 x1830881265470976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:137/0 lens 488/0 e 0 to 0 dl 1746065232 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065221.096623:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1052672->1056767) req@ffff880135223100 x1830881265471104/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/0 e 0 to 0 dl 1746065232 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065221.096632:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221880 with x1830881265470976 ext(2117632->2121727) 00002000:00100000:2.0:1746065221.096632:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223100 with x1830881265471104 ext(1052672->1056767) 00002000:00010000:3.0:1746065221.096635:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135221880 00002000:00010000:2.0:1746065221.096635:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135223100 00000100:00100000:3.0:1746065221.096659:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6347 00000100:00100000:3.0:1746065221.096665:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265470976:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065221.096717:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6348 00000100:00100000:2.0:1746065221.096722:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2007:x1830881265471104:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065221.096762:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265470976:12345-192.168.202.27@tcp:3:cat.0 Request processed in 96us (400us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065221.096767:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6347 00000100:00100000:2.0:1746065221.096767:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2007:x1830881265471104:12345-192.168.202.27@tcp:3:cat.0 Request processed in 46us (366us total) trans 0 rc 4096/4096 00002000:00100000:3.0:1746065221.096790:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2117632->2121727) req@ffff880135221880 x1830881265470976/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:137/0 lens 488/4536 e 0 to 0 dl 1746065232 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065221.096791:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6348 00002000:00100000:2.0:1746065221.096795:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x94:0x0] (1052672->1056767) req@ffff880135223100 x1830881265471104/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/4536 e 0 to 0 dl 1746065232 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065221.096796:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135221880 with x1830881265470976 ext(2117632->2121727) 00002000:00010000:3.0:1746065221.096799:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135221880 00002000:00100000:2.0:1746065221.096801:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223100 with x1830881265471104 ext(1052672->1056767) 00002000:00010000:2.0:1746065221.096803:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135223100 00000100:00100000:0.0:1746065221.096916:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.096971:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265471232 00000100:00100000:3.0:1746065221.096975:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265471232 00000100:00100000:3.0:1746065221.097138:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17662 00000100:00100000:3.0:1746065221.097143:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2597:x1830881265471232:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065221.097151:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065221.097162:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939be9 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.097179:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 43 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.097185:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065221.097187:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065221.097189:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [4194304->5038079] (req 4194304->5038079) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 27 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.097209:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 43 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.097223:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 43 pid: 1880 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.097233:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264016256:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065221.097296:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065221.101107:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264016256:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.101130:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [4194304->5038079] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 27 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.101143:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfa00, rc 0) 00000100:00100000:3.0:1746065221.101195:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2597:x1830881265471232:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4050us (4277us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.101202:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17662 00000100:00100000:0.0:1746065221.102129:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.102293:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265471744 00000100:00100000:3.0:1746065221.102298:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265471744 00000100:00100000:3.0:1746065221.102360:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5500 00000100:00100000:3.0:1746065221.102367:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2593:x1830881265471744:12345-192.168.202.27@tcp:35:multiop.0 00000100:00080000:0.0:1746065221.102657:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065221.103032:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.103084:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265471488 00000100:00100000:0.0:1746065221.103087:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265471488 00002000:00100000:0.0:1746065221.103107:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2121727) req@ffff8800907bce00 x1830881265471488/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:137/0 lens 488/0 e 0 to 0 dl 1746065232 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065221.103115:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bce00 with x1830881265471488 ext(2097152->2121727) 00010000:00010000:0.0:1746065221.103122:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 44 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.103133:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 44 pid: 1880 timeout: 917 lvb_type: 0 00002000:00010000:0.0:1746065221.103139:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bce00 00000100:00100000:0.0:1746065221.103914:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2091 00000100:00100000:0.0:1746065221.103921:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265471488:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065221.104055:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2593:x1830881265471744:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1687us (1926us total) trans 8589937153 rc 0/0 00000100:00100000:3.0:1746065221.104062:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5500 00000100:00100000:1.0:1746065221.106294:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265471488:12345-192.168.202.27@tcp:4:cat.0 Request processed in 2367us (3255us total) trans 17179874328 rc 0/0 00000100:00100000:1.0:1746065221.106304:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2091 00002000:00100000:1.0:1746065221.106321:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2121727) req@ffff8800907bce00 x1830881265471488/t17179874328(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:137/0 lens 488/448 e 0 to 0 dl 1746065232 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065221.106330:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800907bce00 with x1830881265471488 ext(2097152->2121727) 00010000:00010000:1.0:1746065221.106338:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 46 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.106351:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 46 pid: 1880 timeout: 917 lvb_type: 0 00002000:00010000:1.0:1746065221.106357:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800907bce00 00000100:00100000:0.0:1746065221.108478:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.110338:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265471872 00000100:00100000:1.0:1746065221.110348:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265471872 00010000:00010000:1.0:1746065221.110382:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 46 pid: 1880 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.110409:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8272 00000100:00100000:1.0:1746065221.110416:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+46:2006:x1830881265471872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065221.110427:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065221.110439:0:7191:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065220 -> 1746065221 00002000:00010000:1.0:1746065221.110442:0:7191:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065220 -> 1746065221 00010000:00010000:1.0:1746065221.110448:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 46 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.110459:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 46 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.110477:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a073 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2121727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bdb expref: 46 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.110508:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.110511:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.110516:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.110525:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.110551:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065221.110562:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264016384:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065221.110624:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:1.0:1746065221.114532:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264016384:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065221.114554:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065221.114586:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881265471872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4170us (6114us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.114596:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8272 00000100:00100000:0.0:1746065221.115635:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.116030:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265472128 00000100:00100000:1.0:1746065221.116037:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265472128 00002000:00100000:1.0:1746065221.116069:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880135223480 x1830881265472128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/0 e 0 to 0 dl 1746065232 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065221.116078:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223480 with x1830881265472128 ext(4194304->5038079) 00002000:00010000:1.0:1746065221.116082:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135223480 00000100:00100000:1.0:1746065221.116108:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6349 00000100:00100000:1.0:1746065221.116115:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265472128:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065221.121515:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065221.126304:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265472128:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10181us (10663us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746065221.126327:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6349 00002000:00100000:1.0:1746065221.126337:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880135223480 x1830881265472128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/440 e 0 to 0 dl 1746065232 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065221.126345:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223480 with x1830881265472128 ext(4194304->5038079) 00002000:00010000:1.0:1746065221.126351:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135223480 00000100:00100000:0.0:1746065221.129485:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.129590:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265472256 00000100:00100000:3.0:1746065221.129598:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265472256 00000100:00100000:3.0:1746065221.129634:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17663 00000100:00100000:3.0:1746065221.129640:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2007:x1830881265472256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065221.129655:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065221.129670:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc147a088 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939bf0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065221.129714:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264016512:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065221.129831:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065221.131330:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264016512:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065221.131352:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc147a088 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bf0 expref: 28 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065221.131363:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc147a088 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bf0 expref: 28 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065221.132038:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf600, rc 0) 00000100:00100000:3.0:1746065221.132090:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2007:x1830881265472256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2448us (2609us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065221.132098:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17663 00000100:00100000:0.0:1746065221.136574:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.136666:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265472384 00000100:00100000:3.0:1746065221.136673:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265472384 00000100:00100000:3.0:1746065221.136705:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17664 00000100:00100000:3.0:1746065221.136712:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2006:x1830881265472384:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065221.136725:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065221.136738:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a08f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939bf7 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065221.136799:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264016640:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065221.136871:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065221.141059:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264016640:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065221.141086:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a08f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bf7 expref: 28 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065221.141098:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a08f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bf7 expref: 28 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065221.141119:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf000, rc 0) 00000100:00100000:3.0:1746065221.141168:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2006:x1830881265472384:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4456us (4600us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065221.141176:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17664 00000100:00100000:0.0:1746065221.147166:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.147850:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265472640 00000100:00100000:3.0:1746065221.147860:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265472640 00000100:00100000:3.0:1746065221.147910:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5501 00000100:00100000:3.0:1746065221.147917:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2597:x1830881265472640:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065221.148165:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2597:x1830881265472640:12345-192.168.202.27@tcp:35:cat.0 Request processed in 248us (1007us total) trans 8589937154 rc 0/0 00000100:00100000:3.0:1746065221.148172:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5501 00000100:00100000:0.0:1746065221.159694:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.159836:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265472768 00000100:00100000:3.0:1746065221.159844:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265472768 00000100:00080000:0.0:1746065221.161402:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065221.161444:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14622 00000100:00100000:3.0:1746065221.161453:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2606:x1830881265472768:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065221.161473:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065221.161489:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a096 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939bfe expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.161538:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc147a09d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.162459:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc147a09d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.162472:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc147a09d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.162485:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc147a0a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.162490:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc147a0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.162495:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc147a0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.162547:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.162556:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b87 expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.162562:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.162586:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b87 expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.162595:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b87 expref: 40 pid: 7205 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.162609:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264016768:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065221.162691:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065221.164493:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264016768:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.164510:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065221.166620:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.166675:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265473024 00000100:00100000:1.0:1746065221.166682:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265473024 00000100:00100000:1.0:1746065221.168796:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5502 00000100:00100000:1.0:1746065221.168807:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+41:30399:x1830881265473024:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00080000:0.0:1746065221.169130:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065221.169735:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+42:30399:x1830881265473024:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 930us (3118us total) trans 8589937155 rc 0/0 00000100:00100000:1.0:1746065221.169742:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5502 00000100:00100000:0.0:1746065221.176642:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.176710:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265473152 00000100:00100000:1.0:1746065221.176717:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265473152 00010000:00010000:1.0:1746065221.176746:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b87 expref: 42 pid: 7205 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.176798:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8273 00000100:00100000:1.0:1746065221.176805:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881265473152:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065221.176819:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065221.176825:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b87 expref: 42 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.176835:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b87 expref: 42 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.176852:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc1479fe0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b87 expref: 42 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.176875:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065221.176880:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065221.176888:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065221.176894:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065221.176919:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065221.176958:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265473152:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 153us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.176964:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8273 00010000:00010000:3.0:1746065221.177074:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177081:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065221.177123:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065221.177126:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065221.177141:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177149:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177157:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc147a09d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177162:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc147a09d lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177167:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc147a09d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177172:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc147a09d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177179:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065221.177182:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc147a09d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177188:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc147a09d lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177195:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065221.177197:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065221.177200:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc147a09d lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177204:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf400/0xad6b7ddc147a09d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177216:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc147a0a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177221:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc147a0a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177224:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc147a0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177228:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bf000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065221.177230:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc147a0a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177234:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc147a0a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177239:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5d500) 00010000:00010000:3.0:1746065221.177241:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065221.177244:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc147a0a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177247:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf000/0xad6b7ddc147a0a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.177272:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a096 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bfe expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.177281:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bfe expref: 9 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.177287:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065221.177289:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065221.177291:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf600, rc 0) 00000100:00100000:3.0:1746065221.177326:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2606:x1830881265472768:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 15875us (17638us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.177331:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14622 00000100:00100000:0.0:1746065221.180158:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.180192:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.180218:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.180231:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.180248:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265473408 00000100:00100000:0.0:1746065221.180254:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265473408 00000100:00100000:0.0:1746065221.180283:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265473664 00000100:00100000:0.0:1746065221.180285:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265473664 00000100:00100000:0.0:1746065221.180293:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265473920 00000100:00100000:0.0:1746065221.180295:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265473920 00000100:00100000:0.0:1746065221.180302:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265473280 00000100:00100000:0.0:1746065221.180304:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265473280 00000100:00100000:0.0:1746065221.180329:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17665 00000100:00100000:0.0:1746065221.180336:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265473408:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065221.180350:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065221.180364:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a0b2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c0c expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065221.180405:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264016896:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065221.180407:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17666 00000100:00100000:3.0:1746065221.180416:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17667 00000100:00100000:1.0:1746065221.180416:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265473664:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065221.180424:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065221.180425:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265473920:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065221.180432:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065221.180433:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc147a0b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c1a expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.180439:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc147a0c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c28 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065221.180441:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17668 00000100:00100000:2.0:1746065221.180448:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265473280:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065221.180450:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.180451:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065221.180453:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065221.180455:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264017024:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065221.180458:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc147a0c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c28 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.180460:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc147a0c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c05 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065221.180460:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929490c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065221.180471:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc147a0c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c28 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065221.180479:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7f000, rc 0) 00000100:00100000:1.0:1746065221.180480:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065221.180481:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264017152:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065221.180484:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.180494:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265473536 00000100:00100000:1.0:1746065221.180497:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265473536 00000100:00100000:3.0:1746065221.180499:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265473920:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 76us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065221.180502:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d640c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065221.180504:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17667 00000100:00100000:2.0:1746065221.180517:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17669 00000100:00100000:2.0:1746065221.180521:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265473536:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065221.180527:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065221.180533:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c539a00/0xad6b7ddc147a0ce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c13 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065221.180533:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065221.180542:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065221.180543:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065221.180547:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265473792 00010000:00010000:2.0:1746065221.180548:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539a00/0xad6b7ddc147a0ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c13 expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065221.180549:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265473792 00010000:00010000:2.0:1746065221.180557:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c539a00/0xad6b7ddc147a0ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c13 expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.180562:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539a00, rc 0) 00000100:00100000:1.0:1746065221.180564:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17670 00000100:00100000:1.0:1746065221.180569:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265473792:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:2.0:1746065221.180575:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265473536:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 54us (91us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065221.180575:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065221.180579:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17669 00010000:00010000:1.0:1746065221.180581:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552e400/0xad6b7ddc147a0d5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c21 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.180591:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.180592:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.180597:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552e400/0xad6b7ddc147a0d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c21 expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.180605:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552e400/0xad6b7ddc147a0d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c21 expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.180612:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e400, rc 0) 00000100:00100000:1.0:1746065221.180647:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265473792:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 77us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.180654:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17670 00000100:00100000:1.0:1746065221.183339:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264017024:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065221.183367:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc147a0b9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c1a expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.183378:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552fc00/0xad6b7ddc147a0b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c1a expref: 12 pid: 1880 timeout: 0 lvb_type: 1 00002000:00010000:3.0:1746065221.183388:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime: 1746065217 -> 1746065221 00002000:00010000:3.0:1746065221.183392:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime: 1746065217 -> 1746065221 00002000:00010000:3.0:1746065221.183394:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime: 1746065217 -> 1746065221 00000100:00100000:3.0:1746065221.183402:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264017152:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065221.183418:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc147a0c7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c05 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065221.183428:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538600/0xad6b7ddc147a0c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c05 expref: 11 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065221.183435:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538600, rc 0) 00000100:00100000:3.0:1746065221.183471:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265473280:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3023us (3238us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065221.183478:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17668 00010000:00010000:1.0:1746065221.183902:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fc00, rc 0) 00000100:00100000:1.0:1746065221.183924:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265473664:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3510us (3731us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065221.183930:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17666 00002000:00010000:2.0:1746065221.184052:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065220 -> 1746065221 00002000:00010000:2.0:1746065221.184055:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065219 -> 1746065221 00002000:00010000:2.0:1746065221.184057:0:3067:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065219 -> 1746065221 00000100:00100000:2.0:1746065221.184067:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264016896:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065221.184083:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a0b2 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c0c expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.184091:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a0b2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c0c expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.184101:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2a00, rc 0) 00000100:00100000:2.0:1746065221.184120:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265473408:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3785us (3968us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065221.184125:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17665 00000100:00100000:0.0:1746065221.186945:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.188377:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265474176 00000100:00100000:3.0:1746065221.188385:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265474176 00000100:00100000:3.0:1746065221.188434:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14623 00000100:00100000:3.0:1746065221.188441:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2606:x1830881265474176:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065221.188455:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065221.188468:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e600/0xad6b7ddc147a0dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c2f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.188547:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc147a0e3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.188559:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bfe expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.188565:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc147a0e3 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.188589:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bfe expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.188599:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bfe expref: 10 pid: 7205 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.188608:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264017280:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065221.188693:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065221.196059:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.196153:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264017280:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.196174:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc147a0e3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:1.0:1746065221.197038:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265474304 00000100:00100000:1.0:1746065221.197045:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265474304 00010000:00010000:1.0:1746065221.197073:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bfe expref: 11 pid: 7205 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.197106:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8274 00000100:00100000:1.0:1746065221.197113:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265474304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065221.197124:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065221.197129:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bfe expref: 11 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.197138:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bfe expref: 11 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.197160:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a0ab lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bfe expref: 11 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.197575:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065221.197580:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc147a0e3 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065221.197589:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc147a0e3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065221.197595:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc147a0e3 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065221.197620:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065221.197663:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265474304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 549us (1612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.197669:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8274 00010000:00010000:2.0:1746065221.197802:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc147a0e3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065221.197809:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc147a0e3 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065221.197824:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065221.197926:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e600/0xad6b7ddc147a0dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c2f expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.197941:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc147a0e3 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c2f expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.197947:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065221.197950:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065221.197952:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012fd7e000, rc 0) 00000100:00100000:2.0:1746065221.197975:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2606:x1830881265474176:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 9534us (11038us total) trans 8589937156 rc 0/0 00000100:00100000:2.0:1746065221.197981:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14623 00000100:00100000:2.0:1746065221.201408:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.201492:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265474560 00000100:00100000:3.0:1746065221.201500:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265474560 00000100:00100000:3.0:1746065221.201539:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14624 00000100:00100000:3.0:1746065221.201546:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2606:x1830881265474560:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065221.201564:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065221.201567:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065221.201588:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012fd7e000/0xad6b7ddc147a0e3 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c2f expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.201607:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065221.201611:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065221.201620:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a0f1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c36 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.201697:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc147a0f8 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.201709:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc147a0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.201717:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc147a0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065221.201727:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065221.201820:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a0f1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c36 expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.201833:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc147a0f8 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c36 expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.201838:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065221.201840:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065221.201843:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2c00, rc 0) 00000100:00100000:3.0:1746065221.201888:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2606:x1830881265474560:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 342us (487us total) trans 8589937157 rc 0/0 00000100:00100000:3.0:1746065221.201895:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14624 00000100:00100000:2.0:1746065221.205083:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.205186:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265474688 00000100:00100000:1.0:1746065221.205193:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265474688 00000100:00100000:1.0:1746065221.205227:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14625 00000100:00100000:1.0:1746065221.205233:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2606:x1830881265474688:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065221.205248:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065221.205262:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a106 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c3d expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.205303:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a106 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c3d expref: 12 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.205321:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a106 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c3d expref: 12 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.205335:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065221.205338:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065221.205340:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f000, rc 0) 00000100:00100000:1.0:1746065221.205383:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2606:x1830881265474688:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 149us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.205389:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14625 00000100:00100000:2.0:1746065221.208863:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065221.208889:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265474944 00000100:00100000:2.0:1746065221.208896:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265474944 00000100:00100000:2.0:1746065221.208930:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17671 00000100:00100000:2.0:1746065221.208937:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265474944:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065221.208969:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.208985:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.208992:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065221.208993:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065221.208995:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 4/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.209020:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.209030:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 17 pid: 9548 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746065221.209046:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264017408:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065221.209102:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d646c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065221.209126:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065221.209170:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065221.209183:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065221.209193:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065221.209205:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265475200 00000100:00100000:2.0:1746065221.209208:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265475200 00000100:00100000:2.0:1746065221.209222:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265475456 00000100:00100000:2.0:1746065221.209224:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265475456 00000100:00100000:2.0:1746065221.209232:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265474816 00000100:00100000:2.0:1746065221.209234:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265474816 00000100:00100000:2.0:1746065221.209242:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265475072 00000100:00100000:2.0:1746065221.209243:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265475072 00000100:00100000:2.0:1746065221.209254:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17672 00000100:00100000:2.0:1746065221.209259:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265475200:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065221.209276:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.209285:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.209290:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065221.209291:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065221.209293:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.209324:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.209332:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 44 pid: 9548 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746065221.209340:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264017536:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065221.209363:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065221.209376:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17673 00000100:00100000:2.0:1746065221.209381:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265475456:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:1.0:1746065221.209612:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17674 00000100:00100000:1.0:1746065221.209620:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265474816:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065221.209636:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.209645:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.209650:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065221.209651:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065221.209653:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.209668:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 26 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.209675:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 26 pid: 9548 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.209682:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264017664:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065221.209702:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c4356c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065221.209715:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17675 00000100:00100000:1.0:1746065221.209720:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265475072:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065221.209732:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.209740:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.209747:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c539a00/0xad6b7ddc147a0ce lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c13 expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.209753:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.209758:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.209759:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.209761:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.209796:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.209803:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 35 pid: 9548 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.209812:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264017792:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065221.209841:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c539a00/0xad6b7ddc147a0ce lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c13 expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.209848:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c539a00/0xad6b7ddc147a0ce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c13 expref: 12 pid: 12258 timeout: 917 lvb_type: 1 00000100:00100000:1.0:1746065221.209855:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264017920:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065221.209871:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.209878:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 17 pid: 1880 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.209885:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264018048:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065221.209898:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435780 going to sleep for 11 seconds 00010000:00010000:2.0:1746065221.210055:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.210064:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.210070:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc147a0c0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c28 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.210076:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1479fbd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b6b expref: 35 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.210081:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065221.210082:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065221.210084:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.210098:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1479fbd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b6b expref: 35 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.210105:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1479fbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b6b expref: 35 pid: 12260 timeout: 917 lvb_type: 1 00000100:00100000:2.0:1746065221.210112:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264018176:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065221.210134:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc147a0c0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c28 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.210140:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc147a0c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c28 expref: 12 pid: 12260 timeout: 917 lvb_type: 1 00000100:00100000:2.0:1746065221.210146:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264018304:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065221.210159:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.210165:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 17 pid: 9548 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746065221.210171:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264018432:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065221.210184:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065221.210439:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.210531:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265475328 00000100:00100000:3.0:1746065221.210535:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265475328 00000100:00100000:3.0:1746065221.210558:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17676 00000100:00100000:3.0:1746065221.210562:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265475328:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065221.210577:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.210585:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.210591:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552e400/0xad6b7ddc147a0d5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c21 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065221.210595:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.210596:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.210598:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 5/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.210611:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009552e400/0xad6b7ddc147a0d5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c21 expref: 11 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065221.210616:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009552e400/0xad6b7ddc147a0d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c21 expref: 11 pid: 11461 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746065221.210624:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264018560:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.210649:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.210656:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 26 pid: 12260 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.210663:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264018688:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065221.210674:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065221.211580:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264017408:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065221.211596:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065221.211709:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.211769:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265475584 00000100:00100000:1.0:1746065221.211784:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265475584 00002000:00100000:1.0:1746065221.211811:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1056767) req@ffff88012dc3fb80 x1830881265475584/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 8680/0 e 0 to 0 dl 1746065232 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065221.211819:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3fb80 with x1830881265475584 ext(1048576->1056767) 00010000:00010000:1.0:1746065221.211826:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 18 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.211836:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 18 pid: 9548 timeout: 917 lvb_type: 0 00002000:00010000:1.0:1746065221.211845:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc3fb80 00000100:00100000:1.0:1746065221.211860:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2092 00000100:00100000:1.0:1746065221.211864:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265475584:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065221.212722:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265475584:12345-192.168.202.27@tcp:4:cat.0 Request processed in 853us (1009us total) trans 21474841713 rc 0/0 00000100:00100000:1.0:1746065221.212728:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2092 00002000:00100000:1.0:1746065221.212734:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1056767) req@ffff88012dc3fb80 x1830881265475584/t21474841713(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 8680/448 e 0 to 0 dl 1746065232 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065221.212741:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3fb80 with x1830881265475584 ext(1048576->1056767) 00010000:00010000:1.0:1746065221.212746:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 20 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.212752:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 20 pid: 9548 timeout: 917 lvb_type: 0 00002000:00010000:1.0:1746065221.212758:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012dc3fb80 00000001:00080000:0.0:1746065221.215519:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841713 is committed 00000001:00080000:0.0:1746065221.215538:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841710 is committed 00000001:00080000:0.0:1746065221.215544:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841708 is committed 00000100:00100000:0.0:1746065221.223342:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.223365:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.223421:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.223448:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265475968 00000100:00100000:0.0:1746065221.223455:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265475968 00010000:00010000:0.0:1746065221.223483:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539a00/0xad6b7ddc147a0ce lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c13 expref: 13 pid: 12258 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746065221.223518:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8275 00000100:00100000:0.0:1746065221.223525:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265475968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065221.223539:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065221.223555:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c539a00/0xad6b7ddc147a0ce lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c13 expref: 13 pid: 12258 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746065221.223566:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c539a00/0xad6b7ddc147a0ce lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c13 expref: 13 pid: 12258 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746065221.223586:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065221.223618:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265475968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065221.223624:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8275 00000100:00100000:0.0:1746065221.223652:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.223665:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265476352 00000100:00100000:0.0:1746065221.223667:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265476352 00010000:00010000:0.0:1746065221.223678:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1479fbd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b6b expref: 20 pid: 12260 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746065221.223694:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8276 00000100:00100000:0.0:1746065221.223698:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881265476352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065221.223704:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065221.223712:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1479fbd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b6b expref: 20 pid: 12260 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746065221.223719:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1479fbd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b6b expref: 20 pid: 12260 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746065221.223731:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065221.223745:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881265476352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065221.223750:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8276 00000100:00100000:0.0:1746065221.223813:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.223824:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265476224 00000100:00100000:0.0:1746065221.223826:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265476224 00010000:00010000:0.0:1746065221.223836:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 8 pid: 1880 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746065221.223851:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8277 00000100:00100000:0.0:1746065221.223855:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265476224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065221.223861:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065221.223867:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 8 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.223874:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 8 pid: 1880 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.223884:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065221.223898:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac524c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265476224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 43us (85us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065221.223903:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8277 00000100:00100000:0.0:1746065221.224021:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.224031:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265476608 00000100:00100000:0.0:1746065221.224034:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265476608 00010000:00010000:0.0:1746065221.224045:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552e400/0xad6b7ddc147a0d5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c21 expref: 12 pid: 11461 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746065221.224064:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8278 00000100:00100000:0.0:1746065221.224067:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265476608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065221.224073:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065221.224083:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009552e400/0xad6b7ddc147a0d5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c21 expref: 12 pid: 11461 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746065221.224090:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009552e400/0xad6b7ddc147a0d5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c21 expref: 12 pid: 11461 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746065221.224099:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065221.224113:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265476608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 45us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065221.224118:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8278 00000100:00100000:0.0:1746065221.224138:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.224146:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265476480 00000100:00100000:0.0:1746065221.224148:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265476480 00010000:00010000:0.0:1746065221.224156:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 8 pid: 9548 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746065221.224167:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8279 00000100:00100000:0.0:1746065221.224171:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2006:x1830881265476480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065221.224175:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065221.224182:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 8 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.224193:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 8 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.224202:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065221.224214:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2006:x1830881265476480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 43us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065221.224220:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8279 00000100:00100000:0.0:1746065221.224249:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.224259:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265476096 00000100:00100000:0.0:1746065221.224261:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265476096 00010000:00010000:0.0:1746065221.224269:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc147a0c0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c28 expref: 13 pid: 12260 timeout: 917 lvb_type: 1 00000100:00100000:0.0:1746065221.224280:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8280 00000100:00100000:0.0:1746065221.224284:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265476096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065221.224288:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065221.224294:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc147a0c0 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c28 expref: 13 pid: 12260 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746065221.224300:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc147a0c0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c28 expref: 13 pid: 12260 timeout: 917 lvb_type: 1 00010000:00010000:0.0:1746065221.224318:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065221.224320:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065221.224324:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065221.224335:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065221.224349:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065221.224359:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265476096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065221.224364:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8280 00000100:00100000:0.0:1746065221.224388:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.224395:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265476864 00000100:00100000:0.0:1746065221.224397:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265476864 00010000:00010000:0.0:1746065221.224404:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 27 pid: 12260 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746065221.224414:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8281 00000100:00100000:0.0:1746065221.224417:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265476864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065221.224422:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065221.224427:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 27 pid: 12260 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.224433:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 27 pid: 12260 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.224441:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065221.224442:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065221.224444:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065221.224453:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065221.224460:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065221.224469:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265476864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (81us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065221.224473:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8281 00000100:00100000:0.0:1746065221.224494:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.224500:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265476992 00000100:00100000:0.0:1746065221.224502:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265476992 00010000:00010000:0.0:1746065221.224509:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 8 pid: 9548 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.224609:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264017792:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065221.224618:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c539a00/0xad6b7ddc147a0ce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c13 expref: 12 pid: 12258 timeout: 917 lvb_type: 1 00000100:00100000:1.0:1746065221.224629:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264017920:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065221.224637:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71ae00/0xad6b7ddc1479eac lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ab5 expref: 8 pid: 1880 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.224647:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264018048:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065221.224663:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065221.224679:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264017664:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065221.224686:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065221.224698:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265475712 00000100:00100000:1.0:1746065221.224701:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265475712 00002000:00100000:1.0:1746065221.224719:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1191936->2097151) req@ffff88013615fb80 x1830881265475712/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:137/0 lens 488/0 e 0 to 0 dl 1746065232 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065221.224726:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615fb80 with x1830881265475712 ext(1191936->2097151) 00010000:00010000:1.0:1746065221.224731:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 45 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.224738:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 45 pid: 9548 timeout: 917 lvb_type: 0 00002000:00010000:1.0:1746065221.224742:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013615fb80 00000100:00100000:1.0:1746065221.224750:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265475840 00000100:00100000:1.0:1746065221.224752:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265475840 00002000:00100000:1.0:1746065221.224763:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (4096->1048575) req@ffff88013615d500 x1830881265475840/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/0 e 0 to 0 dl 1746065232 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065221.224786:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615d500 with x1830881265475840 ext(4096->1048575) 00010000:00010000:1.0:1746065221.224791:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 27 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.224797:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 27 pid: 9548 timeout: 917 lvb_type: 0 00002000:00010000:1.0:1746065221.224802:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013615d500 00000100:00100000:1.0:1746065221.224812:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2093 00000100:00100000:1.0:1746065221.224816:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881265475712:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065221.224937:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2094 00000100:00100000:1.0:1746065221.224941:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2006:x1830881265475840:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:3.0:1746065221.225097:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552e400/0xad6b7ddc147a0d5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c21 expref: 11 pid: 11461 timeout: 917 lvb_type: 1 00000100:00100000:3.0:1746065221.225109:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264018560:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.225116:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a081 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939be9 expref: 28 pid: 12260 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.225123:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264018688:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.225134:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.225141:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.225147:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.225158:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.225164:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.225171:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.225176:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065221.225179:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.225184:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.225192:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.225197:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a130 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065221.225224:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265475328:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 14661us (14786us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.225229:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17676 00000100:00100000:0.0:1746065221.230339:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8282 00000100:00100000:0.0:1746065221.230363:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2005:x1830881265476992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065221.230379:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065221.230404:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 7 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.230420:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 7 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.230442:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552e600/0xad6b7ddc147a06c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1056767) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bd4 expref: 7 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:0.0:1746065221.230474:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065221.230476:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065221.230480:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065221.230490:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065221.230510:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065221.230547:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+6:2005:x1830881265476992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 193us (6051us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065221.230593:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.230600:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.230617:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.230623:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.230629:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.230635:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065221.230638:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.230643:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.230651:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.230655:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538000/0xad6b7ddc147a10d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065221.230699:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265474944:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 21763us (21844us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.230707:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17671 00000100:00100000:1.0:1746065221.230872:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.230891:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265476736 00000100:00100000:1.0:1746065221.230897:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265476736 00010000:00010000:1.0:1746065221.230939:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 20 pid: 9548 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746065221.231945:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264017536:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065221.231963:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.231991:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3c00/0xad6b7ddc1479fbd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b6b expref: 20 pid: 12260 timeout: 917 lvb_type: 1 00000100:00100000:2.0:1746065221.232005:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264018176:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065221.232020:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012fd7f000/0xad6b7ddc147a0c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c28 expref: 10 pid: 12260 timeout: 917 lvb_type: 1 00000100:00100000:2.0:1746065221.232028:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264018304:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065221.232037:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc1479f8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b48 expref: 6 pid: 9548 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746065221.232044:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264018432:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065221.232055:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.232061:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.232066:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.232081:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.232087:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.232094:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.232099:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065221.232101:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.232107:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.232116:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.232122:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60e00/0xad6b7ddc147a129 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065221.232156:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265475456:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 22774us (22985us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065221.232163:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17673 00000100:00100000:0.0:1746065221.233195:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8282 00000100:00100000:1.0:1746065221.233226:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8283 00000100:00100000:1.0:1746065221.233236:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+19:2007:x1830881265476736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065221.233248:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065221.233263:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 19 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.233272:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 19 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.233287:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc1479ee4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939aed expref: 19 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.233297:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.233298:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.233302:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.233309:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.233337:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065221.233366:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+18:2007:x1830881265476736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 133us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.233372:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8283 00010000:00010000:1.0:1746065221.233393:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.233399:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.233410:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.233417:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.233423:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.233428:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552fc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065221.233431:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.233437:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.233445:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.233450:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552fc00/0xad6b7ddc147a122 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065221.233480:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265475072:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 23759us (24285us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.233486:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17675 00000100:00100000:1.0:1746065221.256960:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+47:2007:x1830881265475712:12345-192.168.202.27@tcp:4:cat.0 Request processed in 32135us (33618us total) trans 17179874329 rc 0/0 00000100:00100000:1.0:1746065221.256972:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2093 00002000:00100000:1.0:1746065221.256986:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1191936->2097151) req@ffff88013615fb80 x1830881265475712/t17179874329(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:137/0 lens 488/448 e 0 to 0 dl 1746065232 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065221.256996:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615fb80 with x1830881265475712 ext(1191936->2097151) 00010000:00010000:1.0:1746065221.257004:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 47 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.257016:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 47 pid: 9548 timeout: 917 lvb_type: 0 00002000:00010000:1.0:1746065221.257022:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013615fb80 00000100:00100000:0.0:1746065221.270599:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.274171:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265477120 00000100:00100000:3.0:1746065221.274182:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265477120 00010000:00010000:3.0:1746065221.274224:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 47 pid: 9548 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.274262:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8284 00000100:00100000:3.0:1746065221.274268:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+47:2004:x1830881265477120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065221.274280:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065221.274295:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 47 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.274304:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 47 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.274332:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a050 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1191936->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bb8 expref: 47 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.274348:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.274349:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.274353:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.274359:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.277132:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065221.277157:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.277167:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.277188:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.277198:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.277204:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.277209:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ae22600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065221.277212:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.277218:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.277228:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.277233:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ae22600/0xad6b7ddc147a114 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065221.277291:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265475200:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 68028us (68160us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.277299:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17672 00000100:00100000:3.0:1746065221.277340:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265477120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3073us (6751us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.277346:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8284 00000100:00100000:2.0:1746065221.281116:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2006:x1830881265475840:12345-192.168.202.27@tcp:4:cat.0 Request processed in 56165us (57741us total) trans 17179874331 rc 0/0 00000100:00100000:2.0:1746065221.281127:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2094 00002000:00100000:2.0:1746065221.281137:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (4096->1048575) req@ffff88013615d500 x1830881265475840/t17179874331(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:137/0 lens 488/448 e 0 to 0 dl 1746065232 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065221.281147:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013615d500 with x1830881265475840 ext(4096->1048575) 00010000:00010000:2.0:1746065221.281155:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 29 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746065221.281168:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 29 pid: 9548 timeout: 917 lvb_type: 0 00002000:00010000:2.0:1746065221.281174:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88013615d500 00000100:00100000:0.0:1746065221.284709:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.284813:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265477248 00000100:00100000:3.0:1746065221.284821:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265477248 00010000:00010000:3.0:1746065221.284850:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 29 pid: 9548 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.284872:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8285 00000100:00100000:3.0:1746065221.284878:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+29:2007:x1830881265477248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065221.285146:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1746065221.285160:0:7190:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 1912 -> 2048 00010000:00010000:3.0:1746065221.285167:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 29 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.285178:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 29 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.285197:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147a065 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4096->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939bcd expref: 29 pid: 9548 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.285420:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.285422:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.285426:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.285433:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.285461:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065221.285506:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2007:x1830881265477248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 627us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.285515:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8285 00010000:00010000:1.0:1746065221.285766:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.285793:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.285808:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.285814:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.285820:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.285826:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009552fe00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065221.285829:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.285840:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.285850:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065221.285856:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a11b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065221.285897:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265474816:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 76278us (76712us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.285904:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17674 00000100:00100000:1.0:1746065221.289191:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.289259:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265477504 00000100:00100000:3.0:1746065221.289266:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265477504 00000100:00100000:3.0:1746065221.289300:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14626 00000100:00100000:3.0:1746065221.289307:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2606:x1830881265477504:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:3.0:1746065221.289353:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065221.289374:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a106 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c3d expref: 12 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289389:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065221.289393:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065221.289414:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.289426:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc1479dd3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a4c expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289432:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc1479e0b lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a68 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289438:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399d5 expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289444:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289449:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 40 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289458:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479fa8 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b5d expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289463:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 9/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.289486:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b5d expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289496:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479fa8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b5d expref: 40 pid: 7205 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.289506:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264018816:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.289582:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 40 pid: 9571 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289589:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 40 pid: 9571 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.289596:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264018944:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.289614:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 20 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289620:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 20 pid: 7203 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.289626:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264019072:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.289643:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399d5 expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289649:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399d5 expref: 40 pid: 7205 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.289654:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264019200:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.289669:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc1479e0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a68 expref: 20 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289675:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc1479e0b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a68 expref: 20 pid: 7205 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.289680:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264019328:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.289695:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc1479dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a4c expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.289700:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc1479dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a4c expref: 40 pid: 7205 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.289706:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264019456:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065221.289716:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065221.294544:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.294562:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264018816:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065221.294573:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264018944:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065221.294580:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264019072:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065221.294585:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264019200:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065221.294591:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264019328:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065221.294659:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265477760 00000100:00100000:1.0:1746065221.294665:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265477760 00000100:00100000:1.0:1746065221.294712:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5503 00000100:00100000:1.0:1746065221.294718:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+41:30399:x1830881265477760:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065221.294907:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264019456:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065221.294934:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:1.0:1746065221.295735:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+42:30399:x1830881265477760:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 1015us (1195us total) trans 8589937158 rc 0/0 00000100:00100000:1.0:1746065221.295742:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5503 00000100:00100000:0.0:1746065221.296960:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.296988:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.297010:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265477888 00000100:00100000:0.0:1746065221.297012:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.297016:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265477888 00010000:00010000:3.0:1746065221.297041:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 42 pid: 9571 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.297133:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265478144 00000100:00100000:3.0:1746065221.297136:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265478144 00000100:00100000:0.0:1746065221.297139:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065221.297143:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399d5 expref: 43 pid: 7205 timeout: 917 lvb_type: 0 00000100:00100000:0.0:1746065221.297347:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.297898:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265478400 00000100:00100000:2.0:1746065221.297898:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265478016 00000100:00100000:3.0:1746065221.297901:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265478400 00000100:00100000:2.0:1746065221.297901:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265478016 00010000:00010000:3.0:1746065221.297915:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc1479dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a4c expref: 44 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746065221.297915:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 21 pid: 7203 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.297926:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265478272 00000100:00100000:3.0:1746065221.297928:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265478272 00000100:00100000:2.0:1746065221.297929:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8286 00010000:00010000:3.0:1746065221.297934:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc1479e0b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a68 expref: 22 pid: 7205 timeout: 917 lvb_type: 0 00000100:00100000:2.0:1746065221.297935:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265477888:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065221.297942:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8287 00000100:00100000:3.0:1746065221.297945:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265478144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065221.297945:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065221.297950:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065221.297950:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 44 pid: 9571 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.297953:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399d5 expref: 44 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:2.0:1746065221.297958:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 44 pid: 9571 timeout: 917 lvb_type: 0 00000100:00100000:1.0:1746065221.297987:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8288 00000100:00100000:1.0:1746065221.297993:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265478016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065221.297999:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065221.298002:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 14 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 22 pid: 7203 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298069:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399d5 expref: 44 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298084:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ca00/0xad6b7ddc1479d47 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399d5 expref: 44 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298096:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065221.298099:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.298106:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065221.298134:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265478144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 188us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.298140:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8287 00000100:00100000:3.0:1746065221.298153:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8289 00000100:00100000:3.0:1746065221.298157:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265478400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065221.298162:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065221.298166:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc1479dd3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a4c expref: 42 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298172:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc1479dd3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a4c expref: 42 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298181:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099524000/0xad6b7ddc1479dd3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a4c expref: 42 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298188:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065221.298191:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.298196:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065221.298209:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265478400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.298213:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8289 00000100:00100000:3.0:1746065221.298222:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8290 00000100:00100000:3.0:1746065221.298226:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265478272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065221.298231:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065221.298235:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc1479e0b lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a68 expref: 22 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298241:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc1479e0b lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a68 expref: 22 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298250:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009993f800/0xad6b7ddc1479e0b lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939a68 expref: 22 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298257:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065221.298260:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.298264:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065221.298276:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265478272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.298280:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8290 00000100:00100000:3.0:1746065221.298358:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.298372:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265478528 00000100:00100000:3.0:1746065221.298374:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265478528 00010000:00010000:3.0:1746065221.298383:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479fa8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b5d expref: 41 pid: 7205 timeout: 917 lvb_type: 0 00000100:00100000:3.0:1746065221.298393:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8291 00000100:00100000:3.0:1746065221.298396:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265478528:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065221.298401:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065221.298403:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479fa8 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b5d expref: 41 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298409:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479fa8 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b5d expref: 41 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298418:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091ae6000/0xad6b7ddc1479fa8 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939b5d expref: 41 pid: 7205 timeout: 917 lvb_type: 0 00010000:00010000:3.0:1746065221.298425:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065221.298428:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.298432:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065221.298444:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac527850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265478528:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (86us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.298448:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8291 00010000:00010000:2.0:1746065221.300017:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b400/0xad6b7ddc1479d55 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399e3 expref: 39 pid: 9571 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.300017:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 20 pid: 7203 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.300031:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06800/0xad6b7ddc1479d4e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9399dc expref: 20 pid: 7203 timeout: 917 lvb_type: 0 00010000:00010000:1.0:1746065221.300040:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065221.300082:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065221.300091:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065221.300098:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065221.300107:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065221.300109:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065221.300122:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065221.300140:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2004:x1830881265477888:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2204us (3182us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.300140:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265478016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2146us (2999us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.300146:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8288 00000100:00100000:2.0:1746065221.300148:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8286 00010000:00010000:3.0:1746065221.300426:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.300433:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000040:00080000:3.0:1746065221.301488:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1083, 88 off103144 00000004:00080000:3.0:1746065221.301496:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 817319722120ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065221.301526:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1096, 88 off104288 00000004:00080000:3.0:1746065221.301530:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 817319756941ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065221.306850:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1097, 88 off104376 00000004:00080000:3.0:1746065221.306861:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 817325086629ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065221.306896:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1084, 88 off103232 00000004:00080000:3.0:1746065221.306899:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 817325125556ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065221.306910:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1085, 88 off103320 00000004:00080000:3.0:1746065221.306912:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 817325138550ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065221.306920:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1098, 88 off104464 00000004:00080000:3.0:1746065221.306922:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 817325148444ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065221.306929:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1099, 88 off104552 00000004:00080000:3.0:1746065221.306931:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 817325157443ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065221.306938:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1100, 88 off104640 00000004:00080000:3.0:1746065221.306940:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 817325166241ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065221.306946:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1086, 88 off103408 00000004:00080000:3.0:1746065221.306948:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 817325174803ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065221.306955:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1101, 88 off104728 00000004:00080000:3.0:1746065221.306957:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 817325183274ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065221.306963:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1087, 88 off103496 00000004:00080000:3.0:1746065221.306965:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 817325191311ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065221.306971:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1102, 88 off104816 00000004:00080000:3.0:1746065221.306973:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 817325199489ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065221.306979:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1088, 88 off103584 00000004:00080000:3.0:1746065221.306984:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 817325210536ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065221.306992:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1089, 88 off103672 00000004:00080000:3.0:1746065221.306995:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 817325221095ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065221.307001:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1090, 88 off103760 00000004:00080000:3.0:1746065221.307004:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 817325230310ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065221.307011:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1091, 88 off103848 00000004:00080000:3.0:1746065221.307013:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 817325239933ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065221.307020:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1103, 88 off104904 00000004:00080000:3.0:1746065221.307022:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 817325248930ns, next at 761143559853ns, rc = 0 00000001:00080000:1.0:1746065221.312695:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937159 is committed 00000004:00080000:1.0:1746065221.312706:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1082 committed 00000004:00080000:1.0:1746065221.312722:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1072 committed 00000004:00080000:1.0:1746065221.312735:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1071 committed 00000004:00080000:1.0:1746065221.312737:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1070 committed 00000004:00080000:1.0:1746065221.312739:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1069 committed 00000004:00080000:1.0:1746065221.312740:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1081 committed 00000004:00080000:1.0:1746065221.312742:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1068 committed 00000004:00080000:1.0:1746065221.312743:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1080 committed 00000004:00080000:1.0:1746065221.312745:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1067 committed 00000004:00080000:1.0:1746065221.312747:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1079 committed 00000004:00080000:1.0:1746065221.312748:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1078 committed 00000004:00080000:1.0:1746065221.312749:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1077 committed 00000004:00080000:1.0:1746065221.312751:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1066 committed 00000004:00080000:1.0:1746065221.312752:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1065 committed 00000004:00080000:1.0:1746065221.312753:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1076 committed 00000004:00080000:1.0:1746065221.312755:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1075 committed 00000004:00080000:1.0:1746065221.312756:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1064 committed 00000001:00080000:1.0:1746065221.312761:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937158 is committed 00000001:00080000:1.0:1746065221.312770:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937154 is committed 00000100:00100000:1.0:1746065221.312832:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264019584:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065221.312879:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264019840:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065221.312882:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065221.312898:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065221.312916:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264019584 00000100:00100000:3.0:1746065221.312922:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264019584 00000100:00100000:1.0:1746065221.312926:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264020096:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065221.312941:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065221.312952:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065221.312953:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264019840 00000100:00100000:3.0:1746065221.312954:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264019840 00000100:00100000:1.0:1746065221.312956:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264019968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065221.312963:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264020096 00000100:00100000:3.0:1746065221.312965:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264020096 00000100:00100000:1.0:1746065221.312968:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065221.312973:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264019968 00000100:00100000:3.0:1746065221.312975:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264019968 00000100:00100000:1.0:1746065221.312978:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264020480:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065221.312984:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17677 00000100:00100000:3.0:1746065221.312990:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+26:3762:x1830881264019584:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065221.312990:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065221.313004:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264019712:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065221.313015:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065221.313024:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264020224:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065221.313034:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065221.313051:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264020480 00000100:00100000:1.0:1746065221.313053:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264020480 00000100:00100000:1.0:1746065221.313062:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264019712 00000100:00100000:1.0:1746065221.313063:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264019712 00000100:00100000:1.0:1746065221.313069:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264020224 00000100:00100000:1.0:1746065221.313071:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264020224 00000100:00100000:1.0:1746065221.313076:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17678 00000100:00100000:1.0:1746065221.313080:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3760:x1830881264019840:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065221.313105:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881264019584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 115us (223us total) trans 17179874332 rc 0/0 00000100:00100000:3.0:1746065221.313111:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17677 00000100:00100000:3.0:1746065221.313122:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17679 00000100:00100000:3.0:1746065221.313126:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881264020096:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065221.313128:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+30:3760:x1830881264019840:12345-0@lo:2:osp-syn-1-0.0 Request processed in 48us (229us total) trans 17179874333 rc 0/0 00000100:00100000:1.0:1746065221.313132:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17678 00000100:00100000:1.0:1746065221.313140:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17680 00000100:00100000:1.0:1746065221.313143:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881264019968:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065221.313165:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065221.313168:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065221.313170:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065221.313172:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065221.313173:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065221.313179:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881264019968:12345-0@lo:2:osp-syn-1-0.0 Request processed in 35us (210us total) trans 17179874335 rc 0/0 00000100:00100000:1.0:1746065221.313184:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17680 00000100:00100000:3.0:1746065221.313185:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881264020096:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (244us total) trans 17179874334 rc 0/0 00000100:00100000:3.0:1746065221.313190:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17679 00000100:00100000:1.0:1746065221.313192:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17681 00000100:00100000:3.0:1746065221.313196:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17682 00000100:00100000:1.0:1746065221.313196:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3762:x1830881264020480:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065221.313199:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881264019712:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065221.313227:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17683 00002000:00010000:1.0:1746065221.313230:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00000100:00100000:3.0:1746065221.313231:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3759:x1830881264020224:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065221.313232:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065221.313234:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065221.313236:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065221.313237:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:1.0:1746065221.313253:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881264020480:12345-0@lo:2:osp-syn-1-0.0 Request processed in 57us (262us total) trans 17179874336 rc 0/0 00000100:00100000:1.0:1746065221.313258:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17681 00000100:00100000:3.0:1746065221.313273:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3759:x1830881264020224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (237us total) trans 17179874338 rc 0/0 00000100:00100000:3.0:1746065221.313277:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17683 00000004:00080000:1.0:1746065221.313285:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3d880/2, rc 0, transno 17179874335 00000004:00080000:3.0:1746065221.313292:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3e680/2, rc 0, transno 17179874333 00000100:00100000:1.0:1746065221.313292:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264019968:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065221.313295:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264019840:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065221.313299:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264020352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065221.313299:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3f480/2, rc 0, transno 17179874336 00000100:00100000:1.0:1746065221.313301:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264020480:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065221.313307:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3d180/2, rc 0, transno 17179874334 00000100:00100000:3.0:1746065221.313327:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065221.313329:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264020096:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065221.313336:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3ea00/2, rc 0, transno 17179874332 00000100:00100000:1.0:1746065221.313339:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264019584:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065221.313348:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3c000/2, rc 0, transno 17179874338 00000100:00100000:3.0:1746065221.313350:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264020224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065221.313358:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264020352 00000100:00100000:1.0:1746065221.313359:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264020608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065221.313360:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264020352 00000100:00100000:3.0:1746065221.313371:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17684 00000100:00100000:1.0:1746065221.313374:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065221.313375:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+31:3760:x1830881264020352:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065221.313388:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264020608 00000100:00100000:1.0:1746065221.313390:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264020608 00000100:00100000:1.0:1746065221.313400:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17685 00000100:00100000:1.0:1746065221.313404:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+33:3762:x1830881264020608:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065221.313410:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065221.313412:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065221.313414:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065221.313415:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065221.313417:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:3.0:1746065221.313436:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881264020352:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (108us total) trans 17179874339 rc 0/0 00000100:00100000:3.0:1746065221.313441:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17684 00000100:00100000:1.0:1746065221.313446:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+34:3762:x1830881264020608:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (71us total) trans 17179874340 rc 0/0 00000100:00100000:1.0:1746065221.313450:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17685 00000004:00080000:3.0:1746065221.313458:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3dc00/2, rc 0, transno 17179874339 00000100:00100000:3.0:1746065221.313461:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264020352:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065221.313464:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834df80/2, rc 0, transno 17179874340 00000100:00100000:1.0:1746065221.313466:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264020608:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065221.313492:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881264019712:12345-0@lo:2:osp-syn-1-0.0 Request processed in 291us (475us total) trans 17179874337 rc 0/0 00000100:00100000:3.0:1746065221.313497:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17682 00000004:00080000:3.0:1746065221.313513:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3df80/2, rc 0, transno 17179874337 00000100:00100000:3.0:1746065221.313516:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264019712:0@lo:2:osp-syn-1-0.0 00000004:00010000:3.0:1746065221.313544:0:7205:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800907be300 reply state ffff88009aa0e800 transno 8589937159 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.313557:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.313564:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065221.313566:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065221.313569:0:7205:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746065221.313622:0:7205:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065221.313631:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2606:x1830881265477504:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 24323us (24446us total) trans 8589937159 rc 0/0 00000100:00100000:3.0:1746065221.313635:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14626 00010000:00010000:3.0:1746065221.313667:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.313676:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.313680:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.313685:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065221.313688:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00000100:00080000:0.0:1746065221.313925:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065221.313998:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264020864:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065221.314017:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065221.314036:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264021376:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065221.314048:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065221.314056:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065221.314059:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264020736:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065221.314068:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065221.314076:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264021248:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065221.314085:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065221.314096:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264020864 00000100:00100000:0.0:1746065221.314098:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264020864 00000100:00100000:0.0:1746065221.314114:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264021376 00000100:00100000:0.0:1746065221.314115:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264021376 00000100:00100000:0.0:1746065221.314121:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264020736 00000100:00100000:0.0:1746065221.314122:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264020736 00000100:00100000:0.0:1746065221.314128:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264021248 00000100:00100000:0.0:1746065221.314129:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264021248 00000100:00100000:0.0:1746065221.314137:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17686 00000100:00100000:0.0:1746065221.314140:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3760:x1830881264020864:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065221.314202:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3760:x1830881264020864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (184us total) trans 21474841714 rc 0/0 00000100:00100000:0.0:1746065221.314206:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17686 00000100:00100000:0.0:1746065221.314214:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17687 00000100:00100000:0.0:1746065221.314217:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3760:x1830881264021376:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065221.314244:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:0.0:1746065221.314246:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065221.314248:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065221.314249:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065221.314251:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:0.0:1746065221.314262:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3760:x1830881264021376:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (214us total) trans 21474841715 rc 0/0 00000100:00100000:0.0:1746065221.314266:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17687 00000100:00100000:0.0:1746065221.314272:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17688 00000100:00100000:0.0:1746065221.314275:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3760:x1830881264020736:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065221.314323:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3760:x1830881264020736:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (253us total) trans 21474841716 rc 0/0 00000100:00100000:0.0:1746065221.314328:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17688 00000100:00100000:0.0:1746065221.314336:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17689 00000100:00100000:0.0:1746065221.314339:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3760:x1830881264021248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065221.314372:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065221.314375:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065221.314377:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065221.314378:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065221.314380:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:0.0:1746065221.314394:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3760:x1830881264021248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (308us total) trans 21474841717 rc 0/0 00000100:00100000:0.0:1746065221.314399:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17689 00000100:00100000:0.0:1746065221.314416:0:3760:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841708 gen 2 00000004:00080000:0.0:1746065221.314419:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ca80, transno 21474841669 00000004:00080000:0.0:1746065221.314423:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3f100, transno 21474841670 00000004:00080000:0.0:1746065221.314426:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b64a80, transno 21474841671 00000004:00080000:0.0:1746065221.314428:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b65c00, transno 21474841672 00000004:00080000:0.0:1746065221.314430:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b66680, transno 21474841673 00000004:00080000:0.0:1746065221.314432:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ce00, transno 21474841674 00000004:00080000:0.0:1746065221.314434:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b64e00, transno 21474841675 00000004:00080000:0.0:1746065221.314435:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091b67b80, transno 21474841676 00000004:00080000:0.0:1746065221.314437:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec7b80, transno 21474841677 00000004:00080000:0.0:1746065221.314439:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec6680, transno 21474841678 00000004:00080000:0.0:1746065221.314441:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3480, transno 21474841679 00000004:00080000:0.0:1746065221.314443:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec5f80, transno 21474841680 00000004:00080000:0.0:1746065221.314444:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec5500, transno 21474841681 00000004:00080000:0.0:1746065221.314446:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135222680, transno 21474841682 00000004:00080000:0.0:1746065221.314448:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099ec6300, transno 21474841683 00000004:00080000:0.0:1746065221.314450:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3800, transno 21474841684 00000004:00080000:0.0:1746065221.314452:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4e00, transno 21474841693 00000004:00080000:0.0:1746065221.314454:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4380, transno 21474841694 00000004:00080000:0.0:1746065221.314456:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a91180, transno 21474841695 00000004:00080000:0.0:1746065221.314458:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4700, transno 21474841696 00000004:00080000:0.0:1746065221.314460:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a92d80, transno 21474841697 00000004:00080000:0.0:1746065221.314461:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a90380, transno 21474841698 00000004:00080000:0.0:1746065221.314463:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a90000, transno 21474841699 00000004:00080000:0.0:1746065221.314465:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd6d80, transno 21474841700 00000004:00080000:0.0:1746065221.314467:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd8a80, transno 21474841701 00000004:00080000:0.0:1746065221.314469:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098ddaa00, transno 21474841702 00000004:00080000:0.0:1746065221.314471:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dda300, transno 21474841703 00000004:00080000:0.0:1746065221.314473:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd9180, transno 21474841704 00000004:00080000:0.0:1746065221.314475:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd9c00, transno 21474841705 00000004:00080000:0.0:1746065221.314477:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098ddb800, transno 21474841706 00000004:00080000:0.0:1746065221.314478:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd9880, transno 21474841707 00000004:00080000:0.0:1746065221.314480:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd9f80, transno 21474841708 00000100:00100000:0.0:1746065221.314485:0:3760:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88013615dc00 x1830881264020736/t21474841716(21474841716) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065237 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:0.0:1746065221.314491:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615dc00/2, rc 0, transno 21474841716 00000100:00100000:0.0:1746065221.314494:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264020736:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065221.314500:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615d880/2, rc 0, transno 21474841717 00000100:00100000:0.0:1746065221.314502:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264021248:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065221.314507:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615c700/2, rc 0, transno 21474841714 00000100:00100000:0.0:1746065221.314510:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264020864:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065221.314515:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615ca80/2, rc 0, transno 21474841715 00000100:00100000:0.0:1746065221.314517:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264021376:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1746065221.314524:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1746065221.314639:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 32 done 00000100:00100000:2.0:1746065221.315745:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264020992:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065221.315801:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065221.315827:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264021504:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065221.315841:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065221.315854:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065221.315858:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264021120:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065221.315871:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065221.315881:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264021632:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065221.315892:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065221.315912:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264020992 00000100:00100000:2.0:1746065221.315916:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264020992 00000100:00100000:2.0:1746065221.315937:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264021504 00000100:00100000:2.0:1746065221.315939:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264021504 00000100:00100000:2.0:1746065221.315945:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264021120 00000100:00100000:2.0:1746065221.315946:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264021120 00000100:00100000:2.0:1746065221.315951:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264021632 00000100:00100000:2.0:1746065221.315952:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264021632 00000100:00100000:2.0:1746065221.315960:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17690 00000100:00100000:2.0:1746065221.315965:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881264020992:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065221.315972:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17691 00000100:00100000:0.0:1746065221.315977:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881264021504:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065221.316029:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17692 00000100:00100000:2.0:1746065221.316033:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881264021120:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065221.316046:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881264021504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (204us total) trans 21474841719 rc 0/0 00000100:00100000:0.0:1746065221.316052:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17691 00000100:00100000:0.0:1746065221.316063:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17693 00002000:00010000:2.0:1746065221.316076:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065221.316079:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065221.316081:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065221.316083:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065221.316084:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:2.0:1746065221.316102:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3761:x1830881264021120:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (230us total) trans 21474841720 rc 0/0 00000100:00100000:2.0:1746065221.316107:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17692 00010000:00010000:3.0:1746065221.316121:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.316136:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00000100:00100000:2.0:1746065221.316136:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881264020992:12345-0@lo:2:osp-syn-0-0.0 Request processed in 172us (336us total) trans 21474841718 rc 0/0 00010000:00010000:3.0:1746065221.316139:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:2.0:1746065221.316141:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17690 00010000:00010000:3.0:1746065221.316143:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065221.316148:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a137 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00000004:00080000:2.0:1746065221.316163:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615e680/2, rc 0, transno 21474841720 00000100:00100000:2.0:1746065221.316166:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264021120:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065221.316172:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615c380/2, rc 0, transno 21474841718 00000100:00100000:2.0:1746065221.316175:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264020992:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065221.316180:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615e300/2, rc 0, transno 21474841719 00000100:00100000:2.0:1746065221.316182:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264021504:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065221.316520:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881264021632:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065221.316589:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881264021632:12345-0@lo:2:osp-syn-0-0.0 Request processed in 521us (695us total) trans 21474841721 rc 0/0 00000100:00100000:0.0:1746065221.316595:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17693 00000004:00080000:3.0:1746065221.316649:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615d180/2, rc 0, transno 21474841721 00000100:00100000:3.0:1746065221.316652:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264021632:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065221.321123:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.321440:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265478656 00000100:00100000:3.0:1746065221.321448:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265478656 00000100:00100000:3.0:1746065221.321494:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14627 00000100:00100000:3.0:1746065221.321501:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+7:2606:x1830881265478656:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065221.321519:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065221.321534:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a13e lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c44 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.321583:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a13e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c44 expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.321593:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a13e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c44 expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065221.321606:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065221.321609:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065221.321611:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2e00, rc 0) 00000100:00100000:3.0:1746065221.321654:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2606:x1830881265478656:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 148us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.321659:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14627 00000100:00100000:0.0:1746065221.328525:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065221.328806:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265478784 00000100:00100000:2.0:1746065221.328813:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265478784 00000100:00100000:2.0:1746065221.328862:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14628 00000100:00100000:2.0:1746065221.328869:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2606:x1830881265478784:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065221.328884:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065221.328901:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc147a145 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c4b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.328967:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065221.328978:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065221.328990:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065221.329010:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:2.0:1746065221.329013:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065221.329025:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065221.329043:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30800/0xad6b7ddc147a145 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c4b expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.329064:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c4b expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.329070:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065221.329072:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065221.329074:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31000, rc 0) 00000100:00100000:2.0:1746065221.329123:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2606:x1830881265478784:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 255us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065221.329129:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14628 00000100:00100000:0.0:1746065221.338539:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.338582:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.338610:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265479040 00000100:00100000:0.0:1746065221.338610:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.338617:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265479040 00000100:00100000:0.0:1746065221.338625:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.338637:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.338648:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265478912 00000100:00100000:1.0:1746065221.338650:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265478912 00000100:00100000:1.0:1746065221.338704:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265479296 00000100:00100000:1.0:1746065221.338706:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265479296 00000100:00100000:0.0:1746065221.338711:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065221.339217:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265479552 00000100:00100000:1.0:1746065221.339220:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265479552 00000100:00100000:0.0:1746065221.339225:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265479168 00000100:00100000:0.0:1746065221.339227:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265479168 00000100:00100000:1.0:1746065221.339233:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265479424 00000100:00100000:1.0:1746065221.339235:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265479424 00000100:00100000:0.0:1746065221.339243:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17694 00000100:00100000:1.0:1746065221.339247:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17695 00000100:00100000:0.0:1746065221.339249:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265479040:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:1.0:1746065221.339251:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265478912:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065221.339264:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065221.339264:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065221.339279:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc147a153 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c52 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065221.339279:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147a15a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c59 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065221.339295:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d745, atime: 0x6812d743, ctime: 0x6812d745, blocks: 0x800 00002000:00010000:1.0:1746065221.339306:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d745, atime: 0x6812d741, ctime: 0x6812d745, blocks: 0x800 00010000:00010000:0.0:1746065221.339315:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065221.339317:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.339319:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.339320:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.339324:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc147a153 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c52 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065221.339324:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147a15a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c59 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.339336:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc147a153 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c52 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065221.339336:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147a15a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c59 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.339344:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd400, rc 0) 00010000:00010000:0.0:1746065221.339344:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538a00, rc 0) 00000100:00100000:3.0:1746065221.339382:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17696 00000100:00100000:3.0:1746065221.339389:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265479296:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:2.0:1746065221.339390:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17697 00010000:00010000:3.0:1746065221.339395:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065221.339395:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265479552:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065221.339400:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065221.339403:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a161 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c67 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065221.339406:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147a168 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c75 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065221.339412:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d745, atime: 0x6812d745, ctime: 0x6812d745, blocks: 0x808 00002000:00010000:2.0:1746065221.339414:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d744, atime: 0x6812d743, ctime: 0x6812d744, blocks: 0x1008 00010000:00010000:3.0:1746065221.339417:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.339418:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065221.339420:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065221.339421:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065221.339422:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a161 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c67 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.339424:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147a168 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c75 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065221.339430:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a161 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c67 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.339431:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147a168 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c75 expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065221.339438:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30e00, rc 0) 00010000:00010000:3.0:1746065221.339440:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3200, rc 0) 00000100:00100000:1.0:1746065221.339477:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265478912:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 224us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.339483:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17695 00000100:00100000:1.0:1746065221.339497:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17698 00000100:00100000:1.0:1746065221.339500:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265479168:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065221.339505:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065221.339512:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147a16f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c60 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065221.339521:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d744, atime: 0x6812d73f, ctime: 0x6812d744, blocks: 0x808 00010000:00010000:1.0:1746065221.339527:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.339528:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065221.339532:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147a16f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c60 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.339539:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147a16f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c60 expref: 13 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065221.339545:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd200, rc 0) 00000100:00100000:0.0:1746065221.340504:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265479040:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1252us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065221.340512:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17694 00000100:00100000:0.0:1746065221.340607:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17699 00000100:00100000:0.0:1746065221.340612:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265479424:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065221.340620:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065221.340628:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147a176 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c6e expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065221.340640:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 5034592, mtime: 0x6812d745, atime: 0x6812d744, ctime: 0x6812d745, blocks: 0x1678 00010000:00010000:0.0:1746065221.340648:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065221.340651:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065221.340655:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147a176 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c6e expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065221.340668:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147a176 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c6e expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065221.340675:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538400, rc 0) 00000100:00100000:0.0:1746065221.340690:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265479424:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 78us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065221.340695:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17699 00000100:00100000:2.0:1746065221.340782:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265479552:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1378us (2146us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065221.340786:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17697 00000100:00100000:3.0:1746065221.341085:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265479296:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 1695us (2471us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.341090:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17696 00000100:00100000:1.0:1746065221.342514:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265479168:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 3005us (3868us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065221.342520:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17698 00000100:00100000:0.0:1746065221.449915:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.449953:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065221.450675:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265479808 00000100:00100000:3.0:1746065221.450684:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265479808 00000100:00100000:0.0:1746065221.450691:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065221.450727:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065221.450816:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265480064 00000100:00100000:2.0:1746065221.450820:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265480064 00000100:00100000:0.0:1746065221.450922:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265479936 00000100:00100000:0.0:1746065221.450925:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265479936 00000100:00100000:3.0:1746065221.450964:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265479680 00000100:00100000:3.0:1746065221.450966:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265479680 00000100:00100000:2.0:1746065221.450977:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1144 00000100:00100000:2.0:1746065221.450984:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+5:2006:x1830881265480064:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065221.450986:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 241 00000100:00100000:3.0:1746065221.450989:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2006:x1830881265479680:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:2.0:1746065221.451032:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+5:2006:x1830881265480064:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 49us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065221.451038:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1144 00000100:00080000:1.0:1746065221.451054:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746065221.451142:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:124d38bc-0f92-4827-84b7-a543154654fd+15:2006:x1830881265479680:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 150us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.451148:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 241 00000100:00100000:3.0:1746065221.451178:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1145 00000100:00100000:3.0:1746065221.451182:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2006:x1830881265479936:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065221.451317:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2006:x1830881265479936:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 124us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.451323:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1145 00000100:00100000:3.0:1746065221.451334:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1146 00000100:00100000:3.0:1746065221.451339:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:2006:x1830881265479808:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065221.451358:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+294:2006:x1830881265479808:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 20us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065221.451362:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1146 00010000:00010000:2.0:1746065222.124096:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065222.351671:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.352533:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.353284:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265480320 00000100:00100000:1.0:1746065222.353293:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265480320 00000100:00100000:1.0:1746065222.353356:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17700 00000100:00100000:1.0:1746065222.353367:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265480320:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:1.0:1746065222.353541:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265480320:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 178us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.353548:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17700 00000100:00100000:0.0:1746065222.353648:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.353683:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.353690:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265480576 00000100:00100000:3.0:1746065222.353695:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265480576 00000100:00100000:0.0:1746065222.353698:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.353718:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265480832 00000100:00100000:3.0:1746065222.353720:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265480832 00000100:00100000:3.0:1746065222.353731:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265480192 00000100:00100000:3.0:1746065222.353732:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265480192 00000100:00100000:3.0:1746065222.353741:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265480448 00000100:00100000:3.0:1746065222.353743:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265480448 00000100:00100000:3.0:1746065222.353753:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17701 00000100:00100000:3.0:1746065222.353758:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265480576:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065222.353790:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.353805:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265480704 00000100:00100000:0.0:1746065222.353808:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265480704 00000100:00100000:3.0:1746065222.353817:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265480576:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 59us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.353823:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17702 00000100:00100000:3.0:1746065222.353827:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17701 00000100:00100000:0.0:1746065222.353828:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265480832:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:3.0:1746065222.353839:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17703 00000100:00100000:3.0:1746065222.353844:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265480192:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065222.353857:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265480832:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 29us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.353864:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17702 00000100:00100000:3.0:1746065222.353871:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265480192:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 27us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.353872:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17704 00000100:00100000:3.0:1746065222.353876:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17703 00000100:00100000:0.0:1746065222.353876:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265480448:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:3.0:1746065222.353887:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17705 00000100:00100000:3.0:1746065222.353891:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265480704:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065222.353894:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265480448:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 17us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.353898:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17704 00000100:00100000:3.0:1746065222.353916:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265480704:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 24us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.353921:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17705 00000100:00100000:0.0:1746065222.358333:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.358369:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.358916:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.359223:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.359239:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265480960 00000100:00100000:1.0:1746065222.359247:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265480960 00000100:00100000:2.0:1746065222.359313:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265481088 00000100:00100000:2.0:1746065222.359316:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265481088 00000100:00100000:2.0:1746065222.359341:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265481216 00000100:00100000:2.0:1746065222.359342:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265481216 00000100:00100000:2.0:1746065222.359356:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17706 00000100:00100000:2.0:1746065222.359363:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265481088:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:1.0:1746065222.359476:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265481344 00000100:00100000:1.0:1746065222.359479:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265481344 00000100:00100000:1.0:1746065222.359493:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17707 00000100:00100000:1.0:1746065222.359497:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265481216:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:1.0:1746065222.359561:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265481216:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 62us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.359567:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17707 00000100:00100000:1.0:1746065222.359581:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17708 00000100:00100000:1.0:1746065222.359585:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265480960:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:3.0:1746065222.359639:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17709 00000100:00100000:3.0:1746065222.359648:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265481344:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:3.0:1746065222.359863:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265481344:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 215us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.359868:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17709 00000100:00100000:0.0:1746065222.360029:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.360060:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.360075:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265481472 00000100:00100000:0.0:1746065222.360078:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265481472 00000100:00100000:2.0:1746065222.360083:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265481088:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 719us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.360092:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265481600 00000100:00100000:2.0:1746065222.360093:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17706 00000100:00100000:0.0:1746065222.360094:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265481600 00000100:00100000:2.0:1746065222.360105:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17710 00000100:00100000:2.0:1746065222.360110:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265481472:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:2.0:1746065222.360139:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265481472:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 30us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.360659:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265480960:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 1072us (2331us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.361073:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17711 00000100:00100000:2.0:1746065222.361094:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17710 00000100:00100000:0.0:1746065222.361223:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265481600:12345-192.168.202.27@tcp:23:mirror_io.0 00000100:00100000:0.0:1746065222.361272:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265481600:12345-192.168.202.27@tcp:23:mirror_io.0 Request processed in 52us (1211us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.361278:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17711 00000100:00100000:1.0:1746065222.361433:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17708 00000100:00100000:0.0:1746065222.366551:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.366646:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265481728 00000100:00100000:1.0:1746065222.366654:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265481728 00000100:00100000:1.0:1746065222.366705:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17712 00000100:00100000:1.0:1746065222.366711:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265481728:12345-192.168.202.27@tcp:22:mirror_io.0 00002000:00010000:1.0:1746065222.366884:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065222.366887:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065222.366889:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065222.366891:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065222.366892:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:1.0:1746065222.366939:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265481728:12345-192.168.202.27@tcp:22:mirror_io.0 Request processed in 227us (395us total) trans 21474841722 rc 0/0 00000100:00100000:1.0:1746065222.366945:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17712 00000100:00100000:0.0:1746065222.369107:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.369162:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265481856 00000100:00100000:2.0:1746065222.369168:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265481856 00000100:00100000:2.0:1746065222.369211:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17713 00000100:00100000:2.0:1746065222.369217:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265481856:12345-192.168.202.27@tcp:22:mirror_io.0 00002000:00010000:2.0:1746065222.369372:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065222.369376:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.369605:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065222.369608:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.369610:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:2.0:1746065222.369654:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265481856:12345-192.168.202.27@tcp:22:mirror_io.0 Request processed in 436us (551us total) trans 17179874341 rc 0/0 00000100:00100000:2.0:1746065222.369661:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17713 00000001:00080000:0.0:1746065222.371122:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874341 is committed 00000001:00080000:0.0:1746065222.371131:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874340 is committed 00000001:00080000:0.0:1746065222.371146:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874331 is committed 00000001:00080000:0.0:1746065222.371151:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874329 is committed 00000100:00100000:0.0:1746065222.376256:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.376645:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265482112 00000100:00100000:2.0:1746065222.376653:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265482112 00000100:00100000:2.0:1746065222.376713:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6350 00000100:00100000:2.0:1746065222.376720:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265482112:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:2.0:1746065222.376748:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc147a17d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.376763:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.376764:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.376768:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc147a17d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.376798:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc147a17d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.380627:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.381013:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.381538:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265482496 00000100:00100000:1.0:1746065222.381545:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265482496 00000100:00100000:1.0:1746065222.381600:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265482368 00000100:00100000:1.0:1746065222.381603:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265482368 00000100:00100000:1.0:1746065222.381633:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6351 00000100:00100000:1.0:1746065222.381640:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265482496:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065222.381669:0:29490:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a184 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.381686:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.381688:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.381691:0:29490:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a184 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.381701:0:29490:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a184 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.381869:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6352 00000100:00100000:3.0:1746065222.381875:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265482368:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:3.0:1746065222.381890:0:29491:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a18b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.381897:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.381899:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.381901:0:29491:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a18b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.381913:0:29491:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a18b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.382951:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.382971:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.383005:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.383026:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.383042:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265482880 00000100:00100000:0.0:1746065222.383046:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265482880 00000100:00100000:0.0:1746065222.383073:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265483136 00000100:00100000:0.0:1746065222.383075:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265483136 00000100:00100000:0.0:1746065222.383087:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265483392 00000100:00100000:0.0:1746065222.383088:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265483392 00000100:00100000:0.0:1746065222.383099:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265483648 00000100:00100000:0.0:1746065222.383100:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265483648 00000100:00100000:0.0:1746065222.383112:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6353 00000100:00100000:0.0:1746065222.383117:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:02506576-29fe-43be-8266-ebca0ccafd52+15:2006:x1830881265482880:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065222.383134:0:29492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a192 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.383143:0:29492:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.383144:0:29492:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.383147:0:29492:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a192 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.383156:0:29492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a192 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.383392:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6354 00000100:00100000:1.0:1746065222.383398:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:02506576-29fe-43be-8266-ebca0ccafd52+16:2006:x1830881265483136:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:1.0:1746065222.383412:0:9555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dca00/0xad6b7ddc147a199 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.383420:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.383421:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.383424:0:9555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dca00/0xad6b7ddc147a199 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.383432:0:9555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3dca00/0xad6b7ddc147a199 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.383640:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6355 00000100:00100000:0.0:1746065222.383646:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:02506576-29fe-43be-8266-ebca0ccafd52+16:2007:x1830881265483392:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:0.0:1746065222.383659:0:29488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a1a0 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.383666:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.383668:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.383670:0:29488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a1a0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.383678:0:29488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a1a0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.383842:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6356 00000100:00100000:3.0:1746065222.383848:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:02506576-29fe-43be-8266-ebca0ccafd52+16:2007:x1830881265483648:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:3.0:1746065222.383862:0:9554:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a1a7 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.383869:0:9554:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.383870:0:9554:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.383872:0:9554:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a1a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.383880:0:9554:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a1a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.386847:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.386924:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265483904 00000100:00100000:3.0:1746065222.386932:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265483904 00000100:00100000:3.0:1746065222.386973:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6357 00000100:00100000:3.0:1746065222.386980:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265483904:12345-192.168.202.27@tcp:3:mirror_io.0 00010000:00010000:3.0:1746065222.387005:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a1ae lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.387017:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.387019:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.387023:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a1ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.387032:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a1ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.396427:0:13378:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc147a17d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.396439:0:13378:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc147a17d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.396443:0:13378:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc147a17d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.396447:0:13378:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065222.396450:0:13378:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc147a17d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.396454:0:13378:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc147a17d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.396466:0:13378:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc147a17d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.396472:0:13378:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30a00/0xad6b7ddc147a17d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.396699:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+17:2007:x1830881265482112:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 19976us (20447us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746065222.396709:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6350 00010000:00010000:1.0:1746065222.402042:0:29490:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a184 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.402055:0:29490:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a184 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.402062:0:29490:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a184 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.402068:0:29490:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dcc00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065222.402072:0:29490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a184 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.402078:0:29490:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a184 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.402093:0:29490:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a184 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.402098:0:29490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a184 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.402176:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+18:2007:x1830881265482496:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 20533us (21552us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065222.402184:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6351 00010000:00010000:2.0:1746065222.408121:0:29492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a192 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.408134:0:29492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a192 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.408141:0:29492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a192 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.408146:0:29492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065222.408149:0:29492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a192 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.408155:0:29492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a192 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.408169:0:29492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a192 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.408174:0:29492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a192 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.408264:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:02506576-29fe-43be-8266-ebca0ccafd52+15:2006:x1830881265482880:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 25144us (25313us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065222.408273:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6353 00010000:00010000:3.0:1746065222.419856:0:29491:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a18b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.419872:0:29491:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a18b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.419880:0:29491:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a18b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.419885:0:29491:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065222.419889:0:29491:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a18b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.419901:0:29491:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a18b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.419918:0:29491:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a18b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.419924:0:29491:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a18b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.420023:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:02506576-29fe-43be-8266-ebca0ccafd52+16:2007:x1830881265482368:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 38141us (39004us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065222.420031:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6352 00010000:00010000:2.0:1746065222.421476:0:29488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a1a0 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.421488:0:29488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a1a0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.421495:0:29488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a1a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.421500:0:29488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065222.421503:0:29488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a1a0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.421510:0:29488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a1a0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.421521:0:29488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a1a0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.421527:0:29488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a1a0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.422284:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881265483392:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 38633us (39273us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065222.422296:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6355 00010000:00010000:3.0:1746065222.431586:0:9554:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a1a7 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.431603:0:9554:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a1a7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.431609:0:9554:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a1a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.431615:0:9554:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065222.431619:0:9554:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a1a7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.431625:0:9554:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a1a7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.431645:0:9554:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a1a7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.431651:0:9554:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a1a7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.431735:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265483648:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 47883us (48704us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065222.431744:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6356 00010000:00010000:1.0:1746065222.437142:0:9555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dca00/0xad6b7ddc147a199 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.437155:0:9555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dca00/0xad6b7ddc147a199 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.437163:0:9555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012f3dca00/0xad6b7ddc147a199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.437168:0:9555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dca00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065222.437171:0:9555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3dca00/0xad6b7ddc147a199 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.437178:0:9555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012f3dca00/0xad6b7ddc147a199 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.437194:0:9555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012f3dca00/0xad6b7ddc147a199 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.437200:0:9555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dca00/0xad6b7ddc147a199 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.437310:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013615c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265483136:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 53900us (54326us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065222.437319:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6354 00010000:00010000:3.0:1746065222.439578:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a1ae lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.439589:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a1ae lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.439596:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a1ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.439602:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065222.439604:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a1ae lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.439611:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a1ae lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.439623:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a1ae lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.439633:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a1ae lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.439693:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265483904:12345-192.168.202.27@tcp:3:mirror_io.0 Request processed in 52711us (52849us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065222.439701:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6357 00000100:00100000:0.0:1746065222.444023:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.444098:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265484032 00000100:00100000:2.0:1746065222.444105:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265484032 00000100:00100000:2.0:1746065222.444546:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 878 00000100:00100000:2.0:1746065222.444554:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2606:x1830881265484032:12345-192.168.202.27@tcp:103:mirror_io.0 00010000:00010000:2.0:1746065222.444565:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065222.444584:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2c00/0xad6b7ddc147a0f8 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c36 expref: 9 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.444613:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.444616:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065222.444653:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2606:x1830881265484032:12345-192.168.202.27@tcp:103:mirror_io.0 Request processed in 100us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.444659:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 878 00000100:00100000:0.0:1746065222.445622:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.445669:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265484288 00000100:00100000:1.0:1746065222.445673:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265484288 00000100:00100000:1.0:1746065222.445707:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5504 00000100:00100000:1.0:1746065222.445711:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2606:x1830881265484288:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065222.446065:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2606:x1830881265484288:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 353us (445us total) trans 8589937160 rc 0/0 00000100:00100000:1.0:1746065222.446071:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5504 00000100:00100000:0.0:1746065222.446897:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.447019:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265484544 00000100:00100000:1.0:1746065222.447023:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265484544 00000100:00100000:1.0:1746065222.447384:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5505 00000100:00100000:1.0:1746065222.447400:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2606:x1830881265484544:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065222.447506:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429ac50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2606:x1830881265484544:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 107us (610us total) trans 8589937161 rc 0/0 00000100:00100000:1.0:1746065222.447516:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5505 00000100:00100000:0.0:1746065222.461893:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.461939:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.462097:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265484800 00000100:00100000:2.0:1746065222.462105:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265484800 00000100:00100000:3.0:1746065222.462355:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265485056 00000100:00100000:3.0:1746065222.462360:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265485056 00000100:00100000:2.0:1746065222.462360:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14629 00000100:00100000:2.0:1746065222.462368:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2614:x1830881265484800:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:3.0:1746065222.462383:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14630 00000100:00100000:3.0:1746065222.462389:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2618:x1830881265485056:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.462405:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.462420:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc147a1b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c83 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.462478:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a1bc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462490:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a1bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462499:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a1bc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462510:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2600/0xad6b7ddc147a1c3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462516:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2600/0xad6b7ddc147a1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462521:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2600/0xad6b7ddc147a1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.462540:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.462548:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f7400/0xad6b7ddc147a1ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c7c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.462577:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc147a1d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.462584:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc147a1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.462593:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc147a1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065222.462597:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a1d8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.462601:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147a1df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065222.462604:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.462606:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147a1df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065222.462610:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.462612:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147a1df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065222.462617:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065222.462651:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a1ed lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.462657:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a1ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.462662:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a1ed lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065222.462668:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a1bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065222.462668:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065222.462675:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a1bc lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462680:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a1bc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462686:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a1bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462691:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065222.462694:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a1bc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.462698:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc147a1d1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065222.462700:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a1bc lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.462704:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc147a1d1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.462708:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc147a1d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.462712:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc147a1d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065222.462716:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065222.462718:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065222.462722:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a1bc lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462732:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a1bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462746:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2600/0xad6b7ddc147a1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462752:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2600/0xad6b7ddc147a1c3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462757:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2600/0xad6b7ddc147a1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462761:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f2600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065222.462763:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2600/0xad6b7ddc147a1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462768:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2600/0xad6b7ddc147a1c3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462796:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5dd00) 00010000:00010000:3.0:1746065222.462798:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065222.462801:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2600/0xad6b7ddc147a1c3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462805:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2600/0xad6b7ddc147a1c3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.462832:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3a00/0xad6b7ddc147a1b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c83 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.462842:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c83 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.462852:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.462855:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065222.462857:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3c00, rc 0) 00000100:00100000:3.0:1746065222.462892:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2618:x1830881265485056:12345-192.168.202.27@tcp:101:cat.0 Request processed in 503us (952us total) trans 8589937162 rc 0/0 00010000:00010000:2.0:1746065222.462893:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b49f6a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065222.462896:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc147a1d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065222.462898:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14630 00010000:00010000:2.0:1746065222.462901:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc147a1d1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.462908:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065222.462911:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065222.462913:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc147a1d1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.462917:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6a00/0xad6b7ddc147a1d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.463212:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147a1df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.463217:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147a1df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.463222:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147a1df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.463226:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b53d1000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065222.463228:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147a1df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.463232:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147a1df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.463239:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5dd00) 00010000:00010000:2.0:1746065222.463241:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065222.463243:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147a1df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.463249:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147a1df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.463278:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f7400/0xad6b7ddc147a1ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c7c expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.463287:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a1ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c7c expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.463292:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.463294:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065222.463295:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174a00, rc 0) 00000100:00100000:2.0:1746065222.463329:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2614:x1830881265484800:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 962us (1444us total) trans 8589937163 rc 0/0 00000100:00100000:2.0:1746065222.463333:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14629 00000100:00100000:0.0:1746065222.468931:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.468967:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.468990:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.469003:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.469016:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265485184 00000100:00100000:0.0:1746065222.469016:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.469024:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265485184 00000100:00100000:0.0:1746065222.469047:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.469117:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265485312 00000100:00100000:1.0:1746065222.469120:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265485312 00000100:00100000:1.0:1746065222.469134:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265485440 00000100:00100000:1.0:1746065222.469136:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265485440 00000100:00100000:1.0:1746065222.469144:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265485568 00000100:00100000:1.0:1746065222.469146:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265485568 00000100:00100000:1.0:1746065222.469155:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265485696 00000100:00100000:1.0:1746065222.469156:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265485696 00000100:00100000:1.0:1746065222.469165:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265485824 00000100:00100000:1.0:1746065222.469167:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265485824 00000100:00100000:1.0:1746065222.469181:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17714 00000100:00100000:1.0:1746065222.469187:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2004:x1830881265485184:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065222.469194:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17715 00010000:00010000:1.0:1746065222.469202:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065222.469203:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2004:x1830881265485312:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.469212:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.469218:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc147a1fb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c8a expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.469222:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a202 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c91 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.469237:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.469239:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.469247:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a202 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c91 expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.469261:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a202 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c91 expref: 8 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.469271:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2800, rc 0) 00000100:00100000:2.0:1746065222.469272:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17716 00000100:00100000:2.0:1746065222.469278:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265485440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065222.469285:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.469293:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c98 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.469315:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.469316:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.469321:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065222.469325:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265485312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 122us (356us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065222.469330:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065222.469331:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17715 00010000:00010000:2.0:1746065222.469337:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174000, rc 0) 00000100:00100000:3.0:1746065222.469350:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17717 00000100:00100000:3.0:1746065222.469355:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265485568:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065222.469356:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265485440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 78us (365us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065222.469361:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065222.469361:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17716 00010000:00010000:3.0:1746065222.469368:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a210 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939c9f expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.469369:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17718 00000100:00100000:2.0:1746065222.469374:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17719 00010000:00010000:3.0:1746065222.469377:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065222.469377:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265485696:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065222.469378:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2004:x1830881265485824:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.469379:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.469382:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a210 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c9f expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.469383:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065222.469386:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.469390:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a210 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c9f expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.469390:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a217 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939cad expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.469393:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc147a21e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ca6 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.469397:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3e00, rc 0) 00010000:00010000:2.0:1746065222.469399:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.469400:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.469404:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a217 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cad expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065222.469405:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.469406:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.469411:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc147a21e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ca6 expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065222.469412:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265485568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 57us (408us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065222.469412:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a217 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cad expref: 8 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065222.469417:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17717 00010000:00010000:2.0:1746065222.469418:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b49f6800, rc 0) 00010000:00010000:0.0:1746065222.469421:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc147a21e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ca6 expref: 10 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065222.469428:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad400, rc 0) 00000100:00100000:0.0:1746065222.469445:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265485696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 69us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.469451:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17718 00010000:00010000:1.0:1746065222.469491:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.469494:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.469501:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc147a1fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c8a expref: 8 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.469510:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc147a1fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c8a expref: 8 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.469517:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552ee00, rc 0) 00000100:00100000:2.0:1746065222.469534:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265485824:12345-192.168.202.27@tcp:101:cat.0 Request processed in 55us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.469540:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17719 00000100:00100000:1.0:1746065222.469541:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265485184:12345-192.168.202.27@tcp:101:cat.0 Request processed in 355us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.469546:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17714 00000100:00100000:0.0:1746065222.471661:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.471807:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265486080 00000100:00100000:2.0:1746065222.471813:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265486080 00000100:00100000:3.0:1746065222.472052:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14631 00000100:00100000:3.0:1746065222.472065:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2617:x1830881265486080:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065222.472084:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.472097:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a225 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939cb4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.472182:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.472194:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c4b expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.472204:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a1d8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c83 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.472210:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a1ed lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c7c expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.472216:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 6/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.472244:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a1ed lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c7c expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.472254:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a1ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c7c expref: 27 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.472264:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264021760:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.472364:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c83 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.472371:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a1d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c83 expref: 10 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.472379:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264021888:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.472406:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c4b expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.472412:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c4b expref: 9 pid: 7204 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.472419:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264022016:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.472435:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.478127:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.478156:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.478183:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.478204:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265486592 00000100:00100000:0.0:1746065222.478211:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265486592 00010000:00010000:0.0:1746065222.478236:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c4b expref: 10 pid: 7204 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746065222.478254:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265486464 00000100:00100000:0.0:1746065222.478256:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265486464 00010000:00010000:0.0:1746065222.478263:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a1ed lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c7c expref: 28 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746065222.478276:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8292 00000100:00100000:0.0:1746065222.478282:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265486592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.478292:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.478296:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c4b expref: 10 pid: 7204 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.478317:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c4b expref: 10 pid: 7204 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.478336:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065222.478341:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.478348:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.478353:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.478383:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265486592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 100us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.478389:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8292 00000100:00100000:0.0:1746065222.478403:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8293 00000100:00100000:0.0:1746065222.478407:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265486464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.478413:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.478416:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a1ed lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c7c expref: 28 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.478434:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a1ed lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c7c expref: 28 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.478443:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065222.478445:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.478450:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.478455:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.478466:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265486464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.478470:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8293 00000100:00100000:2.0:1746065222.478753:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265486336 00000100:00100000:2.0:1746065222.478757:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265486336 00010000:00010000:3.0:1746065222.478835:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a1ed lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c7c expref: 28 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.478856:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14632 00000100:00100000:1.0:1746065222.478864:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2619:x1830881265486336:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:3.0:1746065222.479001:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264021760:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.479014:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264021888:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.479022:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147a14c lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c4b expref: 9 pid: 7204 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.479031:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264022016:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065222.479032:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065222.479053:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065222.479070:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065222.479083:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265486720 00000100:00100000:1.0:1746065222.479086:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265486720 00010000:00010000:1.0:1746065222.479099:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a1d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c83 expref: 11 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.479113:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8294 00000100:00100000:1.0:1746065222.479117:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265486720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.479123:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.479126:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a1d8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c83 expref: 11 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.479134:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c83 expref: 11 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.479147:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3c00/0xad6b7ddc147a1d8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c83 expref: 11 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.479171:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065222.479174:0:9565:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065222.479181:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065222.479191:0:9565:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065222.479204:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065222.479221:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265486720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 104us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.479226:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8294 00010000:00010000:1.0:1746065222.479244:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc147a233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939cbb expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.479331:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147a23a lrc: 3/1,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065222.479339:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147a23a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065222.479345:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147a23a lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:1.0:1746065222.479354:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065222.479420:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552fe00/0xad6b7ddc147a233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cbb expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.479431:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147a23a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cbb expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.479437:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065222.479440:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065222.479442:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f600, rc 0) 00000100:00100000:1.0:1746065222.479460:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2619:x1830881265486336:12345-192.168.202.27@tcp:101:cat.0 Request processed in 598us (1342us total) trans 8589937164 rc 0/0 00000100:00100000:1.0:1746065222.479466:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14632 00010000:00010000:3.0:1746065222.479523:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.479530:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065222.479540:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065222.479579:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a225 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cb4 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.479589:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cb4 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.479600:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.479602:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065222.479604:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2400, rc 0) 00000100:00100000:3.0:1746065222.479620:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2617:x1830881265486080:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7561us (7965us total) trans 8589937165 rc 0/0 00000100:00100000:3.0:1746065222.479625:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14631 00000100:00100000:1.0:1746065222.482695:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.482789:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265486848 00000100:00100000:3.0:1746065222.482795:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265486848 00000100:00100000:3.0:1746065222.482828:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14633 00000100:00100000:3.0:1746065222.482835:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2619:x1830881265486848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.482851:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.482864:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a24f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939cc2 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.482928:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a256 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.482940:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cb4 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.482950:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a256 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.482974:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cb4 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.482984:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cb4 expref: 9 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.482999:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264022144:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.483653:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.486034:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.486166:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265486976 00000100:00100000:1.0:1746065222.486173:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265486976 00000100:00100000:1.0:1746065222.486476:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14634 00000100:00100000:1.0:1746065222.486484:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2618:x1830881265486976:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.486500:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.486514:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a25d lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939cc9 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.486551:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a25d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc9 expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.486562:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a25d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc9 expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.486575:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065222.486577:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065222.486580:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f000, rc 0) 00000100:00100000:1.0:1746065222.486614:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2618:x1830881265486976:12345-192.168.202.27@tcp:101:cat.0 Request processed in 131us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.486620:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14634 00000100:00100000:1.0:1746065222.486719:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.486826:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265487104 00000100:00100000:0.0:1746065222.486830:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265487104 00010000:00010000:0.0:1746065222.486845:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cb4 expref: 11 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746065222.486861:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8295 00000100:00100000:0.0:1746065222.486866:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265487104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.486873:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.486877:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cb4 expref: 11 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.486885:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cb4 expref: 11 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.486897:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065222.486900:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a256 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.486906:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a256 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.486910:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a256 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.486922:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.486940:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265487104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.486945:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8295 00010000:00010000:3.0:1746065222.487176:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2400/0xad6b7ddc147a22c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cb4 expref: 10 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.487193:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264022144:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.487207:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a256 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.487213:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a256 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.487218:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a256 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065222.487251:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065222.487255:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065222.487269:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a256 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.487376:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a24f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc2 expref: 31 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.487386:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a256 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc2 expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.487392:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.487393:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065222.487396:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174a00, rc 0) 00000100:00100000:3.0:1746065222.487429:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2619:x1830881265486848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4595us (4740us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.487434:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14633 00000100:00100000:0.0:1746065222.490334:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.490362:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.490420:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.490431:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265487232 00000100:00100000:3.0:1746065222.490437:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265487232 00000100:00100000:3.0:1746065222.490469:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265487360 00000100:00100000:1.0:1746065222.490470:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265487488 00000100:00100000:3.0:1746065222.490471:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265487360 00000100:00100000:1.0:1746065222.490473:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265487488 00000100:00100000:3.0:1746065222.490485:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17720 00000100:00100000:3.0:1746065222.490491:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881265487232:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.490503:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.490515:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc147a264 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939cd0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.490532:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.490533:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.490540:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc147a264 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd0 expref: 25 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.490550:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc147a264 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd0 expref: 25 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.490558:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2600, rc 0) 00000100:00100000:3.0:1746065222.490590:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2007:x1830881265487232:12345-192.168.202.27@tcp:101:cat.0 Request processed in 99us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.490661:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17721 00000100:00100000:1.0:1746065222.490666:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+19:2006:x1830881265487360:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.490674:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.490684:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc147a26b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939cd7 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.490694:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:3.0:1746065222.490695:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17720 00010000:00010000:1.0:1746065222.490696:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.490700:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc147a26b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd7 expref: 20 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065222.490709:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17722 00010000:00010000:1.0:1746065222.490710:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc147a26b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd7 expref: 20 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065222.490714:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881265487488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.490716:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f400, rc 0) 00010000:00010000:3.0:1746065222.490721:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.490727:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc147a272 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939cde expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.490731:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881265487360:12345-192.168.202.27@tcp:101:cat.0 Request processed in 65us (368us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065222.490736:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065222.490736:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17721 00010000:00010000:3.0:1746065222.490737:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.490741:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc147a272 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cde expref: 21 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.490749:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc147a272 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cde expref: 20 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.490755:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3a00, rc 0) 00000100:00100000:3.0:1746065222.490770:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881265487488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 56us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.490793:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17722 00000100:00100000:0.0:1746065222.490968:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.490991:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.491022:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.491212:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265487616 00000100:00100000:1.0:1746065222.491216:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265487616 00000100:00100000:1.0:1746065222.491231:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265487744 00000100:00100000:1.0:1746065222.491233:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265487744 00000100:00100000:1.0:1746065222.491240:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265487872 00000100:00100000:1.0:1746065222.491241:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265487872 00000100:00100000:1.0:1746065222.491251:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17723 00000100:00100000:1.0:1746065222.491255:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881265487616:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.491261:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.491267:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ce5 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.491281:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.491282:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.491286:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 27 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.491294:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 27 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.491310:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fe00, rc 0) 00000100:00100000:1.0:1746065222.491328:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881265487616:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.491333:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17723 00000100:00100000:1.0:1746065222.491343:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17724 00000100:00100000:1.0:1746065222.491347:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2007:x1830881265487744:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.491351:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.491356:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a280 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939cec expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.491364:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.491365:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.491369:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a280 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cec expref: 27 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.491376:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a280 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cec expref: 27 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.491386:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fa00, rc 0) 00000100:00100000:1.0:1746065222.491398:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881265487744:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.491402:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17724 00000100:00100000:1.0:1746065222.491410:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17725 00000100:00100000:1.0:1746065222.491414:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881265487872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.491418:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.491423:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc147a287 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939cf3 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.491431:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.491432:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.491436:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc147a287 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cf3 expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.491443:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc147a287 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cf3 expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.491449:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552e000, rc 0) 00000100:00100000:1.0:1746065222.491459:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265487872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 45us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.491463:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17725 00000100:00100000:0.0:1746065222.492257:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.492322:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265488128 00000100:00100000:3.0:1746065222.492325:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265488128 00000100:00100000:2.0:1746065222.492378:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14635 00000100:00100000:2.0:1746065222.492384:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2614:x1830881265488128:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065222.492393:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.492394:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 1 00010000:00010000:2.0:1746065222.492408:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f600/0xad6b7ddc147a23a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cbb expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.492429:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147a256 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc2 expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.492435:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.492437:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065222.492443:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a28e lrc: 2/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939cfa expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.492480:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.492489:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a13e lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c44 expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.492495:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a25d lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc9 expref: 9 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.492500:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.492522:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a25d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc9 expref: 9 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.492535:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a25d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc9 expref: 9 pid: 7205 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.492544:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264022272:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.492622:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a13e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c44 expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.492630:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a13e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c44 expref: 8 pid: 7205 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.492636:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264022400:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.492654:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065222.493743:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264022272:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.493752:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264022400:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.493768:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065222.494451:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.494513:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.494563:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265488256 00000100:00100000:2.0:1746065222.494568:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265488256 00000100:00100000:1.0:1746065222.494580:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265488384 00000100:00100000:1.0:1746065222.494584:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265488384 00010000:00010000:2.0:1746065222.494590:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a25d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc9 expref: 10 pid: 7205 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.494597:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a13e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c44 expref: 9 pid: 7205 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.494610:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8296 00000100:00100000:1.0:1746065222.494614:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8297 00000100:00100000:2.0:1746065222.494616:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265488256:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065222.494619:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265488384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065222.494624:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.494626:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065222.494628:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a25d lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc9 expref: 10 pid: 7205 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.494629:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a13e lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c44 expref: 9 pid: 7205 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.494636:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a25d lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc9 expref: 10 pid: 7205 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.494645:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a13e lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c44 expref: 9 pid: 7205 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.494745:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009552f000/0xad6b7ddc147a25d lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cc9 expref: 10 pid: 7205 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.494752:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a13e lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c44 expref: 9 pid: 7205 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.494760:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.494764:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.494771:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.494791:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065222.494810:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065222.494813:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065222.494886:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265488384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 266us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.494892:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8297 00010000:00010000:2.0:1746065222.495403:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065222.495436:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265488256:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 819us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.495442:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8296 00010000:00010000:3.0:1746065222.495987:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065222.495994:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000040:00080000:3.0:1746065222.496178:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1092, 88 off103936 00000004:00080000:3.0:1746065222.496184:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818514410296ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.496215:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1104, 88 off104992 00000004:00080000:3.0:1746065222.496220:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818514445924ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.496238:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1105, 88 off105080 00000004:00080000:3.0:1746065222.496241:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818514467768ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.496249:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1093, 88 off104024 00000004:00080000:3.0:1746065222.496252:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818514478519ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.496261:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1094, 88 off104112 00000004:00080000:3.0:1746065222.496263:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818514489794ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.496271:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1106, 88 off105168 00000004:00080000:3.0:1746065222.496273:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818514499711ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.496312:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1107, 88 off105256 00000004:00080000:3.0:1746065222.496316:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818514542266ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.496336:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1108, 88 off105344 00000004:00080000:3.0:1746065222.496339:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818514565329ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.496347:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1095, 88 off104200 00000004:00080000:3.0:1746065222.496499:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818514725326ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.496522:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1109, 88 off105432 00000004:00080000:3.0:1746065222.496525:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818514751394ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.496541:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1096, 88 off104288 00000004:00080000:3.0:1746065222.496544:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818514770446ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.496552:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1110, 88 off105520 00000004:00080000:3.0:1746065222.496555:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818514781554ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.496564:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1097, 88 off104376 00000004:00080000:3.0:1746065222.496567:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818514793919ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.496575:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1098, 88 off104464 00000004:00080000:3.0:1746065222.496578:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818514803998ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.496584:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1099, 88 off104552 00000004:00080000:3.0:1746065222.496587:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818514813531ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.496594:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1100, 88 off104640 00000004:00080000:3.0:1746065222.496596:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818514822918ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.496604:0:7231:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1111, 88 off105608 00000004:00080000:3.0:1746065222.496607:0:7231:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818514833009ns, next at 761143559853ns, rc = 0 00000001:00080000:0.0:1746065222.498506:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937166 is committed 00000004:00080000:0.0:1746065222.498513:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1090 committed 00000004:00080000:0.0:1746065222.498517:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1081 committed 00000004:00080000:0.0:1746065222.498520:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1080 committed 00000004:00080000:0.0:1746065222.498522:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1079 committed 00000004:00080000:0.0:1746065222.498523:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1078 committed 00000004:00080000:0.0:1746065222.498525:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1089 committed 00000004:00080000:0.0:1746065222.498528:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1077 committed 00000004:00080000:0.0:1746065222.498529:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1088 committed 00000004:00080000:0.0:1746065222.498530:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1076 committed 00000004:00080000:0.0:1746065222.498532:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1087 committed 00000004:00080000:0.0:1746065222.498533:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1086 committed 00000004:00080000:0.0:1746065222.498535:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1085 committed 00000004:00080000:0.0:1746065222.498536:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1075 committed 00000004:00080000:0.0:1746065222.498537:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1074 committed 00000004:00080000:0.0:1746065222.498539:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1084 committed 00000004:00080000:0.0:1746065222.498540:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1083 committed 00000004:00080000:0.0:1746065222.498541:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1073 committed 00000001:00080000:0.0:1746065222.498544:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937165 is committed 00000001:00080000:0.0:1746065222.498555:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937161 is committed 00010000:00010000:3.0:1746065222.498635:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cfa expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.498644:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.498647:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065222.498659:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147a28e lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cfa expref: 28 pid: 7231 timeout: 0 lvb_type: 3 00000100:00100000:0.0:1746065222.498659:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264022656:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746065222.498674:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cfa expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.498694:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264022784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065222.498703:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.498719:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065222.498723:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264023168:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.498812:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264022528:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.498831:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264022912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.498952:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264023296:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.498955:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065222.498977:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.498980:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065222.498982:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3000, rc 0) 00000100:00100000:3.0:1746065222.499012:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2614:x1830881265488128:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6628us (6757us total) trans 8589937166 rc 0/0 00000100:00100000:3.0:1746065222.499019:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14635 00000100:00100000:3.0:1746065222.499065:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.499132:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265488512 00000100:00100000:3.0:1746065222.499137:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265488512 00000100:00100000:3.0:1746065222.499159:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14636 00000100:00100000:3.0:1746065222.499164:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2619:x1830881265488512:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.499177:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.499187:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc147a29c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d01 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.499212:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc147a29c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d01 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.499220:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc147a29c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d01 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.499228:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.499231:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065222.499232:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b2800, rc 0) 00000100:00100000:3.0:1746065222.499256:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2619:x1830881265488512:12345-192.168.202.27@tcp:101:cat.0 Request processed in 91us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.499262:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14636 00000100:00100000:1.0:1746065222.499324:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264023424:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.499340:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065222.499359:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264022656 00000100:00100000:0.0:1746065222.499362:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264022656 00000100:00100000:0.0:1746065222.499379:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264022784 00000100:00100000:0.0:1746065222.499381:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264022784 00000100:00100000:0.0:1746065222.499389:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264022912 00000100:00100000:0.0:1746065222.499390:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264022912 00000100:00100000:2.0:1746065222.499558:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17726 00000100:00100000:2.0:1746065222.499564:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3760:x1830881264022656:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065222.499641:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065222.499644:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065220 -> 1746065220 00002000:00010000:2.0:1746065222.499646:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065215 -> 1746065215 00002000:00010000:2.0:1746065222.499648:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065220 -> 1746065220 00002000:00010000:2.0:1746065222.499650:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065222.499670:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3760:x1830881264022656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 107us (967us total) trans 21474841723 rc 0/0 00000100:00100000:2.0:1746065222.499675:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17726 00000100:00100000:2.0:1746065222.499684:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17727 00000100:00100000:2.0:1746065222.499689:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3761:x1830881264022784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065222.499716:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065222.499718:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065220 -> 1746065220 00002000:00010000:2.0:1746065222.499720:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065219 -> 1746065219 00002000:00010000:2.0:1746065222.499722:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065220 -> 1746065220 00002000:00010000:2.0:1746065222.499723:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746065222.499737:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3761:x1830881264022784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (1018us total) trans 21474841724 rc 0/0 00000100:00100000:2.0:1746065222.499741:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17727 00000100:00100000:2.0:1746065222.499748:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17728 00000100:00100000:2.0:1746065222.499752:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+15:3762:x1830881264022912:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065222.499795:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065222.499797:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.499799:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065222.499800:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.499802:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:2.0:1746065222.499816:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+16:3762:x1830881264022912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (861us total) trans 21474841725 rc 0/0 00000100:00100000:2.0:1746065222.499820:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17728 00000100:00100000:1.0:1746065222.500069:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264023936:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.500087:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065222.500097:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264024448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.500109:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065222.500132:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf5880/2, rc 0, transno 21474841725 00000100:00100000:1.0:1746065222.500136:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264022912:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.500143:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746065222.500146:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264023808:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.500160:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065222.500169:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264024320:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.500180:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065222.500195:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065222.500206:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264023040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.500208:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264023424 00000100:00100000:3.0:1746065222.500212:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264023424 00000100:00100000:1.0:1746065222.500221:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065222.500259:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065222.500476:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264023552:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.500491:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.500509:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264023936 00000100:00100000:3.0:1746065222.500512:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264023936 00000100:00100000:2.0:1746065222.500526:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264023680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065222.500543:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264024448 00000100:00100000:2.0:1746065222.500546:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264024448 00000100:00100000:3.0:1746065222.500588:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264023808 00000100:00100000:3.0:1746065222.500591:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264023808 00000100:00100000:0.0:1746065222.500619:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264024320 00000100:00100000:0.0:1746065222.500622:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264024320 00000100:00100000:1.0:1746065222.500692:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264024064:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.500705:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065222.500724:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264022528 00000100:00100000:2.0:1746065222.500747:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264023040 00000100:00100000:2.0:1746065222.500749:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264023040 00000100:00100000:3.0:1746065222.500751:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264023168 00000100:00100000:3.0:1746065222.500755:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264023168 00000100:00100000:2.0:1746065222.500756:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264023552 00000100:00100000:2.0:1746065222.500757:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264023552 00000100:00100000:2.0:1746065222.500763:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264024064 00000100:00100000:2.0:1746065222.500764:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264024064 00000100:00100000:3.0:1746065222.500767:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17729 00000100:00100000:2.0:1746065222.500785:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17730 00000100:00100000:3.0:1746065222.500786:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3762:x1830881264023424:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065222.500789:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881264023936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065222.500855:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+11:3762:x1830881264023936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (767us total) trans 17179874342 rc 0/0 00000100:00100000:2.0:1746065222.500860:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17730 00000100:00100000:2.0:1746065222.500868:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17731 00000100:00100000:3.0:1746065222.500871:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3762:x1830881264023424:12345-0@lo:2:osp-syn-0-0.0 Request processed in 99us (1529us total) trans 21474841726 rc 0/0 00000100:00100000:1.0:1746065222.501089:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264022528 00000100:00100000:3.0:1746065222.501373:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17729 00000100:00100000:2.0:1746065222.501374:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881264024448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.501386:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17732 00000100:00100000:3.0:1746065222.501392:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881264023808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065222.501410:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:2.0:1746065222.501412:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.501414:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065222.501416:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.501417:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00002000:00010000:3.0:1746065222.501434:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00000100:00100000:2.0:1746065222.501436:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881264024448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1325us total) trans 17179874343 rc 0/0 00002000:00010000:3.0:1746065222.501437:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065221 -> 1746065221 00002000:00010000:3.0:1746065222.501439:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065220 -> 1746065220 00002000:00010000:3.0:1746065222.501441:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065221 -> 1746065221 00000100:00100000:2.0:1746065222.501441:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17731 00002000:00010000:3.0:1746065222.501442:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00000100:00100000:2.0:1746065222.501451:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17733 00000100:00100000:2.0:1746065222.501456:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3759:x1830881264023040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.501463:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3762:x1830881264023808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (1301us total) trans 17179874344 rc 0/0 00000100:00100000:3.0:1746065222.501468:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17732 00000100:00100000:3.0:1746065222.501477:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17734 00000100:00100000:3.0:1746065222.501481:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3759:x1830881264023552:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065222.501490:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065222.501492:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.501494:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065222.501496:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.501497:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:2.0:1746065222.501517:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881264023040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (1295us total) trans 21474841727 rc 0/0 00002000:00010000:3.0:1746065222.501521:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:2.0:1746065222.501522:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17733 00002000:00010000:3.0:1746065222.501523:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065221 -> 1746065221 00002000:00010000:3.0:1746065222.501525:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065217 -> 1746065217 00002000:00010000:3.0:1746065222.501526:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065221 -> 1746065221 00002000:00010000:3.0:1746065222.501528:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746065222.501530:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17735 00000100:00100000:2.0:1746065222.501534:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+19:3760:x1830881264023168:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.501547:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3759:x1830881264023552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1054us total) trans 17179874345 rc 0/0 00000100:00100000:3.0:1746065222.501551:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17734 00000100:00100000:3.0:1746065222.501562:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17736 00002000:00010000:2.0:1746065222.501564:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:2.0:1746065222.501566:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:2.0:1746065222.501567:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065222.501569:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:2.0:1746065222.501570:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:3.0:1746065222.501571:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+10:3759:x1830881264024064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065222.501586:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+20:3760:x1830881264023168:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (1327us total) trans 21474841728 rc 0/0 00000100:00100000:2.0:1746065222.501590:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17735 00000100:00100000:2.0:1746065222.501603:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1746065222.501606:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065222.501607:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065222.501609:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065222.501611:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065222.501612:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065222.501615:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264024192:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065222.501630:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.501631:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3759:x1830881264024064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (924us total) trans 17179874346 rc 0/0 00000100:00100000:3.0:1746065222.501636:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17736 00000004:00080000:2.0:1746065222.501644:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf4000/2, rc 0, transno 21474841723 00000100:00100000:3.0:1746065222.501645:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264023680 00000100:00100000:3.0:1746065222.501647:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264023680 00000100:00100000:2.0:1746065222.501648:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264022656:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065222.501654:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4eaa00/2, rc 0, transno 21474841728 00000100:00100000:3.0:1746065222.501655:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264024192 00000100:00100000:3.0:1746065222.501656:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264024192 00000100:00100000:2.0:1746065222.501656:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264023168:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.501662:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17737 00000100:00100000:3.0:1746065222.501665:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3760:x1830881264023680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065222.501669:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17738 00000100:00100000:2.0:1746065222.501673:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+12:3760:x1830881264024192:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065222.501699:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065222.501700:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065221 -> 1746065221 00002000:00010000:3.0:1746065222.501702:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065221 -> 1746065221 00002000:00010000:3.0:1746065222.501703:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065221 -> 1746065221 00002000:00010000:3.0:1746065222.501704:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065222.501717:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3760:x1830881264024192:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (86us total) trans 17179874348 rc 0/0 00000100:00100000:2.0:1746065222.501722:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17738 00000100:00100000:3.0:1746065222.501724:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+14:3760:x1830881264023680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (120us total) trans 17179874347 rc 0/0 00000100:00100000:3.0:1746065222.501729:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17737 00000100:00100000:2.0:1746065222.501736:0:3760:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874340 gen 2 00000004:00080000:2.0:1746065222.501739:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077d180, transno 17179874304 00000004:00080000:2.0:1746065222.501743:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaea00, transno 17179874305 00000004:00080000:2.0:1746065222.501745:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077df80, transno 17179874306 00000100:00100000:3.0:1746065222.501746:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065222.501747:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edae680, transno 17179874307 00000004:00080000:2.0:1746065222.501749:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edaca80, transno 17179874308 00000004:00080000:2.0:1746065222.501751:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edad500, transno 17179874309 00000004:00080000:2.0:1746065222.501753:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077c000, transno 17179874310 00000004:00080000:2.0:1746065222.501755:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012edac000, transno 17179874311 00000004:00080000:2.0:1746065222.501757:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd8700, transno 17179874312 00000004:00080000:2.0:1746065222.501759:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0000, transno 17179874313 00000004:00080000:2.0:1746065222.501761:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0e00, transno 17179874314 00000004:00080000:2.0:1746065222.501762:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f2d80, transno 17179874315 00000004:00080000:2.0:1746065222.501764:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3b80, transno 17179874316 00000004:00080000:2.0:1746065222.501766:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1880, transno 17179874317 00000004:00080000:2.0:1746065222.501767:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1500, transno 17179874318 00000004:00080000:3.0:1746065222.501768:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf6d80/2, rc 0, transno 21474841724 00000004:00080000:2.0:1746065222.501769:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3100, transno 17179874319 00000004:00080000:2.0:1746065222.501771:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1f80, transno 17179874320 00000004:00080000:2.0:1746065222.501785:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0a80, transno 17179874321 00000004:00080000:2.0:1746065222.501787:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3ea00, transno 17179874332 00000004:00080000:2.0:1746065222.501789:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3e680, transno 17179874333 00000004:00080000:2.0:1746065222.501790:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3d180, transno 17179874334 00000100:00100000:3.0:1746065222.501791:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264022784:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065222.501792:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3d880, transno 17179874335 00000004:00080000:2.0:1746065222.501794:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3f480, transno 17179874336 00000004:00080000:2.0:1746065222.501795:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3df80, transno 17179874337 00000004:00080000:2.0:1746065222.501797:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3c000, transno 17179874338 00000004:00080000:2.0:1746065222.501799:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3dc00, transno 17179874339 00000100:00100000:3.0:1746065222.501800:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264023296 00000004:00080000:2.0:1746065222.501801:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834df80, transno 17179874340 00000100:00100000:3.0:1746065222.501803:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264023296 00000100:00100000:2.0:1746065222.501806:0:3760:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff88009834d180 x1830881264023680/t17179874347(17179874347) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065238 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746065222.501813:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834d180/2, rc 0, transno 17179874347 00000100:00100000:3.0:1746065222.501816:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17739 00000100:00100000:2.0:1746065222.501816:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264023680:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.501819:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+20:3761:x1830881264023296:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065222.501822:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834ca80/2, rc 0, transno 17179874348 00000100:00100000:2.0:1746065222.501825:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264024192:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.501873:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+21:3761:x1830881264023296:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (126us total) trans 21474841729 rc 0/0 00000100:00100000:3.0:1746065222.501878:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17739 00000004:00080000:3.0:1746065222.501895:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4e8700/2, rc 0, transno 21474841729 00000100:00100000:3.0:1746065222.501898:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264023296:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065222.501932:0:8154:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 6 in flight, 27 done 00000100:00100000:3.0:1746065222.502223:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1746065222.502232:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264024576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.502253:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065222.502408:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264024576 00000100:00100000:0.0:1746065222.502411:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264024576 00000100:00100000:0.0:1746065222.502422:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17740 00000100:00100000:0.0:1746065222.502426:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881264024320:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.502459:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17741 00000100:00100000:3.0:1746065222.502464:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3760:x1830881264024576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065222.502464:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065222.502467:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065222.502469:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065222.502470:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065222.502472:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:0.0:1746065222.502489:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881264024320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (2308us total) trans 17179874349 rc 0/0 00000100:00100000:0.0:1746065222.502494:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17740 00000100:00100000:3.0:1746065222.502524:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+14:3760:x1830881264024576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (269us total) trans 17179874350 rc 0/0 00000100:00100000:3.0:1746065222.502529:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17741 00000004:00080000:3.0:1746065222.502550:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091bc0700/2, rc 0, transno 17179874350 00000100:00100000:3.0:1746065222.502553:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264024576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.502632:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.502647:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265488640 00000100:00100000:3.0:1746065222.502650:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265488640 00000100:00100000:1.0:1746065222.502667:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17742 00000100:00100000:1.0:1746065222.502672:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881264022528:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.502674:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17743 00000100:00100000:3.0:1746065222.502678:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2614:x1830881265488640:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065222.502687:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.502696:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d08 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065222.502707:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065222.502709:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065221 -> 1746065221 00002000:00010000:1.0:1746065222.502711:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065219 -> 1746065219 00002000:00010000:1.0:1746065222.502713:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065221 -> 1746065221 00002000:00010000:1.0:1746065222.502714:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00010000:00010000:3.0:1746065222.502715:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147a16f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c60 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.502726:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc147a272 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cde expref: 22 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065222.502730:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881264022528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (2534us total) trans 21474841730 rc 0/0 00010000:00010000:3.0:1746065222.502732:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 7 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065222.502735:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17742 00010000:00010000:3.0:1746065222.502737:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.502739:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.502742:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1748992->2097151] (req 1748992->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.502760:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 7 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.502789:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 7 pid: 12258 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.502798:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264024704:192.168.202.27@tcp:104: 00000004:00080000:1.0:1746065222.502841:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834c700/2, rc 0, transno 17179874345 00000100:00100000:1.0:1746065222.502844:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264023552:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065222.502847:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc147a272 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cde expref: 22 pid: 12260 timeout: 0 lvb_type: 1 00000004:00080000:1.0:1746065222.502850:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834c380/2, rc 0, transno 17179874346 00000100:00100000:1.0:1746065222.502852:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264024064:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065222.502854:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc147a272 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cde expref: 22 pid: 12260 timeout: 918 lvb_type: 1 00000004:00080000:1.0:1746065222.502859:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf4700/2, rc 0, transno 21474841730 00000100:00100000:3.0:1746065222.502861:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264024832:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.502861:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264022528:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065222.502867:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009adf5f80/2, rc 0, transno 21474841727 00000100:00100000:1.0:1746065222.502869:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264023040:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065222.502880:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834e680/2, rc 0, transno 17179874344 00000100:00100000:1.0:1746065222.502882:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264023808:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065222.502884:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147a16f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c60 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00000004:00080000:1.0:1746065222.502887:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834dc00/2, rc 0, transno 17179874349 00000100:00100000:1.0:1746065222.502890:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264024320:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065222.502891:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147a16f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c60 expref: 11 pid: 12260 timeout: 918 lvb_type: 1 00000004:00080000:1.0:1746065222.502895:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834d880/2, rc 0, transno 17179874342 00000100:00100000:1.0:1746065222.502897:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264023936:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.502898:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264024960:192.168.202.27@tcp:104: 00000004:00080000:1.0:1746065222.502902:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013615ed80/2, rc 0, transno 17179874343 00000100:00100000:1.0:1746065222.502904:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264024448:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065222.502910:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4ead80/2, rc 0, transno 21474841726 00000100:00100000:3.0:1746065222.502912:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065222.502912:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264023424:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065222.504466:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.504480:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.504499:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.504513:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265488768 00000100:00100000:0.0:1746065222.504517:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265488768 00010000:00010000:0.0:1746065222.504535:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc147a272 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cde expref: 23 pid: 12260 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746065222.504550:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265488896 00000100:00100000:0.0:1746065222.504551:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265488896 00010000:00010000:0.0:1746065222.504558:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147a16f lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c60 expref: 12 pid: 12260 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746065222.504568:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265489024 00000100:00100000:0.0:1746065222.504570:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265489024 00000100:00100000:0.0:1746065222.504583:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8298 00000100:00100000:3.0:1746065222.504584:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264024704:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065222.504588:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881265488768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065222.504596:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264024832:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065222.504596:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065222.504602:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264024960:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065222.504609:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc147a272 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cde expref: 23 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.504622:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc147a272 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cde expref: 23 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.504709:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [1748992->2097151] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 23 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.504721:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3800, rc 0) 00010000:00010000:0.0:1746065222.504742:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3a00/0xad6b7ddc147a272 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cde expref: 23 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.504753:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065222.504801:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8299 00000100:00100000:3.0:1746065222.504803:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c459880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+22:2614:x1830881265488640:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2123us (2170us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.504807:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265488896:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065222.504810:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17743 00010000:00010000:1.0:1746065222.504813:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.504820:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147a16f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c60 expref: 12 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.504827:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147a16f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c60 expref: 12 pid: 12260 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.504832:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 879 00010000:00010000:1.0:1746065222.504837:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd200/0xad6b7ddc147a16f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c60 expref: 12 pid: 12260 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.504838:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265489024:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065222.504847:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.504866:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.504908:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265488768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 319us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.504913:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8298 00000100:00100000:1.0:1746065222.505000:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265488896:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 192us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.505005:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8299 00010000:00010000:3.0:1746065222.505014:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b2800/0xad6b7ddc147a29c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d01 expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.505309:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.505313:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065222.505343:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881265489024:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 505us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.505349:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 879 00000100:00100000:0.0:1746065222.505881:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.505906:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.506020:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265489152 00000100:00100000:3.0:1746065222.506024:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265489152 00000100:00100000:0.0:1746065222.506246:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.506343:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17744 00000100:00100000:3.0:1746065222.506349:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265489152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.506359:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.506367:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc147a2aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d0f expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.506380:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.506386:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc147a2aa lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d0f expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.506394:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf800/0xad6b7ddc147a2aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d0f expref: 22 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.506402:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf800, rc 0) 00000100:00100000:3.0:1746065222.506424:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265489152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 75us (543us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065222.506429:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17744 00000100:00100000:0.0:1746065222.507199:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.507689:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.507907:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265489408 00000100:00100000:2.0:1746065222.507912:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265489408 00002000:00100000:2.0:1746065222.507940:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012b4e9500 x1830881265489408/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.507948:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e9500 with x1830881265489408 ext(0->1048575) 00002000:00010000:2.0:1746065222.507953:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4e9500 00000100:00100000:2.0:1746065222.507968:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265489664 00000100:00100000:2.0:1746065222.507969:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265489664 00002000:00100000:2.0:1746065222.507980:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88012b4e8e00 x1830881265489664/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.507987:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e8e00 with x1830881265489664 ext(1048576->2097151) 00002000:00010000:2.0:1746065222.507989:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4e8e00 00000100:00100000:2.0:1746065222.507996:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265490048 00000100:00100000:2.0:1746065222.507998:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265490048 00002000:00100000:2.0:1746065222.508004:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012b4ebb80 x1830881265490048/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.508010:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4ebb80 with x1830881265490048 ext(1048576->2097151) 00010000:00010000:2.0:1746065222.508015:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 9 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:2.0:1746065222.508027:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 9 pid: 12258 timeout: 918 lvb_type: 1 00002000:00010000:2.0:1746065222.508033:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b4ebb80 00000100:00100000:2.0:1746065222.508041:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2095 00000100:00100000:2.0:1746065222.508047:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265490048:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065222.508687:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6358 00000100:00100000:2.0:1746065222.508692:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265489408:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065222.509129:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6359 00000100:00100000:1.0:1746065222.509138:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265489664:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065222.510265:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265490176 00000100:00100000:1.0:1746065222.510273:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265490176 00002000:00100000:1.0:1746065222.510308:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012b4eb100 x1830881265490176/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.510317:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4eb100 with x1830881265490176 ext(1048576->2097151) 00002000:00010000:1.0:1746065222.510321:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4eb100 00000100:00100000:1.0:1746065222.510338:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6360 00000100:00100000:1.0:1746065222.510344:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265490176:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065222.519132:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265490048:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11079us (11929us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065222.519132:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.519142:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2095 00002000:00100000:2.0:1746065222.519156:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012b4ebb80 x1830881265490048/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.519165:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4ebb80 with x1830881265490048 ext(1048576->2097151) 00010000:00010000:2.0:1746065222.519174:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 10 pid: 12258 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.519861:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265490432 00000100:00100000:3.0:1746065222.519869:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265490432 00002000:00100000:3.0:1746065222.519899:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012b4e9880 x1830881265490432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.519908:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e9880 with x1830881265490432 ext(0->1048575) 00002000:00010000:3.0:1746065222.519917:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4e9880 00000100:00100000:3.0:1746065222.519944:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6361 00000100:00100000:3.0:1746065222.519950:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265490432:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065222.520543:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 10 pid: 12258 timeout: 918 lvb_type: 1 00002000:00010000:2.0:1746065222.520550:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b4ebb80 00000100:00100000:2.0:1746065222.522514:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.522594:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265490688 00000100:00100000:0.0:1746065222.522601:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265490688 00002000:00100000:0.0:1746065222.522633:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880091bc2300 x1830881265490688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065222.522643:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc2300 with x1830881265490688 ext(1048576->2097151) 00002000:00010000:0.0:1746065222.522647:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc2300 00000100:00100000:0.0:1746065222.522675:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6362 00000100:00100000:0.0:1746065222.522681:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265490688:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065222.525930:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.526164:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265490816 00000100:00100000:3.0:1746065222.526171:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265490816 00000100:00100000:3.0:1746065222.526219:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14637 00000100:00100000:3.0:1746065222.526227:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2617:x1830881265490816:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065222.526248:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.526271:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a2b1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d16 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.526341:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a2b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d16 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.526355:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a2b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d16 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.526374:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.526376:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065222.526380:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf600, rc 0) 00000100:00100000:3.0:1746065222.526407:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2617:x1830881265490816:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 181us (483us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.526413:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14637 00000100:00100000:3.0:1746065222.527009:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265489408:12345-192.168.202.27@tcp:3:cat.0 Request processed in 18315us (21100us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065222.527017:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6358 00002000:00100000:3.0:1746065222.527024:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012b4e9500 x1830881265489408/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.527032:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e9500 with x1830881265489408 ext(0->1048575) 00002000:00010000:3.0:1746065222.527036:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4e9500 00000100:00100000:0.0:1746065222.528550:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.528731:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265490944 00000100:00100000:3.0:1746065222.528737:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265490944 00010000:00010000:3.0:1746065222.528760:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 10 pid: 12258 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.528804:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8300 00000100:00100000:3.0:1746065222.528810:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265490944:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065222.528821:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065222.528836:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 10 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.528848:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 10 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.528866:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147a209 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c98 expref: 10 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.528891:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.528894:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.528900:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.528913:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.528939:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 22 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.528950:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881264025088:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065222.529023:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065222.532276:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265489664:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23132us (26022us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065222.532285:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6359 00002000:00100000:1.0:1746065222.532294:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88012b4e8e00 x1830881265489664/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.532310:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e8e00 with x1830881265489664 ext(1048576->2097151) 00002000:00010000:1.0:1746065222.532315:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4e8e00 00000100:00100000:0.0:1746065222.545770:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.545821:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881264025088:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065222.545841:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065222.545882:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2007:x1830881265490944:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 17071us (17334us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.545892:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8300 00000100:00100000:1.0:1746065222.546631:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265490176:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36285us (38940us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065222.546640:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6360 00002000:00100000:1.0:1746065222.546648:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012b4eb100 x1830881265490176/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.546656:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4eb100 with x1830881265490176 ext(1048576->2097151) 00002000:00010000:1.0:1746065222.546660:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4eb100 00000100:00100000:1.0:1746065222.546672:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265491200 00000100:00100000:1.0:1746065222.546677:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265491200 00002000:00100000:1.0:1746065222.546696:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1748992->1753087) req@ffff88012b4e9f80 x1830881265491200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.546702:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e9f80 with x1830881265491200 ext(1748992->1753087) 00002000:00010000:1.0:1746065222.546704:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4e9f80 00000100:00100000:1.0:1746065222.546723:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6363 00000100:00100000:1.0:1746065222.546728:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265491200:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065222.546832:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265491200:12345-192.168.202.27@tcp:3:cat.0 Request processed in 103us (1070us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065222.546837:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6363 00002000:00100000:1.0:1746065222.546842:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1748992->1753087) req@ffff88012b4e9f80 x1830881265491200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/4536 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.546848:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e9f80 with x1830881265491200 ext(1748992->1753087) 00002000:00010000:1.0:1746065222.546850:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012b4e9f80 00000100:00100000:3.0:1746065222.547552:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265490432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27601us (28523us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065222.547558:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6361 00002000:00100000:3.0:1746065222.547563:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012b4e9880 x1830881265490432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.547570:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e9880 with x1830881265490432 ext(0->1048575) 00002000:00010000:3.0:1746065222.547573:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4e9880 00000100:00100000:1.0:1746065222.549633:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265490688:12345-192.168.202.27@tcp:3:cat.0 Request processed in 26945us (27118us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065222.549642:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6362 00002000:00100000:1.0:1746065222.549649:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880091bc2300 x1830881265490688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.549658:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc2300 with x1830881265490688 ext(1048576->2097151) 00002000:00010000:1.0:1746065222.549663:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc2300 00000100:00100000:0.0:1746065222.559019:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.559083:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265491328 00000100:00100000:2.0:1746065222.559091:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265491328 00000100:00100000:0.0:1746065222.559108:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.559466:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17745 00000100:00100000:2.0:1746065222.559474:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+27:2614:x1830881265491328:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:0.0:1746065222.559479:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065222.559490:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065222.559542:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265491584 00000100:00100000:3.0:1746065222.559546:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265491584 00010000:00010000:2.0:1746065222.559555:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d1d expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.559566:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17746 00000100:00100000:3.0:1746065222.559570:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2617:x1830881265491584:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065222.559577:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.559584:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d2b expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.559585:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a161 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c67 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.559593:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 28 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.559598:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147a176 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c6e expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.559600:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a210 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c9f expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.559604:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a280 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cec expref: 28 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.559606:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.559607:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.559611:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc147a21e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ca6 expref: 9 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.559611:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 28 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.559615:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.559616:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.559618:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3682304->4132863] (req 3682304->4132863) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 9 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.559635:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc147a21e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ca6 expref: 9 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.559635:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a210 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c9f expref: 9 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.559645:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc147a21e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ca6 expref: 9 pid: 13375 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.559655:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264025216:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.559686:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a210 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c9f expref: 9 pid: 3068 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.559700:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264025344:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.559913:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265491456 00000100:00100000:3.0:1746065222.559916:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265491456 00000100:00100000:3.0:1746065222.559940:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14638 00000100:00100000:3.0:1746065222.559968:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2618:x1830881265491456:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065222.559995:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 28 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.560004:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 28 pid: 9549 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.560013:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264025472:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.560035:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a161 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c67 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.560042:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a161 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c67 expref: 10 pid: 9550 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.560050:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264025600:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.560063:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00010000:00010000:3.0:1746065222.560114:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.560131:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a2c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d24 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.560171:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a2c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d24 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.560181:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a2c6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d24 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.560193:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.560196:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065222.560199:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf200, rc 0) 00000100:00100000:3.0:1746065222.560223:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2618:x1830881265491456:12345-192.168.202.27@tcp:101:cat.0 Request processed in 278us (1115us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.560229:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14638 00010000:00010000:3.0:1746065222.560255:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a280 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cec expref: 28 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.560263:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a280 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cec expref: 28 pid: 9549 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.560271:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264025728:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.560938:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147a176 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c6e expref: 10 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.560951:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147a176 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c6e expref: 10 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.560963:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264025856:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.560981:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.567648:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.567692:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264025216:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065222.567694:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.567718:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.567721:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264025344:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065222.567736:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.567758:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.567791:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265491712 00000100:00100000:0.0:1746065222.567793:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.567797:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265491712 00000100:00100000:0.0:1746065222.567806:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.567817:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265491840 00000100:00100000:0.0:1746065222.567821:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265491840 00010000:00010000:2.0:1746065222.567825:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc147a21e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ca6 expref: 10 pid: 13375 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.567835:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a210 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c9f expref: 11 pid: 3068 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.567848:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265492608 00000100:00100000:0.0:1746065222.567849:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265492864 00000100:00100000:2.0:1746065222.567850:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265492608 00000100:00100000:0.0:1746065222.567851:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265492864 00000100:00100000:0.0:1746065222.567863:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8301 00000100:00100000:0.0:1746065222.567868:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265491712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065222.567878:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264025472:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065222.567878:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1746065222.567886:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264025600:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065222.567896:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc147a21e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ca6 expref: 11 pid: 13375 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.567905:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc147a21e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ca6 expref: 11 pid: 13375 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.567914:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->1155071] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 28 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.567921:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c7ad400/0xad6b7ddc147a21e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ca6 expref: 11 pid: 13375 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.567926:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c285e00, rc 0) 00010000:00010000:0.0:1746065222.567934:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.567965:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265491712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.567970:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8301 00000100:00100000:0.0:1746065222.567982:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8302 00000100:00100000:0.0:1746065222.567985:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265491840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.567991:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.567996:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a210 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c9f expref: 9 pid: 3068 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.568003:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a210 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c9f expref: 9 pid: 3068 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.568012:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a210 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c9f expref: 9 pid: 3068 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.568019:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.568028:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265491840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 42us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.568031:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 880 00000100:00100000:0.0:1746065222.568039:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8302 00000100:00100000:1.0:1746065222.568040:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265492864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.568049:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.568062:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a2c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d24 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.568064:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065222.568075:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065222.568079:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.568080:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265492736 00000100:00100000:0.0:1746065222.568082:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265492736 00010000:00010000:0.0:1746065222.568090:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a280 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cec expref: 29 pid: 9549 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.568096:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265492864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.568102:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 880 00000100:00100000:0.0:1746065222.568109:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8303 00000100:00100000:0.0:1746065222.568113:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265492736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.568118:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065222.568121:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265492096 00000100:00100000:1.0:1746065222.568124:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265492096 00010000:00010000:0.0:1746065222.568130:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a280 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cec expref: 29 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.568137:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a280 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cec expref: 29 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:2.0:1746065222.568144:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a161 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c67 expref: 11 pid: 9550 timeout: 918 lvb_type: 1 00002000:00100000:1.0:1746065222.568146:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1748991) req@ffff88012f09d880 x1830881265492096/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:0.0:1746065222.568148:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:1.0:1746065222.568156:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d880 with x1830881265492096 ext(1048576->1748991) 00002000:00010000:1.0:1746065222.568160:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09d880 00000100:00100000:1.0:1746065222.568168:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265492480 00000100:00100000:1.0:1746065222.568170:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265492480 00000100:00100000:3.0:1746065222.568172:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2614:x1830881265491328:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8698us (9161us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.568178:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17745 00002000:00100000:1.0:1746065222.568179:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012f09df80 x1830881265492480/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.568185:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09df80 with x1830881265492480 ext(1048576->2097151) 00010000:00010000:1.0:1746065222.568190:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 29 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.568200:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 29 pid: 9549 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.568202:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6364 00002000:00010000:1.0:1746065222.568205:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09df80 00000100:00100000:3.0:1746065222.568208:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265492096:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065222.568214:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2096 00000100:00100000:1.0:1746065222.568218:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265492480:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065222.568244:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265492736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 129us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.568249:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8303 00000100:00100000:0.0:1746065222.568257:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8304 00000100:00100000:0.0:1746065222.568261:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265492608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.568266:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.568271:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a161 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c67 expref: 11 pid: 9550 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.568278:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a161 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c67 expref: 11 pid: 9550 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.568287:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3200/0xad6b7ddc147a161 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c67 expref: 11 pid: 9550 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.568308:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.568320:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800ac526050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265492608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.568324:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8304 00010000:00010000:2.0:1746065222.568664:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a280 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cec expref: 29 pid: 9549 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.568680:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264025728:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.568694:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264025856:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.568713:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3682304->4132863] (req 3682304->4132863) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 7 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.568721:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be200, rc 0) 00000100:00100000:2.0:1746065222.568744:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2617:x1830881265491584:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9173us (9264us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.568749:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17746 00000100:00100000:2.0:1746065222.568802:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265492224 00000100:00100000:2.0:1746065222.568806:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265492224 00000100:00100000:2.0:1746065222.568828:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14639 00000100:00100000:2.0:1746065222.568833:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+6:2620:x1830881265492224:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065222.568846:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.568856:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a600/0xad6b7ddc147a2cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d32 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.568899:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc147a2d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.568909:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc147a2d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.568920:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc147a2d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.568930:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a2db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.568935:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a2db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.568940:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a2db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.568996:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.569004:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.569010:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065222.569041:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:2.0:1746065222.569045:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065222.569058:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.569066:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.569073:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc147a2d4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.569078:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc147a2d4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.569086:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc147a2d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.569091:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc147a2d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.569096:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1bc00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065222.569098:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc147a2d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.570040:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc147a2d4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.570052:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065222.570056:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065222.570058:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc147a2d4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.570062:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1bc00/0xad6b7ddc147a2d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.570071:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a2db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.570075:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a2db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.570079:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a2db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.570082:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065222.570085:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a2db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.570092:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a2db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.570096:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ef2a000) 00010000:00010000:2.0:1746065222.570098:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065222.570099:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a2db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.570103:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a2db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.570126:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a600/0xad6b7ddc147a2cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d32 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.570133:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d32 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.570138:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.570140:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065222.570141:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a200, rc 0) 00000100:00100000:2.0:1746065222.570160:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+7:2620:x1830881265492224:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1326us (2423us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.570166:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14639 00000100:00100000:2.0:1746065222.576875:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.576915:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.576939:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265493248 00000100:00100000:2.0:1746065222.576947:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265493248 00002000:00100000:2.0:1746065222.576986:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880091bc1880 x1830881265493248/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.577005:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1880 with x1830881265493248 ext(1048576->2097151) 00002000:00010000:2.0:1746065222.577011:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc1880 00000100:00100000:2.0:1746065222.577028:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6365 00000100:00100000:2.0:1746065222.577034:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2006:x1830881265493248:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065222.578500:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265492480:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10269us (10729us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065222.578510:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2096 00002000:00100000:2.0:1746065222.578519:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012f09df80 x1830881265492480/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.578529:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09df80 with x1830881265492480 ext(1048576->2097151) 00010000:00010000:2.0:1746065222.578540:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 27 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:2.0:1746065222.578553:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 27 pid: 9549 timeout: 918 lvb_type: 1 00002000:00010000:2.0:1746065222.578561:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012f09df80 00000100:00100000:1.0:1746065222.579269:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265492992 00000100:00100000:1.0:1746065222.579279:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265492992 00010000:00010000:1.0:1746065222.579311:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147a176 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c6e expref: 10 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.579344:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8305 00000100:00100000:1.0:1746065222.579350:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265492992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.579360:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.579377:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147a176 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c6e expref: 10 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.579388:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147a176 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c6e expref: 10 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.579410:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538400/0xad6b7ddc147a176 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c6e expref: 10 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.579426:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.579428:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.579436:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 6 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.579444:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 6 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.579472:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 6 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.579483:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264025984:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065222.579545:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065222.582918:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265492096:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14701us (15189us total) trans 0 rc 700416/700416 00000100:00100000:3.0:1746065222.582929:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6364 00002000:00100000:3.0:1746065222.582941:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1748991) req@ffff88012f09d880 x1830881265492096/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 700416/700416 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.582949:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09d880 with x1830881265492096 ext(1048576->1748991) 00002000:00010000:3.0:1746065222.582955:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f09d880 00000100:00100000:2.0:1746065222.583315:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.583359:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265493376 00000100:00100000:3.0:1746065222.583365:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265493376 00010000:00010000:3.0:1746065222.583387:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 27 pid: 9549 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.583412:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264025984:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065222.583418:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8306 00000100:00100000:3.0:1746065222.583424:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265493376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.583428:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065222.583433:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065222.583448:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 27 pid: 9549 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.583452:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265492992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4102us (6584us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065222.583459:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 27 pid: 9549 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.583459:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8305 00010000:00010000:3.0:1746065222.583477:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552fe00/0xad6b7ddc147a279 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ce5 expref: 27 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.584217:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.584220:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.584226:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.584234:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.584258:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.584267:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264026112:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065222.584333:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.585424:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.585455:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.585479:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.585496:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.585858:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265493760 00000100:00100000:3.0:1746065222.585865:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265493760 00000100:00100000:2.0:1746065222.585899:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2006:x1830881265493248:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8863us (8981us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065222.585904:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265493888 00000100:00100000:3.0:1746065222.585906:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265493888 00000100:00100000:2.0:1746065222.585907:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6365 00002000:00100000:2.0:1746065222.585915:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880091bc1880 x1830881265493248/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00000100:00100000:3.0:1746065222.585918:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265494016 00000100:00100000:3.0:1746065222.585919:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265494016 00002000:00100000:2.0:1746065222.585929:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1880 with x1830881265493248 ext(1048576->2097151) 00000100:00100000:3.0:1746065222.585931:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17747 00002000:00010000:2.0:1746065222.585934:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc1880 00000100:00100000:3.0:1746065222.585937:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265493760:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065222.585947:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265493632 00000100:00100000:2.0:1746065222.585950:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265493632 00010000:00010000:3.0:1746065222.585951:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.585969:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc147a2e9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d39 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065222.585970:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3682304->3686399) req@ffff88009acef100 x1830881265493632/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.585976:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef100 with x1830881265493632 ext(3682304->3686399) 00002000:00010000:2.0:1746065222.585978:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009acef100 00000100:00100000:2.0:1746065222.585990:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6366 00000100:00100000:2.0:1746065222.585995:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2004:x1830881265493632:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065222.586010:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264026240:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065222.586052:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065222.586068:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17748 00000100:00100000:3.0:1746065222.586072:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265493888:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065222.586078:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2004:x1830881265493632:12345-192.168.202.27@tcp:3:cat.0 Request processed in 83us (657us total) trans 0 rc 4096/4096 00010000:00010000:3.0:1746065222.586079:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065222.586084:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6366 00010000:00010000:3.0:1746065222.586086:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a2f0 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d40 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00002000:00100000:2.0:1746065222.586088:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3682304->3686399) req@ffff88009acef100 x1830881265493632/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/4536 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.586094:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acef100 with x1830881265493632 ext(3682304->3686399) 00002000:00010000:2.0:1746065222.586097:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009acef100 00000100:00100000:3.0:1746065222.586109:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264026368:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065222.586115:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17749 00000100:00100000:2.0:1746065222.586121:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265494016:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065222.586125:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00010000:00010000:2.0:1746065222.586126:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.586134:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009580e200/0xad6b7ddc147a2f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d47 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.586166:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264026496:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065222.586187:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065222.587710:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264026112:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065222.587726:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065222.587766:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265493376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4341us (4451us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.587801:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8306 00002000:00010000:3.0:1746065222.590753:0:12258:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065220 -> 1746065222 00002000:00010000:3.0:1746065222.590761:0:12258:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065215 -> 1746065222 00002000:00010000:3.0:1746065222.590763:0:12258:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065220 -> 1746065222 00000100:00100000:3.0:1746065222.590801:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264026240:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065222.590828:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc147a2e9 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d39 expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.590839:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099524200/0xad6b7ddc147a2e9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d39 expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.590848:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524200, rc 0) 00000100:00100000:3.0:1746065222.590896:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265493760:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4959us (5439us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065222.590904:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17747 00002000:00010000:3.0:1746065222.590943:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime: 1746065221 -> 1746065222 00002000:00010000:3.0:1746065222.590946:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065221 -> 1746065222 00002000:00010000:3.0:1746065222.590947:0:3068:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime: 1746065221 -> 1746065222 00000100:00100000:3.0:1746065222.590958:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264026368:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065222.590974:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a2f0 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d40 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.590981:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552fa00/0xad6b7ddc147a2f0 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d40 expref: 12 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.590989:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552fa00, rc 0) 00000100:00100000:3.0:1746065222.591006:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265493888:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4933us (5525us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065222.591011:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17748 00000100:00100000:0.0:1746065222.591147:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.591246:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.591338:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265494272 00000100:00100000:3.0:1746065222.591343:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265494272 00000100:00100000:3.0:1746065222.591354:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265494400 00000100:00100000:3.0:1746065222.591355:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265494400 00000100:00100000:3.0:1746065222.591387:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17750 00000100:00100000:3.0:1746065222.591393:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2618:x1830881265494400:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.591404:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.591413:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d4e expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.591435:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.591441:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065222.591442:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065222.591445:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065222.591805:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746065221 -> 1746065222 00010000:00010000:3.0:1746065222.591806:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 20 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065222.591809:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065220 -> 1746065222 00002000:00010000:2.0:1746065222.591811:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746065221 -> 1746065222 00010000:00010000:3.0:1746065222.591817:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 20 pid: 9550 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.591821:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264026496:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065222.591827:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264026624:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.591837:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009580e200/0xad6b7ddc147a2f7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d47 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.591847:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009580e200/0xad6b7ddc147a2f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d47 expref: 10 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.591859:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e200, rc 0) 00000100:00100000:3.0:1746065222.591884:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00002000:00100000:3.0:1746065222.591911:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x77:0x0] (1150976->1155071) req@ffff88012b4ea300 x1830881265494272/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.591919:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4ea300 with x1830881265494272 ext(1150976->1155071) 00002000:00010000:3.0:1746065222.591924:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4ea300 00000100:00100000:3.0:1746065222.591946:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6367 00000100:00100000:3.0:1746065222.591951:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265494272:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065222.592042:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265494272:12345-192.168.202.27@tcp:3:cat.0 Request processed in 90us (895us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065222.592047:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6367 00002000:00100000:3.0:1746065222.592052:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x77:0x0] (1150976->1155071) req@ffff88012b4ea300 x1830881265494272/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/4536 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.592059:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4ea300 with x1830881265494272 ext(1150976->1155071) 00002000:00010000:3.0:1746065222.592061:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4ea300 00000100:00100000:2.0:1746065222.593417:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265494016:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7291us (7914us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065222.593424:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17749 00000100:00100000:0.0:1746065222.596030:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.596355:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265494656 00000100:00100000:3.0:1746065222.596363:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265494656 00002000:00100000:3.0:1746065222.596394:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4128768->4132863) req@ffff88012b4eb480 x1830881265494656/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:2.0:1746065222.596412:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264026624:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.596436:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.596449:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009552f600, rc 0) 00000100:00100000:2.0:1746065222.596495:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2618:x1830881265494400:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5102us (5249us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.596503:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17750 00002000:00100000:3.0:1746065222.596556:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4eb480 with x1830881265494656 ext(4128768->4132863) 00002000:00010000:3.0:1746065222.596560:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4eb480 00000100:00100000:3.0:1746065222.596576:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6368 00000100:00100000:3.0:1746065222.596587:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2005:x1830881265494656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065222.596690:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4eb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2005:x1830881265494656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 107us (664us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065222.596695:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6368 00002000:00100000:3.0:1746065222.596701:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4128768->4132863) req@ffff88012b4eb480 x1830881265494656/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/4536 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.596707:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4eb480 with x1830881265494656 ext(4128768->4132863) 00002000:00010000:3.0:1746065222.596710:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012b4eb480 00000100:00100000:0.0:1746065222.596829:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.596952:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265494784 00000100:00100000:3.0:1746065222.596955:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265494784 00002000:00100000:3.0:1746065222.596969:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1748992->2097151) req@ffff88012b4e8380 x1830881265494784/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.596976:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e8380 with x1830881265494784 ext(1748992->2097151) 00010000:00010000:3.0:1746065222.596981:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 21 pid: 9550 timeout: 918 lvb_type: 0 00010000:00010000:3.0:1746065222.596991:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 21 pid: 9550 timeout: 918 lvb_type: 0 00002000:00010000:3.0:1746065222.597000:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b4e8380 00000100:00100000:3.0:1746065222.597060:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2097 00000100:00100000:3.0:1746065222.597539:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265494784:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065222.597901:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.597918:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265495040 00000100:00100000:2.0:1746065222.597921:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265495040 00000100:00100000:2.0:1746065222.598056:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14640 00000100:00100000:2.0:1746065222.598062:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+7:2620:x1830881265495040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065222.598075:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.598089:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f800/0xad6b7ddc147a305 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d55 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.598192:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.598204:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d32 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.598210:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.598234:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d32 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.598242:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d32 expref: 8 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.598252:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264026752:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.598321:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.605850:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.605902:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.605984:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091bc0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264026752:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.606003:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065222.606037:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265495424 00000100:00100000:2.0:1746065222.606041:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265495424 00010000:00010000:2.0:1746065222.606064:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d32 expref: 9 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.606085:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8307 00000100:00100000:2.0:1746065222.606090:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2006:x1830881265495424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065222.606100:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065222.606104:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d32 expref: 9 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.606113:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d32 expref: 9 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.606130:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a2e2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d32 expref: 9 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.606150:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.606154:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.606162:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.606168:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.606180:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065222.606208:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2006:x1830881265495424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 118us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.606214:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8307 00010000:00010000:2.0:1746065222.606228:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.606234:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065222.606246:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065222.606353:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f800/0xad6b7ddc147a305 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d55 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.606363:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d55 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.606368:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.606370:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065222.606372:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fa00, rc 0) 00000100:00100000:2.0:1746065222.606393:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2620:x1830881265495040:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8331us (8492us total) trans 8589937167 rc 0/0 00000100:00100000:2.0:1746065222.606398:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14640 00000100:00100000:3.0:1746065222.606567:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265495296 00000100:00100000:3.0:1746065222.606571:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265495296 00002000:00100000:3.0:1746065222.606593:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1155072->2097151) req@ffff88012f09dc00 x1830881265495296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.606602:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09dc00 with x1830881265495296 ext(1155072->2097151) 00002000:00010000:3.0:1746065222.606606:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09dc00 00000100:00100000:3.0:1746065222.606616:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6369 00000100:00100000:3.0:1746065222.606621:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265495296:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065222.607561:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.607578:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265495680 00000100:00100000:2.0:1746065222.607580:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265495680 00000100:00100000:2.0:1746065222.607602:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5506 00000100:00100000:2.0:1746065222.607607:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2614:x1830881265495680:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065222.607730:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2614:x1830881265495680:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 122us (172us total) trans 8589937168 rc 0/0 00000100:00100000:2.0:1746065222.607736:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5506 00000100:00100000:0.0:1746065222.609044:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.609737:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.609804:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265495936 00000100:00100000:3.0:1746065222.609809:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265495936 00000100:00100000:1.0:1746065222.611209:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5507 00000100:00100000:1.0:1746065222.611218:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2617:x1830881265495936:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065222.611296:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881265494784:12345-192.168.202.27@tcp:4:cat.0 Request processed in 14229us (14466us total) trans 21474841731 rc 0/0 00000100:00100000:3.0:1746065222.611311:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2097 00002000:00100000:3.0:1746065222.611320:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1748992->2097151) req@ffff88012b4e8380 x1830881265494784/t21474841731(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/448 e 0 to 0 dl 1746065233 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.611328:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012b4e8380 with x1830881265494784 ext(1748992->2097151) 00010000:00010000:3.0:1746065222.611335:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 23 pid: 9550 timeout: 918 lvb_type: 0 00010000:00010000:3.0:1746065222.611347:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 23 pid: 9550 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.611348:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2617:x1830881265495936:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 133us (2307us total) trans 8589937169 rc 0/0 00000100:00100000:1.0:1746065222.611353:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5507 00002000:00010000:3.0:1746065222.611354:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88012b4e8380 00000100:00100000:2.0:1746065222.611536:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265496064 00000100:00100000:2.0:1746065222.611540:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265496064 00000100:00100000:2.0:1746065222.611740:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14641 00000100:00100000:2.0:1746065222.611747:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2620:x1830881265496064:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065222.611757:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.611769:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc147a31a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d5c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.611838:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc147a321 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.611850:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d55 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.611856:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc147a321 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.611877:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d55 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.611885:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d55 expref: 9 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.611896:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264026880:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.611944:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065222.614855:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264026880:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.614875:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc147a321 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065222.616063:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.616705:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265496192 00000100:00100000:2.0:1746065222.616711:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265496192 00010000:00010000:2.0:1746065222.616733:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d55 expref: 10 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.616754:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8308 00000100:00100000:2.0:1746065222.616760:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265496192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065222.616770:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065222.616791:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d55 expref: 10 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.616799:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d55 expref: 10 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.616817:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147a30c lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d55 expref: 10 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.616827:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.616831:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc147a321 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.616840:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc147a321 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.616845:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc147a321 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.616868:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065222.616902:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc147a321 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065222.616907:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265496192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 147us (847us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065222.616909:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc147a321 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065222.616913:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8308 00000004:00200000:3.0:1746065222.616952:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065222.616956:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065222.616970:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc147a321 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065222.616995:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580f600/0xad6b7ddc147a31a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d5c expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.617018:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc147a321 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d5c expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.617024:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.617026:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065222.617029:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580e600, rc 0) 00000100:00100000:3.0:1746065222.617061:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2620:x1830881265496064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5314us (7323us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.617067:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14641 00000100:00100000:0.0:1746065222.617446:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.617539:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265496320 00000100:00100000:1.0:1746065222.617543:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265496320 00010000:00010000:1.0:1746065222.617556:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 23 pid: 9550 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.617572:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8309 00000100:00100000:3.0:1746065222.617575:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265495296:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10954us (11731us total) trans 0 rc 942080/942080 00000100:00100000:1.0:1746065222.617577:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265496320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1746065222.617582:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6369 00010000:00010000:1.0:1746065222.617584:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:3.0:1746065222.617588:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1155072->2097151) req@ffff88012f09dc00 x1830881265495296/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 942080/942080 job:'cat.0' uid:0 gid:0 00010000:00010000:1.0:1746065222.617595:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 23 pid: 9550 timeout: 918 lvb_type: 0 00002000:00100000:3.0:1746065222.617596:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f09dc00 with x1830881265495296 ext(1155072->2097151) 00002000:00010000:3.0:1746065222.617599:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f09dc00 00010000:00010000:1.0:1746065222.617603:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 23 pid: 9550 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.617615:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a2a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1748992->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d08 expref: 23 pid: 9550 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.617624:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.617625:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.617630:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.617640:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.617659:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.617667:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881264027008:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065222.617720:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012b30d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065222.621592:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881264027008:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065222.621612:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065222.621649:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881265496320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4071us (4203us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.621659:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8309 00000100:00100000:0.0:1746065222.622269:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.622293:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.622367:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265496448 00000100:00100000:3.0:1746065222.622373:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265496448 00000100:00100000:0.0:1746065222.622392:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.622437:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265496704 00000100:00100000:3.0:1746065222.622439:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265496704 00000100:00100000:0.0:1746065222.622446:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265496576 00000100:00100000:0.0:1746065222.622450:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265496576 00000100:00100000:3.0:1746065222.622462:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17751 00000100:00100000:3.0:1746065222.622468:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265496448:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065222.622481:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.622494:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc147a328 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d63 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.622510:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.622512:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065222.622516:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17752 00010000:00010000:3.0:1746065222.622519:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc147a328 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d63 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065222.622522:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265496704:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065222.622530:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.622533:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc147a328 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d63 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065222.622538:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bfe00/0xad6b7ddc147a32f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d71 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.622541:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524800, rc 0) 00000100:00100000:3.0:1746065222.622563:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265496448:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 96us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.622568:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17751 00000100:00100000:0.0:1746065222.622568:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264027136:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065222.622581:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17753 00000100:00100000:3.0:1746065222.622586:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265496576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065222.622592:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.622598:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a336 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d6a expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.622606:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065222.622618:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264027264:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065222.622638:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.623109:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.623241:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265496960 00000100:00100000:3.0:1746065222.623245:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265496960 00002000:00100000:3.0:1746065222.623267:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009aecb480 x1830881265496960/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.623275:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb480 with x1830881265496960 ext(1048576->2097151) 00002000:00010000:3.0:1746065222.623279:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aecb480 00000100:00100000:3.0:1746065222.623450:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6370 00000100:00100000:3.0:1746065222.623456:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265496960:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065222.627249:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264027264:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065222.627281:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a336 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d6a expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.627296:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a336 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d6a expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.627327:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524000, rc 0) 00000100:00100000:3.0:1746065222.627369:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265496576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4782us (4976us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065222.627377:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17753 00000100:00100000:1.0:1746065222.627843:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264027136:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065222.627859:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bfe00/0xad6b7ddc147a32f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d71 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.627867:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bfe00/0xad6b7ddc147a32f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d71 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.627874:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfe00, rc 0) 00000100:00100000:1.0:1746065222.628881:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265496704:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6354us (6583us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065222.628888:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17752 00000100:00100000:0.0:1746065222.629242:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.629820:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265497088 00000100:00100000:1.0:1746065222.629826:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265497088 00000100:00100000:1.0:1746065222.629868:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17754 00000100:00100000:1.0:1746065222.629874:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+26:2619:x1830881265497088:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.629887:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.629900:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d78 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.629927:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 6 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.629934:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065222.629936:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065222.629939:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.629963:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 6 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.629974:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 6 pid: 9550 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.630327:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264027392:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.631491:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065222.634907:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265496960:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11443us (11790us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065222.634916:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6370 00002000:00100000:3.0:1746065222.634925:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009aecb480 x1830881265496960/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.634933:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aecb480 with x1830881265496960 ext(1048576->2097151) 00002000:00010000:3.0:1746065222.634939:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aecb480 00000100:00100000:0.0:1746065222.636317:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.636423:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265497344 00000100:00100000:3.0:1746065222.636431:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265497344 00000100:00100000:3.0:1746065222.636467:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14642 00000100:00100000:3.0:1746065222.636485:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2620:x1830881265497344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065222.636500:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.636516:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc147a344 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d7f expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.636608:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a34b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065222.636622:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a34b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065222.636632:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a34b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065222.636641:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065222.636717:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c284a00/0xad6b7ddc147a344 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d7f expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.636733:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a34b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d7f expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.636746:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.636749:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065222.636752:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800985b3800, rc 0) 00000100:00100000:3.0:1746065222.636811:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2620:x1830881265497344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 337us (497us total) trans 8589937170 rc 0/0 00000100:00100000:3.0:1746065222.636817:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14642 00000100:00100000:1.0:1746065222.637320:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264027392:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065222.637340:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.637358:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd2800, rc 0) 00000100:00100000:1.0:1746065222.637376:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+27:2619:x1830881265497088:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7502us (8135us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.637382:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17754 00000100:00100000:0.0:1746065222.639286:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.639328:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.639350:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.639380:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265497472 00000100:00100000:3.0:1746065222.639387:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265497472 00002000:00100000:3.0:1746065222.639419:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3682304->4132863) req@ffff88009aeca680 x1830881265497472/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.639428:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeca680 with x1830881265497472 ext(3682304->4132863) 00010000:00010000:3.0:1746065222.639435:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 7 pid: 9550 timeout: 918 lvb_type: 0 00010000:00010000:3.0:1746065222.639447:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 7 pid: 9550 timeout: 918 lvb_type: 0 00002000:00010000:3.0:1746065222.639453:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aeca680 00000100:00100000:3.0:1746065222.639471:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2098 00000100:00100000:3.0:1746065222.639477:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2005:x1830881265497472:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065222.640281:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.640294:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265497600 00000100:00100000:1.0:1746065222.640306:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265497600 00000100:00100000:1.0:1746065222.640331:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265497728 00000100:00100000:1.0:1746065222.640333:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265497728 00000100:00100000:1.0:1746065222.640345:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17755 00000100:00100000:1.0:1746065222.640350:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265497600:12345-192.168.202.27@tcp:1:lfs.0 00000100:00100000:3.0:1746065222.640354:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17756 00000100:00100000:3.0:1746065222.640361:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265497728:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065222.640371:0:12258:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.640380:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.640385:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc147a153 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c52 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.640392:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc147a264 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd0 expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.640394:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147a15a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c59 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.640399:0:12258:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc147a1fb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c8a expref: 8 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.640404:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.640406:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.640408:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.640412:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc147a26b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd7 expref: 21 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.640419:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a202 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c91 expref: 7 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.640424:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.640425:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.640427:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.640435:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc147a1fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c8a expref: 8 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.640443:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a202 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c91 expref: 7 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.640444:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc147a1fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c8a expref: 8 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.640451:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a202 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c91 expref: 7 pid: 3068 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.640456:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264027520:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.640460:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264027648:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065222.640505:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc147a264 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd0 expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.640512:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc147a264 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd0 expref: 26 pid: 12260 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.640519:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264027776:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.640520:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc147a26b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd7 expref: 21 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.640537:0:12258:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc147a153 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c52 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.640538:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc147a26b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd7 expref: 21 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.640544:0:12258:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc147a153 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c52 expref: 9 pid: 12260 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.640551:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264027904:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.640551:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264028032:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.640562:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad480 going to sleep for 11 seconds 00010000:00010000:3.0:1746065222.640578:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147a15a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c59 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.640585:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147a15a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c59 expref: 12 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.640593:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264028160:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.640608:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.641393:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.641405:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.641428:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.641480:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265497856 00000100:00100000:2.0:1746065222.641484:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265497856 00000100:00100000:2.0:1746065222.641508:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265497984 00000100:00100000:2.0:1746065222.641510:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265497984 00000100:00100000:2.0:1746065222.641518:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265498112 00000100:00100000:2.0:1746065222.641519:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265498112 00000100:00100000:2.0:1746065222.641528:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265498240 00000100:00100000:2.0:1746065222.641530:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265498240 00000100:00100000:2.0:1746065222.641540:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17757 00000100:00100000:2.0:1746065222.641544:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265497856:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065222.641562:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.641573:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.641580:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc147a328 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d63 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065222.641583:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17758 00010000:00010000:2.0:1746065222.641585:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.641586:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.641588:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 5/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.641590:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265497984:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065222.641601:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc147a328 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d63 expref: 14 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.641607:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.641609:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc147a328 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d63 expref: 14 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.641616:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264028288:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.641618:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.641623:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065222.641624:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065222.641626:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.641642:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 26 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.641651:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 7 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.641654:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 26 pid: 3068 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.641659:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 7 pid: 3068 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.641662:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264028416:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.641666:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264028544:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.641683:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065222.641699:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17759 00000100:00100000:3.0:1746065222.641704:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265498112:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065222.641718:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.641726:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065222.641729:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 26 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.641734:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:3.0:1746065222.641735:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.641761:0:9550:0:(ldlm_lockd.c:950:ldlm_server_blocking_ast()) ### lock not granted, not sending blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 26 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.641769:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.641850:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17760 00000100:00100000:1.0:1746065222.641856:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265498240:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065222.641871:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.641880:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147a168 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c75 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.641887:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc147a287 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cf3 expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.641893:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a217 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cad expref: 7 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.641898:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.641899:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.641901:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.641912:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a217 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cad expref: 7 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.641919:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a217 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cad expref: 7 pid: 12258 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.641926:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264028800:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.642309:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065222.642344:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.643101:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265498368 00000100:00100000:0.0:1746065222.643105:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265498368 00000100:00100000:0.0:1746065222.643129:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17761 00000100:00100000:0.0:1746065222.643134:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2618:x1830881265498368:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065222.643143:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065222.643152:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d86 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.643166:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065222.643168:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.643179:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:0.0:1746065222.643182:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.643192:0:13375:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.643200:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 10 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.643208:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf000, rc 0) 00000100:00100000:0.0:1746065222.643228:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2618:x1830881265498368:12345-192.168.202.27@tcp:101:cat.0 Request processed in 94us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.643234:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17761 00010000:00010000:1.0:1746065222.643429:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc147a287 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cf3 expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.643443:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc147a287 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cf3 expref: 21 pid: 9549 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.643452:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264028928:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065222.643473:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147a168 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c75 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.643480:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147a168 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c75 expref: 14 pid: 9548 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.643487:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264029056:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.643497:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.647506:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.647625:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264027520:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065222.648555:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.648574:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265498496 00000100:00100000:1.0:1746065222.648579:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265498496 00010000:00010000:1.0:1746065222.648604:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc147a1fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c8a expref: 12 pid: 9549 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.648701:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265497472:12345-192.168.202.27@tcp:4:cat.0 Request processed in 9224us (9419us total) trans 17179874351 rc 0/0 00000100:00100000:2.0:1746065222.648710:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2098 00002000:00100000:2.0:1746065222.648717:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3682304->4132863) req@ffff88009aeca680 x1830881265497472/t17179874351(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/448 e 0 to 0 dl 1746065233 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.648726:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aeca680 with x1830881265497472 ext(3682304->4132863) 00010000:00010000:2.0:1746065222.648732:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 11 pid: 9550 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.648740:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 11 pid: 9550 timeout: 918 lvb_type: 0 00002000:00010000:2.0:1746065222.648746:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aeca680 00000100:00100000:3.0:1746065222.648997:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264027648:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.649006:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264027904:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.649013:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264028160:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.649032:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.649213:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265498752 00000100:00100000:1.0:1746065222.649216:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265498752 00000100:00100000:1.0:1746065222.649229:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8310 00000100:00100000:1.0:1746065222.649236:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265498496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.649246:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.649261:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc147a1fb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c8a expref: 10 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.649270:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc147a1fb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c8a expref: 10 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.649286:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009552ee00/0xad6b7ddc147a1fb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c8a expref: 10 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.649321:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065222.649338:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265498496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 103us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.649343:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8310 00000100:00100000:1.0:1746065222.649365:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264027776:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.649373:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264028032:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065222.649386:0:12258:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.649400:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc147a264 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd0 expref: 27 pid: 12260 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.649412:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8311 00000100:00100000:1.0:1746065222.649416:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881265498752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.649421:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.649426:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc147a264 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd0 expref: 27 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.649438:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc147a264 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd0 expref: 27 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.649447:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b2600/0xad6b7ddc147a264 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd0 expref: 27 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:1.0:1746065222.649453:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065222.649465:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881265498752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 49us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.649469:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8311 00000100:00100000:0.0:1746065222.649917:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.649930:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.649938:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265498880 00000100:00100000:0.0:1746065222.649941:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265498880 00010000:00010000:0.0:1746065222.649951:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147a15a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c59 expref: 15 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746065222.649962:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265499008 00000100:00100000:0.0:1746065222.649963:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265499008 00010000:00010000:0.0:1746065222.649970:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc147a26b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd7 expref: 22 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746065222.649995:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8312 00000100:00100000:0.0:1746065222.650000:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+15:2006:x1830881265498880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.650006:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.650014:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147a15a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c59 expref: 15 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650022:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147a15a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c59 expref: 15 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650033:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147a15a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c59 expref: 15 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650043:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.650056:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265498880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 56us (140us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.650061:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8312 00000100:00100000:0.0:1746065222.650070:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8313 00000100:00100000:0.0:1746065222.650074:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265499008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.650079:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.650084:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc147a26b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd7 expref: 22 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650091:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc147a26b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd7 expref: 22 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650105:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552f400/0xad6b7ddc147a26b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cd7 expref: 22 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650113:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.650123:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881265499008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 48us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.650127:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8313 00000100:00100000:0.0:1746065222.650147:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.650154:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265498624 00000100:00100000:0.0:1746065222.650157:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265498624 00010000:00010000:0.0:1746065222.650164:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc147a153 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c52 expref: 12 pid: 12260 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746065222.650175:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8314 00000100:00100000:0.0:1746065222.650178:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265498624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.650183:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.650188:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc147a153 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c52 expref: 12 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650195:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc147a153 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c52 expref: 12 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650205:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3dd400/0xad6b7ddc147a153 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c52 expref: 12 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650211:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.650213:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.650217:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.650223:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.650236:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.650245:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265498624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (98us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.650250:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8314 00000100:00100000:0.0:1746065222.650287:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.650294:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265499136 00000100:00100000:0.0:1746065222.650309:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265499136 00010000:00010000:0.0:1746065222.650318:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a202 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c91 expref: 8 pid: 3068 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746065222.650330:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8315 00000100:00100000:0.0:1746065222.650334:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265499136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.650339:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.650344:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a202 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c91 expref: 8 pid: 3068 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650351:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a202 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c91 expref: 8 pid: 3068 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650360:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a202 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c91 expref: 8 pid: 3068 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650372:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.650374:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.650376:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.650382:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.650392:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.650401:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2004:x1830881265499136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 67us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.650406:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8315 00000100:00100000:0.0:1746065222.650467:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264028800:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065222.650490:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264028928:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065222.650504:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.650510:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265499264 00000100:00100000:0.0:1746065222.650511:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265499264 00010000:00010000:0.0:1746065222.650519:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc147a328 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d63 expref: 14 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746065222.650529:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8316 00000100:00100000:0.0:1746065222.650533:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265499264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.650538:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.650544:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc147a328 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d63 expref: 14 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650556:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc147a328 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d63 expref: 14 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650564:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.650576:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65eb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265499264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 42us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.650580:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8316 00000100:00100000:0.0:1746065222.650610:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.650637:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.650643:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265499648 00000100:00100000:0.0:1746065222.650645:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265499648 00010000:00010000:0.0:1746065222.650653:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc147a287 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cf3 expref: 21 pid: 9549 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746065222.650663:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8317 00000100:00100000:0.0:1746065222.650666:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265499648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.650671:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.650677:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc147a287 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cf3 expref: 21 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650683:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc147a287 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cf3 expref: 21 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650693:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552e000/0xad6b7ddc147a287 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cf3 expref: 21 pid: 9549 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650704:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.650714:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881265499648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (77us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.650718:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8317 00000100:00100000:0.0:1746065222.650730:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265499392 00000100:00100000:0.0:1746065222.650732:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265499392 00002000:00100000:0.0:1746065222.650746:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1155071) req@ffff880097d07480 x1830881265499392/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065222.650754:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07480 with x1830881265499392 ext(1048576->1155071) 00010000:00010000:0.0:1746065222.650758:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 26 pid: 3068 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.650766:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 26 pid: 3068 timeout: 918 lvb_type: 0 00002000:00010000:0.0:1746065222.650792:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d07480 00000100:00100000:0.0:1746065222.650802:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2099 00000100:00100000:0.0:1746065222.650805:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881265499392:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065222.650877:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.650884:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265499520 00000100:00100000:0.0:1746065222.650887:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265499520 00010000:00010000:0.0:1746065222.650894:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a217 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cad expref: 7 pid: 12258 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746065222.650904:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8318 00000100:00100000:0.0:1746065222.650908:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2006:x1830881265499520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.650912:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.650917:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a217 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cad expref: 7 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650924:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a217 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cad expref: 7 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650933:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a217 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cad expref: 7 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.650939:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.650948:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+6:2006:x1830881265499520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 40us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.650953:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8318 00000100:00100000:0.0:1746065222.650976:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.650983:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265499776 00000100:00100000:0.0:1746065222.650985:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265499776 00010000:00010000:0.0:1746065222.650991:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 6 pid: 3068 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746065222.651001:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8319 00000100:00100000:0.0:1746065222.651005:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+6:2004:x1830881265499776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.651009:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.651014:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 6 pid: 3068 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.651025:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 6 pid: 3068 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.651032:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.651034:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.651036:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651042:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651049:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.651059:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+6:2004:x1830881265499776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.651062:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8319 00000100:00100000:0.0:1746065222.651098:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264029056:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065222.651112:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.651154:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.651162:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265499904 00000100:00100000:0.0:1746065222.651164:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265499904 00010000:00010000:0.0:1746065222.651172:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147a168 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c75 expref: 14 pid: 9548 timeout: 918 lvb_type: 1 00000100:00100000:0.0:1746065222.651182:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8320 00000100:00100000:0.0:1746065222.651186:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265499904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.651191:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.651196:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147a168 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c75 expref: 14 pid: 9548 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.651203:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147a168 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c75 expref: 14 pid: 9548 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.651211:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147a168 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939c75 expref: 14 pid: 9548 timeout: 918 lvb_type: 1 00010000:00010000:0.0:1746065222.651218:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.651219:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.651221:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651227:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651236:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.651245:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265499904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 58us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.651249:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8320 00010000:00010000:0.0:1746065222.651260:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651266:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651281:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651288:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651294:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651311:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065222.651314:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651320:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651328:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.651333:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131047000/0xad6b7ddc147a37c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.651361:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265498240:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 9506us (9933us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.651367:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17760 00000100:00100000:3.0:1746065222.651587:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264028416:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.651597:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.651610:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.651615:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.651625:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.651631:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.651637:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.651641:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c285800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065222.651643:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.651650:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.651657:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.651661:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c285800/0xad6b7ddc147a360 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.651691:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265497728:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 11331us (12340us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.651695:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17756 00010000:00010000:1.0:1746065222.651761:0:12258:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.651768:0:12258:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.651796:0:12258:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.651801:0:12258:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.651807:0:12258:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.651812:0:12258:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009835ce00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065222.651815:0:12258:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.651820:0:12258:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.651829:0:12258:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.651834:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009835ce00/0xad6b7ddc147a359 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.651862:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265497600:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 11511us (12533us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.651867:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17755 00010000:00010000:2.0:1746065222.651938:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099524800/0xad6b7ddc147a328 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d63 expref: 10 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.651959:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264028288:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.651968:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009552f600/0xad6b7ddc147a2fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d4e expref: 5 pid: 3068 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.651976:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264028544:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.651986:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.651992:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.651998:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.652007:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.652013:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.652018:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.652023:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e890c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065222.652026:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.652031:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.652040:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.652046:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a367 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.652069:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265497856:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 10524us (11789us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.652074:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17757 00000100:00100000:2.0:1746065222.654090:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.654149:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265500032 00000100:00100000:0.0:1746065222.654155:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265500032 00010000:00010000:0.0:1746065222.654180:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 9 pid: 9550 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746065222.663891:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8321 00000100:00100000:0.0:1746065222.663905:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265500032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.663922:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.663942:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 9 pid: 9550 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.663954:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 9 pid: 9550 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.663973:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996be200/0xad6b7ddc147a2bf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3682304->4132863) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d2b expref: 9 pid: 9550 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.663985:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.663987:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.663992:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.663999:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60080000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.664025:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.664033:0:7192:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746065222.664043:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264029184:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065222.665436:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265499392:12345-192.168.202.27@tcp:4:cat.0 Request processed in 14624us (14819us total) trans 17179874352 rc 0/0 00000100:00100000:1.0:1746065222.665445:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2099 00002000:00100000:1.0:1746065222.665453:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1155071) req@ffff880097d07480 x1830881265499392/t17179874352(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/448 e 0 to 0 dl 1746065233 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.665461:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d07480 with x1830881265499392 ext(1048576->1155071) 00010000:00010000:1.0:1746065222.665468:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 28 pid: 3068 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.665476:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 28 pid: 3068 timeout: 918 lvb_type: 0 00002000:00010000:1.0:1746065222.665486:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d07480 00000100:00100000:0.0:1746065222.666312:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065222.668344:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264029184:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065222.668362:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065222.668398:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265500032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4496us (14312us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.668407:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8321 00000100:00100000:0.0:1746065222.673291:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.673343:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.673444:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265500416 00000100:00100000:1.0:1746065222.673452:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265500416 00002000:00100000:1.0:1746065222.673487:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880097d04700 x1830881265500416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.673496:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04700 with x1830881265500416 ext(2097152->3145727) 00010000:00010000:1.0:1746065222.673503:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 28 pid: 12258 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.673513:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 28 pid: 12258 timeout: 918 lvb_type: 0 00002000:00010000:1.0:1746065222.673520:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d04700 00000100:00100000:1.0:1746065222.673537:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2100 00000100:00100000:1.0:1746065222.673543:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265500416:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065222.674155:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265500160 00000100:00100000:2.0:1746065222.674159:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265500160 00010000:00010000:2.0:1746065222.674176:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 30 pid: 3068 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.674200:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8322 00000100:00100000:2.0:1746065222.674205:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265500160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065222.674213:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065222.674225:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 30 pid: 3068 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.674239:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 30 pid: 3068 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.674257:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c285e00/0xad6b7ddc147a2b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1155071) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d1d expref: 30 pid: 3068 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.674273:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.674275:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.674278:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.674285:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.674324:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065222.674339:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.674346:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.674359:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.674365:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.674375:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.674380:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdac00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065222.674383:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.674389:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.674396:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.674398:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.674402:0:1880:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 7 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.674408:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 7 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.674428:0:1880:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 7 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.674438:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264029312:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065222.674488:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065222.674507:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265500160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 301us (1163us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.674513:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8322 00000100:00100000:2.0:1746065222.679576:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264029312:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065222.679598:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.679608:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdac00/0xad6b7ddc147a36e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.679663:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265497984:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 38072us (38270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.679672:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17758 00000100:00100000:0.0:1746065222.682957:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.683148:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265500416:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9604us (9863us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065222.683159:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2100 00002000:00100000:1.0:1746065222.683170:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880097d04700 x1830881265500416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.683178:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04700 with x1830881265500416 ext(2097152->3145727) 00010000:00010000:1.0:1746065222.683188:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.683206:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 918 lvb_type: 0 00002000:00010000:1.0:1746065222.683212:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d04700 00000100:00100000:1.0:1746065222.683231:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265500672 00000100:00100000:1.0:1746065222.683237:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265500672 00002000:00100000:1.0:1746065222.683259:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f7fed80 x1830881265500672/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.683266:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fed80 with x1830881265500672 ext(1048576->2097151) 00002000:00010000:1.0:1746065222.683268:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fed80 00000100:00100000:1.0:1746065222.683294:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6371 00000100:00100000:1.0:1746065222.683308:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265500672:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065222.689846:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.689948:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265500672:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6640us (6998us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065222.689957:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6371 00002000:00100000:1.0:1746065222.689967:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f7fed80 x1830881265500672/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.689975:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fed80 with x1830881265500672 ext(1048576->2097151) 00002000:00010000:1.0:1746065222.689980:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fed80 00000100:00100000:3.0:1746065222.690032:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265500800 00000100:00100000:3.0:1746065222.690039:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265500800 00000100:00100000:3.0:1746065222.690062:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17762 00000100:00100000:3.0:1746065222.690067:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+20:2619:x1830881265500800:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.690078:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.690093:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147a38a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d8d expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065222.690109:0:1880:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d744, atime: 0x6812d743, ctime: 0x6812d744, blocks: 0x1008 00010000:00010000:3.0:1746065222.690123:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.690125:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.690131:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147a38a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d8d expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.690148:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147a38a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d8d expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.690157:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdaa00, rc 0) 00000100:00100000:3.0:1746065222.690173:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+21:2619:x1830881265500800:12345-192.168.202.27@tcp:101:cat.0 Request processed in 106us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.690178:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17762 00000100:00100000:0.0:1746065222.693178:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.693234:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265500928 00000100:00100000:1.0:1746065222.693240:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265500928 00010000:00010000:1.0:1746065222.693265:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.693319:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8323 00000100:00100000:1.0:1746065222.693326:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265500928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.693336:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.693350:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.693359:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.693377:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099cd2800/0xad6b7ddc147a33d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d78 expref: 27 pid: 12258 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.693404:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.693406:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.693409:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.693416:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.693434:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065222.694661:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265500928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1333us (1485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.694669:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8323 00010000:00010000:0.0:1746065222.695049:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.695058:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.695079:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.695085:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.695092:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.695098:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdae00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065222.695104:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.695110:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.695120:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.695126:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdae00/0xad6b7ddc147a375 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.695171:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881265498112:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 53466us (53763us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.695177:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17759 00000100:00100000:0.0:1746065222.697720:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.697804:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265501184 00000100:00100000:1.0:1746065222.697811:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265501184 00002000:00100000:1.0:1746065222.697842:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88008f7fca80 x1830881265501184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.697851:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fca80 with x1830881265501184 ext(2097152->3145727) 00002000:00010000:1.0:1746065222.697855:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fca80 00000100:00100000:1.0:1746065222.697869:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6372 00000100:00100000:1.0:1746065222.697875:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881265501184:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065222.700898:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.701848:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265501440 00000100:00100000:2.0:1746065222.701911:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265501440 00000100:00100000:2.0:1746065222.702208:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14643 00000100:00100000:2.0:1746065222.702216:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2620:x1830881265501440:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065222.702255:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065222.702277:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580e600/0xad6b7ddc147a321 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d5c expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.702311:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.702315:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065222.702335:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.702705:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cfa expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.702715:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a2b1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d16 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.702725:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 5/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.702749:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a2b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d16 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.702759:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a2b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d16 expref: 8 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.702770:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264029440:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.703716:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cfa expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.703724:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cfa expref: 27 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.703732:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264029568:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.703767:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.704899:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.706259:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265501568 00000100:00100000:1.0:1746065222.706267:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265501568 00000100:00100000:1.0:1746065222.706323:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17763 00000100:00100000:1.0:1746065222.706330:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265501568:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.706343:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.706359:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc147a398 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d94 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065222.706376:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d745, atime: 0x6812d741, ctime: 0x6812d745, blocks: 0x800 00010000:00010000:1.0:1746065222.706392:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.706394:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.706402:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc147a398 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d94 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.706414:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc147a398 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d94 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.706423:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046400, rc 0) 00000100:00100000:1.0:1746065222.706460:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265501568:12345-192.168.202.27@tcp:101:cat.0 Request processed in 130us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.706469:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17763 00000100:00100000:1.0:1746065222.706738:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.706765:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264029440:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.707492:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.707533:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265501824 00000100:00100000:3.0:1746065222.707538:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265501824 00000100:00100000:3.0:1746065222.707575:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17764 00000100:00100000:3.0:1746065222.707581:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2004:x1830881265501824:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.707588:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065222.707591:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065222.707598:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc147a39f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939da2 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.707602:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265502080 00000100:00100000:1.0:1746065222.707605:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265502080 00002000:00010000:3.0:1746065222.707611:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d746, atime: 0x6812d746, ctime: 0x6812d746, blocks: 0x808 00000100:00100000:1.0:1746065222.707617:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265501696 00000100:00100000:1.0:1746065222.707619:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265501696 00010000:00010000:3.0:1746065222.707620:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.707622:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.707627:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc147a39f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da2 expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065222.707628:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17765 00000100:00100000:1.0:1746065222.707632:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265502080:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.707637:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc147a39f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da2 expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.707637:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.707642:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc147a3a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939db0 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.707644:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda800, rc 0) 00010000:00010000:1.0:1746065222.707650:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.707652:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.707655:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc147a3a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db0 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065222.707663:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265501824:12345-192.168.202.27@tcp:101:cat.0 Request processed in 83us (927us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065222.707663:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc147a3a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db0 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065222.707668:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17764 00010000:00010000:1.0:1746065222.707669:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131046e00, rc 0) 00000100:00100000:3.0:1746065222.707678:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17766 00000100:00100000:1.0:1746065222.707680:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265502080:12345-192.168.202.27@tcp:101:cat.0 Request processed in 47us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.707682:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265501696:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065222.707684:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17765 00010000:00010000:3.0:1746065222.707686:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.707691:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc147a3ad lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939d9b expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065222.707700:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d745, atime: 0x6812d743, ctime: 0x6812d745, blocks: 0x800 00000100:00100000:1.0:1746065222.707704:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065222.707706:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.707707:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.707711:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc147a3ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d9b expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065222.707714:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265501952 00000100:00100000:1.0:1746065222.707716:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265501952 00010000:00010000:3.0:1746065222.707718:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc147a3ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d9b expref: 8 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.707724:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdbe00, rc 0) 00000100:00100000:1.0:1746065222.707727:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17767 00000100:00100000:1.0:1746065222.707730:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265501952:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.707735:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065222.707736:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265501696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 54us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.707740:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17766 00010000:00010000:1.0:1746065222.707742:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131047800/0xad6b7ddc147a3b4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939da9 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065222.707751:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 5034592, mtime: 0x6812d746, atime: 0x6812d744, ctime: 0x6812d746, blocks: 0x1678 00010000:00010000:1.0:1746065222.707757:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.707759:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.707762:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047800/0xad6b7ddc147a3b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da9 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.707770:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131047800/0xad6b7ddc147a3b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da9 expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.707794:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047800, rc 0) 00000100:00100000:1.0:1746065222.707809:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265501952:12345-192.168.202.27@tcp:101:cat.0 Request processed in 78us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.707813:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17767 00000100:00100000:1.0:1746065222.707862:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.707874:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265502336 00000100:00100000:1.0:1746065222.707876:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265502336 00000100:00100000:0.0:1746065222.707889:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065222.707890:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cfa expref: 28 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.707903:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265502208 00000100:00100000:1.0:1746065222.707905:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265502208 00010000:00010000:1.0:1746065222.707912:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a2b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d16 expref: 9 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.707928:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8324 00000100:00100000:1.0:1746065222.707933:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265502336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065222.707939:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8325 00010000:00010000:1.0:1746065222.707941:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065222.707944:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265502208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.707945:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cfa expref: 28 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.707949:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.707952:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cfa expref: 28 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.707952:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a2b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d16 expref: 9 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.707959:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a2b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d16 expref: 9 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:3.0:1746065222.708309:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3000/0xad6b7ddc147a295 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939cfa expref: 28 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.708325:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077df80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264029568:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065222.708361:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf600/0xad6b7ddc147a2b1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d16 expref: 9 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.708371:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065222.708376:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.708383:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.708389:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.708399:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.708414:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265502208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 470us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.708419:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8325 00010000:00010000:1.0:1746065222.708448:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065222.708452:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065222.708469:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265502336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 535us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.708475:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8324 00010000:00010000:3.0:1746065222.708588:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.708595:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.708600:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000040:00080000:3.0:1746065222.708825:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1101, 88 off104728 00000004:00080000:3.0:1746065222.708833:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818727059005ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.708867:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1112, 88 off105696 00000004:00080000:3.0:1746065222.708870:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818727096319ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.708886:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1113, 88 off105784 00000004:00080000:3.0:1746065222.708888:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818727114882ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.708896:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1102, 88 off104816 00000004:00080000:3.0:1746065222.708899:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818727125369ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.708906:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1103, 88 off104904 00000004:00080000:3.0:1746065222.708909:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818727135074ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.708916:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1114, 88 off105872 00000004:00080000:3.0:1746065222.708918:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818727144490ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.708925:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1115, 88 off105960 00000004:00080000:3.0:1746065222.708927:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818727153107ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.708933:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1116, 88 off106048 00000004:00080000:3.0:1746065222.708936:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818727162112ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.708943:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1104, 88 off104992 00000004:00080000:3.0:1746065222.708946:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818727172217ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.708953:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1117, 88 off106136 00000004:00080000:3.0:1746065222.708956:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818727182232ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.708963:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1105, 88 off105080 00000004:00080000:3.0:1746065222.708966:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818727192397ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.708974:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1118, 88 off106224 00000004:00080000:3.0:1746065222.708976:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818727202900ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.708983:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1106, 88 off105168 00000004:00080000:3.0:1746065222.708986:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818727212457ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.708993:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1107, 88 off105256 00000004:00080000:3.0:1746065222.708995:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818727221912ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.709002:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1108, 88 off105344 00000004:00080000:3.0:1746065222.709004:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818727230367ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.709010:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1109, 88 off105432 00000004:00080000:3.0:1746065222.709013:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818727239297ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.709020:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1119, 88 off106312 00000004:00080000:3.0:1746065222.709022:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818727248665ns, next at 761143559853ns, rc = 0 00000100:00100000:1.0:1746065222.709519:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881265501184:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11642us (11802us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065222.709526:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6372 00002000:00100000:1.0:1746065222.709533:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88008f7fca80 x1830881265501184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.709541:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fca80 with x1830881265501184 ext(2097152->3145727) 00002000:00010000:1.0:1746065222.709545:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fca80 00000100:00100000:1.0:1746065222.710575:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.710702:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265502464 00000100:00100000:3.0:1746065222.710707:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265502464 00000100:00100000:3.0:1746065222.710732:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14644 00000100:00100000:3.0:1746065222.710737:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2618:x1830881265502464:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.710752:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.710763:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbc00/0xad6b7ddc147a3bb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939db7 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.710817:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.710824:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbc00/0xad6b7ddc147a3bb lrc: 4/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db7 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.710836:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.710845:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbc00/0xad6b7ddc147a3bb lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db7 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.710852:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.710854:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065222.710857:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbc00/0xad6b7ddc147a3bb lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db7 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.710862:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdbc00, rc 0) 00000100:00100000:3.0:1746065222.710884:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2618:x1830881265502464:12345-192.168.202.27@tcp:101:cat.0 Request processed in 147us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.710889:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14644 00000001:00080000:1.0:1746065222.711392:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937171 is committed 00000004:00080000:1.0:1746065222.711397:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1098 committed 00000004:00080000:1.0:1746065222.711411:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1090 committed 00000004:00080000:1.0:1746065222.711422:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1089 committed 00000004:00080000:1.0:1746065222.711424:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1088 committed 00000004:00080000:1.0:1746065222.711425:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1087 committed 00000004:00080000:1.0:1746065222.711427:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1097 committed 00000004:00080000:1.0:1746065222.711429:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1086 committed 00000004:00080000:1.0:1746065222.711430:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1096 committed 00000004:00080000:1.0:1746065222.711431:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1085 committed 00000004:00080000:1.0:1746065222.711433:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1095 committed 00000004:00080000:1.0:1746065222.711434:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1094 committed 00000004:00080000:1.0:1746065222.711435:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1093 committed 00000004:00080000:1.0:1746065222.711437:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1084 committed 00000004:00080000:1.0:1746065222.711438:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1083 committed 00000004:00080000:1.0:1746065222.711439:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1092 committed 00000004:00080000:1.0:1746065222.711440:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1091 committed 00000004:00080000:1.0:1746065222.711442:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1082 committed 00000001:00080000:1.0:1746065222.711447:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937169 is committed 00000001:00080000:1.0:1746065222.711450:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937168 is committed 00000100:00100000:2.0:1746065222.711613:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264029824:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065222.711647:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065222.711665:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264030336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065222.711676:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065222.711688:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065222.711692:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264029952:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065222.711705:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065222.711714:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264030464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065222.711807:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264029824 00000100:00100000:0.0:1746065222.711810:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264029824 00000100:00100000:0.0:1746065222.711827:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264030336 00000100:00100000:0.0:1746065222.711829:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264030336 00000100:00100000:3.0:1746065222.711858:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264029696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.711877:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065222.711934:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264030080:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.711950:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264030976:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.712014:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264030208:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.712029:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065222.712044:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264029952 00000100:00100000:0.0:1746065222.712047:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264029952 00000100:00100000:0.0:1746065222.712062:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264029696 00000100:00100000:0.0:1746065222.712064:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264029696 00000100:00100000:0.0:1746065222.712076:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17768 00000100:00100000:0.0:1746065222.712082:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+17:3761:x1830881264029824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.712137:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17769 00000100:00100000:1.0:1746065222.712142:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3761:x1830881264030336:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.712213:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881264030336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (535us total) trans 17179874353 rc 0/0 00000100:00100000:1.0:1746065222.712218:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17769 00000100:00100000:1.0:1746065222.712227:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17770 00000100:00100000:1.0:1746065222.712230:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3761:x1830881264029952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065222.712260:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00002000:00010000:1.0:1746065222.712262:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065222 -> 1746065222 00002000:00010000:1.0:1746065222.712264:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065220 -> 1746065220 00002000:00010000:1.0:1746065222.712266:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065222 -> 1746065222 00002000:00010000:1.0:1746065222.712267:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00000100:00100000:1.0:1746065222.712279:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881264029952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (573us total) trans 17179874354 rc 0/0 00000100:00100000:1.0:1746065222.712282:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17770 00000100:00100000:1.0:1746065222.712289:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17771 00000100:00100000:1.0:1746065222.712292:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+17:3760:x1830881264029696:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065222.712330:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065222.712332:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065221 -> 1746065221 00002000:00010000:1.0:1746065222.712333:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065217 -> 1746065217 00002000:00010000:1.0:1746065222.712335:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065221 -> 1746065221 00002000:00010000:1.0:1746065222.712336:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746065222.712349:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+18:3760:x1830881264029696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (471us total) trans 17179874355 rc 0/0 00000100:00100000:1.0:1746065222.712353:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17771 00002000:00010000:0.0:1746065222.712404:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065222.712406:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065222 -> 1746065222 00002000:00010000:0.0:1746065222.712407:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065222 -> 1746065222 00002000:00010000:0.0:1746065222.712409:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065222 -> 1746065222 00002000:00010000:0.0:1746065222.712410:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065222.712425:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881264029824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 344us (778us total) trans 17179874356 rc 0/0 00000100:00100000:0.0:1746065222.712429:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17768 00000004:00010000:0.0:1746065222.712921:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88008f7ffb80 reply state ffff88012be34000 transno 8589937171 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.712935:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.712943:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065222.712946:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065222.712951:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbc00/0xad6b7ddc147a3bb lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db7 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.712961:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbc00/0xad6b7ddc147a3bb lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db7 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.712967:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbc00/0xad6b7ddc147a3bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db7 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.712988:0:7203:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbc00/0xad6b7ddc147a3bb lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db7 expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.712997:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264031744:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065222.713039:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065222.713314:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264030208 00000100:00100000:3.0:1746065222.713318:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264030720:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065222.713319:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264030208 00000100:00100000:3.0:1746065222.713336:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.713346:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264031232:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065222.713346:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264030720 00000100:00100000:2.0:1746065222.713348:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264030720 00000100:00100000:3.0:1746065222.713358:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065222.713360:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17772 00000100:00100000:2.0:1746065222.713365:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+18:3760:x1830881264030208:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065222.713384:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077c000/2, rc 0, transno 17179874355 00000100:00100000:3.0:1746065222.713390:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264029696:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.713403:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264031232 00000100:00100000:3.0:1746065222.713405:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264031232 00002000:00010000:2.0:1746065222.713412:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065222.713415:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065222.713416:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065222.713418:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00000100:00100000:3.0:1746065222.713419:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17773 00002000:00010000:2.0:1746065222.713419:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065222.713423:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881264030720:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065222.713440:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+19:3760:x1830881264030208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (1409us total) trans 17179874357 rc 0/0 00000100:00100000:2.0:1746065222.713444:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17772 00000100:00100000:2.0:1746065222.713453:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17774 00000100:00100000:2.0:1746065222.713457:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881264031232:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065222.713475:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065222.713477:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065221 -> 1746065221 00002000:00010000:3.0:1746065222.713479:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065219 -> 1746065219 00002000:00010000:3.0:1746065222.713481:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065221 -> 1746065221 00002000:00010000:3.0:1746065222.713483:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:2.0:1746065222.713487:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065222.713488:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.713490:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065222.713491:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.713493:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:3.0:1746065222.713498:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+24:3760:x1830881264030720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 75us (162us total) trans 21474841732 rc 0/0 00000100:00100000:3.0:1746065222.713504:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17773 00000100:00100000:2.0:1746065222.713504:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+24:3760:x1830881264031232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (145us total) trans 21474841733 rc 0/0 00000100:00100000:2.0:1746065222.713508:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17774 00000004:00080000:3.0:1746065222.713522:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c529c00/2, rc 0, transno 17179874357 00000100:00100000:3.0:1746065222.713525:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c529c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264030208:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065222.713532:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fdc00/2, rc 0, transno 21474841732 00000100:00100000:3.0:1746065222.713535:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264030720:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065222.713540:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fc380/2, rc 0, transno 21474841733 00000100:00100000:3.0:1746065222.713543:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264031232:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.713549:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264031872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065222.713698:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065222.713723:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077df80/2, rc 0, transno 17179874356 00000100:00100000:0.0:1746065222.713726:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264029824:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065222.713733:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52b480/2, rc 0, transno 17179874353 00000100:00100000:0.0:1746065222.713735:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264030336:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065222.713743:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264030848:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065222.713760:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065222.713787:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264031360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065222.713802:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065222.713817:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077c700/2, rc 0, transno 17179874354 00000100:00100000:0.0:1746065222.713820:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264029952:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065222.713832:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264030464 00000100:00100000:0.0:1746065222.713835:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264030464 00000100:00100000:0.0:1746065222.713847:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264030848 00000100:00100000:0.0:1746065222.713849:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264030848 00000100:00100000:0.0:1746065222.713857:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264031360 00000100:00100000:0.0:1746065222.713858:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264031360 00000100:00100000:0.0:1746065222.713868:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17775 00000100:00100000:0.0:1746065222.713873:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881264030464:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065222.713914:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065222.713917:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065222.713919:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065222.713921:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065222.713922:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:0.0:1746065222.713942:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+20:3761:x1830881264030464:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (244us total) trans 17179874358 rc 0/0 00000100:00100000:0.0:1746065222.713947:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17775 00000100:00100000:0.0:1746065222.713957:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17776 00000100:00100000:0.0:1746065222.713961:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3761:x1830881264030848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065222.713995:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065222.713997:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065222 -> 1746065222 00002000:00010000:0.0:1746065222.713999:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065222 -> 1746065222 00002000:00010000:0.0:1746065222.714000:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065222 -> 1746065222 00002000:00010000:0.0:1746065222.714001:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065222.714017:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+25:3761:x1830881264030848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (256us total) trans 21474841734 rc 0/0 00000100:00100000:0.0:1746065222.714021:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17776 00000100:00100000:0.0:1746065222.714030:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17777 00000100:00100000:0.0:1746065222.714034:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+24:3761:x1830881264031360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.714074:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065222.714087:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264030976 00000100:00100000:2.0:1746065222.714089:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264030976 00000100:00100000:1.0:1746065222.714090:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264031488:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065222.714103:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17778 00000100:00100000:1.0:1746065222.714105:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065222.714107:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+25:3762:x1830881264030976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.714122:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264031488 00000100:00100000:1.0:1746065222.714125:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264031488 00000100:00100000:1.0:1746065222.714140:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17779 00000100:00100000:1.0:1746065222.714143:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+27:3762:x1830881264031488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065222.714152:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065222.714154:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065220 -> 1746065220 00002000:00010000:2.0:1746065222.714156:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065219 -> 1746065219 00002000:00010000:2.0:1746065222.714157:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065220 -> 1746065220 00002000:00010000:2.0:1746065222.714159:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746065222.714179:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+28:3762:x1830881264030976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 72us (104us total) trans 21474841735 rc 0/0 00000100:00100000:2.0:1746065222.714184:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17778 00000100:00100000:1.0:1746065222.714188:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+28:3762:x1830881264031488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (83us total) trans 21474841736 rc 0/0 00000100:00100000:1.0:1746065222.714193:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17779 00000004:00080000:2.0:1746065222.714202:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fd880/2, rc 0, transno 21474841735 00000100:00100000:2.0:1746065222.714205:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264030976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.714207:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065222.714211:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e4380/2, rc 0, transno 21474841736 00000100:00100000:2.0:1746065222.714213:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264031488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.714218:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264030592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.714233:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065222.714240:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264031104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.714250:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065222.714257:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264031616:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065222.714261:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264030080 00000100:00100000:2.0:1746065222.714263:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264030080 00000100:00100000:1.0:1746065222.714268:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065222.714275:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264030592 00000100:00100000:2.0:1746065222.714276:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264030592 00000100:00100000:2.0:1746065222.714282:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264031616 00000100:00100000:1.0:1746065222.714282:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264031104 00000100:00100000:2.0:1746065222.714283:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264031616 00000100:00100000:1.0:1746065222.714284:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264031104 00000100:00100000:2.0:1746065222.714290:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17780 00000100:00100000:1.0:1746065222.714293:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17781 00000100:00100000:2.0:1746065222.714294:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881264030080:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.714307:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881264030592:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065222.714341:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17782 00002000:00010000:1.0:1746065222.714343:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:1.0:1746065222.714345:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00000100:00100000:2.0:1746065222.714346:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+28:3759:x1830881264031616:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065222.714347:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065222.714349:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065222.714350:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:1.0:1746065222.714368:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+23:3759:x1830881264030592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (134us total) trans 17179874359 rc 0/0 00000100:00100000:1.0:1746065222.714373:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17781 00000100:00100000:1.0:1746065222.714381:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17783 00000100:00100000:1.0:1746065222.714385:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881264031104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065222.714393:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881264031616:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (125us total) trans 21474841737 rc 0/0 00000100:00100000:2.0:1746065222.714398:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17782 00002000:00010000:1.0:1746065222.714416:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065222.714418:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065222.714420:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065222.714422:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065222.714423:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:2.0:1746065222.714426:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b33c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+22:3759:x1830881264030080:12345-0@lo:2:osp-syn-1-0.0 Request processed in 133us (219us total) trans 17179874360 rc 0/0 00000100:00100000:2.0:1746065222.714431:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17780 00000100:00100000:1.0:1746065222.714435:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+29:3759:x1830881264031104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (184us total) trans 21474841738 rc 0/0 00000100:00100000:1.0:1746065222.714439:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17783 00000004:00080000:1.0:1746065222.714456:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009077f800/2, rc 0, transno 17179874360 00000100:00100000:1.0:1746065222.714458:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009077f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264030080:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065222.714463:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52a300/2, rc 0, transno 17179874359 00000100:00100000:1.0:1746065222.714465:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264030592:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065222.714470:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fd500/2, rc 0, transno 21474841738 00000100:00100000:1.0:1746065222.714472:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264031104:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065222.714477:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e5500/2, rc 0, transno 21474841737 00000100:00100000:1.0:1746065222.714479:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264031616:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.714760:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.714793:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264031872 00000100:00100000:3.0:1746065222.714796:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264031872 00000100:00100000:3.0:1746065222.714811:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17784 00000100:00100000:3.0:1746065222.714815:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881264031872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.714866:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+23:3760:x1830881264031872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 51us (106us total) trans 17179874361 rc 0/0 00002000:00010000:0.0:1746065222.716287:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:0.0:1746065222.716291:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065222.716293:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065222.716295:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065222.716306:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:0.0:1746065222.716337:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881264031360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2302us (2533us total) trans 21474841739 rc 0/0 00000100:00100000:3.0:1746065222.716542:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17784 00000004:00080000:3.0:1746065222.716583:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c528e00/2, rc 0, transno 17179874361 00000100:00100000:3.0:1746065222.716588:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264031872:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065222.716632:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17777 00000004:00080000:0.0:1746065222.716662:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f7fea00/2, rc 0, transno 21474841734 00000100:00100000:0.0:1746065222.716665:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264030848:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065222.716673:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e6a00/2, rc 0, transno 21474841739 00000100:00100000:0.0:1746065222.716675:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264031360:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065222.716685:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c528380/2, rc 0, transno 17179874358 00000100:00100000:0.0:1746065222.716687:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264030464:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065222.720339:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.720397:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265502592 00000100:00100000:2.0:1746065222.720404:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265502592 00000100:00100000:2.0:1746065222.720442:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17785 00000100:00100000:2.0:1746065222.720448:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+26:2619:x1830881265502592:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065222.720461:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.720474:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a3c2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939dbe expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.720493:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.720495:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.720500:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a3c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dbe expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.720511:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a3c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dbe expref: 27 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.720518:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524000, rc 0) 00000100:00100000:2.0:1746065222.720561:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2619:x1830881265502592:12345-192.168.202.27@tcp:101:cat.0 Request processed in 113us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.720566:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17785 00000100:00100000:0.0:1746065222.720836:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.720926:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265502720 00000100:00100000:2.0:1746065222.720930:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265502720 00000100:00100000:1.0:1746065222.721031:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264031744:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065222.721048:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5508 00000100:00100000:1.0:1746065222.721050:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065222.721053:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2618:x1830881265502720:12345-192.168.202.27@tcp:49:cat.0 00010000:00080000:1.0:1746065222.721100:0:7203:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065222.721858:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2620:x1830881265501440:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 19642us (20966us total) trans 8589937171 rc 0/0 00000100:00100000:1.0:1746065222.721864:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14643 00000100:00100000:2.0:1746065222.721926:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2618:x1830881265502720:12345-192.168.202.27@tcp:49:cat.0 Request processed in 872us (1089us total) trans 0 rc 0/0 00010000:00010000:3.0:1746065222.721927:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065222.721931:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5508 00010000:00010000:3.0:1746065222.721935:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.721941:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.721945:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ad2c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065222.721949:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.721955:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.721965:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.721968:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065222.721971:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.721975:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2c600/0xad6b7ddc147a391 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065222.724243:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.724622:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265502848 00000100:00100000:1.0:1746065222.724628:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265502848 00000100:00100000:1.0:1746065222.724674:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14645 00000100:00100000:1.0:1746065222.724681:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2619:x1830881265502848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.724701:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.724716:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc147a3c9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939dc5 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.724754:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc147a3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dc5 expref: 27 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.724764:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc147a3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dc5 expref: 27 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.724802:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065222.724804:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065222.724807:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ad2ca00, rc 0) 00000100:00100000:1.0:1746065222.724841:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2619:x1830881265502848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 161us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.724847:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14645 00000100:00100000:0.0:1746065222.726821:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.726874:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265502976 00000100:00100000:2.0:1746065222.726878:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265502976 00000100:00100000:2.0:1746065222.726902:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14646 00000100:00100000:2.0:1746065222.726907:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+7:2620:x1830881265502976:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065222.726918:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.726927:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a3d0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939dcc expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.726955:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a3d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dcc expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.726964:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a3d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dcc expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.726973:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.726975:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065222.726977:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8e00, rc 0) 00000100:00100000:2.0:1746065222.726998:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2620:x1830881265502976:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 91us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.727003:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14646 00000100:00100000:0.0:1746065222.730103:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.730126:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265503104 00000100:00100000:0.0:1746065222.730132:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265503104 00000100:00100000:0.0:1746065222.730176:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14647 00000100:00100000:0.0:1746065222.730182:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2620:x1830881265503104:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065222.730197:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065222.730211:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00400/0xad6b7ddc147a3d7 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939dd3 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.730281:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.730293:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.730314:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065222.730338:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:0.0:1746065222.730342:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065222.730354:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.730684:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00400/0xad6b7ddc147a3d7 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dd3 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.730707:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dd3 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.730714:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065222.730716:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065222.730718:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00200, rc 0) 00000100:00100000:0.0:1746065222.730753:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2620:x1830881265503104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 572us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.730759:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14647 00000100:00100000:0.0:1746065222.730849:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.730863:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265503360 00000100:00100000:2.0:1746065222.730868:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265503360 00000100:00100000:2.0:1746065222.730897:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14648 00000100:00100000:2.0:1746065222.730901:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2624:x1830881265503360:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065222.730906:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.730912:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc147a3e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939dda expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.730940:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a3ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.730945:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a3ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.730949:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a3ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.730956:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a3f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.730959:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.730962:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.731007:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.731012:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a34b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d7f expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.731016:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.731036:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a34b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d7f expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.731043:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a34b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d7f expref: 8 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.731051:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264032000:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.731102:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.736484:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.736515:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.736540:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.736543:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265503616 00000100:00100000:2.0:1746065222.736550:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265503616 00000100:00100000:0.0:1746065222.736565:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.736580:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265503872 00000100:00100000:1.0:1746065222.736581:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265504128 00000100:00100000:0.0:1746065222.736583:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265503872 00000100:00100000:1.0:1746065222.736584:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265504128 00000100:00100000:3.0:1746065222.736641:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265503744 00000100:00100000:3.0:1746065222.736645:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265503744 00000100:00100000:1.0:1746065222.736676:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17786 00000100:00100000:1.0:1746065222.736683:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265504128:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065222.736697:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065222.736707:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17787 00010000:00010000:1.0:1746065222.736711:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc147a401 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939dfd expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.736713:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265503872:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065222.736721:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.736729:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.736730:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147a408 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939def expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.736731:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.736738:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc147a401 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dfd expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065222.736740:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.736742:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.736746:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147a408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939def expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.736754:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc147a401 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dfd expref: 10 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065222.736755:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147a408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939def expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.736762:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131047000, rc 0) 00010000:00010000:0.0:1746065222.736762:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01c00, rc 0) 00000100:00100000:0.0:1746065222.736818:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265503872:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 106us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.736823:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17787 00000100:00100000:2.0:1746065222.736838:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17788 00000100:00100000:2.0:1746065222.736844:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265503616:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065222.736850:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.736858:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a40f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939de1 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.736867:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.736869:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.736873:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a40f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de1 expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065222.736878:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17789 00010000:00010000:2.0:1746065222.736880:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a40f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de1 expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065222.736884:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265503744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065222.736887:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5ce800, rc 0) 00010000:00010000:0.0:1746065222.736889:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065222.736895:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc147a416 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939de8 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.736903:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.736905:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.736908:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc147a416 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de8 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065222.736915:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc147a416 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de8 expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065222.736921:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f00000, rc 0) 00000100:00100000:1.0:1746065222.736991:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265504128:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 308us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.736995:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17786 00000100:00100000:2.0:1746065222.737024:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265503616:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 181us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.737028:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265503744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 144us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.737032:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17788 00000100:00100000:0.0:1746065222.737035:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17789 00000100:00100000:0.0:1746065222.737059:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.737067:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265504000 00000100:00100000:1.0:1746065222.737070:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265504000 00000100:00100000:1.0:1746065222.737092:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17790 00000100:00100000:1.0:1746065222.737096:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265504000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065222.737101:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065222.737102:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065222.737106:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147a41d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939df6 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.737115:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.737116:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.737120:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147a41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939df6 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.737128:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147a41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939df6 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.737134:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fa00, rc 0) 00000100:00100000:3.0:1746065222.737142:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265504256 00000100:00100000:3.0:1746065222.737145:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265504256 00000100:00100000:1.0:1746065222.737149:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265504000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 52us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.737156:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17790 00000100:00100000:3.0:1746065222.737159:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17791 00000100:00100000:3.0:1746065222.737163:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265504256:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065222.737168:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.737175:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095fdb800/0xad6b7ddc147a424 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e04 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.737183:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.737185:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.737188:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdb800/0xad6b7ddc147a424 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e04 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.737197:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095fdb800/0xad6b7ddc147a424 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e04 expref: 12 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065222.737203:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdb800, rc 0) 00000100:00100000:3.0:1746065222.737216:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265504256:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 53us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.737221:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17791 00000100:00100000:0.0:1746065222.739761:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.739861:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264032000:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.739879:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065222.739992:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.740082:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265504384 00000100:00100000:1.0:1746065222.740086:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265504384 00010000:00010000:1.0:1746065222.740107:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a34b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d7f expref: 9 pid: 7231 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.740128:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8326 00000100:00100000:1.0:1746065222.740134:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265504384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.740144:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.740149:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a34b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d7f expref: 9 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.740157:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a34b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d7f expref: 9 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.740178:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800985b3800/0xad6b7ddc147a34b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d7f expref: 9 pid: 7231 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.740203:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065222.740207:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065222.740215:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065222.740220:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065222.740234:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065222.740259:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2007:x1830881265504384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 124us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.740264:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8326 00010000:00010000:2.0:1746065222.740344:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740350:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065222.740363:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065222.740445:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740451:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740455:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740460:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b49f6800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065222.740462:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740467:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065222.740470:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065222.740474:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.740476:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065222.740479:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 2/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740486:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b49f6800/0xad6b7ddc147a3fa lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740503:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a3ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065222.740506:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265504512 00010000:00010000:2.0:1746065222.740507:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a3ec lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065222.740510:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265504512 00010000:00010000:2.0:1746065222.740511:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a3ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740515:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a3ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740519:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099524800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065222.740520:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a3ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740524:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a3ec lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740530:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00002000:00100000:3.0:1746065222.740532:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880129f43800 x1830881265504512/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065222.740532:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065222.740535:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a3ec lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740539:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099524800/0xad6b7ddc147a3ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00002000:00100000:3.0:1746065222.740541:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43800 with x1830881265504512 ext(3145728->4194303) 00002000:00010000:3.0:1746065222.740544:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f43800 00010000:00010000:2.0:1746065222.740546:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a3f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740551:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a3f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740555:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740559:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012e890c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065222.740560:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a3f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740565:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a3f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740570:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ef2a200) 00010000:00010000:2.0:1746065222.740572:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065222.740574:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a3f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740578:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012e890c00/0xad6b7ddc147a3f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065222.740617:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc147a3e5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dda expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.740624:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d9400/0xad6b7ddc147a3e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dda expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.740632:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d9400, rc 0) 00000100:00100000:2.0:1746065222.740652:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2624:x1830881265503360:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9750us (9803us total) trans 8589937172 rc 301/301 00000100:00100000:2.0:1746065222.740658:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14648 00000100:00100000:2.0:1746065222.740676:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265504768 00000100:00100000:2.0:1746065222.740679:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265504768 00002000:00100000:2.0:1746065222.740693:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880129f42680 x1830881265504768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.740700:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42680 with x1830881265504768 ext(3145728->4194303) 00002000:00010000:2.0:1746065222.740704:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f42680 00000100:00100000:2.0:1746065222.740715:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6373 00000100:00100000:2.0:1746065222.740720:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265504768:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065222.740842:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6374 00000100:00100000:3.0:1746065222.740849:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265504512:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065222.752967:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.753002:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.753026:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.753040:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.753052:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.753063:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.753086:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.753098:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.753215:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265504768:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12492us (12742us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065222.753223:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6373 00002000:00100000:0.0:1746065222.753233:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880129f42680 x1830881265504768/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065222.753241:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f42680 with x1830881265504768 ext(3145728->4194303) 00002000:00010000:0.0:1746065222.753246:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f42680 00000100:00100000:0.0:1746065222.753265:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265505024 00000100:00100000:0.0:1746065222.753270:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265505024 00002000:00100000:0.0:1746065222.753290:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880129f40000 x1830881265505024/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065222.753310:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40000 with x1830881265505024 ext(2097152->4194303) 00002000:00010000:0.0:1746065222.753314:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f40000 00000100:00100000:0.0:1746065222.753330:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265505280 00000100:00100000:0.0:1746065222.753332:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265505280 00002000:00100000:0.0:1746065222.753343:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880129f40e00 x1830881265505280/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065222.753349:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40e00 with x1830881265505280 ext(2097152->4194303) 00002000:00010000:0.0:1746065222.753351:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f40e00 00000100:00100000:0.0:1746065222.753361:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6375 00000100:00100000:0.0:1746065222.753366:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265505024:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065222.753758:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6376 00000100:00100000:3.0:1746065222.753765:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265505280:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065222.754616:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265505408 00000100:00100000:2.0:1746065222.754621:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265505408 00000100:00100000:2.0:1746065222.754644:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265505664 00000100:00100000:2.0:1746065222.754646:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265505664 00000100:00100000:2.0:1746065222.754656:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265505920 00000100:00100000:2.0:1746065222.754657:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265505920 00000100:00100000:2.0:1746065222.754666:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265505536 00000100:00100000:2.0:1746065222.754668:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265505536 00000100:00100000:2.0:1746065222.754675:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265505792 00000100:00100000:2.0:1746065222.754677:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265505792 00000100:00100000:2.0:1746065222.754683:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265506048 00000100:00100000:2.0:1746065222.754685:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265506048 00000100:00100000:2.0:1746065222.754693:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17792 00000100:00100000:2.0:1746065222.754698:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265505408:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065222.754753:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265505408:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 54us (1725us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.754758:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17792 00000100:00100000:2.0:1746065222.754768:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17793 00000100:00100000:2.0:1746065222.754786:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265505664:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065222.754822:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265505664:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 48us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.754830:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17793 00000100:00100000:2.0:1746065222.754839:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17794 00000100:00100000:2.0:1746065222.754843:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265505920:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065222.754865:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265505920:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 22us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.754869:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17794 00000100:00100000:2.0:1746065222.754877:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17795 00000100:00100000:2.0:1746065222.754881:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265505536:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065222.754902:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265505536:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 21us (1838us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.754906:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17795 00000100:00100000:2.0:1746065222.754913:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17796 00000100:00100000:2.0:1746065222.754917:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265505792:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065222.754938:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265505792:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 20us (1852us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.754942:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17796 00000100:00100000:2.0:1746065222.754949:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17797 00000100:00100000:2.0:1746065222.754952:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265506048:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065222.754972:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265506048:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 20us (1874us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.754976:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17797 00000100:00100000:3.0:1746065222.762594:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265504512:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21737us (22593us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065222.762605:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6374 00002000:00100000:3.0:1746065222.762614:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880129f43800 x1830881265504512/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.762622:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f43800 with x1830881265504512 ext(3145728->4194303) 00002000:00010000:3.0:1746065222.762627:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f43800 00000100:00100000:0.0:1746065222.763673:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.763705:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.763725:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.763738:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.763750:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.764471:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265506176 00000100:00100000:3.0:1746065222.764478:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265506176 00000100:00100000:3.0:1746065222.764510:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265506432 00000100:00100000:3.0:1746065222.764512:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265506432 00000100:00100000:3.0:1746065222.764523:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265506688 00000100:00100000:3.0:1746065222.764524:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265506688 00000100:00100000:3.0:1746065222.764533:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265506304 00000100:00100000:3.0:1746065222.764535:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265506304 00000100:00100000:3.0:1746065222.764542:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265506560 00000100:00100000:0.0:1746065222.764898:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.765131:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265506560 00000100:00100000:2.0:1746065222.765131:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265506816 00000100:00100000:2.0:1746065222.765135:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265506816 00000100:00100000:3.0:1746065222.765150:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17798 00000100:00100000:2.0:1746065222.765155:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17799 00000100:00100000:3.0:1746065222.765156:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265506176:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065222.765159:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265506432:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065222.765244:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265506432:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 83us (1537us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.765249:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17799 00000100:00100000:2.0:1746065222.765262:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17800 00000100:00100000:2.0:1746065222.765266:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265506688:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065222.765712:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17801 00000100:00100000:1.0:1746065222.765719:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265506304:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065222.765895:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265506176:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 737us (2223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.765895:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265506688:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 627us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.765900:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17800 00000100:00100000:1.0:1746065222.765936:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265506304:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 218us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.766628:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17798 00000100:00100000:3.0:1746065222.766639:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17802 00000100:00100000:3.0:1746065222.766645:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265506560:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065222.766689:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265506560:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 45us (2939us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.766695:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17802 00000100:00100000:3.0:1746065222.766702:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17803 00000100:00100000:3.0:1746065222.766707:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265506816:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065222.766730:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265506816:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 22us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.766734:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17803 00000100:00100000:1.0:1746065222.767024:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17801 00000100:00100000:0.0:1746065222.768027:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.768071:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265507072 00000100:00100000:3.0:1746065222.768076:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265507072 00000100:00100000:3.0:1746065222.768130:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14649 00000100:00100000:3.0:1746065222.768135:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2624:x1830881265507072:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065222.768148:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.768151:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065222.768172:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdbc00/0xad6b7ddc147a3bb lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db7 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.768187:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.768190:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065222.768199:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147a432 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e0b expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.768232:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.768242:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dd3 expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.768248:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc147a3c9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dc5 expref: 26 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.768254:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a3d0 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dcc expref: 7 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.768259:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 6/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.768285:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a3d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dcc expref: 7 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.768294:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a3d0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dcc expref: 7 pid: 7205 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.768313:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264032128:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.768854:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc147a3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dc5 expref: 26 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.768862:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc147a3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dc5 expref: 26 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.768869:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264032256:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.769089:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dd3 expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.769097:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dd3 expref: 7 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.769105:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264032384:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.769124:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880092949240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065222.772533:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265505024:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19160us (19565us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065222.772542:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6375 00002000:00100000:2.0:1746065222.772550:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880129f40000 x1830881265505024/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.772558:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40000 with x1830881265505024 ext(2097152->4194303) 00002000:00010000:2.0:1746065222.772563:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f40000 00000100:00100000:0.0:1746065222.773421:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.773900:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.774003:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.774027:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.774177:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265507200 00000100:00100000:2.0:1746065222.774184:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265507200 00000100:00100000:2.0:1746065222.774196:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265507328 00000100:00100000:2.0:1746065222.774198:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265507328 00000100:00100000:1.0:1746065222.774403:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265507456 00000100:00100000:1.0:1746065222.774407:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265507456 00000100:00100000:1.0:1746065222.774434:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265507584 00000100:00100000:1.0:1746065222.774437:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265507584 00000100:00100000:1.0:1746065222.774452:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17804 00000100:00100000:1.0:1746065222.774458:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265507328:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.774471:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.774484:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a440 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e19 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.774501:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.774504:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.774511:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a440 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e19 expref: 23 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.774523:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a440 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e19 expref: 23 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.774532:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf200, rc 0) 00000100:00100000:0.0:1746065222.774540:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17805 00000100:00100000:0.0:1746065222.774544:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265507456:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065222.774551:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065222.774557:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1aa00/0xad6b7ddc147a447 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e20 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.774558:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265507328:12345-192.168.202.27@tcp:101:cat.0 Request processed in 101us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.774563:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17804 00010000:00010000:0.0:1746065222.774565:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.774566:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.774570:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1aa00/0xad6b7ddc147a447 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e20 expref: 24 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065222.774574:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17806 00000100:00100000:1.0:1746065222.774579:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265507584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065222.774579:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1aa00/0xad6b7ddc147a447 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e20 expref: 23 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.774584:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065222.774585:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1aa00, rc 0) 00010000:00010000:1.0:1746065222.774591:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a44e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e27 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.774597:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265507456:12345-192.168.202.27@tcp:101:cat.0 Request processed in 53us (594us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065222.774601:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.774602:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:0.0:1746065222.774602:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17805 00010000:00010000:1.0:1746065222.774605:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a44e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e27 expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.774612:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a44e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e27 expref: 29 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.774618:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfa00, rc 0) 00000100:00100000:1.0:1746065222.774629:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265507584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 50us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.774634:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17806 00000100:00100000:2.0:1746065222.774687:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17807 00000100:00100000:2.0:1746065222.774691:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265507200:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065222.774697:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.774703:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc147a455 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e12 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.774711:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.774712:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.774717:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc147a455 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e12 expref: 29 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.774724:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc147a455 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e12 expref: 29 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.774730:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70aa00, rc 0) 00000100:00100000:2.0:1746065222.774744:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265507200:12345-192.168.202.27@tcp:101:cat.0 Request processed in 53us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.774748:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17807 00000100:00100000:0.0:1746065222.776211:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.776249:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.776425:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264032128:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.776484:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265507712 00000100:00100000:1.0:1746065222.776488:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265507712 00000100:00100000:2.0:1746065222.776519:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265507840 00000100:00100000:2.0:1746065222.776523:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265507840 00000100:00100000:2.0:1746065222.776544:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17808 00000100:00100000:2.0:1746065222.776549:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265507840:12345-192.168.202.27@tcp:22:lfs.0 00002000:00010000:2.0:1746065222.776684:0:3067:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065222.776687:0:3067:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.776689:0:3067:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065222.776691:0:3067:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065222.776692:0:3067:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:2.0:1746065222.776717:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265507840:12345-192.168.202.27@tcp:22:lfs.0 Request processed in 168us (468us total) trans 21474841740 rc 0/0 00000100:00100000:2.0:1746065222.776722:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17808 00010000:00010000:1.0:1746065222.776809:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a3d0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dcc expref: 8 pid: 7205 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.776827:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8327 00000100:00100000:1.0:1746065222.776832:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2007:x1830881265507712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.776840:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.776844:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a3d0 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dcc expref: 8 pid: 7205 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.776852:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a3d0 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dcc expref: 8 pid: 7205 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.776867:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a3d0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dcc expref: 8 pid: 7205 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.776880:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065222.776884:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065222.776891:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065222.776896:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065222.776910:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+7:2007:x1830881265507712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 79us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.776916:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8327 00000100:00100000:0.0:1746065222.784146:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.784174:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.784515:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264032256:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.784525:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264032384:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.784541:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265507968 00000100:00100000:1.0:1746065222.784547:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265507968 00010000:00010000:3.0:1746065222.784549:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065222.784573:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc147a3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dc5 expref: 27 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.784592:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265508096 00000100:00100000:1.0:1746065222.784594:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265508096 00010000:00010000:1.0:1746065222.784601:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dd3 expref: 7 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.784629:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8328 00000100:00100000:1.0:1746065222.784636:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265507968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.784647:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.784651:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc147a3c9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dc5 expref: 27 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.784659:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc147a3c9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dc5 expref: 27 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.784676:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ad2ca00/0xad6b7ddc147a3c9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dc5 expref: 27 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746065222.784680:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8329 00000100:00100000:0.0:1746065222.784686:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2004:x1830881265508096:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065222.784691:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065222.784693:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065222.784695:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.784696:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dd3 expref: 7 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.784701:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065222.784710:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065222.784712:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dd3 expref: 7 pid: 7203 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.784722:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f00200/0xad6b7ddc147a3de lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dd3 expref: 7 pid: 7203 timeout: 918 lvb_type: 0 00000100:00100000:1.0:1746065222.784743:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265507968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 108us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.784748:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8328 00010000:00010000:0.0:1746065222.784801:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065222.784804:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.784810:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.784815:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.784965:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.784980:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+6:2004:x1830881265508096:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 294us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.784986:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8329 00010000:00010000:3.0:1746065222.785032:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.785037:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065222.786379:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265505280:12345-192.168.202.27@tcp:3:cat.0 Request processed in 32612us (33374us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065222.786387:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6376 00002000:00100000:2.0:1746065222.786395:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880129f40e00 x1830881265505280/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.786402:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40e00 with x1830881265505280 ext(2097152->4194303) 00002000:00010000:2.0:1746065222.786406:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f40e00 00000040:00080000:3.0:1746065222.786500:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1110, 88 off105520 00000004:00080000:3.0:1746065222.786509:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818804735245ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.786530:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1120, 88 off106400 00000004:00080000:3.0:1746065222.786532:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818804758930ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.787141:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1122, 88 off106584 00000004:00080000:3.0:1746065222.787146:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818805372655ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.787164:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1111, 88 off105608 00000004:00080000:3.0:1746065222.787167:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818805393053ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.787186:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1112, 88 off105696 00000100:00100000:0.0:1746065222.787315:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.787347:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.787451:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265508224 00000100:00100000:1.0:1746065222.787457:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265508224 00000100:00100000:1.0:1746065222.787490:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265508352 00000100:00100000:1.0:1746065222.787492:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265508352 00000100:00100000:0.0:1746065222.787507:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14650 00000100:00100000:0.0:1746065222.787517:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+6:2620:x1830881265508224:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065222.787530:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065222.787545:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a45c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e2e expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.787720:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14651 00000100:00100000:1.0:1746065222.787727:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2619:x1830881265508352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065222.787734:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.787931:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e35 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000004:00080000:3.0:1746065222.787990:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818806216595ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.788014:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1123, 88 off106672 00000004:00080000:3.0:1746065222.788017:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818806243217ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.788026:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1124, 88 off106760 00000004:00080000:3.0:1746065222.788029:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818806255353ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.788036:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1125, 88 off106848 00000100:00100000:0.0:1746065222.789148:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00080000:3.0:1746065222.789255:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818807481278ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.789289:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1113, 88 off105784 00000004:00080000:3.0:1746065222.789294:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818807519950ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.789794:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1126, 88 off106936 00000004:00080000:3.0:1746065222.789798:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818808024886ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065222.790267:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1114, 88 off105872 00000004:00080000:3.0:1746065222.790272:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818808497984ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.790282:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1127, 88 off107024 00000004:00080000:3.0:1746065222.790285:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818808510993ns, next at 761143559853ns, rc = 0 00000100:00100000:2.0:1746065222.790288:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265508480 00000040:00080000:3.0:1746065222.790292:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1115, 88 off105960 00000004:00080000:3.0:1746065222.790294:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818808520756ns, next at 761143591313ns, rc = 0 00000100:00100000:2.0:1746065222.790305:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265508480 00000040:00080000:3.0:1746065222.790313:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1116, 88 off106048 00000004:00080000:3.0:1746065222.790316:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818808542114ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.790323:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1117, 88 off106136 00000004:00080000:3.0:1746065222.790326:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818808552034ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.790333:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1118, 88 off106224 00000004:00080000:3.0:1746065222.790336:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 818808562073ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065222.790342:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1128, 88 off107112 00000004:00080000:3.0:1746065222.790345:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 818808571249ns, next at 761143559853ns, rc = 0 00000100:00100000:2.0:1746065222.790348:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14652 00000100:00100000:2.0:1746065222.790355:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2618:x1830881265508480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065222.790373:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.790389:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e3c expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.791284:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.791304:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a45c lrc: 4/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e2e expref: 7 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.791323:0:7204:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065222.791334:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a45c lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e2e expref: 7 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.791345:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065222.791349:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065222.791351:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a45c lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e2e expref: 7 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.791358:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a200, rc 0) 00010000:00010000:1.0:1746065222.791446:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 27 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.791459:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 27 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.791470:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065222.791472:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065222.791475:0:7205:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a45c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e2e expref: 7 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.791482:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835ce00, rc 0) 00010000:00010000:2.0:1746065222.791620:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.791634:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 12 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.791644:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.791649:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065222.791652:0:13395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a45c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e2e expref: 7 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.791660:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70be00, rc 0) 00000100:00100000:0.0:1746065222.791721:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2620:x1830881265508224:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4208us (4406us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.791725:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2619:x1830881265508352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3996us (4375us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.791732:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14650 00000100:00100000:1.0:1746065222.791737:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14651 00000100:00100000:2.0:1746065222.792056:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2618:x1830881265508480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1700us (2915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.792062:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14652 00000001:00080000:1.0:1746065222.795836:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937173 is committed 00000004:00080000:1.0:1746065222.795847:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1106 committed 00000004:00080000:1.0:1746065222.796813:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1099 committed 00000004:00080000:1.0:1746065222.796828:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1098 committed 00000004:00080000:1.0:1746065222.796830:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1097 committed 00000004:00080000:1.0:1746065222.796831:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1096 committed 00000004:00080000:1.0:1746065222.796832:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1105 committed 00000004:00080000:1.0:1746065222.796834:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1095 committed 00000004:00080000:1.0:1746065222.796835:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1104 committed 00000004:00080000:1.0:1746065222.796838:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1094 committed 00000004:00080000:1.0:1746065222.796839:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1103 committed 00000004:00080000:1.0:1746065222.796840:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1102 committed 00000004:00080000:1.0:1746065222.796842:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1101 committed 00000004:00080000:1.0:1746065222.796844:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1093 committed 00000004:00080000:1.0:1746065222.796845:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1092 committed 00000004:00080000:1.0:1746065222.796846:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1100 committed 00000004:00080000:1.0:1746065222.796847:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1099 committed 00000004:00080000:1.0:1746065222.796848:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1091 committed 00000100:00100000:0.0:1746065222.797097:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264032512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065222.797162:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.797638:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264032896:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.797690:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065222.797715:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264033024:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.797718:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264033408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065222.797741:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.797746:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264032640:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.798154:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264032768:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.798237:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.798259:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264033152:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.798272:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.798283:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264033664:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.798293:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065222.798310:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264032512 00000100:00100000:3.0:1746065222.798313:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264034304:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065222.798319:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264032512 00000100:00100000:3.0:1746065222.798324:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.798346:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065222.798354:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264032896 00000100:00100000:2.0:1746065222.798356:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264032896 00000100:00100000:3.0:1746065222.798357:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264034048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.798367:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065222.798372:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264033024 00000100:00100000:2.0:1746065222.798373:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264033024 00000100:00100000:2.0:1746065222.798379:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264032640 00000100:00100000:2.0:1746065222.798380:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264032640 00000100:00100000:3.0:1746065222.798386:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264033152 00000100:00100000:2.0:1746065222.798387:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264033664 00000100:00100000:2.0:1746065222.798388:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264033664 00000100:00100000:3.0:1746065222.798391:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264033152 00000100:00100000:2.0:1746065222.798394:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264034304 00000100:00100000:2.0:1746065222.798396:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264034304 00000100:00100000:2.0:1746065222.798400:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264033408 00000100:00100000:2.0:1746065222.798402:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264033408 00000100:00100000:2.0:1746065222.798407:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264034048 00000100:00100000:2.0:1746065222.798408:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264034048 00000100:00100000:2.0:1746065222.798418:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17809 00000100:00100000:0.0:1746065222.798449:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264033536:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065222.798468:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065222.798474:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264034176:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065222.798486:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065222.798533:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264033536 00000100:00100000:0.0:1746065222.798535:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264033536 00000100:00100000:3.0:1746065222.798893:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264034176 00000100:00100000:3.0:1746065222.798897:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264034176 00000100:00100000:3.0:1746065222.798911:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17810 00000100:00100000:3.0:1746065222.798917:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3760:x1830881264032896:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065222.799028:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065222.799031:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065222 -> 1746065222 00002000:00010000:3.0:1746065222.799033:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065222 -> 1746065222 00002000:00010000:3.0:1746065222.799034:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065222 -> 1746065222 00002000:00010000:3.0:1746065222.799036:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065222.799065:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3760:x1830881264032896:12345-0@lo:2:osp-syn-0-0.0 Request processed in 147us (1375us total) trans 21474841741 rc 0/0 00000100:00100000:3.0:1746065222.799077:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17810 00000100:00100000:3.0:1746065222.799092:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17811 00000100:00100000:3.0:1746065222.799097:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+28:3761:x1830881264033024:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065222.799166:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00002000:00010000:3.0:1746065222.799169:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065222 -> 1746065222 00002000:00010000:3.0:1746065222.799170:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065220 -> 1746065220 00002000:00010000:3.0:1746065222.799172:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065222 -> 1746065222 00002000:00010000:3.0:1746065222.799174:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00000100:00100000:3.0:1746065222.799198:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+29:3761:x1830881264033024:12345-0@lo:2:osp-syn-1-0.0 Request processed in 101us (1457us total) trans 17179874362 rc 0/0 00000100:00100000:3.0:1746065222.799204:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17811 00000100:00100000:3.0:1746065222.799213:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17812 00000100:00100000:3.0:1746065222.799218:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3762:x1830881264032640:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065222.799255:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065222.799257:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065221 -> 1746065221 00002000:00010000:3.0:1746065222.799259:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065219 -> 1746065219 00002000:00010000:3.0:1746065222.799261:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065221 -> 1746065221 00002000:00010000:3.0:1746065222.799262:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746065222.799282:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3762:x1830881264032640:12345-0@lo:2:osp-syn-0-0.0 Request processed in 64us (1045us total) trans 21474841742 rc 0/0 00000100:00100000:3.0:1746065222.799286:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17812 00000100:00100000:3.0:1746065222.799295:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17813 00000100:00100000:3.0:1746065222.799308:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+33:3762:x1830881264033664:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065222.799337:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065222.799339:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065222.799341:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065222.799342:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065222.799344:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:1.0:1746065222.799351:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.799364:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3762:x1830881264033664:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (1069us total) trans 21474841743 rc 0/0 00000100:00100000:1.0:1746065222.799367:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264033280:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.799369:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17813 00000100:00100000:3.0:1746065222.799376:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264032768 00000100:00100000:3.0:1746065222.799378:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264032768 00000100:00100000:1.0:1746065222.799382:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.799388:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264033280 00000100:00100000:3.0:1746065222.799390:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264033280 00000100:00100000:1.0:1746065222.799390:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264033920:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.799399:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17814 00000100:00100000:1.0:1746065222.799401:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.799403:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+34:3762:x1830881264034304:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.799406:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008c52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264033792:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.799417:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065222.799423:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264034432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065222.799434:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065222.799443:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1746065222.799447:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881264034560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746065222.799451:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+35:3762:x1830881264034304:12345-0@lo:2:osp-syn-0-0.0 Request processed in 47us (1125us total) trans 21474841744 rc 0/0 00000100:00100000:3.0:1746065222.799456:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17814 00000100:00100000:3.0:1746065222.799463:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264033920 00000100:00100000:1.0:1746065222.799464:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.799465:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264033920 00000100:00100000:3.0:1746065222.799474:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264033792 00000100:00100000:3.0:1746065222.799476:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264033792 00000100:00100000:3.0:1746065222.799482:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264034432 00000100:00100000:3.0:1746065222.799484:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264034432 00000100:00100000:3.0:1746065222.799491:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17815 00000100:00100000:1.0:1746065222.799493:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264034560 00000100:00100000:3.0:1746065222.799495:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3760:x1830881264033408:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.799496:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264034560 00000100:00100000:1.0:1746065222.799524:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00002000:00010000:3.0:1746065222.799528:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00000100:00100000:1.0:1746065222.799529:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881264034560:12345-0@lo:13:osp-pre-1-1.0 00002000:00010000:3.0:1746065222.799530:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065222.799531:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065222.799533:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065222.799534:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00002000:00000024:1.0:1746065222.799545:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1068976448 pending 606208 free 3906641920 avail 3665522688 00000100:00100000:3.0:1746065222.799552:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3760:x1830881264033408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (1204us total) trans 17179874363 rc 0/0 00000100:00100000:3.0:1746065222.799556:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17815 00000100:00100000:3.0:1746065222.799565:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17816 00000100:00100000:3.0:1746065222.799568:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3760:x1830881264034048:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.799571:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aced880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881264034560:12345-0@lo:13:osp-pre-1-1.0 Request processed in 42us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065222.799576:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00080000:1.0:1746065222.799592:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1746065222.799596:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:3.0:1746065222.799598:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065222.799599:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065222.799602:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065222.799603:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:3.0:1746065222.799617:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3760:x1830881264034048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (1249us total) trans 17179874364 rc 0/0 00000100:00100000:3.0:1746065222.799622:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17816 00000100:00100000:1.0:1746065222.799622:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881264034560:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1746065222.799630:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17817 00000100:00100000:3.0:1746065222.799634:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3762:x1830881264033152:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065222.799642:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17818 00000100:00100000:1.0:1746065222.799647:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3761:x1830881264034176:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065222.799732:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:1.0:1746065222.799735:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065222.799737:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065222.799739:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065222.799740:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:1.0:1746065222.799760:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+37:3761:x1830881264034176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 113us (1272us total) trans 21474841745 rc 0/0 00000100:00100000:1.0:1746065222.799764:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17818 00000100:00100000:3.0:1746065222.799767:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3762:x1830881264033152:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (1492us total) trans 17179874365 rc 0/0 00000100:00100000:3.0:1746065222.799789:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17817 00000100:00100000:3.0:1746065222.799799:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17819 00000100:00100000:3.0:1746065222.799802:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+30:3759:x1830881264032768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065222.799818:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+27:3761:x1830881264032512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065222.799835:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065222.799838:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065222 -> 1746065222 00002000:00010000:3.0:1746065222.799839:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065222 -> 1746065222 00002000:00010000:3.0:1746065222.799841:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065222 -> 1746065222 00002000:00010000:3.0:1746065222.799842:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065222.799862:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881264032768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (512us total) trans 17179874366 rc 0/0 00000100:00100000:3.0:1746065222.799866:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17819 00002000:00010000:2.0:1746065222.799873:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00000100:00100000:3.0:1746065222.799874:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17820 00002000:00010000:2.0:1746065222.799875:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065221 -> 1746065221 00002000:00010000:2.0:1746065222.799877:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065217 -> 1746065217 00000100:00100000:3.0:1746065222.799878:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881264033280:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065222.799879:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065221 -> 1746065221 00002000:00010000:3.0:1746065222.799913:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065222.799915:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065220 -> 1746065220 00002000:00010000:3.0:1746065222.799917:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065219 -> 1746065219 00002000:00010000:3.0:1746065222.799919:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065220 -> 1746065220 00002000:00010000:3.0:1746065222.799921:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746065222.799937:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+37:3759:x1830881264033280:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (554us total) trans 21474841746 rc 0/0 00000100:00100000:3.0:1746065222.799966:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17820 00000100:00100000:3.0:1746065222.799977:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17821 00000100:00100000:3.0:1746065222.799982:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+31:3759:x1830881264033920:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065222.800020:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065222.800022:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065222.800024:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065222.800025:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065222.800029:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:3.0:1746065222.800047:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+32:3759:x1830881264033920:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (645us total) trans 17179874368 rc 0/0 00000100:00100000:0.0:1746065222.800048:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17822 00000100:00100000:3.0:1746065222.800052:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17821 00000100:00100000:0.0:1746065222.800055:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881264033792:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.800063:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17823 00000100:00100000:3.0:1746065222.800068:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+36:3759:x1830881264034432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065222.800096:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065222.800098:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065222.800100:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065222.800102:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065222.800103:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:0.0:1746065222.800130:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+38:3759:x1830881264033792:12345-0@lo:2:osp-syn-0-0.0 Request processed in 76us (711us total) trans 21474841747 rc 0/0 00000100:00100000:3.0:1746065222.800133:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+38:3759:x1830881264034432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 63us (696us total) trans 21474841748 rc 0/0 00000100:00100000:0.0:1746065222.800135:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17822 00000100:00100000:3.0:1746065222.800139:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17823 00000100:00100000:0.0:1746065222.800146:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17824 00000100:00100000:0.0:1746065222.800150:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+31:3761:x1830881264033536:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065222.800178:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c529880/2, rc 0, transno 21474841741 00000100:00100000:3.0:1746065222.800183:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c529880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264032896:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065222.800194:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c459500/2, rc 0, transno 17179874363 00000100:00100000:0.0:1746065222.800197:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+32:3761:x1830881264033536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (1728us total) trans 17179874369 rc 0/0 00000100:00100000:3.0:1746065222.800200:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c459500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264033408:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065222.800203:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17824 00000004:00080000:3.0:1746065222.800208:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856d500/2, rc 0, transno 17179874364 00000100:00100000:3.0:1746065222.800211:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264034048:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065222.800231:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c528700/2, rc 0, transno 21474841742 00000004:00080000:0.0:1746065222.800233:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c45a680/2, rc 0, transno 17179874362 00000100:00100000:3.0:1746065222.800234:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264032640:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065222.800238:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264033024:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065222.800242:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c458a80/2, rc 0, transno 17179874365 00000100:00100000:3.0:1746065222.800245:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c458a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264033152:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065222.800246:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c45b480/2, rc 0, transno 17179874369 00000100:00100000:0.0:1746065222.800249:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264033536:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065222.800252:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c529180/2, rc 0, transno 21474841743 00000100:00100000:3.0:1746065222.800254:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c529180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264033664:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065222.800259:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4e8000/2, rc 0, transno 21474841745 00000100:00100000:0.0:1746065222.800262:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264034176:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065222.800263:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4e8a80/2, rc 0, transno 21474841744 00000100:00100000:3.0:1746065222.800266:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264034304:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065222.800315:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746065222.800321:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264034688:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065222.800342:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065222.800364:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264034688 00000100:00100000:3.0:1746065222.800367:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264034688 00000100:00100000:3.0:1746065222.800384:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17825 00000100:00100000:3.0:1746065222.800389:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3762:x1830881264034688:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065222.800391:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746065222.800416:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+32:3761:x1830881264032512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1992us (3254us total) trans 17179874367 rc 0/0 00000100:00100000:2.0:1746065222.800421:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17809 00000100:00100000:3.0:1746065222.800445:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+32:3762:x1830881264034688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (101us total) trans 17179874370 rc 0/0 00000100:00100000:3.0:1746065222.800451:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17825 00000004:00080000:3.0:1746065222.800469:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a6d180/2, rc 0, transno 17179874370 00000100:00100000:3.0:1746065222.800471:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264034688:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1746065222.800508:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e0b expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.800515:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.800518:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065222.800521:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a45c lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e2e expref: 6 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.800527:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a45c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e2e expref: 6 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.800531:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a45c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e2e expref: 6 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.800535:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 26 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.800539:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 26 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.800542:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 26 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.800546:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.800549:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.800552:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.800567:0:7203:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 10 pid: 13395 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.800576:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264034816:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065222.800626:0:7203:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 26 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.800631:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264034944:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065222.800642:0:7203:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a45c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e2e expref: 6 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.800646:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264035072:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065222.800652:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929490c0 going to sleep for 11 seconds 00000004:00080000:0.0:1746065222.802664:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c45bb80/2, rc 0, transno 17179874367 00000100:00100000:0.0:1746065222.802674:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c45bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264032512:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065222.802807:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c459880/2, rc 0, transno 17179874366 00000100:00100000:0.0:1746065222.802811:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c459880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264032768:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065222.802823:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c528000/2, rc 0, transno 21474841746 00000100:00100000:0.0:1746065222.802826:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c528000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264033280:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065222.802833:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856c700/2, rc 0, transno 17179874368 00000100:00100000:0.0:1746065222.802835:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264033920:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065222.802842:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008c52b100/2, rc 0, transno 21474841747 00000100:00100000:0.0:1746065222.802844:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008c52b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264033792:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065222.802851:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012b4eb800/2, rc 0, transno 21474841748 00000100:00100000:0.0:1746065222.802853:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264034432:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065222.804944:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.805021:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6f800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264034816:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065222.805037:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264034944:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065222.805545:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.805599:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265508608 00000100:00100000:3.0:1746065222.805606:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265508608 00000100:00100000:0.0:1746065222.805652:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.806004:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265508736 00000100:00100000:3.0:1746065222.806008:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265508736 00000100:00100000:3.0:1746065222.806018:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265508864 00000100:00100000:3.0:1746065222.806020:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265508864 00000100:00100000:3.0:1746065222.806030:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5509 00000100:00100000:3.0:1746065222.806035:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2619:x1830881265508608:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:2.0:1746065222.806061:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5510 00000100:00100000:2.0:1746065222.806071:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2618:x1830881265508736:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:3.0:1746065222.806136:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2619:x1830881265508608:12345-192.168.202.27@tcp:49:cat.0 Request processed in 100us (1251us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.806142:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5509 00000100:00100000:3.0:1746065222.806153:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5511 00000100:00100000:3.0:1746065222.806158:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+7:2620:x1830881265508864:12345-192.168.202.27@tcp:49:lfs.0 00000100:00100000:2.0:1746065222.806158:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2618:x1830881265508736:12345-192.168.202.27@tcp:49:cat.0 Request processed in 90us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.806165:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5510 00000100:00100000:3.0:1746065222.806186:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+7:2620:x1830881265508864:12345-192.168.202.27@tcp:49:lfs.0 Request processed in 28us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.806191:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5511 00000100:00100000:3.0:1746065222.806216:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264035072:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065222.806247:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3a00/0xad6b7ddc147a432 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e0b expref: 10 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:3.0:1746065222.806266:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e0b expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.806279:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099cd3400, rc 0) 00000100:00100000:3.0:1746065222.806292:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2624:x1830881265507072:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 38158us (38267us total) trans 8589937173 rc 0/0 00000100:00100000:3.0:1746065222.806310:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14649 00000100:00100000:0.0:1746065222.823588:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.823650:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.823746:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265509120 00000100:00100000:1.0:1746065222.823758:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265509120 00000100:00100000:1.0:1746065222.823852:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17826 00000100:00100000:1.0:1746065222.823859:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2624:x1830881265509120:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065222.823875:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065222.823890:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e4a expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.823926:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc147a3ad lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d9b expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.823939:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a440 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e19 expref: 22 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.823945:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc147a416 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de8 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.823950:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.823951:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.823954:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [2060288->2097151] (req 2060288->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 9 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.823977:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc147a416 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de8 expref: 12 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.823987:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc147a416 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de8 expref: 12 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.823996:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264035200:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065222.824082:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a440 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e19 expref: 22 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065222.824084:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265508992 00010000:00010000:1.0:1746065222.824089:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a440 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e19 expref: 22 pid: 12258 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.824092:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265508992 00000100:00100000:1.0:1746065222.824095:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264035328:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065222.824115:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc147a3ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d9b expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.824121:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc147a3ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d9b expref: 9 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:1.0:1746065222.824127:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264035456:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065222.824131:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14653 00000100:00100000:3.0:1746065222.824137:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+7:2620:x1830881265508992:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:1.0:1746065222.824137:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929ad840 going to sleep for 11 seconds 00010000:00010000:3.0:1746065222.824152:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.824168:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc147a478 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e43 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.824258:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a47f lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.824272:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a47f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.824284:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a47f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065222.824324:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065222.824328:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065222.824344:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a47f lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.824366:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc147a478 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e43 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.824393:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a47f lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e43 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.824400:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.824403:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065222.824406:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a000, rc 0) 00000100:00100000:3.0:1746065222.825306:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2620:x1830881265508992:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1157us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.825314:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14653 00000100:00100000:0.0:1746065222.827093:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.830305:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265509376 00000100:00100000:2.0:1746065222.830323:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265509376 00002000:00100000:2.0:1746065222.830387:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880135138700 x1830881265509376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.830398:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138700 with x1830881265509376 ext(4194304->5038079) 00002000:00010000:2.0:1746065222.830405:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138700 00000100:00100000:2.0:1746065222.830445:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6377 00000100:00100000:2.0:1746065222.830451:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265509376:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065222.832249:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.832385:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.832479:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265509632 00000100:00100000:0.0:1746065222.832488:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265509632 00002000:00100000:0.0:1746065222.832531:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009acefb80 x1830881265509632/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065222.832542:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acefb80 with x1830881265509632 ext(2097152->4194303) 00002000:00010000:0.0:1746065222.832547:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acefb80 00000100:00100000:0.0:1746065222.832563:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265509888 00000100:00100000:0.0:1746065222.832565:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265509888 00002000:00100000:0.0:1746065222.832578:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_008: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091bc0e00 x1830881265509888/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065222.832585:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc0e00 with x1830881265509888 ext(3145728->4194303) 00002000:00010000:0.0:1746065222.832588:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc0e00 00000100:00100000:0.0:1746065222.832602:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6378 00000100:00100000:0.0:1746065222.832607:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265509632:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065222.834182:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6379 00000100:00100000:3.0:1746065222.834194:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265509888:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065222.841231:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.841240:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acee680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264035200:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065222.841257:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acef480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264035328:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.841262:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.841268:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acee300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264035456:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.841276:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065222.841321:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [2060288->2097151] (req 2060288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 11 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.841337:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065222.841341:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c400, rc 0) 00000100:00100000:2.0:1746065222.841355:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265510144 00000100:00100000:2.0:1746065222.841365:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265510144 00010000:00010000:2.0:1746065222.841401:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a440 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e19 expref: 23 pid: 12258 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.842113:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265510016 00000100:00100000:3.0:1746065222.842118:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265510016 00010000:00010000:3.0:1746065222.842136:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc147a416 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de8 expref: 13 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.842154:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265510272 00000100:00100000:3.0:1746065222.842157:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265510272 00010000:00010000:3.0:1746065222.842165:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc147a3ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d9b expref: 12 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.842180:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8330 00000100:00100000:3.0:1746065222.842186:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b5357c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881265510144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065222.842199:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065222.842219:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a440 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e19 expref: 23 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.842228:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a440 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e19 expref: 23 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.842250:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a440 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e19 expref: 23 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.842264:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065222.842284:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b5357c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881265510144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (1060us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.842290:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8330 00000100:00100000:3.0:1746065222.842349:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8331 00000100:00100000:3.0:1746065222.842354:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265510016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065222.842360:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065222.842366:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc147a416 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de8 expref: 13 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.842379:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc147a416 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de8 expref: 13 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.842389:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f00000/0xad6b7ddc147a416 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de8 expref: 13 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.842395:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065222.842407:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265510016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.842411:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8331 00000100:00100000:3.0:1746065222.842419:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8332 00000100:00100000:3.0:1746065222.842423:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265510272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065222.842427:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065222.842431:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc147a3ad lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d9b expref: 12 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.842439:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc147a3ad lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d9b expref: 12 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.842448:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdbe00/0xad6b7ddc147a3ad lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d9b expref: 12 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.842454:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.842456:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.842463:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 11 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.842470:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 11 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.842496:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 11 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.842506:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264035584:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065222.842549:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065222.842643:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265510400 00000100:00100000:2.0:1746065222.842647:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265510400 00000100:00100000:2.0:1746065222.842667:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17827 00000100:00100000:2.0:1746065222.842671:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265510400:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065222.842683:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.842692:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72000/0xad6b7ddc147a486 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e51 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.842717:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012b4e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264035712:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065222.842741:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.843339:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2624:x1830881265509120:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 19379us (19586us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.843348:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17826 00000100:00100000:3.0:1746065222.852188:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264035584:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065222.852215:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00010000:1.0:1746065222.852883:0:12258:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065221 -> 1746065222 00002000:00010000:1.0:1746065222.852892:0:12258:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065219 -> 1746065223 00002000:00010000:1.0:1746065222.852894:0:12258:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065221 -> 1746065222 00000100:00100000:1.0:1746065222.852912:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012b4e9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264035712:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065222.852941:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72000/0xad6b7ddc147a486 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e51 expref: 13 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.852954:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72000/0xad6b7ddc147a486 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e51 expref: 13 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.852974:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72000, rc 0) 00000100:00100000:1.0:1746065222.853009:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265510400:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 10336us (11745us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065222.853017:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17827 00000100:00100000:3.0:1746065222.853164:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265510272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10736us (11823us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.853175:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8332 00000100:00100000:2.0:1746065222.853324:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265509376:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22871us (26236us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065222.853332:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6377 00002000:00100000:2.0:1746065222.853341:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880135138700 x1830881265509376/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.853349:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135138700 with x1830881265509376 ext(4194304->5038079) 00002000:00010000:2.0:1746065222.853355:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135138700 00000100:00100000:0.0:1746065222.857349:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.859755:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.860021:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265510656 00000100:00100000:2.0:1746065222.860029:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265510656 00002000:00100000:2.0:1746065222.860067:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (2060288->2064383) req@ffff88013513ad80 x1830881265510656/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.860076:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513ad80 with x1830881265510656 ext(2060288->2064383) 00002000:00010000:2.0:1746065222.860082:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513ad80 00000100:00100000:2.0:1746065222.860098:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6380 00000100:00100000:2.0:1746065222.860104:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265510656:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065222.860203:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265510656:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 99us (457us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065222.860209:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6380 00002000:00100000:2.0:1746065222.860214:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (2060288->2064383) req@ffff88013513ad80 x1830881265510656/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/4536 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.860221:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513ad80 with x1830881265510656 ext(2060288->2064383) 00002000:00010000:2.0:1746065222.860223:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88013513ad80 00000100:00100000:3.0:1746065222.860285:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265510912 00000100:00100000:3.0:1746065222.860290:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265510912 00000100:00100000:3.0:1746065222.860357:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14654 00000100:00100000:3.0:1746065222.860363:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+27:2626:x1830881265510912:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065222.860374:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.860387:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc147a48d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e58 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.860444:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc147a494 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860455:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc147a494 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860464:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc147a494 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860474:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147a49b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860479:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147a49b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860483:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147a49b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860561:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147a4a2 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860569:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147a4a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860574:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147a4a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065222.860582:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065222.860640:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147a4a2 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860646:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147a4a2 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860651:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147a4a2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860656:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71ba00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065222.860659:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147a4a2 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860668:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147a4a2 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860676:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065222.860678:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065222.860682:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147a4a2 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860686:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147a4a2 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860715:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc147a494 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860719:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc147a494 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860724:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc147a494 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860728:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc147a494 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860732:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71be00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065222.860735:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc147a494 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860739:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc147a494 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860744:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065222.860746:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065222.860748:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc147a494 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860753:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71be00/0xad6b7ddc147a494 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860759:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147a49b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860763:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147a49b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860768:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147a49b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860788:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065222.860791:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147a49b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860796:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147a49b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860802:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800924c5b00) 00010000:00010000:3.0:1746065222.860803:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065222.860805:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147a49b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860810:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147a49b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065222.860838:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc147a48d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e58 expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.860845:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b000/0xad6b7ddc147a48d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e58 expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.860856:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b000, rc 0) 00000100:00100000:3.0:1746065222.860875:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2626:x1830881265510912:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 513us (3536us total) trans 8589937174 rc 301/301 00000100:00100000:3.0:1746065222.860881:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14654 00000100:00100000:2.0:1746065222.865519:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acefb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265509632:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 32904us (33277us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065222.865529:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6378 00002000:00100000:2.0:1746065222.865539:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009acefb80 x1830881265509632/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.865547:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009acefb80 with x1830881265509632 ext(2097152->4194303) 00002000:00010000:2.0:1746065222.865551:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009acefb80 00000100:00100000:2.0:1746065222.866145:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.866309:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.866327:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265511040 00000100:00100000:0.0:1746065222.866332:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265511040 00000100:00100000:0.0:1746065222.866355:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265511168 00000100:00100000:0.0:1746065222.866357:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265511168 00000100:00100000:0.0:1746065222.866368:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17828 00000100:00100000:0.0:1746065222.866373:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265511040:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065222.866388:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065222.866401:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a4b0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e5f expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.866441:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264035840:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065222.866496:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.866512:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17829 00000100:00100000:0.0:1746065222.866517:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881265511168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065222.866523:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065222.866529:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880098c1ba00/0xad6b7ddc147a4b7 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e66 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.866547:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264035968:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065222.866565:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065222.866827:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265509888:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 32636us (34440us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065222.866834:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6379 00002000:00100000:3.0:1746065222.866841:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880091bc0e00 x1830881265509888/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.866849:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc0e00 with x1830881265509888 ext(3145728->4194303) 00002000:00010000:3.0:1746065222.866852:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc0e00 00000100:00100000:0.0:1746065222.868310:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:2.0:1746065222.868380:0:9548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065222 -> 1746065223 00002000:00010000:2.0:1746065222.868384:0:9548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065222 -> 1746065223 00000100:00100000:2.0:1746065222.868397:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264035840:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065222.868418:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a4b0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e5f expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.868428:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ac00/0xad6b7ddc147a4b0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e5f expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.868456:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ac00, rc 0) 00000100:00100000:2.0:1746065222.868483:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265511040:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2109us (2339us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065222.868489:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17828 00000100:00100000:2.0:1746065222.868506:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265511296 00000100:00100000:2.0:1746065222.868509:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265511296 00000100:00100000:2.0:1746065222.868530:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17830 00000100:00100000:2.0:1746065222.868536:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2624:x1830881265511296:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065222.868545:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.868554:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e6d expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.868573:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc147a39f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da2 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.868581:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880098c1aa00/0xad6b7ddc147a447 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e20 expref: 23 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.868587:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147a408 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939def expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.868593:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.868594:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.868598:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->1392639] (req 1048576->1392639) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 9 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.868617:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147a408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939def expref: 11 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.868626:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147a408 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939def expref: 11 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.868634:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264036096:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.868681:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880098c1aa00/0xad6b7ddc147a447 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e20 expref: 23 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.868688:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880098c1aa00/0xad6b7ddc147a447 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e20 expref: 23 pid: 12260 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.868695:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264036224:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.868716:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc147a39f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da2 expref: 9 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.868722:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc147a39f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da2 expref: 9 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.868728:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264036352:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.868739:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065222.868916:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264035968:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065222.868930:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880098c1ba00/0xad6b7ddc147a4b7 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e66 expref: 23 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.868939:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1ba00/0xad6b7ddc147a4b7 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e66 expref: 23 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065222.868950:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ba00, rc 0) 00000100:00100000:1.0:1746065222.868970:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881265511168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2453us (2661us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065222.868975:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17829 00000100:00100000:2.0:1746065222.876062:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264036224:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.876150:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.876216:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264036352:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065222.876289:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.876395:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.876673:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265511424 00000100:00100000:3.0:1746065222.876679:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265511424 00010000:00010000:3.0:1746065222.876708:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880098c1aa00/0xad6b7ddc147a447 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e20 expref: 22 pid: 12260 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.876729:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265511552 00000100:00100000:3.0:1746065222.876731:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265511552 00010000:00010000:3.0:1746065222.876740:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc147a39f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da2 expref: 10 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.876752:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8333 00000100:00100000:3.0:1746065222.876758:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881265511424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065222.876768:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065222.876810:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880098c1aa00/0xad6b7ddc147a447 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e20 expref: 22 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.876819:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880098c1aa00/0xad6b7ddc147a447 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e20 expref: 22 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.876838:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880098c1aa00/0xad6b7ddc147a447 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e20 expref: 22 pid: 12260 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.876859:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065222.876895:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265511424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 136us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.876901:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8333 00000100:00100000:3.0:1746065222.876914:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8334 00000100:00100000:3.0:1746065222.876919:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265511552:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065222.876926:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065222.876932:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc147a39f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da2 expref: 10 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.876939:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc147a39f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da2 expref: 10 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.876950:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fda800/0xad6b7ddc147a39f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da2 expref: 10 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.876957:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065222.876971:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265511552:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.876977:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8334 00000100:00100000:0.0:1746065222.877343:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265511680 00000100:00100000:0.0:1746065222.877347:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265511680 00000100:00100000:0.0:1746065222.877376:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17831 00000100:00100000:0.0:1746065222.877381:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265511680:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065222.877392:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065222.877400:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84b000/0xad6b7ddc147a4c5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e74 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.877434:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264036480:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065222.877488:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065222.877808:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d06300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264036096:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.877828:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->1392639] (req 1048576->1392639) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 8 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.877837:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73600, rc 0) 00000100:00100000:2.0:1746065222.877870:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2624:x1830881265511296:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9333us (9572us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.877874:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17830 00000100:00100000:0.0:1746065222.879398:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.880275:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.880350:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265511808 00000100:00100000:2.0:1746065222.880356:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265511808 00000100:00100000:2.0:1746065222.880386:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17832 00000100:00100000:2.0:1746065222.880391:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265511808:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065222.880404:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.880415:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147a4cc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e7b expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.880432:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.880439:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147a4cc lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e7b expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.880447:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73e00/0xad6b7ddc147a4cc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e7b expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065222.880508:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.880540:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265511936 00000100:00100000:3.0:1746065222.880544:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265511936 00010000:00010000:3.0:1746065222.880559:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147a408 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939def expref: 12 pid: 10219 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.880575:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8335 00000100:00100000:3.0:1746065222.880580:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265511936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065222.880587:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065222.880601:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147a408 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939def expref: 12 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.880610:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147a408 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939def expref: 12 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.880623:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147a408 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939def expref: 12 pid: 10219 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.880630:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.880632:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.880637:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 7 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.880643:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 7 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.880665:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 7 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.880675:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881264036608:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065222.880732:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065222.883436:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.883466:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.883484:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.883495:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.883599:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265512576 00000100:00100000:0.0:1746065222.883605:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265512576 00000100:00100000:0.0:1746065222.883637:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17833 00000100:00100000:0.0:1746065222.883643:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265512576:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065222.883656:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065222.883667:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc147a4d3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e82 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.883707:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264036736:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065222.883761:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.883815:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264036480:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065222.883833:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b000/0xad6b7ddc147a4c5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e74 expref: 23 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065222.883845:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b000/0xad6b7ddc147a4c5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e74 expref: 23 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065222.883857:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b000, rc 0) 00000100:00100000:0.0:1746065222.883877:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881265511680:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6495us (7481us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065222.883882:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17831 00000100:00100000:0.0:1746065222.883902:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265512320 00000100:00100000:0.0:1746065222.883905:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265512320 00000100:00100000:0.0:1746065222.883924:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265512448 00000100:00100000:0.0:1746065222.883926:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265512448 00000100:00100000:0.0:1746065222.883937:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265512832 00000100:00100000:0.0:1746065222.883938:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265512832 00000100:00100000:0.0:1746065222.883947:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265513088 00000100:00100000:0.0:1746065222.883949:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265513088 00000100:00100000:0.0:1746065222.883959:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6381 00000100:00100000:0.0:1746065222.883964:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265512320:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065222.883979:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 3/1,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.883990:0:13377:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 9 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.883996:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065222.883997:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065222.884000:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 4/1,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.884020:0:13377:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 9 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.884029:0:13377:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 9 pid: 9548 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746065222.884037:0:13377:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:13377:1830881264036864:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065222.884064:0:13377:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065222.884077:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6382 00000100:00100000:0.0:1746065222.884082:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265512448:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065222.884096:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7400/0xad6b7ddc147a4e1 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.884102:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.884103:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.884106:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7400/0xad6b7ddc147a4e1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.884115:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800985b7400/0xad6b7ddc147a4e1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.884643:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6383 00000100:00100000:0.0:1746065222.884648:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265512832:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065222.884660:0:29488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.884672:0:29488:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 9 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.884676:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065222.884678:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065222.884679:0:29488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.884691:0:29488:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 9 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.884697:0:29488:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 9 pid: 9548 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746065222.884704:0:29488:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:29488:1830881264036992:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065222.884719:0:29488:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065222.886174:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6384 00000100:00100000:3.0:1746065222.886185:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265513088:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:3.0:1746065222.886207:0:9554:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc147a4ef lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.886216:0:9554:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.886218:0:9554:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.886221:0:9554:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc147a4ef lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.886230:0:9554:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc147a4ef lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.887765:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73e00, rc 0) 00000100:00100000:2.0:1746065222.887822:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+21:2007:x1830881265511808:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7427us (8423us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065222.887830:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17832 00000100:00100000:2.0:1746065222.891880:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.891921:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.891941:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265513344 00000100:00100000:2.0:1746065222.891948:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265513344 00000100:00100000:2.0:1746065222.892865:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265513600 00000100:00100000:2.0:1746065222.892869:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265513600 00000100:00100000:3.0:1746065222.892950:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6385 00000100:00100000:3.0:1746065222.892960:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265513344:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:3.0:1746065222.892990:0:29491:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.893002:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.893004:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.893009:0:29491:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.893018:0:29491:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.893506:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6386 00000100:00100000:2.0:1746065222.893513:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265513600:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065222.893530:0:29492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc147a4fd lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.893537:0:29492:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.893539:0:29492:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.893542:0:29492:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc147a4fd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.893550:0:29492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc147a4fd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.898035:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065222.898123:0:13378:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800985b7400/0xad6b7ddc147a4e1 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.898135:0:13378:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800985b7400/0xad6b7ddc147a4e1 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.898142:0:13378:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800985b7400/0xad6b7ddc147a4e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.898147:0:13378:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b7400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065222.898151:0:13378:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b7400/0xad6b7ddc147a4e1 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.898157:0:13378:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800985b7400/0xad6b7ddc147a4e1 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.898171:0:13378:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800985b7400/0xad6b7ddc147a4e1 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.898176:0:13378:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800985b7400/0xad6b7ddc147a4e1 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.898221:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265512448:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 14137us (14789us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065222.898230:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6382 00000100:00100000:0.0:1746065222.898249:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265513856 00000100:00100000:0.0:1746065222.898254:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265513856 00000100:00100000:0.0:1746065222.898286:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6387 00000100:00100000:0.0:1746065222.898292:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265513856:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065222.898323:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc147a504 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.898332:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.898333:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.898338:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc147a504 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.898346:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc147a504 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.900270:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881264036608:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065222.900288:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065222.900328:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+15:2006:x1830881265511936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 19746us (20053us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.900337:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8335 00000100:00100000:0.0:1746065222.907677:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.909562:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265514112 00000100:00100000:1.0:1746065222.909573:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265514112 00000100:00100000:1.0:1746065222.909635:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6388 00000100:00100000:1.0:1746065222.909643:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265514112:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065222.909675:0:29490:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc147a50b lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.909687:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.909688:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065222.909693:0:29490:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc147a50b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.909704:0:29490:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc147a50b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065222.917210:0:12260:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065222 -> 1746065223 00002000:00010000:2.0:1746065222.917216:0:12260:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065222 -> 1746065223 00002000:00010000:2.0:1746065222.917218:0:12260:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065222 -> 1746065223 00000100:00100000:2.0:1746065222.917236:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264036736:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065222.917263:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc147a4d3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e82 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.917275:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b400/0xad6b7ddc147a4d3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e82 expref: 9 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065222.917400:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.917417:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.917433:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265514624 00000100:00100000:1.0:1746065222.917438:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265514624 00000100:00100000:1.0:1746065222.917470:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5512 00000100:00100000:1.0:1746065222.917476:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2619:x1830881265514624:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065222.917641:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2619:x1830881265514624:12345-192.168.202.27@tcp:35:cat.0 Request processed in 164us (222us total) trans 8589937175 rc 0/0 00000100:00100000:1.0:1746065222.917647:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5512 00000100:00100000:1.0:1746065222.917676:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.917717:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.917890:0:13377:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_010:lustre-OST0000_UUID:13377:1830881264036864:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065222.917902:0:13377:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 3/1,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.917919:0:29488:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_004:lustre-OST0000_UUID:29488:1830881264036992:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065222.917927:0:29488:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.918405:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b400, rc 0) 00000100:00100000:2.0:1746065222.918432:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2004:x1830881265512576:12345-192.168.202.27@tcp:101:cat.0 Request processed in 34788us (34964us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065222.918438:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17833 00000100:00100000:2.0:1746065222.918454:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265514368 00000100:00100000:2.0:1746065222.918457:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265514368 00000100:00100000:2.0:1746065222.918477:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17834 00000100:00100000:2.0:1746065222.918481:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2626:x1830881265514368:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065222.918490:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.918501:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e89 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.918518:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047800/0xad6b7ddc147a3b4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da9 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.918525:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc147a401 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dfd expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.918531:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a3c2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dbe expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.918536:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 2/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.918541:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065222.918543:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065222.918546:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 7/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.918558:0:12260:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.918576:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a3c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dbe expref: 30 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.918584:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a3c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dbe expref: 30 pid: 1880 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.918596:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264037120:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.918643:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc147a401 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dfd expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.918651:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc147a401 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dfd expref: 16 pid: 3068 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.918658:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264037248:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065222.918679:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131047800/0xad6b7ddc147a3b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da9 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.918685:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131047800/0xad6b7ddc147a3b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da9 expref: 9 pid: 12258 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.918692:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264037376:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065222.918705:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065222.919441:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265514240 00000100:00100000:1.0:1746065222.919446:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265514240 00002000:00100000:1.0:1746065222.919469:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (2060288->2097151) req@ffff880092745f80 x1830881265514240/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.919477:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745f80 with x1830881265514240 ext(2060288->2097151) 00010000:00010000:1.0:1746065222.919483:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 8 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.919491:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 8 pid: 9548 timeout: 918 lvb_type: 0 00002000:00010000:1.0:1746065222.919496:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092745f80 00000100:00100000:1.0:1746065222.919507:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265514880 00000100:00100000:1.0:1746065222.919509:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265514880 00002000:00100000:1.0:1746065222.919519:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1388544->1392639) req@ffff880092746300 x1830881265514880/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.919525:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746300 with x1830881265514880 ext(1388544->1392639) 00010000:00010000:1.0:1746065222.919530:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 9 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.919536:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 9 pid: 9548 timeout: 918 lvb_type: 0 00002000:00010000:1.0:1746065222.919541:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092746300 00000100:00100000:1.0:1746065222.919551:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2101 00000100:00100000:1.0:1746065222.919556:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2006:x1830881265514240:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065222.919679:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2102 00000100:00100000:3.0:1746065222.919686:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265514880:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065222.919762:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265514880:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 77us (2044us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065222.919767:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2102 00002000:00100000:3.0:1746065222.919792:0:29489:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_005: refresh rw locks for [0x280000401:0x95:0x0] (1388544->1392639) req@ffff880092746300 x1830881265514880/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/4536 e 0 to 0 dl 1746065233 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065222.919799:0:29489:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092746300 with x1830881265514880 ext(1388544->1392639) 00010000:00010000:3.0:1746065222.919804:0:29489:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 10 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:3.0:1746065222.919811:0:29489:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 10 pid: 9548 timeout: 918 lvb_type: 0 00002000:00010000:3.0:1746065222.919817:0:29489:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092746300 00010000:00010000:0.0:1746065222.920669:0:13378:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc147a504 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.920678:0:13378:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc147a504 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.920685:0:13378:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc147a504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.920689:0:13378:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065222.920692:0:13378:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc147a504 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.920698:0:13378:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc147a504 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.920712:0:13378:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc147a504 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.920717:0:13378:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46200/0xad6b7ddc147a504 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921008:0:9554:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc147a4ef lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921016:0:9554:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc147a4ef lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921022:0:9554:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc147a4ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921031:0:9554:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71b200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065222.921034:0:9554:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc147a4ef lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921039:0:9554:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc147a4ef lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921048:0:9554:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc147a4ef lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921053:0:9554:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71b200/0xad6b7ddc147a4ef lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.921097:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265513088:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 34915us (37600us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065222.921103:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6384 00010000:00010000:2.0:1746065222.921144:0:29492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc147a4fd lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921150:0:29492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc147a4fd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921155:0:29492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc147a4fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921160:0:29492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f72400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065222.921162:0:29492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc147a4fd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921168:0:29492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc147a4fd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921176:0:29492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc147a4fd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.921180:0:29492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72400/0xad6b7ddc147a4fd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.921201:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265513600:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 27689us (29279us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065222.921206:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6386 00000100:00100000:0.0:1746065222.921507:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265513856:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 23213us (23478us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065222.921514:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6387 00000100:00100000:2.0:1746065222.931853:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264037376:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.932037:0:29491:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.932047:0:29491:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000020 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.932054:0:29491:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.932060:0:29491:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71aa00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065222.932063:0:29491:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000020 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.932069:0:29491:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000020 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.932084:0:29491:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.932089:0:29491:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a4f6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000020 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065222.932138:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265513344:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 39179us (40263us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065222.932145:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6385 00000100:00100000:1.0:1746065222.932312:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265514240:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 12739us (14619us total) trans 21474841749 rc 0/0 00000100:00100000:1.0:1746065222.932319:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2101 00002000:00100000:1.0:1746065222.932327:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x94:0x0] (2060288->2097151) req@ffff880092745f80 x1830881265514240/t21474841749(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/448 e 0 to 0 dl 1746065233 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.932341:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745f80 with x1830881265514240 ext(2060288->2097151) 00010000:00010000:1.0:1746065222.933400:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 10 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.933415:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 10 pid: 9548 timeout: 918 lvb_type: 0 00002000:00010000:1.0:1746065222.933422:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092745f80 00000100:00100000:0.0:1746065222.934254:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065222.934994:0:29490:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc147a50b lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.935003:0:29490:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc147a50b lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.935009:0:29490:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc147a50b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.935014:0:29490:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683a800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065222.935018:0:29490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc147a50b lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.935024:0:29490:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc147a50b lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.935037:0:29490:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc147a50b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.935047:0:29490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683a800/0xad6b7ddc147a50b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.935099:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265514112:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 25455us (27429us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065222.935107:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6388 00000100:00100000:3.0:1746065222.935176:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265515008 00000100:00100000:3.0:1746065222.935182:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265515008 00010000:00010000:3.0:1746065222.935210:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131047800/0xad6b7ddc147a3b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da9 expref: 10 pid: 12258 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.935228:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8336 00000100:00100000:3.0:1746065222.935233:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265515008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065222.935244:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065222.935252:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264037120:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.935257:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131047800/0xad6b7ddc147a3b4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da9 expref: 10 pid: 12258 timeout: 918 lvb_type: 1 00000100:00100000:2.0:1746065222.935263:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264037248:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065222.935265:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131047800/0xad6b7ddc147a3b4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da9 expref: 10 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.935280:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047800/0xad6b7ddc147a3b4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939da9 expref: 10 pid: 12258 timeout: 918 lvb_type: 1 00010000:00010000:2.0:1746065222.935285:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.935289:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065222.935305:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091bae600, rc 0) 00000100:00100000:3.0:1746065222.935318:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265515008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.935324:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8336 00000100:00100000:2.0:1746065222.935324:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2626:x1830881265514368:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 16842us (17925us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.935331:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17834 00000100:00100000:0.0:1746065222.936109:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.936168:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.936224:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265515136 00000100:00100000:3.0:1746065222.936227:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265515136 00010000:00010000:3.0:1746065222.936242:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc147a401 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dfd expref: 11 pid: 3068 timeout: 918 lvb_type: 1 00000100:00100000:3.0:1746065222.936257:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265515264 00000100:00100000:3.0:1746065222.936258:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265515264 00010000:00010000:3.0:1746065222.936266:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 10 pid: 9548 timeout: 918 lvb_type: 0 00000100:00100000:3.0:1746065222.936277:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8337 00000100:00100000:3.0:1746065222.936281:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2006:x1830881265515136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065222.936288:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065222.936307:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc147a401 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dfd expref: 11 pid: 3068 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.936314:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc147a401 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dfd expref: 11 pid: 3068 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.936326:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131047000/0xad6b7ddc147a401 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dfd expref: 11 pid: 3068 timeout: 918 lvb_type: 1 00010000:00010000:3.0:1746065222.936334:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065222.936361:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2006:x1830881265515136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 79us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.936366:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8337 00000100:00100000:3.0:1746065222.936394:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8338 00000100:00100000:3.0:1746065222.936399:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265515264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065222.936404:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065222.936412:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 10 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:3.0:1746065222.936419:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 10 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:3.0:1746065222.936430:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009835c400/0xad6b7ddc147a471 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2060288->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e4a expref: 10 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:3.0:1746065222.936438:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.936440:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.936444:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.936451:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.936465:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065222.936476:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265515264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 77us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.936481:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8338 00010000:00010000:0.0:1746065222.936930:0:13377:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.936938:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.937593:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.938394:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.938471:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265515520 00000100:00100000:3.0:1746065222.938476:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265515520 00000100:00100000:3.0:1746065222.938500:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17835 00000100:00100000:3.0:1746065222.938505:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2618:x1830881265515520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065222.938516:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065222.938527:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a519 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e90 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.938541:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.938543:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065222.938548:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a519 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2818048->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e90 expref: 10 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.938558:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a519 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2818048->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e90 expref: 10 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065222.938565:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71aa00, rc 0) 00000100:00100000:3.0:1746065222.938586:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2618:x1830881265515520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 81us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065222.938593:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17835 00000100:00100000:0.0:1746065222.940397:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265515392 00000100:00100000:0.0:1746065222.940406:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265515392 00010000:00010000:0.0:1746065222.940432:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a3c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dbe expref: 30 pid: 1880 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746065222.940514:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8339 00000100:00100000:0.0:1746065222.940521:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265515392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.940530:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.940546:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a3c2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dbe expref: 30 pid: 1880 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.940560:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a3c2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dbe expref: 30 pid: 1880 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.940577:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099524000/0xad6b7ddc147a3c2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939dbe expref: 30 pid: 1880 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.941161:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.941164:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.941169:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.941177:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.941203:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 29 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.941213:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264037504:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065222.942401:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065222.942471:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264037632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1746065222.942503:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065222.943578:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264037632 00000100:00100000:0.0:1746065222.943584:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264037632 00000100:00100000:0.0:1746065222.943634:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:0.0:1746065222.943641:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881264037632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1746065222.943658:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 61440 granted 1066280384 pending 434176 free 3910598656 avail 3674996736 00000100:00080000:2.0:1746065222.943738:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1746065222.943829:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.944000:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265515904 00000100:00100000:2.0:1746065222.944004:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265515904 00000100:00100000:2.0:1746065222.944026:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5513 00000100:00100000:2.0:1746065222.944030:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2624:x1830881265515904:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065222.944170:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2624:x1830881265515904:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 138us (342us total) trans 8589937176 rc 0/0 00000100:00100000:2.0:1746065222.944176:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5513 00000100:00100000:0.0:1746065222.944613:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881264037632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 972us (2109us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.944622:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:3.0:1746065222.944756:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264037632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1746065222.946249:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.946759:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265516032 00000100:00100000:1.0:1746065222.946764:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265516032 00002000:00100000:1.0:1746065222.946812:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1392639) req@ffff88013513b100 x1830881265516032/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.946819:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b100 with x1830881265516032 ext(1048576->1392639) 00010000:00010000:1.0:1746065222.946827:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 9 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.946838:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 9 pid: 9548 timeout: 918 lvb_type: 0 00002000:00010000:1.0:1746065222.946844:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013513b100 00000100:00100000:1.0:1746065222.946860:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2103 00000100:00100000:1.0:1746065222.946865:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265516032:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:0.0:1746065222.947328:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.947337:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.947344:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.947349:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84ae00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065222.947352:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.947358:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.947372:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.947378:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ae00/0xad6b7ddc147a4da lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065222.947509:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265512320:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 63543us (66999us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065222.947516:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6381 00000100:00100000:2.0:1746065222.951861:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264037504:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065222.951879:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065222.953190:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265515392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 12665us (14792us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.953199:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8339 00000100:00100000:3.0:1746065222.953359:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065222.953793:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.953855:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265516416 00000100:00100000:1.0:1746065222.953861:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265516416 00002000:00100000:1.0:1746065222.953891:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2572288->2576383) req@ffff880099cf3800 x1830881265516416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.953905:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3800 with x1830881265516416 ext(2572288->2576383) 00002000:00010000:1.0:1746065222.953909:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf3800 00000100:00100000:1.0:1746065222.953922:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265516544 00000100:00100000:1.0:1746065222.953924:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265516544 00002000:00100000:1.0:1746065222.953935:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880099cf2a00 x1830881265516544/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.953941:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2a00 with x1830881265516544 ext(4194304->5038079) 00002000:00010000:1.0:1746065222.953944:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf2a00 00000100:00100000:1.0:1746065222.953954:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6389 00000100:00100000:1.0:1746065222.953960:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265516416:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065222.954060:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265516416:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 99us (701us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065222.954065:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6389 00002000:00100000:1.0:1746065222.954069:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2572288->2576383) req@ffff880099cf3800 x1830881265516416/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/4536 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.954075:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf3800 with x1830881265516416 ext(2572288->2576383) 00002000:00010000:1.0:1746065222.954077:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf3800 00000100:00100000:1.0:1746065222.954088:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6390 00000100:00100000:1.0:1746065222.954092:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265516544:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065222.961873:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.961950:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265516800 00000100:00100000:2.0:1746065222.961958:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265516800 00002000:00100000:2.0:1746065222.961992:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2813952->2818047) req@ffff88011dad7100 x1830881265516800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/0 e 0 to 0 dl 1746065233 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.962000:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad7100 with x1830881265516800 ext(2813952->2818047) 00002000:00010000:2.0:1746065222.962004:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad7100 00000100:00100000:2.0:1746065222.962023:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6391 00000100:00100000:2.0:1746065222.962029:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265516800:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065222.962131:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265516800:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 101us (265us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065222.962137:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6391 00002000:00100000:2.0:1746065222.962142:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (2813952->2818047) req@ffff88011dad7100 x1830881265516800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:138/0 lens 488/4536 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065222.962148:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad7100 with x1830881265516800 ext(2813952->2818047) 00002000:00010000:2.0:1746065222.962151:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad7100 00000100:00100000:1.0:1746065222.965108:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265516544:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11008us (11308us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746065222.965117:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6390 00002000:00100000:1.0:1746065222.965126:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880099cf2a00 x1830881265516544/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/440 e 0 to 0 dl 1746065233 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.965135:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2a00 with x1830881265516544 ext(4194304->5038079) 00002000:00010000:1.0:1746065222.965139:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099cf2a00 00000100:00100000:0.0:1746065222.968447:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.968671:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265516032:12345-192.168.202.27@tcp:4:cat.0 Request processed in 21804us (22424us total) trans 21474841750 rc 0/0 00000100:00100000:1.0:1746065222.968681:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2103 00002000:00100000:1.0:1746065222.968690:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1392639) req@ffff88013513b100 x1830881265516032/t21474841750(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:138/0 lens 488/448 e 0 to 0 dl 1746065233 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065222.968698:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b100 with x1830881265516032 ext(1048576->1392639) 00010000:00010000:1.0:1746065222.968707:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 11 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:1.0:1746065222.968720:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 11 pid: 9548 timeout: 918 lvb_type: 0 00002000:00010000:1.0:1746065222.968726:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013513b100 00000100:00100000:2.0:1746065222.968797:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265517056 00000100:00100000:2.0:1746065222.968804:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265517056 00000100:00100000:2.0:1746065222.968848:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5514 00000100:00100000:2.0:1746065222.968854:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2626:x1830881265517056:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065222.968985:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2626:x1830881265517056:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 131us (545us total) trans 8589937177 rc 0/0 00000100:00100000:2.0:1746065222.968991:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5514 00000100:00100000:0.0:1746065222.975732:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.975934:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065222.975972:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.977316:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.977354:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265517184 00000100:00100000:2.0:1746065222.977362:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265517184 00000100:00100000:2.0:1746065222.977376:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265517440 00000100:00100000:2.0:1746065222.977378:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265517440 00000100:00100000:2.0:1746065222.977407:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265517312 00000100:00100000:2.0:1746065222.977409:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265517312 00000100:00100000:2.0:1746065222.977424:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17836 00000100:00100000:2.0:1746065222.977430:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265517440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065222.977447:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.977461:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a520 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ea5 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.977488:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a520 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ea5 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.977497:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0600/0xad6b7ddc147a520 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ea5 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.977509:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0600, rc 0) 00000100:00100000:2.0:1746065222.977549:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265517440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 119us (1615us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065222.977555:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17836 00000100:00100000:2.0:1746065222.977568:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17837 00000100:00100000:2.0:1746065222.977572:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265517312:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065222.977579:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.977587:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c1c00/0xad6b7ddc147a527 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e9e expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065222.977624:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264037760:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065222.977670:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065222.977701:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17838 00000100:00100000:2.0:1746065222.977706:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265517184:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065222.977712:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.977720:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc147a52e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939e97 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065222.977736:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d747, atime: 0x6812d743, ctime: 0x6812d747, blocks: 0x800 00010000:00010000:2.0:1746065222.977744:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.977746:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.977753:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc147a52e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e97 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.977769:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc147a52e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e97 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.977796:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1400, rc 0) 00000100:00100000:2.0:1746065222.977812:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265517184:12345-192.168.202.27@tcp:101:cat.0 Request processed in 106us (2088us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.977816:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17838 00000100:00100000:0.0:1746065222.978122:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265517568 00000100:00100000:0.0:1746065222.978126:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265517568 00010000:00010000:0.0:1746065222.978142:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 14 pid: 9548 timeout: 918 lvb_type: 0 00000100:00100000:0.0:1746065222.978425:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8340 00000100:00100000:0.0:1746065222.978431:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265517568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065222.978438:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065222.978447:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 14 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.978456:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 14 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:0.0:1746065222.978468:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.978469:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065222.978472:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.978478:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065222.978500:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065222.978517:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265517568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (1203us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065222.978525:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8340 00010000:00010000:1.0:1746065222.978611:0:29488:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.978617:0:29488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.983808:0:12258:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff880097d04380 x1830881264037760) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 13 pid: 9548 timeout: 918 lvb_type: 0 00010000:00010000:2.0:1746065222.983838:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73600/0xad6b7ddc147a4be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1392639) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e6d expref: 13 pid: 9548 timeout: 918 lvb_type: 0 00000100:00100000:2.0:1746065222.983854:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264037760:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065222.983880:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1c00/0xad6b7ddc147a527 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e9e expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.983891:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1c00/0xad6b7ddc147a527 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e9e expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.983898:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1c00, rc 0) 00000100:00100000:2.0:1746065222.985139:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265517312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7560us (9160us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065222.985148:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17837 00010000:00010000:1.0:1746065222.987225:0:29488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.987243:0:29488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.987249:0:29488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.987255:0:29488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800985b6200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065222.987258:0:29488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.987265:0:29488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.987281:0:29488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065222.987286:0:29488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800985b6200/0xad6b7ddc147a4e8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065222.987368:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265512832:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 102717us (103879us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065222.987375:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6383 00000100:00100000:1.0:1746065222.990562:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065222.990589:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.990642:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265517824 00000100:00100000:2.0:1746065222.990649:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265517824 00000100:00100000:2.0:1746065222.990676:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265517696 00000100:00100000:2.0:1746065222.990678:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265517696 00000100:00100000:2.0:1746065222.990693:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17839 00000100:00100000:2.0:1746065222.990698:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265517824:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065222.990712:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.990726:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c1c00/0xad6b7ddc147a535 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939eb3 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.990750:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1c00/0xad6b7ddc147a535 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eb3 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.990759:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1c00/0xad6b7ddc147a535 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eb3 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.990769:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1c00, rc 0) 00000100:00100000:2.0:1746065222.990819:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265517824:12345-192.168.202.27@tcp:101:cat.0 Request processed in 120us (264us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065222.990825:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17839 00000100:00100000:2.0:1746065222.990837:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17840 00000100:00100000:2.0:1746065222.990842:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265517696:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065222.990848:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065222.990858:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc147a53c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939eac expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065222.990874:0:12258:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d747, atime: 0x6812d747, ctime: 0x6812d747, blocks: 0x808 00010000:00010000:2.0:1746065222.990883:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.990885:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065222.990891:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc147a53c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eac expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.990903:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc147a53c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eac expref: 12 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065222.990910:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0c00, rc 0) 00000100:00100000:2.0:1746065222.990924:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265517696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 82us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065222.990929:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17840 00000100:00100000:0.0:1746065222.995263:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065222.995453:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265518080 00000100:00100000:2.0:1746065222.995461:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265518080 00000100:00100000:2.0:1746065222.995508:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14655 00000100:00100000:2.0:1746065222.995516:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2620:x1830881265518080:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065222.995557:0:7231:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065222.995582:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a47f lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e43 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065222.995595:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.995599:0:7231:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065222.995634:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.995644:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.995652:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00010000:2.0:1746065222.995730:0:7231:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88011dad6a00 reply state ffff88009a903000 transno 8589937178 ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.995738:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065222.995742:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065222.995743:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065222.995745:0:7231:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065222.996958:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2620:x1830881265518080:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 1440us (1700us total) trans 8589937178 rc 0/0 00000100:00100000:2.0:1746065222.996964:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14655 00000100:00100000:0.0:1746065223.002919:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.003006:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.003804:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265518464 00000100:00100000:1.0:1746065223.003812:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265518464 00000100:00100000:1.0:1746065223.003854:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17841 00000100:00100000:1.0:1746065223.003863:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2620:x1830881265518464:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065223.003878:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.003893:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939eba expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.003916:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc147a398 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d94 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.003923:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc147a455 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e12 expref: 28 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.003929:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a40f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de1 expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.003934:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.003936:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.003939:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.003961:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a40f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de1 expref: 11 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.003971:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a40f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de1 expref: 11 pid: 9550 timeout: 919 lvb_type: 1 00000100:00100000:1.0:1746065223.003980:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264037888:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.004053:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc147a455 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e12 expref: 28 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.004061:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc147a455 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e12 expref: 28 pid: 9550 timeout: 919 lvb_type: 1 00000100:00100000:1.0:1746065223.004068:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264038016:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.004092:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc147a398 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d94 expref: 9 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.004099:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc147a398 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d94 expref: 9 pid: 9550 timeout: 919 lvb_type: 1 00000100:00100000:1.0:1746065223.004105:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264038144:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.004119:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809480 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.004305:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265518336 00000100:00100000:2.0:1746065223.004309:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265518336 00000100:00100000:2.0:1746065223.004332:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5515 00000100:00100000:2.0:1746065223.004337:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2618:x1830881265518336:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065223.004461:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2618:x1830881265518336:12345-192.168.202.27@tcp:35:cat.0 Request processed in 123us (1549us total) trans 8589937179 rc 0/0 00000100:00100000:2.0:1746065223.004467:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5515 00000100:00080000:3.0:1746065223.005153:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1746065223.005157:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065223.012226:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.012243:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264037888:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.012254:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264038016:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.012255:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.012262:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264038144:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.012274:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065223.012288:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.012307:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265518720 00010000:00010000:1.0:1746065223.012311:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2000, rc 0) 00000100:00100000:2.0:1746065223.012312:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265518720 00010000:00010000:2.0:1746065223.012340:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc147a455 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e12 expref: 29 pid: 9550 timeout: 919 lvb_type: 1 00000100:00100000:1.0:1746065223.012350:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2620:x1830881265518464:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8487us (9343us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.012357:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265518592 00000100:00100000:1.0:1746065223.012358:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17841 00000100:00100000:2.0:1746065223.012359:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265518592 00010000:00010000:2.0:1746065223.012368:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a40f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de1 expref: 12 pid: 9550 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.012377:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265518848 00000100:00100000:2.0:1746065223.012379:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265518848 00010000:00010000:2.0:1746065223.012385:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc147a398 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d94 expref: 10 pid: 9550 timeout: 919 lvb_type: 1 00000100:00100000:1.0:1746065223.012386:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8341 00000100:00100000:1.0:1746065223.012392:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265518720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065223.012396:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8342 00000100:00100000:2.0:1746065223.012399:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265518592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065223.012402:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.012405:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.012416:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a40f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de1 expref: 11 pid: 9550 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746065223.012418:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc147a455 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e12 expref: 29 pid: 9550 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746065223.012424:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a40f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de1 expref: 11 pid: 9550 timeout: 919 lvb_type: 1 00000100:00100000:3.0:1746065223.012475:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8343 00000100:00100000:3.0:1746065223.012482:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265518848:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.012488:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065223.013032:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc147a455 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e12 expref: 29 pid: 9550 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746065223.013051:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f70aa00/0xad6b7ddc147a455 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e12 expref: 29 pid: 9550 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746065223.013065:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065223.013087:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265518720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 696us (868us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.013093:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8341 00010000:00010000:2.0:1746065223.013133:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a40f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939de1 expref: 11 pid: 9550 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746065223.013152:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.013171:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2007:x1830881265518592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 770us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.013176:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8342 00000100:00080000:2.0:1746065223.013252:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1746065223.014682:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc147a398 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d94 expref: 10 pid: 9550 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.014694:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc147a398 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d94 expref: 10 pid: 9550 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.014709:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131046400/0xad6b7ddc147a398 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d94 expref: 10 pid: 9550 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.014735:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.014737:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.014743:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.014749:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.014800:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 9 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.014811:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264038272:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.014889:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.018923:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.018965:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265518976 00000100:00100000:0.0:1746065223.018972:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265518976 00000100:00100000:3.0:1746065223.018992:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264038272:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.019008:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065223.019028:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17842 00000100:00100000:0.0:1746065223.019035:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2620:x1830881265518976:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065223.019044:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265518848:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6562us (6768us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065223.019049:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065223.019052:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8343 00010000:00010000:0.0:1746065223.019061:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ec1 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.019086:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc147a52e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e97 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.019093:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.019094:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.019097:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.019118:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc147a52e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e97 expref: 11 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.019128:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc147a52e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e97 expref: 11 pid: 13375 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746065223.019137:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264038400:192.168.202.27@tcp:104: 00000100:00080000:2.0:1746065223.019183:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065223.020628:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.025836:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264038400:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.025864:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.025877:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af08000, rc 0) 00000100:00100000:2.0:1746065223.025929:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2620:x1830881265518976:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6893us (7010us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.025937:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17842 00000100:00100000:0.0:1746065223.026583:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.027026:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265519104 00000100:00100000:3.0:1746065223.027032:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265519104 00010000:00010000:3.0:1746065223.028134:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc147a52e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e97 expref: 12 pid: 13375 timeout: 919 lvb_type: 1 00000100:00100000:3.0:1746065223.028174:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8344 00000100:00100000:3.0:1746065223.028181:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265519104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.028192:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00080000:2.0:1746065223.028253:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1746065223.028832:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc147a52e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e97 expref: 12 pid: 13375 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.028845:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc147a52e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e97 expref: 12 pid: 13375 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.028865:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c1400/0xad6b7ddc147a52e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e97 expref: 12 pid: 13375 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.029106:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.029108:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.029115:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.029122:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.029151:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.029162:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264038528:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.029245:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.033256:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.033268:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264038528:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.033284:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.033430:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265519232 00000100:00100000:2.0:1746065223.033436:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265519232 00000100:00100000:2.0:1746065223.033476:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17843 00000100:00100000:2.0:1746065223.033482:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+12:2620:x1830881265519232:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.033496:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.033510:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ec8 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.033535:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc147a53c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eac expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.033542:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.033544:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.033547:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.033720:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265519104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5537us (7136us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.033728:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8344 00010000:00010000:2.0:1746065223.033849:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc147a53c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eac expref: 10 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.033859:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc147a53c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eac expref: 10 pid: 12258 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.033870:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264038656:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.033907:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.036180:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264038656:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.036202:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.036215:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9d800, rc 0) 00000100:00100000:2.0:1746065223.036260:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+13:2620:x1830881265519232:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2777us (3011us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.036267:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17843 00000100:00100000:0.0:1746065223.038120:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.038978:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265519360 00000100:00100000:3.0:1746065223.038986:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265519360 00010000:00010000:3.0:1746065223.039015:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc147a53c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eac expref: 11 pid: 12258 timeout: 919 lvb_type: 1 00000100:00100000:3.0:1746065223.039041:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8345 00000100:00100000:3.0:1746065223.039046:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265519360:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.039057:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.039073:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc147a53c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eac expref: 11 pid: 12258 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.039082:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc147a53c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eac expref: 11 pid: 12258 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.039100:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800999c0c00/0xad6b7ddc147a53c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eac expref: 11 pid: 12258 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.039128:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.039130:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.039136:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.039143:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.039170:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.039181:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264038784:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.039256:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.043256:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.043327:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265519488 00000100:00100000:2.0:1746065223.043334:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265519488 00000100:00100000:2.0:1746065223.043370:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17844 00000100:00100000:2.0:1746065223.043378:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2620:x1830881265519488:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.043393:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.043408:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ecf expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.043431:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 8 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.043432:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264038784:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065223.043438:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a44e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e27 expref: 27 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.043447:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065223.043448:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147a41d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939df6 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.043453:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.043454:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.043457:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.043480:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147a41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939df6 expref: 11 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.043489:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147a41d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939df6 expref: 11 pid: 12258 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.043499:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264038912:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065223.043545:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265519360:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4497us (5427us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.043553:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8345 00010000:00010000:2.0:1746065223.044320:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a44e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e27 expref: 27 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.044330:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a44e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e27 expref: 27 pid: 12258 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.044338:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264039040:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.044365:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 8 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.044377:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 8 pid: 13375 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.044384:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264039168:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.044401:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a180 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.047730:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264038912:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065223.050329:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.050389:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.050453:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.051170:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265519616 00000100:00100000:2.0:1746065223.051178:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265519616 00010000:00010000:2.0:1746065223.051218:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147a41d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939df6 expref: 12 pid: 12258 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.051240:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265519872 00000100:00100000:2.0:1746065223.051242:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265519872 00010000:00010000:2.0:1746065223.051250:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 9 pid: 13375 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.051261:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265519744 00000100:00100000:2.0:1746065223.051262:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265519744 00010000:00010000:2.0:1746065223.051269:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a44e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e27 expref: 28 pid: 12258 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.051281:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8346 00000100:00100000:2.0:1746065223.051287:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265519616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.051307:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.051323:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147a41d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939df6 expref: 12 pid: 12258 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746065223.051332:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147a41d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939df6 expref: 12 pid: 12258 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746065223.051350:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009580fa00/0xad6b7ddc147a41d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939df6 expref: 12 pid: 12258 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746065223.051365:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.051402:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2007:x1830881265519616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 115us (1079us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.051410:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8346 00000100:00100000:2.0:1746065223.051422:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8347 00000100:00100000:2.0:1746065223.051426:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265519872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.051431:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.051437:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 9 pid: 13375 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.051443:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 9 pid: 13375 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.051453:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.051465:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265519872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 38us (1075us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.051469:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8347 00000100:00100000:2.0:1746065223.051476:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8348 00000100:00100000:2.0:1746065223.051480:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265519744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.051486:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.051492:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a44e lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e27 expref: 28 pid: 12258 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746065223.051499:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a44e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e27 expref: 28 pid: 12258 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746065223.051509:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.051510:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.051515:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.051522:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.051547:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.051558:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264039296:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065223.051603:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00010000:00010000:2.0:1746065223.051630:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bfa00/0xad6b7ddc147a44e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e27 expref: 28 pid: 12258 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.051638:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264039040:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.051646:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf000/0xad6b7ddc147a383 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d86 expref: 8 pid: 13375 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.051657:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264039168:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.051679:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.051686:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009af08c00, rc 0) 00000100:00100000:2.0:1746065223.051702:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2620:x1830881265519488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8326us (8452us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.051708:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17844 00000100:00100000:2.0:1746065223.055096:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264039296:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065223.055115:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.055149:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2006:x1830881265519744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3666us (4694us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.055158:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8348 00000100:00100000:0.0:1746065223.055629:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.056460:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265520000 00000100:00100000:2.0:1746065223.056468:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265520000 00000100:00100000:2.0:1746065223.056871:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17845 00000100:00100000:2.0:1746065223.056877:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2620:x1830881265520000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.056891:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.056903:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ed6 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.056925:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.056936:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a519 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2818048->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e90 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.056941:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065223.056942:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 2 00010000:00010000:2.0:1746065223.056945:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.056965:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a519 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2818048->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e90 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.056973:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a519 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2818048->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e90 expref: 7 pid: 12260 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.056982:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264039424:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.058471:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 26 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.058483:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 26 pid: 12260 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.058492:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264039552:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.059875:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.061623:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.061715:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264039424:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065223.062012:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265520128 00000100:00100000:3.0:1746065223.062018:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265520128 00010000:00010000:3.0:1746065223.062045:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a519 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2818048->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e90 expref: 8 pid: 12260 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.062069:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8349 00000100:00100000:3.0:1746065223.062075:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2005:x1830881265520128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.062086:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.062102:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a519 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2818048->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e90 expref: 8 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.062110:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a519 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2818048->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e90 expref: 8 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.062128:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a519 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2818048->18446744073709551615] (req 4194304->5038079) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e90 expref: 8 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.062143:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.062182:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2005:x1830881265520128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 106us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.062188:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8349 00000100:00100000:0.0:1746065223.063322:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.063572:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264039552:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.063596:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 11 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.063606:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6400, rc 0) 00000100:00100000:2.0:1746065223.063634:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+11:2620:x1830881265520000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6757us (8006us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.063641:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17845 00000100:00100000:1.0:1746065223.063805:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265520256 00000100:00100000:1.0:1746065223.063810:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265520256 00002000:00100000:1.0:1746065223.063839:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2572288->2818047) req@ffff880097d2a300 x1830881265520256/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.063847:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2a300 with x1830881265520256 ext(2572288->2818047) 00010000:00010000:1.0:1746065223.063852:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 27 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746065223.063862:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 27 pid: 12260 timeout: 919 lvb_type: 0 00002000:00010000:1.0:1746065223.063872:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d2a300 00000100:00100000:1.0:1746065223.063885:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2104 00000100:00100000:1.0:1746065223.063891:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+27:2007:x1830881265520256:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:1.0:1746065223.073902:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265520256:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 10002us (10573us total) trans 17179874371 rc 0/0 00000100:00100000:1.0:1746065223.073913:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2104 00002000:00100000:1.0:1746065223.073923:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2572288->2818047) req@ffff880097d2a300 x1830881265520256/t17179874371(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/448 e 0 to 0 dl 1746065234 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.073932:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2a300 with x1830881265520256 ext(2572288->2818047) 00010000:00010000:1.0:1746065223.073942:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 29 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746065223.073956:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 29 pid: 12260 timeout: 919 lvb_type: 0 00002000:00010000:1.0:1746065223.073962:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d2a300 00000100:00100000:0.0:1746065223.091396:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.092915:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265520384 00000100:00100000:2.0:1746065223.092923:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265520384 00010000:00010000:2.0:1746065223.092952:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 29 pid: 12260 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.092983:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8350 00000100:00100000:2.0:1746065223.092989:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265520384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.092999:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065223.093012:0:7190:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065222 -> 1746065223 00002000:00010000:2.0:1746065223.093014:0:7190:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065222 -> 1746065223 00010000:00010000:2.0:1746065223.093019:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 29 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.093028:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 29 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.093046:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091bae600/0xad6b7ddc147a512 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2572288->2818047] (req 2572288->2818047) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e89 expref: 29 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.093071:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.093072:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.093078:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.093085:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.093109:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.093119:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264039680:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065223.093196:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c43a600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.102160:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.102243:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264039680:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.102261:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.102303:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265520384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9305us (10905us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.102313:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8350 00000100:00100000:2.0:1746065223.102396:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265520640 00000100:00100000:2.0:1746065223.102402:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265520640 00000100:00100000:2.0:1746065223.102450:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14656 00000100:00100000:2.0:1746065223.102456:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2634:x1830881265520640:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065223.102476:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.102489:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc147a56d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939edd expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.102547:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147a574 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102558:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147a574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102568:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147a574 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102578:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc147a57b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102583:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc147a57b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102588:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc147a57b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102659:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a582 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102667:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a582 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102672:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a582 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065223.102678:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065223.102731:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a582 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102736:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a582 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102741:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a582 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102745:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.102748:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a582 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102756:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a582 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102765:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.102767:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065223.102770:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a582 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.102793:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147a582 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00000100:00080000:3.0:1746065223.103078:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1746065223.106798:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147a574 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106808:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147a574 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106814:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147a574 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106818:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147a574 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106822:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf7200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.106825:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147a574 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106830:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147a574 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106841:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065223.106844:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065223.106846:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147a574 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106851:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7200/0xad6b7ddc147a574 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106861:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc147a57b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106865:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc147a57b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106869:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc147a57b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106873:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.106875:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc147a57b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106878:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc147a57b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106884:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ef2a200) 00010000:00010000:2.0:1746065223.106886:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065223.106888:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc147a57b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106892:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6e00/0xad6b7ddc147a57b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.106933:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc147a56d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939edd expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.106940:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf7a00/0xad6b7ddc147a56d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939edd expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.106952:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf7a00, rc 0) 00000100:00100000:2.0:1746065223.107011:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2634:x1830881265520640:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4554us (4858us total) trans 8589937180 rc 301/301 00000100:00100000:2.0:1746065223.107019:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14656 00000100:00100000:0.0:1746065223.109038:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.109144:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265520896 00000100:00100000:2.0:1746065223.109152:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265520896 00000100:00100000:2.0:1746065223.109191:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14657 00000100:00100000:2.0:1746065223.109198:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2632:x1830881265520896:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065223.109216:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.109231:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6800/0xad6b7ddc147a590 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ee4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.109287:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc147a597 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109304:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc147a597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109312:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc147a597 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109322:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a59e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109328:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a59e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109332:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a59e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109409:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc147a5a5 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109417:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc147a5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109423:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc147a5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065223.109429:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065223.109482:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc147a5a5 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109489:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc147a5a5 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109493:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc147a5a5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109497:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.109500:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc147a5a5 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109505:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc147a5a5 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109514:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.109517:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065223.109520:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc147a5a5 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109524:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6000/0xad6b7ddc147a5a5 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109540:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc147a597 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109545:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc147a597 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109549:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc147a597 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109554:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc147a597 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109557:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.109559:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc147a597 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109563:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc147a597 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109569:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065223.109571:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065223.109573:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc147a597 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109577:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6c00/0xad6b7ddc147a597 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109583:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a59e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109587:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a59e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109591:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a59e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109595:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008dbf6600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.109597:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a59e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109601:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a59e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109607:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ef2a000) 00010000:00010000:2.0:1746065223.109609:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065223.109610:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a59e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109614:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a59e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.109639:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6800/0xad6b7ddc147a590 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ee4 expref: 13 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.109645:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6800/0xad6b7ddc147a590 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ee4 expref: 13 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.109651:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6800, rc 0) 00000100:00100000:2.0:1746065223.109699:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2632:x1830881265520896:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 501us (664us total) trans 8589937181 rc 301/301 00000100:00100000:2.0:1746065223.109705:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14657 00000100:00100000:0.0:1746065223.119306:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.119387:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265521024 00000100:00100000:2.0:1746065223.119394:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265521024 00000100:00100000:2.0:1746065223.119439:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17846 00000100:00100000:2.0:1746065223.119445:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+13:2620:x1830881265521024:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.119459:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.119473:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939eeb expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.119493:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147a38a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d8d expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.119500:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095fdb800/0xad6b7ddc147a424 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e04 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.119506:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc147a3a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db0 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.119510:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.119512:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.119514:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.119535:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc147a3a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db0 expref: 9 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.119543:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc147a3a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db0 expref: 9 pid: 12258 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.119551:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264039808:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.119621:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fdb800/0xad6b7ddc147a424 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e04 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.119632:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fdb800/0xad6b7ddc147a424 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e04 expref: 14 pid: 9550 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.119639:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264039936:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.119655:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147a38a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d8d expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.119661:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147a38a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d8d expref: 20 pid: 1880 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.119667:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264040064:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.119676:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.124176:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.124306:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265521152 00000100:00100000:2.0:1746065223.124313:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265521152 00000100:00100000:2.0:1746065223.124357:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17847 00000100:00100000:2.0:1746065223.124364:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2632:x1830881265521152:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065223.124380:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.124395:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ef2 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.124417:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.124423:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.124425:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.124428:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3039232->3145727] (req 3039232->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 8 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.124450:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 10 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.124459:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 10 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.124468:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264040192:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.124523:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065223.125093:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065223.133646:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264039808:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.133657:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264039936:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.133663:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264040064:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.133687:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.133700:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6600, rc 0) 00000100:00100000:2.0:1746065223.133744:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+14:2620:x1830881265521024:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 14299us (14457us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.133752:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17846 00000100:00100000:3.0:1746065223.133847:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264040192:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065223.133860:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3039232->3145727] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 8 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.133869:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656ee00, rc 0) 00000100:00100000:3.0:1746065223.133882:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2632:x1830881265521152:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9520us (9716us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.133887:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17847 00000100:00100000:2.0:1746065223.137751:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.137801:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.137875:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.137910:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265521408 00000100:00100000:2.0:1746065223.137917:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265521408 00000100:00100000:1.0:1746065223.137938:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265521280 00000100:00100000:1.0:1746065223.137942:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265521280 00010000:00010000:2.0:1746065223.137943:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc147a3a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db0 expref: 10 pid: 12258 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746065223.137962:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdb800/0xad6b7ddc147a424 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e04 expref: 14 pid: 9550 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.137965:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265521536 00000100:00100000:2.0:1746065223.137967:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265521536 00010000:00010000:2.0:1746065223.137982:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147a38a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d8d expref: 21 pid: 1880 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.137982:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8351 00000100:00100000:1.0:1746065223.137988:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2004:x1830881265521408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065223.137996:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8352 00010000:00010000:1.0:1746065223.137998:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065223.138001:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881265521280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.138007:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065223.138014:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc147a3a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db0 expref: 10 pid: 12258 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746065223.138015:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fdb800/0xad6b7ddc147a424 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e04 expref: 14 pid: 9550 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746065223.138023:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fdb800/0xad6b7ddc147a424 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e04 expref: 14 pid: 9550 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746065223.138038:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc147a3a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db0 expref: 10 pid: 12258 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746065223.138210:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8353 00000100:00080000:3.0:1746065223.138217:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065223.138217:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265521536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065223.138224:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.138368:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdb800/0xad6b7ddc147a424 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e04 expref: 14 pid: 9550 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746065223.138373:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880131046e00/0xad6b7ddc147a3a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939db0 expref: 10 pid: 12258 timeout: 919 lvb_type: 1 00010000:00010000:2.0:1746065223.138384:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065223.138384:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065223.138413:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265521408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 426us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.138414:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265521280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 412us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.138418:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8351 00000100:00100000:2.0:1746065223.138421:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8352 00010000:00010000:0.0:1746065223.138645:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147a38a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d8d expref: 21 pid: 1880 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.138653:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147a38a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d8d expref: 21 pid: 1880 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.138665:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147a38a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939d8d expref: 21 pid: 1880 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.138690:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.138691:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.138697:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.138704:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.138728:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065223.138738:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264040320:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065223.138813:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.139928:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264040320:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065223.139944:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.139965:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881265521536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1748us (2089us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.139971:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8353 00000100:00100000:0.0:1746065223.140562:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.140589:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.140601:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.140613:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.140631:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.140699:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265521664 00000100:00100000:2.0:1746065223.140701:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265521920 00000100:00100000:3.0:1746065223.140705:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265521664 00000100:00100000:2.0:1746065223.140705:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265521920 00000100:00100000:3.0:1746065223.140728:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265522176 00000100:00100000:3.0:1746065223.140730:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265522176 00000100:00100000:2.0:1746065223.140736:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265521792 00000100:00100000:2.0:1746065223.140738:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265521792 00000100:00100000:3.0:1746065223.140739:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265522048 00000100:00100000:3.0:1746065223.140741:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265522048 00000100:00100000:2.0:1746065223.140752:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17848 00000100:00100000:2.0:1746065223.140758:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265521664:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065223.140888:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065223.140891:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065221 -> 1746065222 00002000:00010000:2.0:1746065223.140893:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065217 -> 1746065222 00002000:00010000:2.0:1746065223.140895:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065221 -> 1746065223 00002000:00010000:2.0:1746065223.140897:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746065223.140924:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265521664:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 166us (362us total) trans 17179874372 rc 0/0 00000100:00100000:3.0:1746065223.141031:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17849 00000100:00100000:2.0:1746065223.141038:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17848 00000100:00100000:3.0:1746065223.141039:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265521920:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:2.0:1746065223.141050:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17850 00000100:00100000:2.0:1746065223.141055:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265522176:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065223.141094:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00002000:00010000:2.0:1746065223.141096:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065223 -> 1746065222 00002000:00010000:2.0:1746065223.141098:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065220 -> 1746065222 00002000:00010000:3.0:1746065223.141099:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065223.141101:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065223 -> 1746065222 00002000:00010000:3.0:1746065223.141103:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065223 -> 1746065222 00002000:00010000:2.0:1746065223.141104:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065223 -> 1746065223 00002000:00010000:3.0:1746065223.141105:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065223 -> 1746065223 00002000:00010000:3.0:1746065223.141106:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:2.0:1746065223.141106:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00000100:00100000:2.0:1746065223.141525:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265522176:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 468us (921us total) trans 17179874373 rc 0/0 00000100:00100000:2.0:1746065223.141530:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17850 00000100:00100000:2.0:1746065223.141541:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17851 00000100:00100000:2.0:1746065223.141546:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265521792:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065223.141584:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065223.141586:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065223 -> 1746065222 00002000:00010000:2.0:1746065223.141588:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065219 -> 1746065222 00002000:00010000:2.0:1746065223.141589:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065223 -> 1746065223 00002000:00010000:2.0:1746065223.141591:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746065223.141629:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265521792:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 83us (1014us total) trans 21474841752 rc 0/0 00000100:00100000:2.0:1746065223.141634:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17851 00000100:00100000:3.0:1746065223.141635:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265521920:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 592us (1040us total) trans 21474841751 rc 0/0 00000100:00100000:2.0:1746065223.141643:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17852 00000100:00100000:3.0:1746065223.141647:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17849 00000100:00100000:2.0:1746065223.141648:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265522048:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065223.141683:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065223.141685:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065222 -> 1746065222 00002000:00010000:2.0:1746065223.141686:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065222 -> 1746065222 00002000:00010000:2.0:1746065223.141688:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065222 -> 1746065223 00002000:00010000:2.0:1746065223.141689:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065223.141703:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265522048:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 55us (1071us total) trans 17179874374 rc 0/0 00000100:00100000:2.0:1746065223.141708:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17852 00000100:00100000:0.0:1746065223.142747:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.142907:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265522304 00000100:00100000:2.0:1746065223.142916:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265522304 00000100:00100000:2.0:1746065223.142950:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17853 00000100:00100000:2.0:1746065223.142955:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265522304:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065223.143013:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065223.143016:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065220 -> 1746065222 00002000:00010000:2.0:1746065223.143018:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065219 -> 1746065222 00002000:00010000:2.0:1746065223.143020:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065220 -> 1746065223 00002000:00010000:2.0:1746065223.143021:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746065223.143044:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265522304:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 88us (299us total) trans 21474841753 rc 0/0 00000100:00100000:2.0:1746065223.143049:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17853 00000100:00100000:0.0:1746065223.144518:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.145880:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265522560 00000100:00100000:2.0:1746065223.145889:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265522560 00000100:00080000:3.0:1746065223.145955:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065223.145966:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5516 00000100:00100000:2.0:1746065223.145975:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2620:x1830881265522560:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065223.146218:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429a450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2620:x1830881265522560:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 241us (1698us total) trans 8589937182 rc 0/0 00000100:00100000:2.0:1746065223.146225:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5516 00000100:00100000:0.0:1746065223.146943:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.147005:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265522688 00000100:00100000:2.0:1746065223.147012:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265522688 00010000:00010000:2.0:1746065223.147036:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 14 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.147092:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8354 00000100:00100000:2.0:1746065223.147100:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265522688:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.147112:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.147131:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 14 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.147141:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 14 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.147161:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008dbf6400/0xad6b7ddc147a566 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ed6 expref: 14 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.147172:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.147174:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.147180:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.147188:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.147218:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 7 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.147230:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264040448:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065223.147335:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.151446:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.151512:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265522944 00000100:00100000:2.0:1746065223.151520:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265522944 00000100:00100000:2.0:1746065223.151570:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14658 00000100:00100000:2.0:1746065223.151576:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2637:x1830881265522944:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.151596:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.151612:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc147a5c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ef9 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.151669:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147a5c8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151680:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147a5c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151687:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147a5c8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151698:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc147a5cf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151702:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc147a5cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151706:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc147a5cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151809:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130113600/0xad6b7ddc147a5d6 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151817:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130113600/0xad6b7ddc147a5d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151823:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130113600/0xad6b7ddc147a5d6 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065223.151831:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065223.151887:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147a5c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151893:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147a5c8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151899:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147a5c8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151904:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147a5c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151908:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9c000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.151911:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147a5c8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151917:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147a5c8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151926:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065223.151928:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065223.151931:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147a5c8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151935:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147a5c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151944:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc147a5cf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151948:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc147a5cf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151952:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc147a5cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151955:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012db9d000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.151957:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc147a5cf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151964:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc147a5cf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151969:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012ef2a400) 00010000:00010000:2.0:1746065223.151971:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065223.151972:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc147a5cf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.151976:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9d000/0xad6b7ddc147a5cf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.152006:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a656e600/0xad6b7ddc147a5c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef9 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.152014:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130113600/0xad6b7ddc147a5d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef9 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.152020:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.152021:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065223.152024:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130113600, rc 0) 00000100:00100000:2.0:1746065223.152076:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2637:x1830881265522944:12345-192.168.202.27@tcp:101:cat.0 Request processed in 500us (639us total) trans 8589937183 rc 0/0 00000100:00100000:2.0:1746065223.152082:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14658 00000100:00100000:2.0:1746065223.153114:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.153180:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265523200 00000100:00100000:0.0:1746065223.153185:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265523200 00000100:00100000:0.0:1746065223.153219:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5517 00000100:00100000:0.0:1746065223.153226:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2620:x1830881265523200:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:2.0:1746065223.153345:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.153351:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2620:x1830881265523200:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 125us (238us total) trans 8589937184 rc 0/0 00000100:00100000:0.0:1746065223.153357:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5517 00000100:00100000:1.0:1746065223.153432:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265523456 00000100:00100000:1.0:1746065223.153435:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265523456 00002000:00100000:1.0:1746065223.153460:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (3039232->3043327) req@ffff88008f3e4e00 x1830881265523456/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.153468:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4e00 with x1830881265523456 ext(3039232->3043327) 00002000:00010000:1.0:1746065223.153472:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e4e00 00000100:00100000:3.0:1746065223.154065:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264040448:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065223.154070:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6392 00000100:00100000:1.0:1746065223.154077:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2006:x1830881265523456:12345-192.168.202.27@tcp:3:multiop.0 00010000:00010000:3.0:1746065223.154079:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.154101:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265522688:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 7002us (7159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.154107:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8354 00000100:00100000:1.0:1746065223.154258:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2006:x1830881265523456:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 181us (912us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065223.154263:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6392 00002000:00100000:1.0:1746065223.154268:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (3039232->3043327) req@ffff88008f3e4e00 x1830881265523456/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.154281:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4e00 with x1830881265523456 ext(3039232->3043327) 00002000:00010000:1.0:1746065223.154284:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e4e00 00000100:00100000:3.0:1746065223.160166:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.160189:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.160204:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.160220:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265523584 00000100:00100000:3.0:1746065223.160227:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265523584 00000100:00100000:3.0:1746065223.160260:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265523840 00000100:00100000:3.0:1746065223.160262:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265523840 00000100:00100000:3.0:1746065223.160273:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265523712 00000100:00100000:3.0:1746065223.160275:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265523712 00000100:00100000:3.0:1746065223.160286:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17854 00000100:00100000:3.0:1746065223.160292:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2632:x1830881265523584:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065223.160313:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.160325:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f00 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.160352:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.160358:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065223.160360:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065223.160363:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->2138111] (req 2097152->2138111) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 11 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.160388:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 15 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.160398:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 15 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.160408:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264040576:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.160511:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17855 00000100:00100000:2.0:1746065223.160518:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265523840:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.160525:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.160532:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc147a5eb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f0e expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.160556:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264040704:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065223.160888:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17856 00000100:00100000:0.0:1746065223.160894:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265523712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065223.160902:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065223.160910:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0200/0xad6b7ddc147a5f2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f07 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065223.160931:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264040832:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.162421:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.162441:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265524096 00000100:00100000:2.0:1746065223.162446:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265524096 00000100:00100000:2.0:1746065223.162468:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17857 00000100:00100000:2.0:1746065223.162473:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265524096:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.162481:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.162490:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147a5f9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f1c expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.162516:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264040960:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.162637:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.162663:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.162674:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265523968 00000100:00100000:2.0:1746065223.162676:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265523968 00000100:00100000:2.0:1746065223.162691:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17858 00000100:00100000:2.0:1746065223.162696:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265523968:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.162702:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.162709:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147a600 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f15 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.162732:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264041088:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.162823:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.162835:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265524224 00000100:00100000:2.0:1746065223.162837:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265524224 00000100:00100000:2.0:1746065223.162852:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17859 00000100:00100000:2.0:1746065223.162856:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265524224:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.162861:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.162868:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ae7000/0xad6b7ddc147a607 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f23 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.162886:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264041216:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065223.162988:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.163041:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265524480 00000100:00100000:0.0:1746065223.163044:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265524480 00000100:00100000:0.0:1746065223.163076:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14659 00000100:00100000:0.0:1746065223.163081:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2640:x1830881265524480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065223.163092:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065223.163101:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a60e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f2a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.163154:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc147a615 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163163:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc147a615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163172:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc147a615 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163182:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147a61c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163188:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147a61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163192:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147a61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163267:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147a623 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163276:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147a623 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163281:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147a623 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065223.163289:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065223.163355:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc147a615 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163360:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc147a615 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163364:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc147a615 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163369:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc147a615 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163373:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065223.163376:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc147a615 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163381:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc147a615 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163393:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065223.163395:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065223.163398:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc147a615 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163402:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1200/0xad6b7ddc147a615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163411:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147a61c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163415:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147a61c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163419:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147a61c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163423:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065223.163425:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147a61c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163429:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147a61c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163434:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5400) 00010000:00010000:0.0:1746065223.163436:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1746065223.163437:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147a61c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163441:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147a61c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.163468:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a60e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f2a expref: 34 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.163478:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147a623 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f2a expref: 33 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.163483:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065223.163484:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065223.163486:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1600, rc 0) 00000100:00100000:0.0:1746065223.163511:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+33:2640:x1830881265524480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 429us (874us total) trans 8589937185 rc 0/0 00000100:00100000:0.0:1746065223.163516:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14659 00000100:00100000:2.0:1746065223.163885:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435300 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.163926:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.164018:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.164054:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.164137:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.165743:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.165805:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265524608 00000100:00100000:2.0:1746065223.165810:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265524608 00010000:00010000:2.0:1746065223.165833:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 16 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.166485:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8355 00000100:00100000:2.0:1746065223.166493:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+16:2006:x1830881265524608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.166696:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.166713:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 6/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 16 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.166723:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 16 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.166982:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.166984:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.166990:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.166997:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.167019:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.167029:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264041344:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065223.167575:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.167579:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264040576:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065223.167597:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.167605:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a400, rc 0) 00000100:00100000:0.0:1746065223.167625:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b33450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2632:x1830881265523584:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7334us (7467us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.167631:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17854 00000100:00100000:3.0:1746065223.167740:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264040704:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065223.167756:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc147a5eb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f0e expref: 15 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.167764:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577bc00/0xad6b7ddc147a5eb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f0e expref: 15 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.167799:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577bc00, rc 0) 00000100:00100000:3.0:1746065223.167821:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2006:x1830881265523840:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7304us (7631us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065223.167826:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17855 00000100:00100000:3.0:1746065223.167902:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.167913:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265524736 00000100:00100000:3.0:1746065223.167916:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265524736 00000100:00100000:3.0:1746065223.167935:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17860 00000100:00100000:3.0:1746065223.167940:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+28:2007:x1830881265524736:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065223.167950:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.167960:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a631 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f31 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.167983:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264041472:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065223.168013:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.168034:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.168046:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265524864 00000100:00100000:0.0:1746065223.168049:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265524864 00000100:00100000:0.0:1746065223.168069:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17861 00000100:00100000:0.0:1746065223.168074:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+20:2006:x1830881265524864:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065223.168081:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065223.168087:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147a638 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f38 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065223.168110:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264041600:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.168120:0:3068:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff88009aba7480 x1830881264041216) - normal race ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 16 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746065223.168128:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065223.168134:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008dbf6600/0xad6b7ddc147a5b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eeb expref: 16 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.168150:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264041216:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.168165:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ae7000/0xad6b7ddc147a607 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f23 expref: 13 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.168172:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ae7000/0xad6b7ddc147a607 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f23 expref: 13 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.168179:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae7000, rc 0) 00000100:00100000:2.0:1746065223.168198:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265524224:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5341us (5374us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.168202:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17859 00000100:00100000:1.0:1746065223.168614:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d28000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264040832:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065223.168629:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0200/0xad6b7ddc147a5f2 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f07 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.168637:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0200/0xad6b7ddc147a5f2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f07 expref: 11 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.168658:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0200, rc 0) 00000100:00100000:1.0:1746065223.168677:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265523712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7783us (8471us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065223.168682:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17856 00000100:00100000:2.0:1746065223.169708:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264041088:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.169724:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147a600 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f15 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.169733:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577b400/0xad6b7ddc147a600 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f15 expref: 11 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.169740:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b400, rc 0) 00000100:00100000:2.0:1746065223.169757:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265523968:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7061us (7094us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.169763:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17858 00000100:00100000:2.0:1746065223.169802:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264040960:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.169814:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147a5f9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f1c expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.169821:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147a5f9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f1c expref: 9 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.169827:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ba00, rc 0) 00000100:00100000:2.0:1746065223.169839:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2006:x1830881265524096:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7366us (7422us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.169843:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17857 00000100:00100000:1.0:1746065223.170670:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.170687:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.170698:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.170719:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.170750:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264041344:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065223.170759:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065223.170794:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+15:2006:x1830881265524608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4301us (5053us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.170802:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8355 00000100:00100000:1.0:1746065223.170822:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265524992 00000100:00100000:1.0:1746065223.170826:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265524992 00000100:00100000:1.0:1746065223.170849:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265525120 00000100:00100000:1.0:1746065223.170851:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265525120 00000100:00100000:1.0:1746065223.170868:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265525248 00000100:00100000:1.0:1746065223.170870:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265525248 00000100:00100000:1.0:1746065223.170878:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265525376 00000100:00100000:1.0:1746065223.170880:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265525376 00000100:00100000:1.0:1746065223.170891:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17862 00000100:00100000:1.0:1746065223.170896:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265524992:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.170907:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.170916:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147a63f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f3f expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065223.170947:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264041728:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065223.170978:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88011d809d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.170991:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17863 00000100:00100000:1.0:1746065223.170995:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265525120:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.171001:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.171007:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc147a646 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f46 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065223.171026:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264041856:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065223.171045:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.171055:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17864 00000100:00100000:1.0:1746065223.171060:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265525248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.171065:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.171072:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a64d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f4d expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065223.171095:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264041984:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065223.171111:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f016c00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.171133:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.171146:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265525632 00000100:00100000:1.0:1746065223.171149:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265525632 00002000:00100000:1.0:1746065223.171170:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2134016->2138111) req@ffff88011dad7b80 x1830881265525632/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.171178:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad7b80 with x1830881265525632 ext(2134016->2138111) 00002000:00010000:1.0:1746065223.171181:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad7b80 00000100:00100000:1.0:1746065223.171193:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6393 00000100:00100000:1.0:1746065223.171198:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265525632:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065223.171276:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265525632:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 78us (142us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065223.171281:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6393 00002000:00100000:1.0:1746065223.171285:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2134016->2138111) req@ffff88011dad7b80 x1830881265525632/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.171291:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad7b80 with x1830881265525632 ext(2134016->2138111) 00002000:00010000:1.0:1746065223.171304:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88011dad7b80 00000100:00100000:1.0:1746065223.171413:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264041472:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065223.171428:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a631 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f31 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.171437:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a631 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f31 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.171444:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71aa00, rc 0) 00000100:00100000:1.0:1746065223.171456:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265524736:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3516us (3555us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065223.171461:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17860 00000100:00100000:1.0:1746065223.171472:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17865 00000100:00100000:1.0:1746065223.171477:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265525376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.171483:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.171489:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc147a654 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f54 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065223.171509:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264042112:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065223.171525:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.184478:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.184533:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265525888 00000100:00100000:0.0:1746065223.184539:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265525888 00000100:00100000:0.0:1746065223.184583:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5518 00000100:00100000:0.0:1746065223.184589:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2632:x1830881265525888:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065223.184754:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2632:x1830881265525888:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 165us (465us total) trans 8589937186 rc 0/0 00000100:00100000:0.0:1746065223.184761:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5518 00000100:00100000:0.0:1746065223.184821:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264041600:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065223.184846:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147a638 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f38 expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.185680:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147a638 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f38 expref: 25 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.185688:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1400, rc 0) 00000100:00100000:0.0:1746065223.185725:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265524864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 17651us (17690us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065223.185731:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17861 00002000:00010000:2.0:1746065223.185981:0:3067:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746065222 -> 1746065223 00002000:00010000:2.0:1746065223.185984:0:3067:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065222 -> 1746065223 00000100:00100000:2.0:1746065223.185995:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264041984:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.186010:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a64d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f4d expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.186018:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a5ce800/0xad6b7ddc147a64d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f4d expref: 31 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.186028:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a5ce800, rc 0) 00000100:00100000:2.0:1746065223.186044:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265525248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14984us (15344us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.186048:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17864 00002000:00010000:2.0:1746065223.186095:0:12258:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746065222 -> 1746065223 00002000:00010000:2.0:1746065223.186097:0:12258:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065222 -> 1746065223 00000100:00100000:2.0:1746065223.186105:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0000_UUID:12258:1830881264042112:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.186116:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc147a654 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f54 expref: 23 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.186123:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488400/0xad6b7ddc147a654 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f54 expref: 23 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.186129:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488400, rc 0) 00000100:00100000:2.0:1746065223.186140:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881265525376:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14663us (15420us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.186144:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17865 00000100:00100000:0.0:1746065223.186580:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264041728:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065223.186594:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147a63f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f3f expref: 21 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.186605:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147a63f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f3f expref: 21 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.186611:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3200, rc 0) 00000100:00100000:0.0:1746065223.186628:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2007:x1830881265524992:12345-192.168.202.27@tcp:101:cat.0 Request processed in 15731us (15960us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065223.186633:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17862 00000100:00100000:2.0:1746065223.187128:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.187197:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265526016 00000100:00100000:0.0:1746065223.187202:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265526016 00000100:00100000:0.0:1746065223.187224:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17866 00000100:00100000:0.0:1746065223.187229:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2637:x1830881265526016:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065223.187242:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065223.187252:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f5b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.187270:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.187277:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065223.187278:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065223.187281:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.187312:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.187326:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 12 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746065223.187335:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264042240:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065223.187391:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.187750:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264041856:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065223.187765:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc147a646 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f46 expref: 29 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.187796:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc147a646 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f46 expref: 29 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.187804:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1400, rc 0) 00000100:00100000:1.0:1746065223.187833:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265525120:12345-192.168.202.27@tcp:101:cat.0 Request processed in 16836us (17144us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065223.187838:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17863 00000100:00100000:0.0:1746065223.207448:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.207546:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.207620:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265526272 00000100:00100000:1.0:1746065223.207628:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265526272 00000100:00100000:2.0:1746065223.207744:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264042240:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.207767:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 9 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.207805:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577a600, rc 0) 00000100:00100000:1.0:1746065223.207875:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17867 00000100:00100000:1.0:1746065223.207883:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+28:2640:x1830881265526272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.207895:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.207905:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f62 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.207923:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065223.207926:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.207933:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.207939:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489800, rc 0) 00000100:00100000:0.0:1746065223.208118:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265526144 00000100:00100000:0.0:1746065223.208123:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265526144 00010000:00010000:0.0:1746065223.208138:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 13 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746065223.208156:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8356 00000100:00100000:0.0:1746065223.208161:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265526144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065223.208168:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065223.208182:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 13 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.208191:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 13 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.208683:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2637:x1830881265526016:12345-192.168.202.27@tcp:101:cat.0 Request processed in 21451us (21553us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.208689:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17866 00000100:00100000:1.0:1746065223.208732:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2640:x1830881265526272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 850us (1186us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.208737:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17867 00010000:00010000:0.0:1746065223.208939:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f2000/0xad6b7ddc147a54a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939eba expref: 13 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.208954:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.208957:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.208962:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.208968:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.208974:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.208976:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.208978:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.208984:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.209007:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065223.209017:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d28a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264042368:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065223.209072:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 8 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065223.209079:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264042496:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065223.209094:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.214283:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d28a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264042368:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065223.214302:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d29500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264042496:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065223.214320:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.214364:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265526144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6201us (6922us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.214373:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8356 00000100:00100000:0.0:1746065223.216458:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.216493:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.217770:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265526528 00000100:00100000:1.0:1746065223.217806:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265526528 00002000:00100000:1.0:1746065223.217847:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880097d29f80 x1830881265526528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.217856:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d29f80 with x1830881265526528 ext(0->1048575) 00002000:00010000:1.0:1746065223.217861:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d29f80 00000100:00100000:1.0:1746065223.218508:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265526784 00000100:00100000:1.0:1746065223.218512:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265526784 00002000:00100000:1.0:1746065223.218527:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880097d2a680 x1830881265526784/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.218540:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2a680 with x1830881265526784 ext(0->1048575) 00002000:00010000:1.0:1746065223.218543:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d2a680 00000100:00100000:1.0:1746065223.218589:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6394 00000100:00100000:1.0:1746065223.218596:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265526528:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065223.219055:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6395 00000100:00100000:3.0:1746065223.219062:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265526784:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065223.228934:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265526528:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10329us (12471us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065223.228945:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6394 00002000:00100000:1.0:1746065223.228955:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880097d29f80 x1830881265526528/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.228964:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d29f80 with x1830881265526528 ext(0->1048575) 00002000:00010000:1.0:1746065223.228969:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d29f80 00000100:00100000:3.0:1746065223.232122:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265526784:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13053us (15620us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065223.232131:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6395 00002000:00100000:3.0:1746065223.232139:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880097d2a680 x1830881265526784/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.232147:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2a680 with x1830881265526784 ext(0->1048575) 00002000:00010000:3.0:1746065223.232153:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d2a680 00000100:00100000:1.0:1746065223.238030:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.239112:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265526912 00000100:00100000:2.0:1746065223.239120:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265526912 00000100:00100000:1.0:1746065223.239372:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.239616:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265527040 00000100:00100000:2.0:1746065223.239619:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265527040 00000100:00100000:2.0:1746065223.239648:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17868 00000100:00100000:2.0:1746065223.239655:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2637:x1830881265526912:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.239669:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.239682:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f69 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.239703:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.239710:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.239711:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.239714:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.239735:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 14 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.239744:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 14 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.239754:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264042624:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.239824:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.239843:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17869 00000100:00100000:2.0:1746065223.239847:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+20:2640:x1830881265527040:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.239852:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.239857:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f70 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.239866:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.239870:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 21 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.239877:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 21 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.239888:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2000, rc 0) 00000100:00100000:2.0:1746065223.239904:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+21:2640:x1830881265527040:12345-192.168.202.27@tcp:101:cat.0 Request processed in 56us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.239908:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17869 00000100:00100000:0.0:1746065223.243063:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.243259:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264042624:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.243286:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.243310:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61800, rc 0) 00000100:00100000:3.0:1746065223.243683:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265527168 00000100:00100000:3.0:1746065223.243690:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265527168 00010000:00010000:3.0:1746065223.243714:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 15 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.243874:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2637:x1830881265526912:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4219us (5851us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.243882:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17868 00000100:00100000:3.0:1746065223.244077:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8357 00000100:00100000:3.0:1746065223.244084:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265527168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.244094:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.244110:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 15 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.244120:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 15 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.244137:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147a551 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec1 expref: 15 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.244152:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.244154:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.244159:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 10 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.244166:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 10 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.244172:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.244174:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.244177:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 20 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.244182:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 20 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.244204:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 20 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.244217:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264042752:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.244267:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 10 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.244274:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264042880:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.244291:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.246939:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.246949:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264042752:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.246958:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264042880:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.246976:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.247546:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265527296 00000100:00100000:2.0:1746065223.247552:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265527296 00000100:00100000:2.0:1746065223.247585:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17870 00000100:00100000:2.0:1746065223.247591:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+21:2634:x1830881265527296:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065223.247606:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.247618:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f77 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.247639:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.247645:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.247647:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.247650:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3080192->3145727] (req 3080192->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.247669:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 10 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.247679:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 10 pid: 10219 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.247688:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264043008:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065223.247737:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265527168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3652us (4679us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.247745:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8357 00000100:00100000:2.0:1746065223.247924:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.250390:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.251433:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265527552 00000100:00100000:3.0:1746065223.251441:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265527552 00002000:00100000:3.0:1746065223.251479:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009aba7480 x1830881265527552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.251488:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba7480 with x1830881265527552 ext(1048576->2097151) 00002000:00010000:3.0:1746065223.251493:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba7480 00000100:00100000:3.0:1746065223.251520:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6396 00000100:00100000:3.0:1746065223.251527:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881265527552:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065223.252600:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.253218:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264043008:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065223.253242:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3080192->3145727] (req 3080192->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 24 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.253256:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2a00, rc 0) 00000100:00100000:0.0:1746065223.253287:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2634:x1830881265527296:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5695us (6353us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.253305:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17870 00000100:00100000:2.0:1746065223.253972:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265527680 00000100:00100000:2.0:1746065223.253978:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265527680 00002000:00100000:2.0:1746065223.254003:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2138111) req@ffff88011dad5880 x1830881265527680/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.254011:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5880 with x1830881265527680 ext(2097152->2138111) 00010000:00010000:2.0:1746065223.254018:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 11 pid: 10219 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.254030:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 11 pid: 10219 timeout: 919 lvb_type: 0 00002000:00010000:2.0:1746065223.254036:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011dad5880 00000100:00100000:2.0:1746065223.254053:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2105 00000100:00100000:2.0:1746065223.254059:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265527680:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065223.257856:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.258006:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265527936 00000100:00100000:2.0:1746065223.258013:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265527936 00002000:00100000:2.0:1746065223.258048:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880097d29880 x1830881265527936/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.258058:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d29880 with x1830881265527936 ext(1048576->2097151) 00002000:00010000:2.0:1746065223.258062:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d29880 00000100:00100000:2.0:1746065223.258078:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6397 00000100:00100000:2.0:1746065223.258084:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2006:x1830881265527936:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065223.262679:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+22:2005:x1830881265527552:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 11143us (12285us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065223.262692:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6396 00002000:00100000:3.0:1746065223.262702:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88009aba7480 x1830881265527552/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.262711:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba7480 with x1830881265527552 ext(1048576->2097151) 00002000:00010000:3.0:1746065223.262716:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba7480 00000100:00100000:2.0:1746065223.264091:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265527680:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10028us (11489us total) trans 21474841754 rc 0/0 00000100:00100000:2.0:1746065223.264099:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2105 00002000:00100000:2.0:1746065223.264104:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->2138111) req@ffff88011dad5880 x1830881265527680/t21474841754(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/448 e 0 to 0 dl 1746065234 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.264112:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5880 with x1830881265527680 ext(2097152->2138111) 00010000:00010000:2.0:1746065223.264119:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 15 pid: 10219 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.264130:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 15 pid: 10219 timeout: 919 lvb_type: 0 00002000:00010000:2.0:1746065223.264135:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88011dad5880 00000100:00100000:3.0:1746065223.265020:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2006:x1830881265527936:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6929us (7165us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065223.265027:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6397 00002000:00100000:3.0:1746065223.265033:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880097d29880 x1830881265527936/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.265039:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d29880 with x1830881265527936 ext(1048576->2097151) 00002000:00010000:3.0:1746065223.265042:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d29880 00000100:00100000:0.0:1746065223.271418:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.271713:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.271751:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.272345:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265528064 00000100:00100000:3.0:1746065223.272352:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265528064 00010000:00010000:3.0:1746065223.272381:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 13 pid: 10219 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.272413:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8358 00000100:00100000:3.0:1746065223.272420:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265528064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.272430:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.272444:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 13 pid: 10219 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.272455:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 13 pid: 10219 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.272474:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a400/0xad6b7ddc147a5e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2138111) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f00 expref: 13 pid: 10219 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.272497:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.272499:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.272505:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 21 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.272513:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 21 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.272540:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 21 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.272550:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264043136:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.272610:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.273977:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265528192 00000100:00100000:1.0:1746065223.273986:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265528192 00000100:00100000:1.0:1746065223.274019:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265528320 00000100:00100000:1.0:1746065223.274021:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265528320 00000100:00100000:1.0:1746065223.274038:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17871 00000100:00100000:1.0:1746065223.274044:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+22:2640:x1830881265528192:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.274055:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.274067:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f7e expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.274086:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.274092:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065223.274094:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065223.274096:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 23 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.274114:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 13 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.274124:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 13 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.274133:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264043264:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.274167:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.274182:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17872 00000100:00100000:1.0:1746065223.274187:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2637:x1830881265528320:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.274192:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.274197:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f85 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.274207:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065223.274210:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 14 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.274217:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 14 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.274228:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539800, rc 0) 00000100:00100000:1.0:1746065223.274246:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2637:x1830881265528320:12345-192.168.202.27@tcp:101:cat.0 Request processed in 59us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.274251:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17872 00000100:00100000:0.0:1746065223.278019:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.278102:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265528576 00000100:00100000:2.0:1746065223.278108:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265528576 00002000:00100000:2.0:1746065223.278144:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3080192->3084287) req@ffff880097d2b100 x1830881265528576/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.278159:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2b100 with x1830881265528576 ext(3080192->3084287) 00002000:00010000:2.0:1746065223.278163:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d2b100 00000100:00100000:2.0:1746065223.278180:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6398 00000100:00100000:2.0:1746065223.278185:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881265528576:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065223.278216:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264043264:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.278237:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 24 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.278249:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539e00, rc 0) 00000100:00100000:3.0:1746065223.278700:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264043136:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.278711:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065223.278796:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2640:x1830881265528192:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4750us (7082us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.278802:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17871 00000100:00100000:3.0:1746065223.278879:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265528064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6459us (7468us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.278879:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881265528576:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 692us (866us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065223.278885:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6398 00000100:00100000:3.0:1746065223.278887:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8358 00002000:00100000:2.0:1746065223.278890:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3080192->3084287) req@ffff880097d2b100 x1830881265528576/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.278897:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2b100 with x1830881265528576 ext(3080192->3084287) 00002000:00010000:2.0:1746065223.278900:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d2b100 00000100:00100000:0.0:1746065223.279545:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.279586:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.279711:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265528704 00000100:00100000:3.0:1746065223.279715:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265528704 00010000:00010000:3.0:1746065223.279730:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 14 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.279759:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8359 00000100:00100000:3.0:1746065223.279764:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265528704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.279787:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.279799:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 14 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.279809:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 14 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.279826:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012db9d800/0xad6b7ddc147a558 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ec8 expref: 14 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.279848:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.279850:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.279856:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.279863:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.279870:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.279871:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.279874:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 12 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.279880:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 12 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.280095:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265528832 00000100:00100000:2.0:1746065223.280099:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265528832 00000100:00100000:2.0:1746065223.280122:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14660 00000100:00100000:2.0:1746065223.280127:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2643:x1830881265528832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.280140:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.280152:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147a68c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f8c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.280192:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147a693 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280201:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147a693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280209:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147a693 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280219:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a69a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280224:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280229:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280282:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280289:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280305:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065223.280332:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:2.0:1746065223.280336:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065223.280347:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280354:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280360:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147a693 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280365:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147a693 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280369:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147a693 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280378:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147a693 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280383:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.280386:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147a693 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280392:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147a693 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280399:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065223.280402:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065223.280405:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147a693 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280409:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1e00/0xad6b7ddc147a693 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280421:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a69a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280426:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a69a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280429:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a69a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280433:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.280435:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a69a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280439:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a69a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280447:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099592800) 00010000:00010000:2.0:1746065223.280449:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065223.280451:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a69a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280455:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a69a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.280475:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147a68c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f8c expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.280483:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f8c expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.280488:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.280490:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065223.280492:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0c00, rc 0) 00000100:00100000:2.0:1746065223.280517:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+12:2643:x1830881265528832:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 389us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.280522:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14660 00010000:00010000:3.0:1746065223.281056:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 12 pid: 12258 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.281066:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264043392:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.281132:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.281140:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264043520:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.281157:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.286192:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.286597:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265528960 00000100:00100000:1.0:1746065223.286603:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265528960 00000100:00100000:1.0:1746065223.286638:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17873 00000100:00100000:1.0:1746065223.286645:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2634:x1830881265528960:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065223.286658:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.286673:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f93 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.286694:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 8 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.286701:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065223.286703:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065223.286706:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->3874815] (req 3145728->3874815) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 30 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.286729:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 8 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.286739:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 8 pid: 12260 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.286749:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264043648:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.286818:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.286843:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.286864:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265529216 00000100:00100000:2.0:1746065223.286867:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265529216 00002000:00100000:2.0:1746065223.286887:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009aba6300 x1830881265529216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.286895:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba6300 with x1830881265529216 ext(1048576->2097151) 00002000:00010000:2.0:1746065223.286898:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba6300 00000100:00100000:2.0:1746065223.286910:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6399 00000100:00100000:2.0:1746065223.286915:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265529216:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065223.287660:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.287674:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265529472 00000100:00100000:2.0:1746065223.287678:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265529472 00002000:00100000:2.0:1746065223.287694:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009aba5880 x1830881265529472/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.287700:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba5880 with x1830881265529472 ext(1048576->2097151) 00002000:00010000:2.0:1746065223.287703:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba5880 00000100:00100000:2.0:1746065223.287715:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6400 00000100:00100000:2.0:1746065223.287721:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265529472:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065223.288734:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.289039:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.289065:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.289078:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265529728 00000100:00100000:1.0:1746065223.289078:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265529600 00000100:00100000:2.0:1746065223.289081:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265529728 00000100:00100000:1.0:1746065223.289081:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265529600 00000100:00100000:1.0:1746065223.289099:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265529856 00000100:00100000:1.0:1746065223.289101:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265529856 00000100:00100000:3.0:1746065223.289972:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264043392:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.289982:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264043520:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.289996:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.290022:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265528704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10258us (10477us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.290030:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8359 00000100:00100000:3.0:1746065223.294367:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17874 00000100:00100000:3.0:1746065223.294383:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265529600:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065223.294399:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.294414:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc147a6af lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939f9a expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.294435:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.294436:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.294444:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc147a6af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f9a expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.294456:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc147a6af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f9a expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.294465:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a800, rc 0) 00000100:00100000:3.0:1746065223.294506:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265529600:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 129us (5774us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.294511:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17874 00000100:00100000:3.0:1746065223.294530:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17875 00000100:00100000:3.0:1746065223.294536:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265529728:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065223.294543:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.294551:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc147a6b6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939fa1 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.294561:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.294562:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.294567:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc147a6b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa1 expref: 15 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.294576:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc147a6b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa1 expref: 15 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.294582:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b800, rc 0) 00000100:00100000:3.0:1746065223.294595:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265529728:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 60us (5558us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.294603:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17875 00000100:00100000:3.0:1746065223.294614:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17876 00000100:00100000:3.0:1746065223.294619:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265529856:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065223.294625:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.294629:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a6bd lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939fa8 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.294638:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.294640:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.294643:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a6bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa8 expref: 15 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.294650:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a6bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa8 expref: 15 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.294657:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a000, rc 0) 00000100:00100000:3.0:1746065223.294675:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265529856:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 56us (5609us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.294679:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17876 00000100:00100000:2.0:1746065223.295155:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.295197:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.295290:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265529984 00000100:00100000:2.0:1746065223.295308:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265529984 00000100:00100000:2.0:1746065223.295334:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265530112 00000100:00100000:2.0:1746065223.295336:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265530112 00000100:00100000:2.0:1746065223.295349:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17877 00000100:00100000:2.0:1746065223.295354:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265529984:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.295361:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.295369:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147a6c4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939faf expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.295399:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264043776:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.295442:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.295458:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17878 00000100:00100000:2.0:1746065223.295462:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265530112:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.295468:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.295473:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc147a6cb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939fb6 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.295492:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264043904:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.295511:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.298030:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264043648:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.298054:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->3874815] (req 3145728->3874815) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 30 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.298067:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539a00, rc 0) 00000100:00100000:1.0:1746065223.298101:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2634:x1830881265528960:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11457us (11914us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.298108:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17873 00000100:00100000:0.0:1746065223.299074:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.299129:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265530240 00000100:00100000:3.0:1746065223.299136:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265530240 00002000:00100000:3.0:1746065223.299170:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3039232->3145727) req@ffff880097d2b480 x1830881265530240/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.299178:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2b480 with x1830881265530240 ext(3039232->3145727) 00010000:00010000:3.0:1746065223.299185:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 9 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.299200:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 9 pid: 12260 timeout: 919 lvb_type: 0 00002000:00010000:3.0:1746065223.299206:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d2b480 00000100:00100000:3.0:1746065223.299231:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2106 00000100:00100000:3.0:1746065223.299237:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2004:x1830881265530240:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065223.299584:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265529216:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 12667us (12744us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065223.299591:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6399 00002000:00100000:2.0:1746065223.299597:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009aba6300 x1830881265529216/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.299603:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba6300 with x1830881265529216 ext(1048576->2097151) 00002000:00010000:2.0:1746065223.299606:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba6300 00000100:00100000:3.0:1746065223.302214:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264043904:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065223.302244:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc147a6cb lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fb6 expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.302256:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d06a00/0xad6b7ddc147a6cb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fb6 expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.302270:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06a00, rc 0) 00000100:00100000:2.0:1746065223.302398:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264043776:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.302414:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147a6c4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939faf expref: 14 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.302427:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147a6c4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939faf expref: 14 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.302438:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07e00, rc 0) 00000100:00100000:3.0:1746065223.302884:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265530112:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7418us (7683us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065223.302893:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17878 00000100:00100000:2.0:1746065223.302957:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265529984:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7600us (7800us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.302963:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17877 00000100:00100000:2.0:1746065223.303051:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265529472:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15329us (15392us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065223.303058:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6400 00002000:00100000:2.0:1746065223.303064:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88009aba5880 x1830881265529472/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.303072:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba5880 with x1830881265529472 ext(1048576->2097151) 00002000:00010000:2.0:1746065223.303076:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009aba5880 00000100:00100000:3.0:1746065223.303897:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265530240:12345-192.168.202.27@tcp:4:cat.0 Request processed in 4658us (4822us total) trans 17179874375 rc 0/0 00000100:00100000:3.0:1746065223.303904:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2106 00002000:00100000:3.0:1746065223.303909:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3039232->3145727) req@ffff880097d2b480 x1830881265530240/t17179874375(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/448 e 0 to 0 dl 1746065234 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.303916:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2b480 with x1830881265530240 ext(3039232->3145727) 00010000:00010000:3.0:1746065223.303923:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 11 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.303934:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 11 pid: 12260 timeout: 919 lvb_type: 0 00002000:00010000:3.0:1746065223.303940:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d2b480 00000100:00100000:0.0:1746065223.305747:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.305819:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265530368 00000100:00100000:2.0:1746065223.305825:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265530368 00000100:00100000:2.0:1746065223.305857:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17879 00000100:00100000:2.0:1746065223.305863:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+30:2640:x1830881265530368:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.305876:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.305890:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939fbd expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.305912:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.305918:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.305919:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.305922:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.305943:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 12 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.305952:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 12 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.305961:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264044032:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065223.307198:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.309862:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.309985:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264044032:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.310006:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 31 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.310019:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06e00, rc 0) 00000100:00100000:3.0:1746065223.310114:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265530496 00000100:00100000:3.0:1746065223.310119:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265530496 00010000:00010000:3.0:1746065223.310143:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 13 pid: 3067 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.310240:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2640:x1830881265530368:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4376us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.310247:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17879 00000100:00100000:3.0:1746065223.310339:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8360 00000100:00100000:3.0:1746065223.310346:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265530496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.310356:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.310371:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 13 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.310380:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 13 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.310398:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009af08c00/0xad6b7ddc147a55f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ecf expref: 13 pid: 3067 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.310408:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.310409:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.310414:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.310426:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.310934:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 30 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.310943:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264044160:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.311136:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.311749:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.311859:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265530624 00000100:00100000:1.0:1746065223.311864:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265530624 00010000:00010000:1.0:1746065223.311881:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 11 pid: 12260 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.311900:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8361 00000100:00100000:1.0:1746065223.311905:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265530624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065223.311912:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065223.313623:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 11 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746065223.313639:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 11 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746065223.313656:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147a5ba lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3039232->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef2 expref: 11 pid: 12260 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746065223.313688:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.313689:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.313695:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 30 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.313702:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 30 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.313731:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 30 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065223.313743:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264044288:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065223.313821:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.314651:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264044160:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.314662:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.314684:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265530496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4339us (4828us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.314692:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8360 00000100:00100000:0.0:1746065223.314825:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.314870:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.314919:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265530880 00000100:00100000:1.0:1746065223.314923:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265530880 00000100:00100000:1.0:1746065223.314958:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14661 00000100:00100000:1.0:1746065223.314964:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2643:x1830881265530880:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065223.314976:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.314988:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147a6d9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939fc4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.315062:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065223.315075:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130113600/0xad6b7ddc147a5d6 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef9 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.315081:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147a623 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f2a expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.315086:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f8c expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.315091:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065223.315112:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f8c expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.315121:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f8c expref: 13 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.315132:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264044416:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.315168:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147a623 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f2a expref: 32 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.315176:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147a623 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f2a expref: 32 pid: 7203 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.315182:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264044544:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.315203:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130113600/0xad6b7ddc147a5d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef9 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.315210:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130113600/0xad6b7ddc147a5d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef9 expref: 14 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.315216:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264044672:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.315230:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.315392:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265531008 00000100:00100000:2.0:1746065223.315396:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265531008 00000100:00100000:2.0:1746065223.315417:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17880 00000100:00100000:2.0:1746065223.315421:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2637:x1830881265531008:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.315428:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.315435:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d06600/0xad6b7ddc147a6e7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939fcb expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.315447:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.315449:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.315453:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06600/0xad6b7ddc147a6e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fcb expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.315473:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d06600/0xad6b7ddc147a6e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fcb expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.315481:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06600, rc 0) 00000100:00100000:2.0:1746065223.315499:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2637:x1830881265531008:12345-192.168.202.27@tcp:101:cat.0 Request processed in 78us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.315503:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17880 00000100:00100000:0.0:1746065223.315874:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.315965:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264044288:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065223.315974:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065223.315991:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265530624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4086us (4243us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.315996:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8361 00000100:00100000:3.0:1746065223.316211:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265531264 00000100:00100000:3.0:1746065223.316215:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265531264 00002000:00100000:3.0:1746065223.316235:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880097fa0000 x1830881265531264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.316247:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0000 with x1830881265531264 ext(1048576->2097151) 00002000:00010000:3.0:1746065223.316251:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0000 00000100:00100000:3.0:1746065223.316269:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6401 00000100:00100000:3.0:1746065223.316274:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265531264:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065223.320257:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.320921:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264044416:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.320935:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264044544:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.320942:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264044672:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.320965:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065223.324153:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.324342:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265531520 00000100:00100000:2.0:1746065223.324350:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265531520 00010000:00010000:2.0:1746065223.324378:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f8c expref: 14 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.324399:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265531392 00000100:00100000:2.0:1746065223.324401:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265531392 00010000:00010000:2.0:1746065223.324409:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147a623 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f2a expref: 33 pid: 7203 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.324424:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8362 00000100:00100000:2.0:1746065223.324430:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881265531520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.324441:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.324446:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f8c expref: 14 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.324455:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f8c expref: 14 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.324474:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a6a1 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f8c expref: 14 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.324488:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.324491:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.324498:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.324503:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.324533:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265531520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 104us (4284us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.324539:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8362 00000100:00100000:2.0:1746065223.324550:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8363 00000100:00100000:2.0:1746065223.324554:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265531392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.324561:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.324564:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147a623 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f2a expref: 33 pid: 7203 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.324570:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147a623 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f2a expref: 33 pid: 7203 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.324579:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147a623 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f2a expref: 33 pid: 7203 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.324586:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.324589:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.324593:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.324597:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.324606:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265531392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.324611:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8363 00000100:00100000:2.0:1746065223.324636:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.324646:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265531648 00000100:00100000:2.0:1746065223.324648:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265531648 00010000:00010000:2.0:1746065223.324656:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130113600/0xad6b7ddc147a5d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef9 expref: 15 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.324666:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8364 00000100:00100000:2.0:1746065223.324670:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265531648:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.324674:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.324676:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130113600/0xad6b7ddc147a5d6 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef9 expref: 15 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.324683:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130113600/0xad6b7ddc147a5d6 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef9 expref: 15 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.324691:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130113600/0xad6b7ddc147a5d6 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ef9 expref: 15 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.324698:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.324700:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.324705:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.324710:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065223.324928:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.324977:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265531904 00000100:00100000:3.0:1746065223.324980:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265531904 00002000:00100000:3.0:1746065223.325002:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88011dad6d80 x1830881265531904/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.325011:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6d80 with x1830881265531904 ext(1048576->2097151) 00002000:00010000:3.0:1746065223.325014:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad6d80 00000100:00100000:3.0:1746065223.325034:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6402 00000100:00100000:3.0:1746065223.325038:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265531904:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:1.0:1746065223.325822:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065223.325826:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065223.325831:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065223.325846:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265531648:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1173us (1207us total) trans 0 rc 0/0 00000004:00200000:1.0:1746065223.325848:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000100:00100000:2.0:1746065223.325853:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8364 00010000:00010000:1.0:1746065223.325946:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147a6d9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fc4 expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.325958:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fc4 expref: 13 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.325965:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065223.325967:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065223.325969:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906c5200, rc 0) 00000100:00100000:1.0:1746065223.325988:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b4e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2643:x1830881265530880:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11024us (11163us total) trans 8589937187 rc 0/0 00000100:00100000:1.0:1746065223.325994:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14661 00000100:00100000:3.0:1746065223.328403:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265531264:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 12121us (12521us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065223.328412:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6401 00002000:00100000:3.0:1746065223.328421:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880097fa0000 x1830881265531264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.328429:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0000 with x1830881265531264 ext(1048576->2097151) 00002000:00010000:3.0:1746065223.328433:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0000 00000100:00100000:1.0:1746065223.332321:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.333212:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2005:x1830881265531904:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8169us (8280us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065223.333213:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265532160 00000100:00100000:3.0:1746065223.333220:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265532160 00000100:00100000:2.0:1746065223.333221:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6402 00002000:00100000:2.0:1746065223.333230:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88011dad6d80 x1830881265531904/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.333239:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad6d80 with x1830881265531904 ext(1048576->2097151) 00002000:00010000:2.0:1746065223.333244:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad6d80 00002000:00100000:3.0:1746065223.334099:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3870720->3874815) req@ffff88011dad4e00 x1830881265532160/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.334107:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad4e00 with x1830881265532160 ext(3870720->3874815) 00002000:00010000:3.0:1746065223.334111:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad4e00 00000100:00100000:3.0:1746065223.334136:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6403 00000100:00100000:3.0:1746065223.334143:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265532160:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065223.334238:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265532160:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 95us (1924us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065223.334244:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6403 00002000:00100000:3.0:1746065223.334249:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3870720->3874815) req@ffff88011dad4e00 x1830881265532160/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.334255:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad4e00 with x1830881265532160 ext(3870720->3874815) 00002000:00010000:3.0:1746065223.334258:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad4e00 00000100:00100000:1.0:1746065223.334420:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.334439:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265532288 00000100:00100000:1.0:1746065223.334443:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265532288 00000100:00100000:1.0:1746065223.334466:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14662 00000100:00100000:1.0:1746065223.334470:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2643:x1830881265532288:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065223.334485:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.334500:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147a6f5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939fd2 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.334562:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065223.334574:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fc4 expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.334584:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065223.334610:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fc4 expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.334619:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fc4 expref: 14 pid: 7203 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.334629:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264044800:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.334677:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.337087:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264044800:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.337106:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065223.339887:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.339898:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.339980:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265532672 00000100:00100000:1.0:1746065223.339980:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265532544 00000100:00100000:3.0:1746065223.339988:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265532672 00000100:00100000:1.0:1746065223.339988:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265532544 00010000:00010000:3.0:1746065223.340016:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fc4 expref: 15 pid: 7203 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.340024:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14663 00000100:00100000:1.0:1746065223.340031:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2645:x1830881265532544:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:3.0:1746065223.340035:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8365 00000100:00100000:3.0:1746065223.340040:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265532672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.340050:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065223.340051:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.340054:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fc4 expref: 15 pid: 7203 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746065223.340062:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147a703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939fd9 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.340063:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fc4 expref: 15 pid: 7203 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.340079:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906c5200/0xad6b7ddc147a6e0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fc4 expref: 15 pid: 7203 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.340094:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065223.340098:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.340107:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.340113:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065223.340118:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147a70a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340126:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147a70a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340132:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147a70a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.340137:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065223.340143:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc147a711 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340148:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc147a711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340153:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc147a711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065223.340158:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065223.340165:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065223.340169:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265532672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 128us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.340175:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8365 00000004:00200000:0.0:1746065223.340210:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:0.0:1746065223.340214:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065223.340226:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065223.340316:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147a718 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340323:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147a718 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340328:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147a718 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065223.340334:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065223.340386:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147a70a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340395:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147a70a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340400:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147a70a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340405:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147a70a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340409:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065223.340412:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147a70a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340417:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147a70a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340423:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065223.340425:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065223.340428:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147a70a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340432:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147a70a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065223.340440:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61200/0xad6b7ddc147a6f5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd2 expref: 14 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.340442:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc147a711 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340446:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc147a711 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340449:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc147a711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340453:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065223.340454:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd2 expref: 13 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.340455:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc147a711 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340459:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc147a711 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065223.340459:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065223.340461:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065223.340463:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61800, rc 0) 00010000:00010000:1.0:1746065223.340464:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88012edbdc00) 00010000:00010000:1.0:1746065223.340465:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065223.340467:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc147a711 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.340470:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60c00/0xad6b7ddc147a711 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065223.340484:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2643:x1830881265532288:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 6013us (6065us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.340490:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14662 00010000:00010000:1.0:1746065223.340491:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147a703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd9 expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.340497:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147a718 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd9 expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.340502:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065223.340503:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065223.340505:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61e00, rc 0) 00000100:00100000:1.0:1746065223.340520:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2645:x1830881265532544:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 491us (624us total) trans 8589937188 rc 0/0 00000100:00100000:1.0:1746065223.340525:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14663 00000100:00100000:0.0:1746065223.343311:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.343491:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265532928 00000100:00100000:3.0:1746065223.343498:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265532928 00002000:00100000:3.0:1746065223.343532:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880097fa1500 x1830881265532928/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.343541:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1500 with x1830881265532928 ext(2097152->3145727) 00002000:00010000:3.0:1746065223.343545:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1500 00000100:00100000:0.0:1746065223.343847:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.344210:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.344240:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.344276:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265533184 00000100:00100000:3.0:1746065223.344279:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265533184 00000100:00100000:3.0:1746065223.344301:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265533312 00000100:00100000:3.0:1746065223.344303:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265533312 00000100:00100000:3.0:1746065223.344322:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265533440 00000100:00100000:3.0:1746065223.344323:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265533440 00000100:00100000:3.0:1746065223.344335:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17881 00000100:00100000:3.0:1746065223.344340:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265533312:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065223.344351:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.344364:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a726 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939fe0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.344379:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.344381:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.344388:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a726 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fe0 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.344399:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a726 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fe0 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.344408:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71aa00, rc 0) 00000100:00100000:3.0:1746065223.344442:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881265533312:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 102us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.344448:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17881 00000100:00100000:1.0:1746065223.344456:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6404 00000100:00100000:3.0:1746065223.344459:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17882 00000100:00100000:3.0:1746065223.344463:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265533440:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:1.0:1746065223.344465:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265532928:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:3.0:1746065223.344468:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.344473:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc147a72d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939fe7 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.344503:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264044928:192.168.202.27@tcp:106: 00002000:00100000:2.0:1746065223.344730:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3080191) req@ffff880097fa0380 x1830881265533184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.344738:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0380 with x1830881265533184 ext(2097152->3080191) 00002000:00010000:2.0:1746065223.344742:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0380 00000100:00100000:2.0:1746065223.344756:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6405 00000100:00100000:2.0:1746065223.344761:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265533184:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065223.346057:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.346444:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.346966:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.346981:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265533568 00000100:00100000:2.0:1746065223.346991:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265533568 00000100:00100000:2.0:1746065223.347022:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265533696 00000100:00100000:2.0:1746065223.347024:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265533696 00000100:00100000:3.0:1746065223.347051:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17883 00000100:00100000:2.0:1746065223.347056:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17884 00000100:00100000:3.0:1746065223.347058:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+15:2006:x1830881265533568:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065223.347060:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265533696:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065223.347071:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.347071:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.347084:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71b200/0xad6b7ddc147a73b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939fee expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.347084:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc147a734 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ff5 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.347122:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264045184:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.347122:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264045056:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065223.347169:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f016c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.347341:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.347358:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.347374:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265533824 00000100:00100000:0.0:1746065223.347377:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265533824 00000100:00100000:2.0:1746065223.347392:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.347398:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17885 00000100:00100000:0.0:1746065223.347403:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265533824:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065223.347409:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065223.348880:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a742 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd939ffc expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065223.348922:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264045312:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065223.352044:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.352081:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265534080 00000100:00100000:0.0:1746065223.352090:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265534080 00000100:00100000:0.0:1746065223.352143:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5519 00000100:00100000:2.0:1746065223.353124:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265532928:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8658us (9817us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065223.353132:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6404 00002000:00100000:2.0:1746065223.353141:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880097fa1500 x1830881265532928/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.353148:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1500 with x1830881265532928 ext(2097152->3145727) 00002000:00010000:2.0:1746065223.353152:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1500 00000100:00100000:0.0:1746065223.354326:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2634:x1830881265534080:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065223.354572:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2634:x1830881265534080:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 2418us (7175us total) trans 8589937189 rc 0/0 00000100:00100000:0.0:1746065223.354579:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5519 00000100:00100000:2.0:1746065223.355157:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264045056:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.355182:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc147a734 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ff5 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.355193:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc147a734 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ff5 expref: 12 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.355215:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2c00, rc 0) 00000100:00100000:3.0:1746065223.355227:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264044928:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065223.355243:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc147a72d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fe7 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.355257:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a600/0xad6b7ddc147a72d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fe7 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065223.355350:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265533696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8288us (8383us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.355356:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17884 00010000:00010000:3.0:1746065223.355563:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a600, rc 0) 00000100:00100000:3.0:1746065223.355603:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265533440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11138us (11362us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065223.355608:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17882 00000100:00100000:3.0:1746065223.355642:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264045184:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065223.355656:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71b200/0xad6b7ddc147a73b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fee expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.355665:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b200/0xad6b7ddc147a73b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fee expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.355672:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b200, rc 0) 00000100:00100000:3.0:1746065223.355700:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+15:2006:x1830881265533568:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8643us (9258us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065223.355705:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17883 00000100:00100000:2.0:1746065223.356196:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264045312:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.356212:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a742 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ffc expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.356221:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07200/0xad6b7ddc147a742 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939ffc expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.356228:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07200, rc 0) 00000100:00100000:2.0:1746065223.356249:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265533824:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8845us (8891us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.356255:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17885 00000100:00100000:3.0:1746065223.356847:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265533184:12345-192.168.202.27@tcp:3:cat.0 Request processed in 12084us (12999us total) trans 0 rc 983040/983040 00000100:00100000:3.0:1746065223.356854:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6405 00002000:00100000:3.0:1746065223.356861:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3080191) req@ffff880097fa0380 x1830881265533184/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 983040/983040 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.356875:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0380 with x1830881265533184 ext(2097152->3080191) 00002000:00010000:3.0:1746065223.356879:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0380 00000100:00100000:1.0:1746065223.362388:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.362424:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.362433:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.362440:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265534592 00000100:00100000:3.0:1746065223.362448:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265534592 00002000:00100000:3.0:1746065223.362549:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (3874816->4194303) req@ffff88011dad5f80 x1830881265534592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.362558:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5f80 with x1830881265534592 ext(3874816->4194303) 00002000:00010000:3.0:1746065223.362563:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88011dad5f80 00000100:00100000:2.0:1746065223.362606:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265534336 00000100:00100000:2.0:1746065223.362609:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265534336 00000100:00100000:2.0:1746065223.362637:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14664 00000100:00100000:2.0:1746065223.362644:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+13:2643:x1830881265534336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.362655:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.362669:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a749 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a003 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.362743:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a750 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065223.362755:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a750 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065223.362764:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a750 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065223.362805:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a750 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065223.362811:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a750 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065223.362816:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a750 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065223.362825:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f7f3200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.362828:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a750 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065223.362833:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a750 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065223.362842:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.362845:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065223.362847:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a750 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065223.362852:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a750 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:2.0:1746065223.362875:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a749 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a003 expref: 14 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.362885:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f7f3e00/0xad6b7ddc147a749 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 11 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a003 expref: 14 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.362891:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3e00, rc 0) 00000100:00100000:2.0:1746065223.362938:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+13:2643:x1830881265534336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 294us (514us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.362943:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14664 00000100:00100000:2.0:1746065223.362964:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265534720 00000100:00100000:2.0:1746065223.362966:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265534720 00000100:00100000:2.0:1746065223.362984:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17886 00000100:00100000:2.0:1746065223.362988:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2637:x1830881265534720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.362995:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.363003:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a00a expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.363018:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 31 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.363024:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.363026:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.363029:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 12 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.363053:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 31 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.363067:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 31 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.363077:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264045440:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.363123:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.363182:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2107 00000100:00100000:3.0:1746065223.363188:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265534592:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065223.366950:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.367429:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265535104 00000100:00100000:1.0:1746065223.367437:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265535104 00000100:00100000:1.0:1746065223.367491:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5520 00000100:00100000:1.0:1746065223.367498:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+13:2643:x1830881265535104:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065223.367656:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2643:x1830881265535104:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 157us (711us total) trans 8589937190 rc 0/0 00000100:00100000:1.0:1746065223.367662:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5520 00000100:00100000:2.0:1746065223.367869:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092528700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264045440:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.367894:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 12 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.367908:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2a00, rc 0) 00000100:00100000:2.0:1746065223.367929:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2637:x1830881265534720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4940us (5496us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.367935:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17886 00000100:00100000:3.0:1746065223.368391:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265534592:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5202us (6010us total) trans 0 rc 319488/319488 00000100:00100000:3.0:1746065223.368398:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2107 00002000:00100000:3.0:1746065223.368405:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (3874816->4194303) req@ffff88011dad5f80 x1830881265534592/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:H/200/0 rc 319488/319488 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.368412:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88011dad5f80 with x1830881265534592 ext(3874816->4194303) 00010000:00010000:3.0:1746065223.368417:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 31 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.368428:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 31 pid: 11461 timeout: 919 lvb_type: 0 00002000:00010000:3.0:1746065223.368433:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88011dad5f80 00000100:00100000:0.0:1746065223.370985:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.372917:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265535360 00000100:00100000:3.0:1746065223.372927:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265535360 00002000:00100000:3.0:1746065223.372970:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880097fa0700 x1830881265535360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.372979:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0700 with x1830881265535360 ext(3145728->4194303) 00002000:00010000:3.0:1746065223.372984:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0700 00000100:00100000:3.0:1746065223.373387:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6407 00000100:00100000:3.0:1746065223.373395:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881265535360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065223.374265:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.386579:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265534848 00000100:00100000:3.0:1746065223.386591:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265534848 00002000:00100000:3.0:1746065223.386629:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3874815) req@ffff880092528700 x1830881265534848/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.386639:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092528700 with x1830881265534848 ext(3145728->3874815) 00010000:00010000:3.0:1746065223.386647:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 31 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.386660:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 31 pid: 11461 timeout: 919 lvb_type: 0 00002000:00010000:3.0:1746065223.386666:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092528700 00000100:00100000:3.0:1746065223.386687:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2108 00000100:00100000:3.0:1746065223.386694:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265534848:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065223.386916:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.387070:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265535488 00000100:00100000:2.0:1746065223.387074:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265535488 00000100:00100000:2.0:1746065223.387105:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17887 00000100:00100000:2.0:1746065223.387110:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2640:x1830881265535488:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.387119:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.387130:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a011 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.387147:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.387149:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.387153:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 34 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.387162:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 34 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.387171:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800727a8800, rc 0) 00000100:00100000:2.0:1746065223.387194:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2640:x1830881265535488:12345-192.168.202.27@tcp:101:cat.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.387199:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17887 00000100:00100000:3.0:1746065223.388310:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2005:x1830881265535360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14913us (17329us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065223.388318:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6407 00002000:00100000:3.0:1746065223.388325:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff880097fa0700 x1830881265535360/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.388332:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0700 with x1830881265535360 ext(3145728->4194303) 00002000:00010000:3.0:1746065223.388336:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa0700 00000100:00100000:3.0:1746065223.398589:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265534848:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11886us (24316us total) trans 17179874376 rc 0/0 00000100:00100000:3.0:1746065223.398600:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2108 00002000:00100000:3.0:1746065223.398610:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3874815) req@ffff880092528700 x1830881265534848/t17179874376(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/448 e 0 to 0 dl 1746065234 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.398619:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092528700 with x1830881265534848 ext(3145728->3874815) 00010000:00010000:3.0:1746065223.398628:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 34 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.398643:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 34 pid: 11461 timeout: 919 lvb_type: 0 00002000:00010000:3.0:1746065223.398649:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092528700 00000100:00100000:0.0:1746065223.424071:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.424466:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265535616 00000100:00100000:2.0:1746065223.424474:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265535616 00010000:00010000:2.0:1746065223.424517:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 34 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.424666:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8366 00000100:00100000:2.0:1746065223.424674:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881265535616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.424685:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.424703:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 34 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.424714:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 34 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.424733:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147a6a8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->3874815) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f93 expref: 34 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.424761:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.424763:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.424768:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.424799:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.424806:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.424807:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.424810:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.424816:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.424841:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.424852:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264045568:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065223.424942:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.424950:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264045696:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065223.424967:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.429690:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.431286:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265535744 00000100:00100000:3.0:1746065223.431306:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265535744 00000100:00100000:2.0:1746065223.432835:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17888 00000100:00100000:2.0:1746065223.432847:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2645:x1830881265535744:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065223.432862:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.432877:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a018 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.432901:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.432909:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc147a6af lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f9a expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.432915:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.432921:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.432922:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.432925:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [765952->1048575] (req 765952->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 13 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.432948:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.432959:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 33 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.432969:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264045824:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.433058:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264045568:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065223.433088:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc147a6af lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f9a expref: 12 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.433096:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc147a6af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f9a expref: 12 pid: 9548 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.433107:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264045952:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.433446:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.433459:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 13 pid: 3068 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.433715:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092529180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264046080:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.433737:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.435590:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.435637:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.435708:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264045696:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065223.435728:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.435757:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265535616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 11084us (11692us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.435766:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8366 00000100:00100000:2.0:1746065223.435819:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265536000 00000100:00100000:2.0:1746065223.435823:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265536000 00002000:00100000:2.0:1746065223.435848:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880097fa3b80 x1830881265536000/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.435861:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3b80 with x1830881265536000 ext(2097152->3145727) 00002000:00010000:2.0:1746065223.435866:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa3b80 00000100:00100000:2.0:1746065223.435876:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265536256 00000100:00100000:2.0:1746065223.435878:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265536256 00002000:00100000:2.0:1746065223.435887:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012dc3ce00 x1830881265536256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.435893:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ce00 with x1830881265536256 ext(3145728->4194303) 00002000:00010000:2.0:1746065223.435896:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3ce00 00000100:00100000:2.0:1746065223.435905:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6408 00000100:00100000:2.0:1746065223.435910:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265536000:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065223.436098:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6409 00000100:00100000:1.0:1746065223.436105:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265536256:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065223.442735:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.442755:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.442792:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265536384 00000100:00100000:3.0:1746065223.442799:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265536384 00010000:00010000:3.0:1746065223.442827:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc147a6af lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f9a expref: 13 pid: 9548 timeout: 919 lvb_type: 1 00000100:00100000:3.0:1746065223.442849:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265536640 00000100:00100000:3.0:1746065223.442851:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265536640 00010000:00010000:3.0:1746065223.442860:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 16 pid: 3068 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.442880:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8367 00000100:00100000:3.0:1746065223.442886:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265536384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.442896:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.442911:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc147a6af lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f9a expref: 13 pid: 9548 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.442920:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc147a6af lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f9a expref: 13 pid: 9548 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746065223.442925:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8368 00000100:00100000:0.0:1746065223.442934:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265536640:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.442939:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065223.442941:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065223.442951:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 16 pid: 3068 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.442965:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 16 pid: 3068 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.442972:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265536384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 86us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.442977:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8367 00010000:00010000:0.0:1746065223.442977:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065223.442998:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135138a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265536640:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.443003:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8368 00000100:00100000:3.0:1746065223.443019:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.443035:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265536512 00000100:00100000:0.0:1746065223.443038:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265536512 00010000:00010000:0.0:1746065223.443050:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 35 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746065223.443071:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8369 00000100:00100000:0.0:1746065223.443076:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265536512:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065223.443083:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065223.443089:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 35 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.443097:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 35 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.443108:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.443115:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.443121:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.443134:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.443160:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065223.443170:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881264046208:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065223.443219:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00010000:00010000:2.0:1746065223.443396:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489800/0xad6b7ddc147a662 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f62 expref: 35 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.444499:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264045824:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.444520:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a800/0xad6b7ddc147a6af lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f9a expref: 12 pid: 9548 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.444531:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264045952:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.444540:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577a600/0xad6b7ddc147a65b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f5b expref: 15 pid: 3068 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.444548:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092529180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264046080:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.444574:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 14 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.444583:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2e00, rc 0) 00000100:00100000:2.0:1746065223.444611:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2645:x1830881265535744:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11768us (14928us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.444618:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17888 00000100:00100000:0.0:1746065223.452616:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.452827:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9565:1830881264046208:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065223.452843:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.452876:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881265536512:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9799us (9856us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.452885:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8369 00000100:00100000:1.0:1746065223.452917:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265536896 00000100:00100000:1.0:1746065223.452923:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265536896 00002000:00100000:1.0:1746065223.452954:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (765952->770047) req@ffff88012dc3ea00 x1830881265536896/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.452963:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ea00 with x1830881265536896 ext(765952->770047) 00002000:00010000:1.0:1746065223.452967:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3ea00 00000100:00100000:1.0:1746065223.452984:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6410 00000100:00100000:1.0:1746065223.452989:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265536896:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065223.453077:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2005:x1830881265536896:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 88us (467us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065223.453083:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6410 00000100:00100000:3.0:1746065223.453084:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265536000:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 17172us (17497us total) trans 0 rc 1048576/1048576 00002000:00100000:1.0:1746065223.453088:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (765952->770047) req@ffff88012dc3ea00 x1830881265536896/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065223.453090:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6408 00002000:00100000:1.0:1746065223.453094:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ea00 with x1830881265536896 ext(765952->770047) 00002000:00100000:3.0:1746065223.453095:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880097fa3b80 x1830881265536000/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00010000:1.0:1746065223.453097:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3ea00 00002000:00100000:3.0:1746065223.453101:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3b80 with x1830881265536000 ext(2097152->3145727) 00002000:00010000:3.0:1746065223.453105:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa3b80 00000100:00100000:0.0:1746065223.459287:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.459370:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.459681:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265536256:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23575us (24043us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065223.459690:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6409 00002000:00100000:2.0:1746065223.459698:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012dc3ce00 x1830881265536256/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.459705:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3ce00 with x1830881265536256 ext(3145728->4194303) 00002000:00010000:2.0:1746065223.459710:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3ce00 00000100:00100000:2.0:1746065223.459742:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265537024 00000100:00100000:2.0:1746065223.459747:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265537024 00000100:00100000:2.0:1746065223.459768:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265537152 00000100:00100000:2.0:1746065223.459770:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265537152 00000100:00100000:2.0:1746065223.459811:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17889 00000100:00100000:2.0:1746065223.459816:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2645:x1830881265537024:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065223.459829:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.459843:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a01f expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.459865:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.459872:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc147a6b6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa1 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.459878:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.459884:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.459885:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.459889:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1048576->1454079] (req 1048576->1454079) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.459912:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 22 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.459922:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 22 pid: 12258 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.459931:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092529180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264046336:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.459980:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc147a6b6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa1 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.459987:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc147a6b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa1 expref: 14 pid: 9548 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.459993:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264046464:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.460014:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.460020:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 15 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.460026:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264046592:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.460039:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.460054:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17890 00000100:00100000:2.0:1746065223.460059:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2637:x1830881265537152:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.460065:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.460070:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a026 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.460081:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.460086:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.460087:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.460089:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.460100:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.460111:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 22 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.460117:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264046720:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.460135:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.464221:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.464254:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.464271:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.464282:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265537408 00000100:00100000:3.0:1746065223.464305:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265537408 00010000:00010000:3.0:1746065223.464332:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 23 pid: 12258 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.464353:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265537536 00000100:00100000:3.0:1746065223.464355:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265537536 00010000:00010000:3.0:1746065223.464361:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 17 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746065223.464364:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265537280 00000100:00100000:0.0:1746065223.464368:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265537280 00000100:00100000:3.0:1746065223.464373:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8370 00000100:00100000:3.0:1746065223.464378:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881265537408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065223.464382:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc147a6b6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa1 expref: 15 pid: 9548 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.464389:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.464403:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 23 pid: 12258 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.464412:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 23 pid: 12258 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.464428:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.464456:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881265537408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 78us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.464461:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8370 00000100:00100000:3.0:1746065223.464471:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8371 00000100:00100000:3.0:1746065223.464475:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265537536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.464480:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.464484:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 17 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.464494:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 17 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.464503:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.464511:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265537536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 36us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.464515:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8371 00000100:00100000:3.0:1746065223.464520:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8372 00000100:00100000:3.0:1746065223.464524:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265537280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.464528:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.464532:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc147a6b6 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa1 expref: 15 pid: 9548 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.464538:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc147a6b6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa1 expref: 15 pid: 9548 timeout: 919 lvb_type: 1 00010000:00010000:3.0:1746065223.464545:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.464547:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.464552:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.464558:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.464581:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.464591:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264046848:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.464628:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f016c00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.465096:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264046720:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.465118:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.465127:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dda00, rc 0) 00000100:00100000:2.0:1746065223.465145:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2637:x1830881265537152:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5086us (5775us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.465150:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17890 00010000:00010000:2.0:1746065223.465171:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147a670 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f70 expref: 22 pid: 12258 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.465684:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092529180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264046336:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.465699:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71b800/0xad6b7ddc147a6b6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa1 expref: 15 pid: 9548 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.465707:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264046464:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.465716:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b61800/0xad6b7ddc147a669 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f69 expref: 15 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.465727:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264046592:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.465742:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 14 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.465749:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd600, rc 0) 00000100:00100000:2.0:1746065223.465766:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2645:x1830881265537024:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 5950us (6487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.465794:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17889 00000100:00100000:1.0:1746065223.466141:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.466203:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265537664 00000100:00100000:3.0:1746065223.466208:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265537664 00002000:00100000:3.0:1746065223.466233:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3080192->3145727) req@ffff880099cf2d80 x1830881265537664/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.466241:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2d80 with x1830881265537664 ext(3080192->3145727) 00010000:00010000:3.0:1746065223.466246:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 22 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.466256:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 22 pid: 11461 timeout: 919 lvb_type: 0 00002000:00010000:3.0:1746065223.466262:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cf2d80 00000100:00100000:3.0:1746065223.466284:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2109 00000100:00100000:3.0:1746065223.466298:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265537664:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065223.466813:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.466901:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265537792 00000100:00100000:2.0:1746065223.466905:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265537792 00000100:00100000:2.0:1746065223.466924:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17891 00000100:00100000:2.0:1746065223.466929:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+24:2640:x1830881265537792:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.466937:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.466947:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a02d expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.466960:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.466962:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.466965:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.466974:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.466981:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2800, rc 0) 00000100:00100000:2.0:1746065223.467207:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2640:x1830881265537792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 275us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.467212:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17891 00000100:00100000:0.0:1746065223.473456:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265537664:12345-192.168.202.27@tcp:4:cat.0 Request processed in 7158us (7308us total) trans 21474841755 rc 0/0 00000100:00100000:0.0:1746065223.473468:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2109 00002000:00100000:0.0:1746065223.473477:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3080192->3145727) req@ffff880099cf2d80 x1830881265537664/t21474841755(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/448 e 0 to 0 dl 1746065234 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065223.473492:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf2d80 with x1830881265537664 ext(3080192->3145727) 00010000:00010000:0.0:1746065223.473501:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 25 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.473513:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 25 pid: 11461 timeout: 919 lvb_type: 0 00002000:00010000:0.0:1746065223.473518:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099cf2d80 00000100:00100000:3.0:1746065223.474250:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264046848:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.474265:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.474289:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265537280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9763us (10015us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.474305:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8372 00000100:00100000:0.0:1746065223.478674:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.480813:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265538048 00000100:00100000:2.0:1746065223.480824:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265538048 00002000:00100000:2.0:1746065223.480866:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1449984->1454079) req@ffff88012dc3c000 x1830881265538048/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.480875:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3c000 with x1830881265538048 ext(1449984->1454079) 00002000:00010000:2.0:1746065223.480880:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3c000 00000100:00100000:2.0:1746065223.480905:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6411 00000100:00100000:2.0:1746065223.480912:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265538048:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065223.481044:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265538048:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 132us (2376us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065223.481050:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6411 00002000:00100000:2.0:1746065223.481056:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1449984->1454079) req@ffff88012dc3c000 x1830881265538048/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.481063:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3c000 with x1830881265538048 ext(1449984->1454079) 00002000:00010000:2.0:1746065223.481065:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3c000 00000100:00100000:0.0:1746065223.488435:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.488526:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.488581:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265538432 00000100:00100000:1.0:1746065223.488590:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265538432 00000100:00100000:1.0:1746065223.488639:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5521 00000100:00100000:1.0:1746065223.488645:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2645:x1830881265538432:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065223.488659:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265538176 00000100:00100000:3.0:1746065223.488663:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265538176 00010000:00010000:3.0:1746065223.488683:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 25 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.488705:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8373 00000100:00100000:3.0:1746065223.488711:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265538176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.488719:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.488733:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 25 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.488744:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 25 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.488761:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2a00/0xad6b7ddc147a677 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3080192->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f77 expref: 25 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.488796:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.488798:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.488804:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.488812:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.488818:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.488819:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.488822:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 24 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.488828:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 24 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065223.488835:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2645:x1830881265538432:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 189us (308us total) trans 8589937191 rc 0/0 00000100:00100000:1.0:1746065223.488841:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5521 00010000:00010000:3.0:1746065223.488853:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 24 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.488863:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264046976:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.488921:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.488929:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264047104:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.488946:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012f016d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.492887:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264046976:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.492898:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264047104:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.492915:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.492962:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+24:2005:x1830881265538176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4250us (4534us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.492971:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8373 00000100:00100000:0.0:1746065223.495136:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.495221:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265538688 00000100:00100000:2.0:1746065223.495229:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265538688 00002000:00100000:2.0:1746065223.495266:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012dc3f480 x1830881265538688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.495275:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3f480 with x1830881265538688 ext(3145728->4194303) 00002000:00010000:2.0:1746065223.495279:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3f480 00000100:00100000:2.0:1746065223.495306:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6412 00000100:00100000:2.0:1746065223.495312:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265538688:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065223.498798:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.498855:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.498918:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265539072 00000100:00100000:2.0:1746065223.498926:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265539072 00002000:00100000:2.0:1746065223.498960:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012dc3f100 x1830881265539072/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.498970:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3f100 with x1830881265539072 ext(3145728->4194303) 00002000:00010000:2.0:1746065223.498974:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3f100 00000100:00100000:2.0:1746065223.498997:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265539200 00000100:00100000:2.0:1746065223.498999:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265539200 00002000:00100000:2.0:1746065223.499008:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009834df80 x1830881265539200/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.499014:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834df80 with x1830881265539200 ext(2097152->4194303) 00002000:00010000:2.0:1746065223.499017:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834df80 00000100:00100000:2.0:1746065223.499034:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6413 00000100:00100000:2.0:1746065223.499039:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265539072:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065223.499603:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6414 00000100:00100000:2.0:1746065223.499609:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265539200:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065223.501617:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.501671:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265539456 00000100:00100000:3.0:1746065223.501677:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265539456 00000100:00100000:3.0:1746065223.501714:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14665 00000100:00100000:3.0:1746065223.501720:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2649:x1830881265539456:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065223.501737:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.501751:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc147a781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a034 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.501827:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147a788 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.501839:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147a788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.501848:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147a788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.501859:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a78f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.501864:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.501869:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.501944:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147a796 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.501952:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147a796 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.501957:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147a796 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000004:00200000:3.0:1746065223.501964:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065223.502016:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147a788 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502021:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147a788 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502026:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147a788 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502030:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065223.502033:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147a788 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502038:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147a788 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502046:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065223.502048:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065223.502051:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147a788 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502055:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147a788 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502062:0:13395:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a78f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502066:0:13395:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a78f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502070:0:13395:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a78f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502074:0:13395:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84a200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065223.502076:0:13395:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a78f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502080:0:13395:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a78f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502085:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800924c5200) 00010000:00010000:3.0:1746065223.502086:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065223.502088:0:13395:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a78f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502095:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a78f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 13395 initiator: MDT0 00010000:00010000:3.0:1746065223.502124:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a800/0xad6b7ddc147a781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a034 expref: 36 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.502134:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147a796 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a034 expref: 35 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.502139:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065223.502141:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065223.502143:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b200, rc 0) 00000100:00100000:3.0:1746065223.502176:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2649:x1830881265539456:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 457us (564us total) trans 8589937192 rc 0/0 00000100:00100000:3.0:1746065223.502182:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14665 00000100:00100000:2.0:1746065223.516933:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265538688:12345-192.168.202.27@tcp:3:cat.0 Request processed in 21611us (21793us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065223.516944:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6412 00002000:00100000:2.0:1746065223.516954:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (3145728->4194303) req@ffff88012dc3f480 x1830881265538688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.517022:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3f480 with x1830881265538688 ext(3145728->4194303) 00002000:00010000:2.0:1746065223.517027:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012dc3f480 00000100:00100000:3.0:1746065223.517148:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265539072:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 18108us (18373us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065223.517154:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6413 00002000:00100000:3.0:1746065223.517159:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88012dc3f100 x1830881265539072/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.517165:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012dc3f100 with x1830881265539072 ext(3145728->4194303) 00002000:00010000:3.0:1746065223.517168:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012dc3f100 00000100:00100000:2.0:1746065223.522653:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265539200:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 23035us (23789us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065223.522664:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6414 00002000:00100000:2.0:1746065223.522673:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009834df80 x1830881265539200/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.522683:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009834df80 with x1830881265539200 ext(2097152->4194303) 00002000:00010000:2.0:1746065223.522688:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009834df80 00000100:00100000:0.0:1746065223.524189:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.525983:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265539584 00000100:00100000:2.0:1746065223.525992:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265539584 00000100:00100000:2.0:1746065223.526041:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17892 00000100:00100000:2.0:1746065223.526048:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265539584:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.526064:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.526080:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc147a7a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a03b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.526131:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264047232:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.526217:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.526342:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.526590:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265539712 00000100:00100000:3.0:1746065223.526594:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265539712 00000100:00100000:3.0:1746065223.526617:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17893 00000100:00100000:3.0:1746065223.526622:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265539712:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065223.526630:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.526639:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc147a7ab lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a042 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.526664:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264047360:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065223.526697:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00002000:00010000:3.0:1746065223.533508:0:12260:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065222 -> 1746065223 00002000:00010000:3.0:1746065223.533515:0:12260:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065222 -> 1746065223 00000100:00100000:3.0:1746065223.533535:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264047360:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065223.533562:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc147a7ab lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a042 expref: 25 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.533575:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a800/0xad6b7ddc147a7ab lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a042 expref: 25 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.533600:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a800, rc 0) 00000100:00100000:3.0:1746065223.533693:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135221f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265539712:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7068us (7349us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065223.533700:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17893 00002000:00010000:2.0:1746065223.533957:0:3068:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime: 1746065222 -> 1746065223 00002000:00010000:2.0:1746065223.533961:0:3068:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime: 1746065222 -> 1746065223 00000100:00100000:2.0:1746065223.533972:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264047232:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.533993:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc147a7a4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a03b expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.534002:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2c00/0xad6b7ddc147a7a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a03b expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.534027:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2c00, rc 0) 00000100:00100000:2.0:1746065223.534050:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265539584:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8003us (9865us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.534056:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17892 00000100:00100000:0.0:1746065223.543079:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.543143:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265539968 00000100:00100000:2.0:1746065223.543152:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265539968 00002000:00100000:2.0:1746065223.543190:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880135223b80 x1830881265539968/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.543199:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223b80 with x1830881265539968 ext(4194304->5038079) 00002000:00010000:2.0:1746065223.543203:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135223b80 00000100:00100000:2.0:1746065223.543235:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6415 00000100:00100000:2.0:1746065223.543242:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265539968:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065223.552005:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.553070:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135223b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265539968:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9824us (9995us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065223.553078:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6415 00002000:00100000:2.0:1746065223.553088:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880135223b80 x1830881265539968/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.553096:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135223b80 with x1830881265539968 ext(4194304->5038079) 00002000:00010000:2.0:1746065223.553101:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135223b80 00000100:00100000:2.0:1746065223.553121:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265540224 00000100:00100000:2.0:1746065223.553126:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265540224 00002000:00100000:2.0:1746065223.553151:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880135220e00 x1830881265540224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.553167:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220e00 with x1830881265540224 ext(4194304->5038079) 00002000:00010000:2.0:1746065223.553502:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135220e00 00000100:00100000:2.0:1746065223.553630:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6416 00000100:00100000:2.0:1746065223.553637:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265540224:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065223.558955:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.559800:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265540224:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6161us (7801us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065223.559809:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6416 00002000:00100000:3.0:1746065223.559818:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880135220e00 x1830881265540224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.559826:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135220e00 with x1830881265540224 ext(4194304->5038079) 00002000:00010000:3.0:1746065223.559831:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135220e00 00000100:00100000:2.0:1746065223.560089:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265540352 00000100:00100000:2.0:1746065223.560096:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265540352 00000100:00100000:2.0:1746065223.561583:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17894 00000100:00100000:2.0:1746065223.561594:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+24:2649:x1830881265540352:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065223.561607:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.561621:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a049 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.561644:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.561650:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.561652:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.561655:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1896448->2097151] (req 1896448->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.561680:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 13 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.561689:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 13 pid: 3068 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.561705:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264047488:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.561796:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.563305:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.563566:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265540608 00000100:00100000:2.0:1746065223.563573:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265540608 00000100:00100000:2.0:1746065223.564067:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5522 00000100:00100000:2.0:1746065223.564076:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b429a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2637:x1830881265540608:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065223.564247:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b429a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2637:x1830881265540608:12345-192.168.202.27@tcp:35:cat.0 Request processed in 171us (961us total) trans 8589937193 rc 0/0 00000100:00100000:2.0:1746065223.564253:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5522 00000100:00100000:2.0:1746065223.569036:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092529f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264047488:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.569066:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1896448->2097151] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 25 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.569080:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3200, rc 0) 00000100:00100000:2.0:1746065223.569154:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+25:2649:x1830881265540352:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7563us (10207us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.569161:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17894 00000100:00100000:2.0:1746065223.577621:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.577659:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.577680:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265540864 00000100:00100000:2.0:1746065223.577686:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265540864 00000100:00100000:2.0:1746065223.577720:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17895 00000100:00100000:2.0:1746065223.577727:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265540864:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.577744:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.577759:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc147a7b9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a050 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.577820:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264047616:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065223.578366:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265540736 00000100:00100000:0.0:1746065223.578371:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265540736 00002000:00100000:0.0:1746065223.578397:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1454079) req@ffff880092529f80 x1830881265540736/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065223.578406:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529f80 with x1830881265540736 ext(1048576->1454079) 00010000:00010000:0.0:1746065223.578413:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 14 pid: 3068 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.578423:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 14 pid: 3068 timeout: 919 lvb_type: 0 00002000:00010000:0.0:1746065223.578429:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092529f80 00000100:00100000:0.0:1746065223.578442:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2110 00000100:00100000:0.0:1746065223.578446:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265540736:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065223.579654:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.582518:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.582799:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265540992 00000100:00100000:3.0:1746065223.582807:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265540992 00000100:00100000:3.0:1746065223.582845:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17896 00000100:00100000:3.0:1746065223.582851:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881265540992:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065223.582866:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.582880:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a7c0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a057 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.582925:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264047744:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.583009:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264047616:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.583034:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc147a7b9 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a050 expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.583046:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3400/0xad6b7ddc147a7b9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a050 expref: 33 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.583058:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3400, rc 0) 00000100:00100000:2.0:1746065223.583090:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2007:x1830881265540864:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5363us (5430us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.583096:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17895 00000100:00100000:3.0:1746065223.583611:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.586214:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264047744:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065223.586240:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a7c0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a057 expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.586254:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a200/0xad6b7ddc147a7c0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a057 expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.586267:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a200, rc 0) 00000100:00100000:3.0:1746065223.586960:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881265540992:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4107us (4448us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065223.586969:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17896 00000100:00100000:2.0:1746065223.587656:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265540736:12345-192.168.202.27@tcp:4:cat.0 Request processed in 9206us (10040us total) trans 21474841756 rc 0/0 00000100:00100000:2.0:1746065223.587664:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2110 00002000:00100000:2.0:1746065223.587671:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->1454079) req@ffff880092529f80 x1830881265540736/t21474841756(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/448 e 0 to 0 dl 1746065234 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.587680:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529f80 with x1830881265540736 ext(1048576->1454079) 00010000:00010000:2.0:1746065223.587686:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 16 pid: 3068 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.587703:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 16 pid: 3068 timeout: 919 lvb_type: 0 00002000:00010000:2.0:1746065223.587709:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880092529f80 00000100:00100000:0.0:1746065223.591218:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.591745:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265541120 00000100:00100000:3.0:1746065223.591753:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265541120 00010000:00010000:3.0:1746065223.591802:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 16 pid: 3068 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.591845:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8374 00000100:00100000:3.0:1746065223.591853:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265541120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.591866:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.591882:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 16 pid: 3068 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.591893:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 16 pid: 3068 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.591912:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a76c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1454079) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a01f expref: 16 pid: 3068 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.591924:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.591925:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.591931:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 24 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.591938:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 24 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.591964:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 24 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.591976:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264047872:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.592057:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.592374:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.592397:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.592424:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265541248 00000100:00100000:2.0:1746065223.592428:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265541248 00000100:00100000:2.0:1746065223.592455:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265541376 00000100:00100000:2.0:1746065223.592457:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265541376 00000100:00100000:2.0:1746065223.592475:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17897 00000100:00100000:2.0:1746065223.592480:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265541248:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.592491:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.592502:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a7c7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a05e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.592528:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264048000:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.592550:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.592561:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17898 00000100:00100000:2.0:1746065223.592565:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881265541376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.592571:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.592577:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd000/0xad6b7ddc147a7ce lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a065 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.592593:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092529180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264048128:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.592606:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.596141:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092529180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264048128:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.596170:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd000/0xad6b7ddc147a7ce lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a065 expref: 26 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.596182:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dd000/0xad6b7ddc147a7ce lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a065 expref: 26 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.596200:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dd000, rc 0) 00000100:00100000:2.0:1746065223.596231:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2006:x1830881265541376:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3664us (3832us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.596238:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17898 00000100:00100000:2.0:1746065223.596286:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.596345:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265541632 00000100:00100000:2.0:1746065223.596350:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265541632 00002000:00100000:2.0:1746065223.596373:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1896448->1900543) req@ffff880092529180 x1830881265541632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.596381:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529180 with x1830881265541632 ext(1896448->1900543) 00002000:00010000:2.0:1746065223.596385:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092529180 00000100:00100000:2.0:1746065223.596396:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6417 00000100:00100000:2.0:1746065223.596401:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265541632:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065223.596469:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264047872:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.596480:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.596481:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265541632:12345-192.168.202.27@tcp:3:cat.0 Request processed in 80us (194us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065223.596485:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6417 00002000:00100000:2.0:1746065223.596489:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1896448->1900543) req@ffff880092529180 x1830881265541632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.596495:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529180 with x1830881265541632 ext(1896448->1900543) 00002000:00010000:2.0:1746065223.596498:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092529180 00000100:00100000:3.0:1746065223.596504:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265541120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4652us (5294us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.596511:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8374 00000100:00100000:0.0:1746065223.597822:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264048000:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065223.597843:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a7c7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a05e expref: 33 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.597853:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f3000/0xad6b7ddc147a7c7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a05e expref: 33 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.597867:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3000, rc 0) 00000100:00100000:0.0:1746065223.597897:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265541248:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5417us (5523us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065223.597903:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17897 00000100:00100000:0.0:1746065223.602854:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.605011:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265541888 00000100:00100000:1.0:1746065223.605021:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265541888 00000100:00100000:1.0:1746065223.605055:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5523 00000100:00100000:1.0:1746065223.605061:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2640:x1830881265541888:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065223.606684:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2640:x1830881265541888:12345-192.168.202.27@tcp:35:cat.0 Request processed in 1618us (3833us total) trans 8589937194 rc 0/0 00000100:00100000:1.0:1746065223.606691:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5523 00000100:00100000:0.0:1746065223.606884:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.607450:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265542016 00000100:00100000:1.0:1746065223.607455:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265542016 00000100:00100000:1.0:1746065223.608314:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17899 00000100:00100000:1.0:1746065223.608322:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2649:x1830881265542016:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065223.608335:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.608348:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a06c expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.608369:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.608378:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a6bd lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa8 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.608384:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 14 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.608389:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.608391:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.608394:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->1220607] (req 1048576->1220607) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.608416:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 14 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.608425:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 14 pid: 12258 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.608435:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264048256:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.608500:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a6bd lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa8 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.608507:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a6bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa8 expref: 13 pid: 9548 timeout: 919 lvb_type: 1 00000100:00100000:1.0:1746065223.608514:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264048384:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.608531:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.608538:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 26 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.608544:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264048512:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.608554:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.613797:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.613829:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.613848:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265542144 00000100:00100000:0.0:1746065223.613854:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265542144 00010000:00010000:0.0:1746065223.613883:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 15 pid: 12258 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746065223.613904:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265542272 00000100:00100000:0.0:1746065223.613906:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265542272 00010000:00010000:0.0:1746065223.613912:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a6bd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa8 expref: 14 pid: 9548 timeout: 919 lvb_type: 1 00000100:00100000:0.0:1746065223.613927:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8375 00000100:00100000:0.0:1746065223.613932:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265542144:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065223.613943:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065223.613958:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 15 pid: 12258 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.613968:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 15 pid: 12258 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.613988:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065223.614021:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265542144:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.614028:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8375 00000100:00100000:0.0:1746065223.614041:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8376 00000100:00100000:0.0:1746065223.614046:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881265542272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065223.614051:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065223.614057:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a6bd lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa8 expref: 14 pid: 9548 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746065223.614064:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a6bd lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa8 expref: 14 pid: 9548 timeout: 919 lvb_type: 1 00010000:00010000:0.0:1746065223.614073:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065223.614085:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881265542272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 39us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.614090:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8376 00010000:00010000:1.0:1746065223.614643:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147a685 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f85 expref: 14 pid: 12258 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.614668:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264048256:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.614678:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a000/0xad6b7ddc147a6bd lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fa8 expref: 13 pid: 9548 timeout: 919 lvb_type: 1 00000100:00100000:1.0:1746065223.614685:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264048384:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.614693:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264048512:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.614715:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->1220607] (req 1048576->1220607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.614724:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c285e00, rc 0) 00000100:00100000:1.0:1746065223.614755:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2649:x1830881265542016:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6433us (7870us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.614761:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17899 00000100:00100000:0.0:1746065223.624610:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.624669:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265542400 00000100:00100000:3.0:1746065223.624677:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265542400 00010000:00010000:3.0:1746065223.624704:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 26 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.624727:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8377 00000100:00100000:3.0:1746065223.624734:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265542400:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.624748:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.624764:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 26 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.624790:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 26 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.624810:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c539e00/0xad6b7ddc147a67e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939f7e expref: 26 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.624826:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.624828:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.624833:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.624845:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.624873:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.624883:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264048640:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065223.624938:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.628382:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.628447:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265542656 00000100:00100000:2.0:1746065223.628455:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265542656 00002000:00100000:2.0:1746065223.628491:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1216512->1220607) req@ffff880099e11880 x1830881265542656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.628501:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11880 with x1830881265542656 ext(1216512->1220607) 00002000:00010000:2.0:1746065223.628506:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e11880 00000100:00100000:2.0:1746065223.628523:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6418 00000100:00100000:2.0:1746065223.628529:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265542656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065223.628654:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265542656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 124us (278us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065223.628660:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6418 00002000:00100000:2.0:1746065223.628665:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1216512->1220607) req@ffff880099e11880 x1830881265542656/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.628672:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e11880 with x1830881265542656 ext(1216512->1220607) 00002000:00010000:2.0:1746065223.628674:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099e11880 00000100:00100000:3.0:1746065223.628846:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264048640:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065223.628860:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.628878:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265542400:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4145us (4276us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.628884:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8377 00000100:00100000:2.0:1746065223.638221:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.638311:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265542912 00000100:00100000:1.0:1746065223.638319:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265542912 00000100:00100000:1.0:1746065223.638354:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5524 00000100:00100000:1.0:1746065223.638361:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2649:x1830881265542912:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065223.638662:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2649:x1830881265542912:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 300us (447us total) trans 8589937195 rc 0/0 00000100:00100000:1.0:1746065223.638669:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5524 00000100:00100000:0.0:1746065223.714562:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.715500:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265543168 00000100:00100000:1.0:1746065223.715509:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265543168 00000100:00100000:1.0:1746065223.715860:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14666 00000100:00100000:1.0:1746065223.715869:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2659:x1830881265543168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.717169:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.717192:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a7dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a073 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.717285:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc147a7e3 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.717308:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc147a7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.717318:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc147a7e3 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:1.0:1746065223.717328:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:1.0:1746065223.717408:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a7dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a073 expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.717440:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc147a7e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a073 expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.717451:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065223.717453:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1746065223.717456:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835de00, rc 0) 00000100:00100000:1.0:1746065223.718519:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2659:x1830881265543168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2353us (3668us total) trans 8589937196 rc 0/0 00000100:00100000:1.0:1746065223.718530:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14666 00000100:00100000:0.0:1746065223.728771:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.728806:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.728847:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265543552 00000100:00100000:0.0:1746065223.728855:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265543552 00000100:00100000:1.0:1746065223.728866:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265543424 00000100:00100000:1.0:1746065223.728870:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265543424 00000100:00100000:2.0:1746065223.728877:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.729683:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14667 00000100:00100000:1.0:1746065223.729693:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2658:x1830881265543424:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065223.729710:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.729726:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc147a7f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a07a expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065223.730072:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265543680 00000100:00100000:0.0:1746065223.730076:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265543680 00000100:00100000:3.0:1746065223.730080:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17900 00000100:00100000:3.0:1746065223.730089:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265543552:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065223.730096:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17901 00010000:00010000:3.0:1746065223.730098:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065223.730101:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265543680:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065223.730108:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84a000/0xad6b7ddc147a7f8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a081 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.730108:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065223.730115:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07000/0xad6b7ddc147a7ff lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a088 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065223.730146:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264048768:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065223.730147:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264048896:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065223.730227:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64d80 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.730236:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2be40 going to sleep for 11 seconds 00010000:00010000:1.0:1746065223.730660:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.730673:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd2 expref: 13 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.730679:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147a718 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd9 expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.730685:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147a796 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a034 expref: 36 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.730691:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065223.730711:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147a796 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a034 expref: 36 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.730721:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147a796 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a034 expref: 36 pid: 13395 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.730729:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264049024:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.730786:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147a718 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd9 expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.730794:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147a718 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd9 expref: 21 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.730800:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264049152:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.730845:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd2 expref: 13 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.730853:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd2 expref: 13 pid: 7203 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.730860:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264049280:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.730874:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.732475:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264048896:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065223.732497:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84a000/0xad6b7ddc147a7f8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a081 expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.732508:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84a000/0xad6b7ddc147a7f8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a081 expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.732521:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84a000, rc 0) 00000100:00100000:3.0:1746065223.732550:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265543552:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2461us (3788us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065223.732557:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17900 00002000:00010000:2.0:1746065223.732582:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065222 -> 1746065223 00002000:00010000:2.0:1746065223.732586:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065222 -> 1746065223 00000100:00100000:2.0:1746065223.732594:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264048768:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.732607:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d07000/0xad6b7ddc147a7ff lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a088 expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.732619:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07000/0xad6b7ddc147a7ff lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a088 expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.732629:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07000, rc 0) 00000100:00100000:2.0:1746065223.732648:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265543680:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2547us (3771us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.732653:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17901 00000100:00100000:0.0:1746065223.735364:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.735438:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264049024:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.735448:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264049152:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.735455:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264049280:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065223.735475:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065223.735527:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.735644:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.735857:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265543808 00000100:00100000:3.0:1746065223.735863:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265543808 00010000:00010000:3.0:1746065223.735887:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147a796 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a034 expref: 37 pid: 13395 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.735904:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265543936 00000100:00100000:3.0:1746065223.735905:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265543936 00010000:00010000:3.0:1746065223.735911:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd2 expref: 14 pid: 7203 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.735921:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265544064 00000100:00100000:3.0:1746065223.735922:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265544064 00010000:00010000:3.0:1746065223.735928:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147a718 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd9 expref: 22 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.735938:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8378 00000100:00100000:3.0:1746065223.735943:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265543808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.735953:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.735958:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147a796 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a034 expref: 37 pid: 13395 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.735966:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147a796 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a034 expref: 37 pid: 13395 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.735982:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147a796 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a034 expref: 37 pid: 13395 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.735991:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065223.735995:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.736001:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.736005:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.736030:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265543808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.736035:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8378 00000100:00100000:3.0:1746065223.736044:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8379 00000100:00100000:3.0:1746065223.736047:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2007:x1830881265543936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.736052:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.736055:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd2 expref: 14 pid: 7203 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.736062:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd2 expref: 14 pid: 7203 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.736071:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61800/0xad6b7ddc147a6fc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd2 expref: 14 pid: 7203 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.736080:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065223.736082:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.736087:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.736091:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.736104:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265543936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 55us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.736108:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8379 00000100:00100000:3.0:1746065223.736138:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8380 00000100:00100000:3.0:1746065223.736142:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2007:x1830881265544064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065223.736148:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065223.736152:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147a718 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd9 expref: 22 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.736159:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147a718 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd9 expref: 22 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.736169:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61e00/0xad6b7ddc147a718 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fd9 expref: 22 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.736176:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065223.736179:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.736185:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.736191:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.736206:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065223.736219:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265544064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 76us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.736225:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8380 00010000:00010000:0.0:1746065223.737143:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065223.737151:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:0.0:1746065223.737167:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:0.0:1746065223.737273:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c200/0xad6b7ddc147a7f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a07a expref: 22 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.737305:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a07a expref: 21 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.737311:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065223.737314:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065223.737316:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835c400, rc 0) 00000100:00100000:0.0:1746065223.737342:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2658:x1830881265543424:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7651us (8572us total) trans 8589937197 rc 0/0 00000100:00100000:0.0:1746065223.737348:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14667 00000100:00100000:0.0:1746065223.738402:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.738451:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265544320 00000100:00100000:2.0:1746065223.738458:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265544320 00002000:00100000:2.0:1746065223.738485:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (0->765951) req@ffff880099e12d80 x1830881265544320/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.738491:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e12d80 with x1830881265544320 ext(0->765951) 00002000:00010000:2.0:1746065223.738494:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e12d80 00000100:00100000:2.0:1746065223.738514:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6419 00000100:00100000:2.0:1746065223.738520:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265544320:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065223.745607:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265544320:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7079us (7198us total) trans 0 rc 765952/765952 00000100:00100000:2.0:1746065223.745617:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6419 00002000:00100000:2.0:1746065223.745626:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x75:0x0] (0->765951) req@ffff880099e12d80 x1830881265544320/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 765952/765952 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.745635:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e12d80 with x1830881265544320 ext(0->765951) 00002000:00010000:2.0:1746065223.745640:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099e12d80 00000100:00100000:0.0:1746065223.769091:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.769181:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265544448 00000100:00100000:2.0:1746065223.769189:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265544448 00000100:00100000:2.0:1746065223.769283:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17902 00000100:00100000:2.0:1746065223.769300:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2659:x1830881265544448:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.769317:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.769333:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a08f expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.769358:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 24 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.769365:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.769366:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.769369:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 15 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.769394:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 24 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.769404:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 24 pid: 3068 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.769414:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264049408:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.770274:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.774091:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.774362:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264049408:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.774384:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 15 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.774401:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dc600, rc 0) 00000100:00100000:2.0:1746065223.774432:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2659:x1830881265544448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5142us (5348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.774440:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17902 00000100:00100000:3.0:1746065223.775194:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265544576 00000100:00100000:3.0:1746065223.775201:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265544576 00002000:00100000:3.0:1746065223.775229:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1896448->2097151) req@ffff880099e13b80 x1830881265544576/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.775237:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13b80 with x1830881265544576 ext(1896448->2097151) 00010000:00010000:3.0:1746065223.775243:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 25 pid: 3068 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.775253:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 25 pid: 3068 timeout: 919 lvb_type: 0 00002000:00010000:3.0:1746065223.775259:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e13b80 00000100:00100000:3.0:1746065223.775278:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2111 00000100:00100000:3.0:1746065223.775284:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265544576:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065223.789127:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265544576:12345-192.168.202.27@tcp:4:cat.0 Request processed in 13833us (15034us total) trans 21474841757 rc 0/0 00000100:00100000:1.0:1746065223.789138:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2111 00002000:00100000:1.0:1746065223.789149:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1896448->2097151) req@ffff880099e13b80 x1830881265544576/t21474841757(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/448 e 0 to 0 dl 1746065234 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.789157:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099e13b80 with x1830881265544576 ext(1896448->2097151) 00010000:00010000:1.0:1746065223.789167:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 27 pid: 3068 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746065223.789180:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 27 pid: 3068 timeout: 919 lvb_type: 0 00002000:00010000:1.0:1746065223.789186:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099e13b80 00000100:00100000:0.0:1746065223.801598:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.802121:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.802190:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265544832 00000100:00100000:2.0:1746065223.802197:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265544832 00000100:00100000:2.0:1746065223.802245:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14668 00000100:00100000:2.0:1746065223.802252:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+13:2660:x1830881265544832:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.802273:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.802295:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc147a81b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a096 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.802344:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a822 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.802354:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.802362:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a822 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.802374:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc147a829 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.802378:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc147a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.802383:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc147a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.802433:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.802441:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a07a expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.802447:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.802469:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a07a expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.802478:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a07a expref: 20 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.802487:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264049536:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.802552:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065223.803170:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265544704 00000100:00100000:1.0:1746065223.803177:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265544704 00010000:00010000:1.0:1746065223.803197:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 27 pid: 3068 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.803226:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8381 00000100:00100000:1.0:1746065223.803232:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265544704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065223.803241:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065223.803258:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 27 pid: 3068 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746065223.803274:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 27 pid: 3068 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746065223.803300:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3200/0xad6b7ddc147a7b2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1896448->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a049 expref: 27 pid: 3068 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746065223.803320:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.803321:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.803327:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 14 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.803333:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 14 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.803350:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 14 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065223.803356:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881264049664:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065223.803393:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fc00 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.804156:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264049536:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.804173:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065223.806815:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.806916:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265544960 00000100:00100000:2.0:1746065223.806922:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265544960 00010000:00010000:2.0:1746065223.806951:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a07a expref: 21 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.806984:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8382 00000100:00100000:2.0:1746065223.806990:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265544960:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.807004:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.807008:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a07a expref: 21 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.807019:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a07a expref: 21 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.807037:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835c400/0xad6b7ddc147a806 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a07a expref: 21 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.807052:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.807056:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.807065:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.807071:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.807100:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.807132:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265544960:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 142us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.807138:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8382 00010000:00010000:3.0:1746065223.807243:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807250:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065223.807302:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065223.807307:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065223.807321:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807329:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807338:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a822 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807343:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a822 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807348:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a822 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807352:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807357:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dd600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065223.807360:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a822 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807365:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a822 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807373:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065223.807375:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065223.807378:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a822 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807382:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dd600/0xad6b7ddc147a822 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807394:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc147a829 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807399:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc147a829 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807404:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc147a829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807407:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f3dc400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065223.807409:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc147a829 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807413:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc147a829 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807419:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b7e52700) 00010000:00010000:3.0:1746065223.807421:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065223.807423:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc147a829 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807427:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc400/0xad6b7ddc147a829 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.807453:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dc000/0xad6b7ddc147a81b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a096 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.807464:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a096 expref: 14 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.807469:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065223.807471:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065223.807473:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3dcc00, rc 0) 00000100:00100000:3.0:1746065223.807495:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2660:x1830881265544832:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5244us (5375us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.807502:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14668 00000100:00100000:1.0:1746065223.808057:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881264049664:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065223.808070:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065223.808102:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265544704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4869us (6511us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.808108:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8381 00000100:00100000:1.0:1746065223.813690:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.813763:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265545216 00000100:00100000:2.0:1746065223.813770:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265545216 00002000:00100000:2.0:1746065223.813818:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88012f1a7b80 x1830881265545216/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.813826:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7b80 with x1830881265545216 ext(1048576->2097151) 00002000:00010000:2.0:1746065223.813830:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7b80 00000100:00100000:2.0:1746065223.813855:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6420 00000100:00100000:2.0:1746065223.813860:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265545216:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065223.814733:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.821936:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265545344 00000100:00100000:2.0:1746065223.821948:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265545344 00000100:00100000:2.0:1746065223.822003:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17903 00000100:00100000:2.0:1746065223.822010:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265545344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.822025:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.822041:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc147a837 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a09d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.822087:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264049792:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.822999:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.823017:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265545472 00000100:00100000:2.0:1746065223.823020:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265545472 00000100:00100000:2.0:1746065223.823040:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17904 00000100:00100000:2.0:1746065223.823045:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265545472:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.823053:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.823062:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147a83e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0a4 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.823076:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.823077:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.823084:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147a83e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0a4 expref: 14 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.823097:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147a83e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0a4 expref: 14 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.823106:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d200, rc 0) 00000100:00100000:2.0:1746065223.823128:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265545472:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 83us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.823133:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17904 00000100:00100000:2.0:1746065223.823176:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.823188:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265545600 00000100:00100000:2.0:1746065223.823190:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265545600 00000100:00100000:2.0:1746065223.823204:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17905 00000100:00100000:2.0:1746065223.823209:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265545600:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.823215:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.823221:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc147a845 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0ab expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.823243:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092529880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264049920:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.823282:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.823311:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265545728 00000100:00100000:2.0:1746065223.823313:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265545728 00000100:00100000:2.0:1746065223.823330:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17906 00000100:00100000:2.0:1746065223.823334:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265545728:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.823340:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.823347:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147a84c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0b2 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.823357:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.823358:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.823363:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147a84c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b2 expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.823372:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147a84c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b2 expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.823379:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:2.0:1746065223.823393:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265545728:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 58us (111us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.823398:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17906 00000100:00100000:2.0:1746065223.823428:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.823440:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265545856 00000100:00100000:2.0:1746065223.823442:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265545856 00000100:00100000:2.0:1746065223.823456:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17907 00000100:00100000:2.0:1746065223.823460:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+16:2005:x1830881265545856:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.823466:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.823472:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc147a853 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0b9 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.823480:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.823481:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.823485:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc147a853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b9 expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.823493:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc147a853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b9 expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.823500:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f800, rc 0) 00000100:00100000:2.0:1746065223.823513:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265545856:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 52us (85us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.823518:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17907 00000100:00100000:2.0:1746065223.823556:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.823567:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265545984 00000100:00100000:2.0:1746065223.823570:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265545984 00000100:00100000:2.0:1746065223.823585:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17908 00000100:00100000:2.0:1746065223.823589:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2658:x1830881265545984:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065223.823594:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.823600:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0c0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.823612:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 13 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.823619:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147a84c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b2 expref: 14 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.823624:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 31 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.823629:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.823631:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.823634:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3592192->4124671] (req 3592192->4124671) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.823653:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 31 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.823667:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 31 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.823676:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264050048:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.827106:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.827159:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00010000:00010000:2.0:1746065223.827232:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147a84c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b2 expref: 14 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.827245:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147a84c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b2 expref: 14 pid: 12260 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.827256:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264050176:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.827340:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 13 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.827349:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 13 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.827356:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264050304:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.827370:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.830298:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2006:x1830881265545216:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16425us (16602us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065223.830308:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6420 00002000:00100000:2.0:1746065223.830316:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff88012f1a7b80 x1830881265545216/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.830323:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7b80 with x1830881265545216 ext(1048576->2097151) 00002000:00010000:2.0:1746065223.830327:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7b80 00002000:00010000:2.0:1746065223.832895:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime: 1746065223 -> 1746065224 00000100:00100000:2.0:1746065223.832921:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264049792:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.832951:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc147a837 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a09d expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.832963:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f3ddc00/0xad6b7ddc147a837 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a09d expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.833561:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f3ddc00, rc 0) 00000100:00100000:1.0:1746065223.833597:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092529880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264049920:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.833605:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265545344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11593us (18872us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.833612:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17903 00010000:00010000:1.0:1746065223.833614:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc147a845 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ab expref: 16 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.833623:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993fc00/0xad6b7ddc147a845 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ab expref: 16 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.833633:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993fc00, rc 0) 00000100:00100000:1.0:1746065223.833649:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265545600:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 10440us (10473us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065223.833655:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17905 00000100:00100000:2.0:1746065223.833698:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264050048:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065223.833762:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264050176:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.833809:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.833889:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264050304:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065223.833911:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [3592192->4124671] (req 3592192->4124671) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 13 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.833922:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993e400, rc 0) 00000100:00100000:3.0:1746065223.834170:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2658:x1830881265545984:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 10579us (10613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.834176:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17908 00000100:00100000:1.0:1746065223.834176:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265546240 00000100:00100000:1.0:1746065223.834181:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265546240 00010000:00010000:1.0:1746065223.834201:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147a84c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b2 expref: 13 pid: 12260 timeout: 919 lvb_type: 1 00000100:00100000:2.0:1746065223.834220:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.834225:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265546112 00000100:00100000:1.0:1746065223.834227:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265546112 00000100:00100000:2.0:1746065223.834237:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8383 00010000:00010000:1.0:1746065223.834237:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 32 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.834243:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265546240:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065223.834248:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8384 00000100:00100000:1.0:1746065223.834252:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2005:x1830881265546112:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.834253:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065223.834257:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.834263:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147a84c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b2 expref: 13 pid: 12260 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746065223.834263:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 32 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.834272:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147a84c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b2 expref: 13 pid: 12260 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746065223.834279:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 32 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.834307:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993f200/0xad6b7ddc147a84c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b2 expref: 13 pid: 12260 timeout: 919 lvb_type: 1 00010000:00010000:1.0:1746065223.834310:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800727a8800/0xad6b7ddc147a75e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a011 expref: 32 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.834316:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065223.834317:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.834349:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265546240:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.834349:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265546112:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.834354:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8384 00000100:00100000:2.0:1746065223.834357:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8383 00000100:00100000:1.0:1746065223.843489:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.843968:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265546368 00000100:00100000:2.0:1746065223.843976:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265546368 00010000:00010000:2.0:1746065223.844004:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 13 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.844036:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8385 00000100:00100000:2.0:1746065223.844043:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265546368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.844056:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065223.844800:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065223.845051:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 13 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.845062:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 13 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.845081:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2a00/0xad6b7ddc147a757 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a00a expref: 13 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.845093:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.845095:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.845100:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.845106:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.845132:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 12 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.845142:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264050432:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065223.845193:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9000 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.845256:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265546752 00000100:00100000:3.0:1746065223.845260:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265546752 00000100:00100000:3.0:1746065223.845298:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17909 00000100:00100000:3.0:1746065223.845304:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2659:x1830881265546752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065223.845315:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.845326:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0ce expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.845343:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.845347:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065223.845348:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065223.845351:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.845377:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.845385:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 25 pid: 9550 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.845393:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264050560:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065223.845427:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.846747:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.848137:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265546624 00000100:00100000:3.0:1746065223.848145:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265546624 00000100:00100000:3.0:1746065223.848194:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14669 00000100:00100000:3.0:1746065223.848201:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+14:2660:x1830881265546624:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065223.848214:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.848228:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147a868 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0c7 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.848321:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.848333:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a096 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.848340:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.848362:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a096 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.848374:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a096 expref: 15 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.848383:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264050688:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065223.848459:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.849114:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264050432:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065223.849127:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.849152:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2007:x1830881265546368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5110us (5672us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.849160:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8385 00000100:00100000:3.0:1746065223.855389:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0000_UUID:12260:1830881264050560:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065223.855417:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 16 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.855431:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73800, rc 0) 00000100:00100000:2.0:1746065223.855588:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264050688:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065223.855601:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065223.858144:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2659:x1830881265546752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 12830us (13337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.858155:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17909 00000100:00100000:0.0:1746065223.858366:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.858393:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.858413:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265547008 00000100:00100000:0.0:1746065223.858419:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265547008 00002000:00100000:0.0:1746065223.858454:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (3592192->3596287) req@ffff880090dda300 x1830881265547008/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065223.858463:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dda300 with x1830881265547008 ext(3592192->3596287) 00002000:00010000:0.0:1746065223.858468:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090dda300 00000100:00100000:0.0:1746065223.858493:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265547136 00000100:00100000:0.0:1746065223.858495:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265547136 00002000:00100000:0.0:1746065223.858507:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1220607) req@ffff880090dd9f80 x1830881265547136/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065223.858514:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9f80 with x1830881265547136 ext(1048576->1220607) 00010000:00010000:0.0:1746065223.858520:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 26 pid: 9550 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.858531:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 26 pid: 9550 timeout: 919 lvb_type: 0 00002000:00010000:0.0:1746065223.858536:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090dd9f80 00000100:00100000:0.0:1746065223.858548:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2112 00000100:00100000:0.0:1746065223.858554:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2006:x1830881265547136:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065223.858667:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6421 00000100:00100000:3.0:1746065223.858672:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265547008:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065223.859493:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265547008:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 818us (1125us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065223.859500:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6421 00002000:00100000:3.0:1746065223.859506:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (3592192->3596287) req@ffff880090dda300 x1830881265547008/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.859512:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dda300 with x1830881265547008 ext(3592192->3596287) 00002000:00010000:3.0:1746065223.859515:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090dda300 00000100:00100000:0.0:1746065223.859609:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.859724:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265547264 00000100:00100000:2.0:1746065223.859729:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265547264 00010000:00010000:2.0:1746065223.859748:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a096 expref: 16 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.859793:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8386 00000100:00100000:2.0:1746065223.859798:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+16:2005:x1830881265547264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.859808:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.859813:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a096 expref: 16 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.859821:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a096 expref: 16 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.859838:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f3dcc00/0xad6b7ddc147a830 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a096 expref: 16 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.859852:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.859856:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.859864:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.859870:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.859884:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065223.859908:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265547264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 110us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.859914:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8386 00010000:00010000:2.0:1746065223.859949:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.859955:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065223.859968:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065223.860055:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73600/0xad6b7ddc147a868 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c7 expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.860066:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c7 expref: 15 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.860072:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.860074:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065223.860076:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73400, rc 0) 00000100:00100000:2.0:1746065223.860091:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+15:2660:x1830881265546624:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11891us (13347us total) trans 8589937198 rc 0/0 00000100:00100000:2.0:1746065223.860096:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14669 00000100:00100000:0.0:1746065223.865938:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.866486:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265547520 00000100:00100000:2.0:1746065223.866494:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265547520 00000100:00100000:2.0:1746065223.866529:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14670 00000100:00100000:2.0:1746065223.866535:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2665:x1830881265547520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.866552:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.866566:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc147a87d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0d5 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.866625:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147a884 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866636:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147a884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866645:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147a884 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866658:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a88b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866664:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a88b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866669:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a88b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866739:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147a892 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866747:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147a892 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866754:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147a892 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:2.0:1746065223.866761:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:2.0:1746065223.866826:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147a884 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866833:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147a884 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866838:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147a884 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866843:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147a884 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866848:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ab2c600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.866851:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147a884 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866856:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147a884 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866869:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065223.866872:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065223.866875:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147a884 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866879:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c600/0xad6b7ddc147a884 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866888:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a88b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866892:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a88b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866896:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a88b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866900:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009a4d8e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065223.866902:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a88b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866905:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a88b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866910:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b7e52600) 00010000:00010000:2.0:1746065223.866912:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065223.866914:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a88b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866917:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8e00/0xad6b7ddc147a88b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065223.866944:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ab2c000/0xad6b7ddc147a87d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0d5 expref: 39 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.866954:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147a892 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0d5 expref: 38 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.866960:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065223.866961:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1746065223.866963:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8a00, rc 0) 00000100:00100000:2.0:1746065223.867005:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+38:2665:x1830881265547520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 470us (1076us total) trans 8589937199 rc 0/0 00000100:00100000:2.0:1746065223.867010:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14670 00000100:00100000:1.0:1746065223.869220:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2006:x1830881265547136:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10661us (10820us total) trans 21474841758 rc 0/0 00000100:00100000:1.0:1746065223.869231:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2112 00002000:00100000:1.0:1746065223.869239:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1220607) req@ffff880090dd9f80 x1830881265547136/t21474841758(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/448 e 0 to 0 dl 1746065234 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.869247:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090dd9f80 with x1830881265547136 ext(1048576->1220607) 00010000:00010000:1.0:1746065223.869255:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 28 pid: 9550 timeout: 919 lvb_type: 0 00010000:00010000:1.0:1746065223.869267:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 28 pid: 9550 timeout: 919 lvb_type: 0 00002000:00010000:1.0:1746065223.869273:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880090dd9f80 00000100:00100000:2.0:1746065223.869514:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.869675:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265547648 00000100:00100000:0.0:1746065223.869681:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265547648 00000100:00100000:0.0:1746065223.870897:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14671 00000100:00100000:0.0:1746065223.870906:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+15:2660:x1830881265547648:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065223.870926:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065223.870938:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc147a8a0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0dc expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.871001:0:13395:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065223.871014:0:13395:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c7 expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.871020:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065223.871044:0:13395:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c7 expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.871053:0:13395:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c7 expref: 16 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746065223.871063:0:13395:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881264050816:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065223.871138:0:13395:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64a80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.872678:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.873256:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.873285:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.873305:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265547904 00000100:00100000:1.0:1746065223.873311:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265547904 00002000:00100000:1.0:1746065223.873341:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4120576->4124671) req@ffff88009aba5c00 x1830881265547904/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.873349:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba5c00 with x1830881265547904 ext(4120576->4124671) 00002000:00010000:1.0:1746065223.873353:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aba5c00 00000100:00100000:1.0:1746065223.873398:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6422 00000100:00100000:1.0:1746065223.873404:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265547904:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065223.873494:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2006:x1830881265547904:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 90us (239us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065223.873499:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6422 00002000:00100000:1.0:1746065223.873503:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4120576->4124671) req@ffff88009aba5c00 x1830881265547904/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/4536 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.873510:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aba5c00 with x1830881265547904 ext(4120576->4124671) 00002000:00010000:1.0:1746065223.873512:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aba5c00 00000100:00100000:2.0:1746065223.874688:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.874720:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.874732:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265548032 00000100:00100000:1.0:1746065223.874736:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265548032 00000100:00100000:1.0:1746065223.874764:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265548160 00000100:00100000:1.0:1746065223.874766:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265548160 00000100:00100000:1.0:1746065223.874789:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17910 00000100:00100000:1.0:1746065223.874795:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265548032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.874804:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.874815:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc147a8ae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0e3 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065223.874851:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264050944:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065223.874852:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265548800 00000100:00100000:3.0:1746065223.874856:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265548800 00000100:00100000:3.0:1746065223.874868:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17911 00000100:00100000:3.0:1746065223.874873:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265548160:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065223.874880:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.874888:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147a8b5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0ea expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065223.874892:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00010000:00010000:3.0:1746065223.874898:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.874900:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065223.874906:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147a8b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ea expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065223.875023:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.875038:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.875082:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265548288 00000100:00100000:2.0:1746065223.875085:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265548288 00010000:00010000:2.0:1746065223.875100:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 30 pid: 9550 timeout: 919 lvb_type: 0 00000100:00100000:2.0:1746065223.875116:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8387 00000100:00100000:2.0:1746065223.875121:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265548288:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.875128:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.875140:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 30 pid: 9550 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.875148:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 30 pid: 9550 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.875160:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009c285e00/0xad6b7ddc147a7d5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1220607) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a06c expref: 30 pid: 9550 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.875171:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.875173:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.875177:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.875183:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.875201:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.875209:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881264051072:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065223.875230:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00010000:00010000:3.0:1746065223.875324:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147a8b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ea expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065223.875334:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:3.0:1746065223.875356:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265548160:12345-192.168.202.27@tcp:101:cat.0 Request processed in 482us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.875362:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17911 00000100:00100000:3.0:1746065223.875373:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265548416 00000100:00100000:3.0:1746065223.875376:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265548416 00000100:00100000:3.0:1746065223.875388:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265548544 00000100:00100000:3.0:1746065223.875389:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265548544 00000100:00100000:1.0:1746065223.875397:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17912 00000100:00100000:1.0:1746065223.875402:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265548416:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.875408:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.875414:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147a8bc lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0f1 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.875423:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.875424:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.875428:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147a8bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0f1 expref: 30 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.875436:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147a8bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0f1 expref: 30 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.875443:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993e200, rc 0) 00000100:00100000:1.0:1746065223.875458:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265548416:12345-192.168.202.27@tcp:101:cat.0 Request processed in 56us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.875487:0:13395:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:13395:1830881264050816:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065223.875502:0:13395:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:0.0:1746065223.875536:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.875550:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265548928 00000100:00100000:0.0:1746065223.875553:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265548928 00010000:00010000:0.0:1746065223.875570:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c7 expref: 17 pid: 7231 timeout: 919 lvb_type: 0 00000100:00100000:0.0:1746065223.875584:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8388 00000100:00100000:0.0:1746065223.875588:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265548928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065223.875594:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065223.875598:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c7 expref: 17 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.875605:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c7 expref: 17 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.875617:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f73400/0xad6b7ddc147a86f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c7 expref: 17 pid: 7231 timeout: 919 lvb_type: 0 00010000:00010000:0.0:1746065223.875630:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065223.875634:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065223.875642:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065223.875647:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065223.875659:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065223.875674:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+16:2005:x1830881265548928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.875680:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8388 00010000:00010000:0.0:1746065223.875696:0:13395:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065223.875703:0:13395:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00000100:00100000:3.0:1746065223.875741:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17913 00000100:00100000:3.0:1746065223.875747:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265548544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065223.875753:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.875759:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72400/0xad6b7ddc147a8c3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0f8 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065223.875804:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264051200:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065223.875828:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.875860:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14672 00000100:00100000:3.0:1746065223.875864:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2664:x1830881265548800:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065223.875875:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.875882:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a8ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a0ff expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.875928:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc147a8d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.875936:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc147a8d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.875942:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc147a8d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065223.875950:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17912 00010000:00010000:3.0:1746065223.875952:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147a8d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.875956:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147a8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.875961:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147a8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065223.876115:0:13395:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:0.0:1746065223.876119:0:13395:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065223.876133:0:13395:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 13395 initiator: MDT0 00010000:00010000:0.0:1746065223.876153:0:13395:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07e00/0xad6b7ddc147a8a0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0dc expref: 16 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.876162:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0dc expref: 15 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.876167:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065223.876169:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065223.876170:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07200, rc 0) 00000100:00100000:0.0:1746065223.876190:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+15:2660:x1830881265547648:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5286us (6676us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.876195:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14671 00010000:00010000:3.0:1746065223.876357:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147a8df lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876365:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147a8df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876371:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147a8df lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065223.876378:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065223.876431:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc147a8d1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876436:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc147a8d1 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876441:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc147a8d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876445:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc147a8d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876450:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a852aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065223.876453:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc147a8d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876457:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc147a8d1 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876464:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065223.876466:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065223.876469:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc147a8d1 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876473:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852aa00/0xad6b7ddc147a8d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876485:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147a8d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876493:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147a8d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876498:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147a8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876501:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a852b000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065223.876503:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147a8d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876508:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147a8d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876513:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800924c5800) 00010000:00010000:3.0:1746065223.876514:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065223.876516:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147a8d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876520:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147a8d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065223.876932:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf200/0xad6b7ddc147a8ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ff expref: 41 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.876942:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147a8df lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ff expref: 40 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.876948:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065223.876949:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065223.876951:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a852a200, rc 0) 00000100:00100000:3.0:1746065223.877384:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2664:x1830881265548800:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1517us (4707us total) trans 8589937200 rc 0/0 00000100:00100000:3.0:1746065223.877390:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14672 00002000:00010000:0.0:1746065223.877759:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime: 1746065223 -> 1746065224 00002000:00010000:0.0:1746065223.877762:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime: 1746065223 -> 1746065224 00000100:00100000:0.0:1746065223.877799:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264050944:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065223.877818:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc147a8ae lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0e3 expref: 34 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.877991:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf600/0xad6b7ddc147a8ae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0e3 expref: 34 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.878004:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf600, rc 0) 00000100:00100000:1.0:1746065223.878070:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265548032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3274us (4783us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065223.878076:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17910 00000100:00100000:0.0:1746065223.880244:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.880331:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881264051072:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065223.880346:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065223.880512:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265549184 00000100:00100000:1.0:1746065223.880517:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265549184 00000100:00100000:1.0:1746065223.880549:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5525 00000100:00100000:1.0:1746065223.880555:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2658:x1830881265549184:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065223.880713:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265548288:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5590us (5990us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065223.880721:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8387 00002000:00010000:2.0:1746065223.881145:0:12260:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746065223 -> 1746065224 00002000:00010000:2.0:1746065223.881149:0:12260:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065223 -> 1746065224 00002000:00010000:2.0:1746065223.881151:0:12260:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746065223 -> 1746065224 00000100:00100000:2.0:1746065223.881161:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264051200:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.881181:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72400/0xad6b7ddc147a8c3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0f8 expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.881190:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72400/0xad6b7ddc147a8c3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0f8 expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.881207:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72400, rc 0) 00000100:00100000:2.0:1746065223.881229:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265548544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5482us (6190us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.881234:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17913 00000100:00100000:1.0:1746065223.882722:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2658:x1830881265549184:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 2162us (2477us total) trans 8589937201 rc 0/0 00000100:00100000:1.0:1746065223.882729:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5525 00000100:00100000:0.0:1746065223.884500:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.884549:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.886240:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.886373:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265549312 00000100:00100000:2.0:1746065223.886382:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265549312 00000100:00100000:0.0:1746065223.886404:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265549440 00000100:00100000:0.0:1746065223.886407:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265549440 00000100:00100000:2.0:1746065223.886426:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265549696 00000100:00100000:2.0:1746065223.886428:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265549696 00000100:00100000:1.0:1746065223.886615:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17914 00000100:00100000:1.0:1746065223.886626:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265549312:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065223.886639:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.886652:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147a8ed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a106 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065223.886723:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17915 00000100:00100000:0.0:1746065223.886728:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265549440:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065223.886749:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17916 00000100:00100000:2.0:1746065223.886755:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265549696:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065223.886760:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.886768:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f01c00/0xad6b7ddc147a8f4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a114 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.886803:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264051328:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065223.886803:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264051456:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065223.886884:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00010000:00010000:0.0:1746065223.886886:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065223.886895:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147a8fb lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a10d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.886906:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.886908:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065223.886916:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147a8fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a10d expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.886930:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147a8fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a10d expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065223.886939:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07800, rc 0) 00000100:00100000:0.0:1746065223.886968:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265549440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 239us (2419us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.886975:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17915 00000100:00100000:0.0:1746065223.887024:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.887532:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.887975:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265549824 00000100:00100000:2.0:1746065223.887981:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265549824 00002000:00100000:2.0:1746065223.888008:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880091b66680 x1830881265549824/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.888016:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66680 with x1830881265549824 ext(1048576->2097151) 00002000:00010000:2.0:1746065223.888020:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b66680 00000100:00100000:2.0:1746065223.888045:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6423 00000100:00100000:2.0:1746065223.888050:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265549824:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065223.888456:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.888614:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265549952 00000100:00100000:1.0:1746065223.888619:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265549952 00000100:00100000:1.0:1746065223.888639:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17917 00000100:00100000:1.0:1746065223.888643:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2665:x1830881265549952:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.888651:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.888660:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a11b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.888677:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.888689:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065223.888690:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065223.888693:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.888716:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 11 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.888727:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 11 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:1.0:1746065223.888736:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264051584:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065223.888795:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065223.894448:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092528e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264051328:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065223.894480:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f01c00/0xad6b7ddc147a8f4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a114 expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.894492:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f01c00/0xad6b7ddc147a8f4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a114 expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065223.894517:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f01c00, rc 0) 00000100:00100000:2.0:1746065223.894557:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265549696:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7800us (8318us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065223.894565:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17916 00000100:00100000:0.0:1746065223.895463:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264051584:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065223.895481:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065223.895493:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf200, rc 0) 00000100:00100000:0.0:1746065223.895517:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2665:x1830881265549952:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6874us (7062us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.895523:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17917 00000100:00100000:1.0:1746065223.897293:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264051456:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065223.897316:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147a8ed lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a106 expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.897327:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147a8ed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a106 expref: 13 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.897345:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993e600, rc 0) 00000100:00100000:1.0:1746065223.897392:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2004:x1830881265549312:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 10768us (12897us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065223.897399:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17914 00000100:00100000:2.0:1746065223.905235:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.905305:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265550080 00000100:00100000:3.0:1746065223.905313:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265550080 00000100:00100000:2.0:1746065223.905348:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:3.0:1746065223.905352:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x75:0x0] (765952->1048575) req@ffff880092528e00 x1830881265550080/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.905362:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092528e00 with x1830881265550080 ext(765952->1048575) 00010000:00010000:3.0:1746065223.905370:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 12 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.905383:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 12 pid: 11461 timeout: 919 lvb_type: 0 00002000:00010000:3.0:1746065223.905390:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092528e00 00000100:00100000:3.0:1746065223.905409:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2113 00000100:00100000:3.0:1746065223.905416:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2005:x1830881265550080:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065223.905492:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265549824:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 17441us (18469us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065223.905499:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6423 00002000:00100000:2.0:1746065223.905505:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880091b66680 x1830881265549824/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00000100:00100000:3.0:1746065223.905506:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265550336 00000100:00100000:3.0:1746065223.905509:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265550336 00002000:00100000:2.0:1746065223.905517:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66680 with x1830881265549824 ext(1048576->2097151) 00002000:00010000:2.0:1746065223.905520:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b66680 00000100:00100000:3.0:1746065223.905530:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14673 00000100:00100000:3.0:1746065223.905534:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+15:2660:x1830881265550336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065223.905543:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065223.905558:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc147a909 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a122 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.905637:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147a910 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.905653:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147a910 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.905661:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147a910 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.905671:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147a910 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.905676:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147a910 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.905681:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147a910 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.905685:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880098c1b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065223.905688:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147a910 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.905693:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147a910 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.905702:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065223.905705:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065223.905708:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147a910 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.905713:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147a910 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 14 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065223.905747:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc147a909 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a122 expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.905758:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b400/0xad6b7ddc147a909 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a122 expref: 16 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.905764:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b400, rc 0) 00000100:00100000:3.0:1746065223.905802:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+15:2660:x1830881265550336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 267us (454us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065223.905807:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14673 00000100:00100000:2.0:1746065223.907863:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.907910:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265550592 00000100:00100000:1.0:1746065223.907915:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265550592 00000100:00100000:1.0:1746065223.907946:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5526 00000100:00100000:1.0:1746065223.907953:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+15:2660:x1830881265550592:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065223.908097:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+16:2660:x1830881265550592:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 144us (238us total) trans 8589937202 rc 0/0 00000100:00100000:1.0:1746065223.908103:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5526 00000100:00100000:3.0:1746065223.911085:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265550080:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 5661us (5853us total) trans 17179874377 rc 0/0 00000100:00100000:3.0:1746065223.911095:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2113 00002000:00100000:3.0:1746065223.911104:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x75:0x0] (765952->1048575) req@ffff880092528e00 x1830881265550080/t17179874377(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/448 e 0 to 0 dl 1746065234 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.911114:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092528e00 with x1830881265550080 ext(765952->1048575) 00010000:00010000:3.0:1746065223.911122:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 14 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:3.0:1746065223.911134:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 14 pid: 11461 timeout: 919 lvb_type: 0 00002000:00010000:3.0:1746065223.911141:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092528e00 00000100:00100000:0.0:1746065223.917973:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.918145:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.918320:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265550720 00000100:00100000:2.0:1746065223.918329:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265550720 00010000:00010000:2.0:1746065223.918366:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 14 pid: 11461 timeout: 919 lvb_type: 0 00000100:00100000:3.0:1746065223.919298:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265550976 00000100:00100000:3.0:1746065223.919303:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265550976 00002000:00100000:3.0:1746065223.919330:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880091b65500 x1830881265550976/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 504/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.919338:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65500 with x1830881265550976 ext(2097152->4194303) 00002000:00010000:3.0:1746065223.919343:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65500 00000100:00100000:3.0:1746065223.919361:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6424 00000100:00100000:3.0:1746065223.919367:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265550976:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065223.921629:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8389 00000100:00100000:2.0:1746065223.921642:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265550720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065223.921656:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065223.921673:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 16 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.921685:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 16 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.921703:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147a765 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 765952->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a018 expref: 16 pid: 11461 timeout: 919 lvb_type: 0 00010000:00010000:2.0:1746065223.921725:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.921727:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065223.921733:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.921740:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.921766:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 31 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065223.921787:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264051712:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065223.921844:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065223.936363:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264051712:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065223.936384:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065223.936848:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265550720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 15207us (18882us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065223.936858:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8389 00000100:00100000:0.0:1746065223.941739:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065223.941810:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.944490:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065223.944652:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265551232 00000100:00100000:3.0:1746065223.944661:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265551232 00002000:00100000:3.0:1746065223.944700:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880091b67480 x1830881265551232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.944709:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67480 with x1830881265551232 ext(0->1048575) 00002000:00010000:3.0:1746065223.944713:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b67480 00000100:00100000:3.0:1746065223.944739:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265551488 00000100:00100000:3.0:1746065223.944742:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265551488 00002000:00100000:3.0:1746065223.944753:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880091b65180 x1830881265551488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.944759:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65180 with x1830881265551488 ext(1048576->2097151) 00002000:00010000:3.0:1746065223.944762:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b65180 00000100:00100000:3.0:1746065223.944769:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265551744 00000100:00100000:3.0:1746065223.944771:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265551744 00002000:00100000:3.0:1746065223.944797:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012f1a7480 x1830881265551744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.944802:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7480 with x1830881265551744 ext(1048576->2097151) 00002000:00010000:3.0:1746065223.944805:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7480 00000100:00100000:3.0:1746065223.944817:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6425 00000100:00100000:3.0:1746065223.944823:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265551232:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065223.945949:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6426 00000100:00100000:0.0:1746065223.945959:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265551488:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065223.946734:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6427 00000100:00100000:0.0:1746065223.946743:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265551744:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065223.947425:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2007:x1830881265550976:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28054us (29278us total) trans 0 rc 1564672/1564672 00000100:00100000:1.0:1746065223.947432:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6424 00002000:00100000:1.0:1746065223.947441:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880091b65500 x1830881265550976/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 504/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1564672/1564672 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.947450:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65500 with x1830881265550976 ext(2097152->4194303) 00002000:00010000:1.0:1746065223.947454:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b65500 00000100:00100000:0.0:1746065223.958668:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.958817:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265551872 00000100:00100000:1.0:1746065223.958829:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265551872 00000100:00100000:1.0:1746065223.958882:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17918 00000100:00100000:1.0:1746065223.958889:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2004:x1830881265551872:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065223.958906:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065223.958923:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147a917 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a129 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065223.958947:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.958949:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065223.958958:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147a917 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a129 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.958974:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147a917 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a129 expref: 14 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065223.958985:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72a00, rc 0) 00000100:00100000:1.0:1746065223.959041:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2004:x1830881265551872:12345-192.168.202.27@tcp:101:cat.0 Request processed in 151us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065223.959047:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17918 00000100:00100000:3.0:1746065223.968702:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265551232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23869us (26961us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065223.968715:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6425 00002000:00100000:3.0:1746065223.968724:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880091b67480 x1830881265551232/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065223.968732:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b67480 with x1830881265551232 ext(0->1048575) 00002000:00010000:3.0:1746065223.968737:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b67480 00000100:00100000:2.0:1746065223.969943:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265551488:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23982us (28128us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065223.969951:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6426 00002000:00100000:2.0:1746065223.969957:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880091b65180 x1830881265551488/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.969965:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b65180 with x1830881265551488 ext(1048576->2097151) 00002000:00010000:2.0:1746065223.969968:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091b65180 00000100:00100000:1.0:1746065223.972664:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265551744:12345-192.168.202.27@tcp:3:cat.0 Request processed in 25916us (28173us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065223.972675:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6427 00002000:00100000:1.0:1746065223.972683:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012f1a7480 x1830881265551744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.972690:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a7480 with x1830881265551744 ext(1048576->2097151) 00002000:00010000:1.0:1746065223.972694:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f1a7480 00000100:00100000:0.0:1746065223.973873:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065223.973927:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265552128 00000100:00100000:1.0:1746065223.973934:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265552128 00002000:00100000:1.0:1746065223.973966:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880091b66a00 x1830881265552128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/0 e 0 to 0 dl 1746065234 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065223.973974:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66a00 with x1830881265552128 ext(4194304->5038079) 00002000:00010000:1.0:1746065223.973977:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091b66a00 00000100:00100000:1.0:1746065223.975028:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6428 00000100:00100000:1.0:1746065223.975038:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265552128:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065223.989957:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065223.990004:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265552256 00000100:00100000:2.0:1746065223.990012:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265552256 00000100:00100000:2.0:1746065223.990062:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17919 00000100:00100000:2.0:1746065223.990070:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+32:2665:x1830881265552256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065223.990084:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065223.990099:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a130 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.990124:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.990131:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.990133:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065223.990136:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 33 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.990162:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065223.990172:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 15 pid: 12260 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065223.990183:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264051840:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065223.990262:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065223.995613:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264051840:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065223.995652:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 33 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065223.995668:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45600, rc 0) 00000100:00100000:3.0:1746065223.995743:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2665:x1830881265552256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5673us (5791us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065223.995751:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17919 00000100:00100000:2.0:1746065223.995885:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265552128:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20849us (22018us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065223.995892:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6428 00002000:00100000:2.0:1746065223.995899:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880091b66a00 x1830881265552128/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:139/0 lens 488/440 e 0 to 0 dl 1746065234 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065223.995907:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b66a00 with x1830881265552128 ext(4194304->5038079) 00010000:00010000:2.0:1746065223.995913:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 14 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065223.995924:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 14 pid: 12260 timeout: 920 lvb_type: 0 00002000:00010000:2.0:1746065223.995930:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091b66a00 00000100:00100000:0.0:1746065224.000105:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.000947:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.001049:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265552384 00000100:00100000:2.0:1746065224.001056:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265552384 00002000:00100000:2.0:1746065224.001096:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3592192->4124671) req@ffff880091b64000 x1830881265552384/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.001105:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64000 with x1830881265552384 ext(3592192->4124671) 00010000:00010000:2.0:1746065224.001113:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 14 pid: 12260 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.001114:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265552512 00000100:00100000:3.0:1746065224.001120:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265552512 00010000:00010000:2.0:1746065224.001125:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 15 pid: 12260 timeout: 920 lvb_type: 0 00002000:00010000:2.0:1746065224.001131:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091b64000 00000100:00100000:2.0:1746065224.001149:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2114 00000100:00100000:3.0:1746065224.001155:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17920 00000100:00100000:2.0:1746065224.001156:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265552384:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065224.001163:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265552512:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065224.001174:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.001188:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc147a925 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a137 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.001237:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264051968:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065224.001317:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.004734:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264051968:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.004765:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc147a925 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a137 expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.004803:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d47800/0xad6b7ddc147a925 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a137 expref: 17 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.004817:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47800, rc 0) 00000100:00100000:2.0:1746065224.004876:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265552512:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3712us (3930us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065224.004884:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17920 00000100:00100000:0.0:1746065224.008945:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.009105:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265552640 00000100:00100000:3.0:1746065224.009114:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265552640 00000100:00100000:3.0:1746065224.009153:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17921 00000100:00100000:3.0:1746065224.009160:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2659:x1830881265552640:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065224.009175:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.009188:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a13e expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.009209:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065224.009212:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065224.009215:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [5033984->5242879] (req 5033984->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 17 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.009225:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [5033984->5242879] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 17 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.009235:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46c00, rc 0) 00000100:00100000:3.0:1746065224.009269:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2659:x1830881265552640:12345-192.168.202.27@tcp:101:cat.0 Request processed in 109us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.009274:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17921 00000100:00100000:2.0:1746065224.010686:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265552384:12345-192.168.202.27@tcp:4:cat.0 Request processed in 9527us (10589us total) trans 17179874378 rc 0/0 00000100:00100000:2.0:1746065224.010696:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2114 00002000:00100000:2.0:1746065224.010704:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (3592192->4124671) req@ffff880091b64000 x1830881265552384/t17179874378(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/448 e 0 to 0 dl 1746065235 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.010712:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091b64000 with x1830881265552384 ext(3592192->4124671) 00010000:00010000:2.0:1746065224.010718:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 17 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.010729:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 17 pid: 12260 timeout: 920 lvb_type: 0 00002000:00010000:2.0:1746065224.010735:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091b64000 00000100:00100000:0.0:1746065224.024433:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.024512:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265552768 00000100:00100000:2.0:1746065224.024519:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265552768 00010000:00010000:2.0:1746065224.024546:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 17 pid: 12260 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.024697:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8390 00000100:00100000:2.0:1746065224.024704:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2007:x1830881265552768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.024715:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.024731:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 17 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.024743:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 17 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.024769:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147a85a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3592192->4124671) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0c0 expref: 17 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.024905:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.024906:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.024912:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.024919:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.024926:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.024927:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.024929:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.024934:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.024961:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 16 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.024971:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264052096:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065224.025898:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 32 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.025912:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264052224:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065224.027616:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.033952:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.034031:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265553024 00000100:00100000:3.0:1746065224.034037:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265553024 00000100:00100000:3.0:1746065224.034079:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14674 00000100:00100000:3.0:1746065224.034087:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2669:x1830881265553024:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065224.034108:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.034123:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46600/0xad6b7ddc147a933 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a145 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.034185:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a93a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034201:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a93a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034214:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a93a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034225:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc147a941 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034230:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc147a941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034235:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc147a941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034327:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc147a948 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034335:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc147a948 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034341:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc147a948 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065224.034351:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065224.034424:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a93a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034430:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a93a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034435:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a93a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034440:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a93a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034445:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.034448:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a93a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034454:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a93a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034463:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065224.034465:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.034468:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a93a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034472:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a93a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034492:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc147a941 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034496:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc147a941 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034500:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc147a941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034503:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.034505:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc147a941 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034508:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc147a941 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034513:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800924c5c00) 00010000:00010000:3.0:1746065224.034514:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.034516:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc147a941 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034520:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46e00/0xad6b7ddc147a941 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.034549:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46600/0xad6b7ddc147a933 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a145 expref: 24 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.034558:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc147a948 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a145 expref: 23 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.034563:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.034565:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065224.034567:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47e00, rc 0) 00000100:00100000:3.0:1746065224.034620:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2669:x1830881265553024:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 533us (674us total) trans 8589937203 rc 0/0 00000100:00100000:3.0:1746065224.034626:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14674 00000100:00100000:2.0:1746065224.034682:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264052096:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065224.034695:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264052224:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065224.034712:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.034733:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265552768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10030us (10307us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.034740:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8390 00000100:00100000:0.0:1746065224.036851:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.036895:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.036908:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265553152 00000100:00100000:2.0:1746065224.036913:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265553152 00000100:00100000:2.0:1746065224.036949:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17922 00000100:00100000:2.0:1746065224.036956:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2664:x1830881265553152:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065224.036969:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.036981:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a14c expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.037003:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.037011:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc147a853 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b9 expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.037018:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.037029:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.037031:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.037034:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3125248->3145727] (req 3125248->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 30 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.037059:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 30 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.037070:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 30 pid: 3068 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.037081:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264052352:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.037175:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265553408 00000100:00100000:3.0:1746065224.037179:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265553408 00002000:00100000:3.0:1746065224.037204:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff88009577c380 x1830881265553408/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.037212:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577c380 with x1830881265553408 ext(5033984->5038079) 00002000:00010000:3.0:1746065224.037216:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577c380 00000100:00100000:3.0:1746065224.037227:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6429 00000100:00100000:3.0:1746065224.037231:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265553408:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065224.038722:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc147a853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b9 expref: 15 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.038733:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc147a853 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b9 expref: 15 pid: 12260 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.038741:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264052480:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.038933:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265553408:12345-192.168.202.27@tcp:3:cat.0 Request processed in 1698us (2035us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065224.038944:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6429 00002000:00100000:3.0:1746065224.038951:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff88009577c380 x1830881265553408/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.038962:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009577c380 with x1830881265553408 ext(5033984->5038079) 00002000:00010000:3.0:1746065224.038965:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009577c380 00010000:00010000:2.0:1746065224.039534:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.039543:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 15 pid: 12260 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.039556:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264052608:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.039578:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065224.039844:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.039885:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.039900:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265553664 00000100:00100000:3.0:1746065224.039905:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265553664 00002000:00100000:3.0:1746065224.039928:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880135139c00 x1830881265553664/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.039936:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139c00 with x1830881265553664 ext(2097152->4194303) 00002000:00010000:3.0:1746065224.039940:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135139c00 00000100:00100000:3.0:1746065224.039956:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265553920 00000100:00100000:3.0:1746065224.039958:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265553920 00002000:00100000:3.0:1746065224.039968:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88013513b800 x1830881265553920/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.039974:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b800 with x1830881265553920 ext(2097152->3145727) 00010000:00010000:3.0:1746065224.039979:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 31 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.039987:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 31 pid: 3068 timeout: 920 lvb_type: 0 00002000:00010000:3.0:1746065224.039991:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013513b800 00000100:00100000:3.0:1746065224.040003:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2115 00000100:00100000:3.0:1746065224.040009:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265553920:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065224.040947:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6430 00000100:00100000:3.0:1746065224.040958:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265553664:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065224.059186:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264052352:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.059199:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264052480:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.059207:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264052608:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.059234:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [3125248->3145727] (req 3125248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 32 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.059248:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44e00, rc 0) 00000100:00100000:2.0:1746065224.059298:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2664:x1830881265553152:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 22331us (22442us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.059306:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17922 00000100:00100000:3.0:1746065224.060507:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013513b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265553920:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 20493us (20616us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065224.060516:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2115 00002000:00100000:3.0:1746065224.060524:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff88013513b800 x1830881265553920/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:H/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.060532:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88013513b800 with x1830881265553920 ext(2097152->3145727) 00010000:00010000:3.0:1746065224.060540:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 30 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.060550:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 30 pid: 3068 timeout: 920 lvb_type: 0 00002000:00010000:3.0:1746065224.060555:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88013513b800 00000100:00100000:0.0:1746065224.068077:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.068137:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265554048 00000100:00100000:2.0:1746065224.068145:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265554048 00010000:00010000:2.0:1746065224.068175:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc147a853 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b9 expref: 16 pid: 12260 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.068209:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8391 00000100:00100000:2.0:1746065224.068216:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+16:2005:x1830881265554048:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.068227:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.068243:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc147a853 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b9 expref: 16 pid: 12260 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.068257:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc147a853 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b9 expref: 16 pid: 12260 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.068282:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993f800/0xad6b7ddc147a853 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0b9 expref: 16 pid: 12260 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.068314:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.068349:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265554048:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 133us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.068354:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8391 00000100:00100000:0.0:1746065224.069082:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.069534:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265554176 00000100:00100000:2.0:1746065224.069539:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265554176 00010000:00010000:2.0:1746065224.069555:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 16 pid: 12260 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.069583:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8392 00000100:00100000:2.0:1746065224.069589:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265554176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.069596:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.069606:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 16 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.069615:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 16 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.069628:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dda00/0xad6b7ddc147a773 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a026 expref: 16 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.069638:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.069678:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265554176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 89us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.069683:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8392 00000100:00100000:3.0:1746065224.074090:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265553664:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 33127us (34237us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065224.074100:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6430 00002000:00100000:3.0:1746065224.074111:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880135139c00 x1830881265553664/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.074120:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139c00 with x1830881265553664 ext(2097152->4194303) 00002000:00010000:3.0:1746065224.074125:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880135139c00 00000100:00100000:1.0:1746065224.074812:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.075728:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265554304 00000100:00100000:2.0:1746065224.075738:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265554304 00010000:00010000:2.0:1746065224.075817:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 30 pid: 3068 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.075850:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8393 00000100:00100000:2.0:1746065224.075859:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265554304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.075873:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.075894:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 30 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.075905:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 30 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.075928:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f2800/0xad6b7ddc147a77a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a02d expref: 30 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.075945:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.075946:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.075953:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.075966:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.076001:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.076014:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881264052736:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065224.077202:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.086188:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.086262:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.086376:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881264052736:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065224.086400:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.086478:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265554304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10618us (11667us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.086490:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8393 00000100:00100000:2.0:1746065224.086568:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265554560 00000100:00100000:2.0:1746065224.086575:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265554560 00002000:00100000:2.0:1746065224.086612:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009c5f0e00 x1830881265554560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 504/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.086622:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0e00 with x1830881265554560 ext(2097152->4194303) 00002000:00010000:2.0:1746065224.086627:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0e00 00000100:00100000:2.0:1746065224.086645:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265554816 00000100:00100000:2.0:1746065224.086649:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265554816 00002000:00100000:2.0:1746065224.086664:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3125248->3129343) req@ffff88009c5f2d80 x1830881265554816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.086670:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2d80 with x1830881265554816 ext(3125248->3129343) 00002000:00010000:2.0:1746065224.086674:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f2d80 00000100:00100000:2.0:1746065224.086691:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6431 00000100:00100000:2.0:1746065224.086698:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265554560:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065224.088896:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6432 00000100:00100000:3.0:1746065224.088909:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265554816:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065224.089024:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265554816:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 118us (2763us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065224.089031:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6432 00002000:00100000:3.0:1746065224.089037:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (3125248->3129343) req@ffff88009c5f2d80 x1830881265554816/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.089047:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f2d80 with x1830881265554816 ext(3125248->3129343) 00002000:00010000:3.0:1746065224.089052:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f2d80 00000100:00100000:2.0:1746065224.117216:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265554560:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 30507us (31028us total) trans 0 rc 2093056/2093056 00000100:00100000:2.0:1746065224.117228:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6431 00002000:00100000:2.0:1746065224.117240:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88009c5f0e00 x1830881265554560/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 504/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 2093056/2093056 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.117249:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0e00 with x1830881265554560 ext(2097152->4194303) 00002000:00010000:2.0:1746065224.117254:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0e00 00010000:00010000:2.0:1746065224.127068:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065224.130884:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.131010:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.131144:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265554944 00000100:00100000:2.0:1746065224.131155:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265554944 00000100:00100000:2.0:1746065224.131203:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17923 00000100:00100000:2.0:1746065224.131212:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2664:x1830881265554944:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065224.131231:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.131249:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a153 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.131279:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 34 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.131319:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.131329:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.131331:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.131334:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->3952639] (req 3145728->3952639) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 34 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.131366:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 15 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.131378:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 15 pid: 3068 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.131389:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264052864:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.131506:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265555200 00000100:00100000:3.0:1746065224.131510:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265555200 00002000:00100000:3.0:1746065224.131531:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009c5f1880 x1830881265555200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.131539:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1880 with x1830881265555200 ext(4194304->5038079) 00010000:00010000:3.0:1746065224.131543:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 35 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.131550:0:29490:0:(ldlm_lockd.c:596:ldlm_refresh_waiting_lock()) ### wasn't waiting ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 35 pid: 3068 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065224.131555:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f1880 00000100:00100000:3.0:1746065224.131566:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2116 00000100:00100000:3.0:1746065224.131570:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265555200:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:2.0:1746065224.131743:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 35 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.131751:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 35 pid: 3068 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.131758:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264052992:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.131804:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.135921:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.136893:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265555328 00000100:00100000:3.0:1746065224.136903:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265555328 00010000:00010000:3.0:1746065224.136940:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 16 pid: 3068 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.136986:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8394 00000100:00100000:3.0:1746065224.136995:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265555328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.137011:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.137029:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 16 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.137041:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 16 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.137063:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.137113:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265555328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 118us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.137119:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8394 00010000:00010000:2.0:1746065224.137237:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d46c00/0xad6b7ddc147a92c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a13e expref: 15 pid: 3068 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.137258:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264052864:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.137271:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264052992:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.137308:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->3952639] (req 3145728->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 36 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.137316:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44000, rc 0) 00000100:00100000:2.0:1746065224.137335:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2664:x1830881265554944:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6126us (6461us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.137341:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17923 00000100:00100000:3.0:1746065224.141139:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881265555200:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9560us (10122us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065224.141150:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2116 00002000:00100000:3.0:1746065224.141159:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88009c5f1880 x1830881265555200/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:H/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.141167:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f1880 with x1830881265555200 ext(4194304->5038079) 00010000:00010000:3.0:1746065224.141175:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 34 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.141186:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 34 pid: 3068 timeout: 920 lvb_type: 0 00002000:00010000:3.0:1746065224.141193:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009c5f1880 00000100:00100000:0.0:1746065224.147645:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.149151:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.149723:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265555584 00000100:00100000:1.0:1746065224.149732:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265555584 00010000:00010000:1.0:1746065224.149765:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 34 pid: 3068 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.151157:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8395 00000100:00100000:1.0:1746065224.151169:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265555584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.151184:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.151204:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 34 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.151216:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 34 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.151235:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45600/0xad6b7ddc147a91e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a130 expref: 34 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.151253:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.151255:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.151262:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.151269:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.151308:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.151320:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264053120:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065224.151385:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.151663:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265555456 00000100:00100000:2.0:1746065224.151667:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265555456 00000100:00100000:2.0:1746065224.151696:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17924 00000100:00100000:2.0:1746065224.151701:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265555456:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.151712:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.151719:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44400/0xad6b7ddc147a964 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a15a expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.151741:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264053248:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.151760:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065224.154830:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264053120:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065224.154849:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.154883:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265555584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3717us (7247us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.154893:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8395 00000100:00100000:2.0:1746065224.155090:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264053248:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.155110:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44400/0xad6b7ddc147a964 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a15a expref: 34 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.155121:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44400/0xad6b7ddc147a964 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a15a expref: 34 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.155146:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44400, rc 0) 00000100:00100000:2.0:1746065224.155176:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265555456:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3473us (6027us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065224.155185:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17924 00000100:00100000:0.0:1746065224.164890:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.164960:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.165013:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265555712 00000100:00100000:2.0:1746065224.165020:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265555712 00000100:00100000:2.0:1746065224.165050:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17925 00000100:00100000:2.0:1746065224.165055:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2669:x1830881265555712:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065224.165068:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.165080:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a161 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.165103:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.165108:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.165110:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.165112:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [4087808->4194303] (req 4087808->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 16 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.165134:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 28 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.165143:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 28 pid: 11461 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.165153:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264053376:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.165218:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:3.0:1746065224.165942:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265555968 00000100:00100000:3.0:1746065224.165946:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265555968 00002000:00100000:3.0:1746065224.165973:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (3948544->3952639) req@ffff88009c5f3480 x1830881265555968/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.165981:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3480 with x1830881265555968 ext(3948544->3952639) 00002000:00010000:3.0:1746065224.165984:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f3480 00000100:00100000:3.0:1746065224.166011:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6433 00000100:00100000:3.0:1746065224.166017:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265555968:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065224.166122:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265555968:12345-192.168.202.27@tcp:3:cat.0 Request processed in 104us (1160us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065224.166127:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6433 00002000:00100000:3.0:1746065224.166133:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (3948544->3952639) req@ffff88009c5f3480 x1830881265555968/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.166139:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3480 with x1830881265555968 ext(3948544->3952639) 00002000:00010000:3.0:1746065224.166141:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f3480 00000100:00100000:0.0:1746065224.166487:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.166547:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265556224 00000100:00100000:3.0:1746065224.166551:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265556224 00002000:00100000:3.0:1746065224.166564:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff88009c5f3800 x1830881265556224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.166570:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3800 with x1830881265556224 ext(5033984->5038079) 00002000:00010000:3.0:1746065224.166573:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f3800 00000100:00100000:3.0:1746065224.166584:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6434 00000100:00100000:3.0:1746065224.166588:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265556224:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065224.166712:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265556224:12345-192.168.202.27@tcp:3:cat.0 Request processed in 122us (225us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065224.166718:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6434 00002000:00100000:3.0:1746065224.166722:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff88009c5f3800 x1830881265556224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.166729:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3800 with x1830881265556224 ext(5033984->5038079) 00002000:00010000:3.0:1746065224.166731:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009c5f3800 00000100:00100000:2.0:1746065224.167608:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264053376:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.167630:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [4087808->4194303] (req 4087808->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 16 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.167643:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44a00, rc 0) 00000100:00100000:2.0:1746065224.167675:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2669:x1830881265555712:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2619us (2795us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.167681:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17925 00000100:00100000:0.0:1746065224.168093:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.168227:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265556352 00000100:00100000:3.0:1746065224.168232:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265556352 00002000:00100000:3.0:1746065224.168258:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3125248->3145727) req@ffff88009c5f0380 x1830881265556352/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.168265:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0380 with x1830881265556352 ext(3125248->3145727) 00010000:00010000:3.0:1746065224.168270:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 29 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.168282:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 29 pid: 11461 timeout: 920 lvb_type: 0 00002000:00010000:3.0:1746065224.168299:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c5f0380 00000100:00100000:3.0:1746065224.168311:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2117 00000100:00100000:3.0:1746065224.168316:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265556352:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065224.171319:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.171438:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265556608 00000100:00100000:3.0:1746065224.171446:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265556608 00000100:00100000:1.0:1746065224.171538:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.171597:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265556864 00000100:00100000:3.0:1746065224.171600:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265556864 00000100:00100000:3.0:1746065224.171612:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5527 00000100:00100000:3.0:1746065224.171617:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+41:2664:x1830881265556608:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065224.171724:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5528 00000100:00100000:2.0:1746065224.171729:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4299c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2665:x1830881265556864:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065224.171750:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2664:x1830881265556608:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 132us (438us total) trans 8589937204 rc 0/0 00000100:00100000:3.0:1746065224.171756:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5527 00000100:00100000:2.0:1746065224.171813:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4299c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2665:x1830881265556864:12345-192.168.202.27@tcp:35:cat.0 Request processed in 82us (275us total) trans 8589937205 rc 0/0 00000100:00100000:2.0:1746065224.171818:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5528 00000100:00100000:0.0:1746065224.172212:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265556352:12345-192.168.202.27@tcp:4:cat.0 Request processed in 3895us (4119us total) trans 21474841759 rc 0/0 00000100:00100000:0.0:1746065224.172221:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2117 00002000:00100000:0.0:1746065224.172228:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (3125248->3145727) req@ffff88009c5f0380 x1830881265556352/t21474841759(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/448 e 0 to 0 dl 1746065235 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.172236:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0380 with x1830881265556352 ext(3125248->3145727) 00010000:00010000:0.0:1746065224.172243:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.172255:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746065224.172265:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c5f0380 00000100:00100000:0.0:1746065224.178229:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.178332:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265556992 00000100:00100000:1.0:1746065224.178340:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265556992 00010000:00010000:1.0:1746065224.178370:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.178406:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8396 00000100:00100000:1.0:1746065224.178414:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265556992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.178426:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1746065224.178439:0:7191:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065223 -> 1746065224 00002000:00010000:1.0:1746065224.178441:0:7191:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065223 -> 1746065224 00002000:00010000:1.0:1746065224.178443:0:7191:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065223 -> 1746065224 00010000:00010000:1.0:1746065224.178448:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.178458:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.178476:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44e00/0xad6b7ddc147a956 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3125248->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a14c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.178501:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.178503:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.178508:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.178519:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.178545:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.178556:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264053504:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065224.178617:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.180858:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.180884:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265557248 00000100:00100000:0.0:1746065224.180890:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265557248 00002000:00100000:0.0:1746065224.180925:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4087808->4091903) req@ffff88009c5f0700 x1830881265557248/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.180933:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0700 with x1830881265557248 ext(4087808->4091903) 00002000:00010000:0.0:1746065224.180938:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0700 00000100:00100000:0.0:1746065224.180955:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6435 00000100:00100000:0.0:1746065224.180961:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265557248:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065224.181066:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265557248:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 104us (213us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065224.181072:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6435 00002000:00100000:0.0:1746065224.181078:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (4087808->4091903) req@ffff88009c5f0700 x1830881265557248/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.181086:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f0700 with x1830881265557248 ext(4087808->4091903) 00002000:00010000:0.0:1746065224.181089:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009c5f0700 00000100:00100000:1.0:1746065224.181419:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264053504:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065224.181433:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.181469:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265556992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3055us (3246us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.181476:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8396 00000100:00100000:0.0:1746065224.185118:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.185163:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265557376 00000100:00100000:2.0:1746065224.185170:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265557376 00000100:00100000:2.0:1746065224.185206:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17926 00000100:00100000:2.0:1746065224.185213:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2669:x1830881265557376:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065224.185229:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.185244:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a168 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.185268:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 32 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.185275:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.185277:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.185280:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [4194304->4964351] (req 4194304->4964351) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 16 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.185315:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 32 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.185327:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 32 pid: 11461 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.185338:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264053632:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.186204:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.189220:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264053632:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.189250:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [4194304->4964351] (req 4194304->4964351) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 16 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.189266:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45e00, rc 0) 00000100:00100000:2.0:1746065224.189313:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2669:x1830881265557376:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4098us (4201us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.189320:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17926 00000100:00100000:0.0:1746065224.189531:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.189554:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.189664:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265557632 00000100:00100000:2.0:1746065224.189670:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265557632 00000100:00100000:3.0:1746065224.189748:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265557504 00000100:00100000:3.0:1746065224.189751:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265557504 00002000:00100000:3.0:1746065224.189841:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3952639) req@ffff88012edae680 x1830881265557504/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.189848:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edae680 with x1830881265557504 ext(3145728->3952639) 00010000:00010000:3.0:1746065224.189855:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 33 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.189865:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 33 pid: 11461 timeout: 920 lvb_type: 0 00002000:00010000:3.0:1746065224.189870:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012edae680 00000100:00100000:3.0:1746065224.189891:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2118 00000100:00100000:3.0:1746065224.189896:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265557504:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065224.190067:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17927 00000100:00100000:2.0:1746065224.190072:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265557632:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.190079:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.190089:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc147a979 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a16f expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.190121:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264053760:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.190173:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c96c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.193009:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264053760:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.193036:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc147a979 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a16f expref: 17 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.193047:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45400/0xad6b7ddc147a979 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a16f expref: 17 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.193060:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d45400, rc 0) 00000100:00100000:2.0:1746065224.193099:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265557632:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3026us (3567us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065224.193106:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17927 00000100:00100000:0.0:1746065224.199336:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.199407:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265557888 00000100:00100000:1.0:1746065224.199413:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265557888 00000100:00100000:3.0:1746065224.199543:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265557504:12345-192.168.202.27@tcp:4:cat.0 Request processed in 9645us (9987us total) trans 17179874379 rc 0/0 00000100:00100000:3.0:1746065224.199552:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2118 00002000:00100000:3.0:1746065224.199562:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->3952639) req@ffff88012edae680 x1830881265557504/t17179874379(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/448 e 0 to 0 dl 1746065235 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.199574:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edae680 with x1830881265557504 ext(3145728->3952639) 00010000:00010000:3.0:1746065224.199583:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 35 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.199594:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 35 pid: 11461 timeout: 920 lvb_type: 0 00002000:00010000:3.0:1746065224.199600:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88012edae680 00002000:00100000:1.0:1746065224.199740:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012edaca80 x1830881265557888/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065224.199746:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaca80 with x1830881265557888 ext(0->1048575) 00002000:00010000:1.0:1746065224.199749:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaca80 00000100:00100000:1.0:1746065224.199987:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6436 00000100:00100000:1.0:1746065224.199996:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265557888:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065224.204255:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.205874:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265558016 00000100:00100000:1.0:1746065224.205884:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265558016 00010000:00010000:1.0:1746065224.205925:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 35 pid: 11461 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.205965:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8397 00000100:00100000:1.0:1746065224.205972:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265558016:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.205983:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.205999:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 35 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.206101:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 35 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.206123:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a95d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3952639) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a153 expref: 35 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.206970:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.206972:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.206979:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.206986:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.207015:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 17 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.207026:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264053888:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065224.207105:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.208331:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265557888:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8330us (8997us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065224.208340:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6436 00002000:00100000:2.0:1746065224.208348:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012edaca80 x1830881265557888/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.208356:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaca80 with x1830881265557888 ext(0->1048575) 00002000:00010000:2.0:1746065224.208360:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaca80 00000100:00100000:1.0:1746065224.209393:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264053888:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065224.209408:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.209633:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265558016:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3586us (5309us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.209642:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8397 00000100:00100000:0.0:1746065224.219857:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.219880:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265558272 00000100:00100000:2.0:1746065224.219888:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265558272 00002000:00100000:2.0:1746065224.219925:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4960256->4964351) req@ffff88012edad500 x1830881265558272/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.219935:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edad500 with x1830881265558272 ext(4960256->4964351) 00002000:00010000:2.0:1746065224.219939:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edad500 00000100:00100000:2.0:1746065224.219966:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6437 00000100:00100000:2.0:1746065224.219972:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265558272:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065224.220173:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265558272:12345-192.168.202.27@tcp:3:cat.0 Request processed in 200us (322us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065224.220178:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6437 00002000:00100000:2.0:1746065224.220183:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4960256->4964351) req@ffff88012edad500 x1830881265558272/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.220189:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edad500 with x1830881265558272 ext(4960256->4964351) 00002000:00010000:2.0:1746065224.220191:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edad500 00000100:00100000:0.0:1746065224.226001:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.226379:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265558528 00000100:00100000:2.0:1746065224.226388:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265558528 00000100:00100000:2.0:1746065224.226429:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5529 00000100:00100000:2.0:1746065224.226435:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2669:x1830881265558528:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065224.227093:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2669:x1830881265558528:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 655us (1097us total) trans 8589937206 rc 0/0 00000100:00100000:2.0:1746065224.227100:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5529 00000100:00100000:0.0:1746065224.233162:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.233208:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.233339:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265558784 00000100:00100000:3.0:1746065224.233347:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265558784 00002000:00100000:3.0:1746065224.233384:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88012edae300 x1830881265558784/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.233393:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edae300 with x1830881265558784 ext(2097152->4194303) 00002000:00010000:3.0:1746065224.233397:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edae300 00000100:00100000:3.0:1746065224.233423:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265559040 00000100:00100000:3.0:1746065224.233426:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265559040 00002000:00100000:3.0:1746065224.233438:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4087807) req@ffff88012edaf480 x1830881265559040/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.233444:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf480 with x1830881265559040 ext(2097152->4087807) 00002000:00010000:3.0:1746065224.233447:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edaf480 00000100:00100000:3.0:1746065224.233458:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6438 00000100:00100000:3.0:1746065224.233463:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265558784:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065224.234535:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6439 00000100:00100000:3.0:1746065224.234543:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265559040:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065224.254345:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265558784:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20872us (21181us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065224.254354:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6438 00002000:00100000:3.0:1746065224.254362:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff88012edae300 x1830881265558784/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.254371:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edae300 with x1830881265558784 ext(2097152->4194303) 00002000:00010000:3.0:1746065224.254376:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edae300 00000100:00100000:3.0:1746065224.256693:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265559040:12345-192.168.202.27@tcp:3:cat.0 Request processed in 22143us (23477us total) trans 0 rc 1990656/1990656 00000100:00100000:3.0:1746065224.256703:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6439 00002000:00100000:3.0:1746065224.256710:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4087807) req@ffff88012edaf480 x1830881265559040/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 1990656/1990656 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.256718:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf480 with x1830881265559040 ext(2097152->4087807) 00002000:00010000:3.0:1746065224.256721:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edaf480 00000100:00100000:0.0:1746065224.264217:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.264310:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265559296 00000100:00100000:3.0:1746065224.264317:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265559296 00002000:00100000:3.0:1746065224.264351:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4964352->5038079) req@ffff88012edac700 x1830881265559296/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.264360:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac700 with x1830881265559296 ext(4964352->5038079) 00002000:00010000:3.0:1746065224.264365:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac700 00000100:00100000:3.0:1746065224.264685:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6440 00000100:00100000:3.0:1746065224.264692:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265559296:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065224.266453:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2006:x1830881265559296:12345-192.168.202.27@tcp:3:cat.0 Request processed in 1755us (2236us total) trans 0 rc 73728/73728 00000100:00100000:3.0:1746065224.266462:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6440 00002000:00100000:3.0:1746065224.266470:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4964352->5038079) req@ffff88012edac700 x1830881265559296/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 73728/73728 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.266477:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac700 with x1830881265559296 ext(4964352->5038079) 00002000:00010000:3.0:1746065224.266480:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac700 00000100:00100000:0.0:1746065224.296875:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.297019:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265559424 00000100:00100000:3.0:1746065224.297027:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265559424 00000100:00100000:3.0:1746065224.297064:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14675 00000100:00100000:3.0:1746065224.297072:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+16:2679:x1830881265559424:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065224.297097:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.297112:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc147a980 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a176 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.297159:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a987 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297170:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297178:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a987 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297188:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a98e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297193:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a98e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297198:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a98e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297249:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc147a995 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297257:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc147a995 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297262:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc147a995 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065224.297301:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065224.297305:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065224.297318:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc147a995 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 14 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297325:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc147a995 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297332:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a987 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297336:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a987 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297341:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a987 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297345:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a987 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297350:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d46000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.297353:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a987 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297359:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a987 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297368:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065224.297370:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.297373:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a987 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297378:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46000/0xad6b7ddc147a987 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297482:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a98e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297487:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a98e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297490:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a98e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297494:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d47200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.297496:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a98e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297499:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a98e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297505:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5d00) 00010000:00010000:3.0:1746065224.297507:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.297509:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a98e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297513:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a98e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.297534:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc147a980 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a176 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.297542:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc147a995 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a176 expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.297547:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.297549:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065224.297551:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46200, rc 0) 00000100:00100000:3.0:1746065224.297741:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+17:2679:x1830881265559424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 668us (872us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.297747:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14675 00000100:00100000:0.0:1746065224.300415:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.300503:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.300531:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.300574:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.300602:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265559936 00000100:00100000:0.0:1746065224.300609:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265559936 00000100:00100000:0.0:1746065224.300644:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 881 00000100:00100000:0.0:1746065224.300651:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+17:2007:x1830881265559936:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065224.300669:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065224.300687:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265559552 00010000:00010000:0.0:1746065224.300688:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc147a995 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a176 expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.300691:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265559552 00010000:00010000:0.0:1746065224.300703:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065224.300707:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.300714:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265559680 00000100:00100000:2.0:1746065224.300716:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265559680 00000100:00100000:2.0:1746065224.300725:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265559808 00000100:00100000:2.0:1746065224.300726:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265559808 00000100:00100000:0.0:1746065224.300735:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+16:2007:x1830881265559936:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.300738:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17928 00000100:00100000:0.0:1746065224.300741:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 881 00000100:00100000:2.0:1746065224.300742:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265559552:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065224.300755:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.300766:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc147a99c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a17d expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.300798:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.300799:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.300806:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc147a99c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a17d expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.300817:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc147a99c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a17d expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.300825:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44e00, rc 0) 00000100:00100000:2.0:1746065224.300844:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265559552:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 102us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.300850:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17928 00000100:00100000:2.0:1746065224.300860:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17929 00000100:00100000:2.0:1746065224.300865:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265559680:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065224.300871:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.300877:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a9a3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a184 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.300907:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264054016:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065224.300935:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17930 00000100:00100000:1.0:1746065224.300941:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265559808:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065224.300948:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065224.300956:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a9aa lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a18b expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.300958:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065224.300978:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264054144:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065224.300999:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.302252:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264054016:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.302276:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a9a3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a184 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065224.302298:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264054144:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.302303:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44000/0xad6b7ddc147a9a3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a184 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.302312:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a9aa lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a18b expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.302320:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0400/0xad6b7ddc147a9aa lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a18b expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.302324:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d44000, rc 0) 00010000:00010000:1.0:1746065224.302340:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0400, rc 0) 00000100:00100000:2.0:1746065224.302397:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2004:x1830881265559680:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1531us (1894us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065224.302397:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265559808:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1455us (1865us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065224.302403:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17930 00000100:00100000:2.0:1746065224.302544:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17929 00000100:00100000:1.0:1746065224.304108:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.304311:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265560192 00000100:00100000:3.0:1746065224.304318:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265560192 00000100:00100000:3.0:1746065224.305186:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14676 00000100:00100000:3.0:1746065224.305195:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+16:2679:x1830881265560192:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065224.305210:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.305227:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc147a9b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a192 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.305334:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.305347:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0dc expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.305355:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147a8df lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ff expref: 41 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.305362:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc147a948 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a145 expref: 23 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.305368:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.305395:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc147a948 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a145 expref: 23 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.305406:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc147a948 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a145 expref: 23 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.305420:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264054272:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.305512:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147a8df lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ff expref: 41 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.305519:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147a8df lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ff expref: 41 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.305529:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264054400:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.305549:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0dc expref: 17 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.305555:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0dc expref: 17 pid: 13395 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.305560:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264054528:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.305572:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.309372:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.310002:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264054528:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.310071:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265560320 00000100:00100000:2.0:1746065224.310076:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265560320 00010000:00010000:2.0:1746065224.310107:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0dc expref: 18 pid: 13395 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.310138:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8398 00000100:00100000:2.0:1746065224.310144:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265560320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.310157:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.310161:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0dc expref: 18 pid: 13395 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.310493:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264054272:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.310502:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264054400:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.310580:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0dc expref: 18 pid: 13395 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746065224.310595:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065224.310600:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07200/0xad6b7ddc147a8a7 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0dc expref: 18 pid: 13395 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.310627:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00000100:00100000:0.0:1746065224.310628:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065224.310631:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:2.0:1746065224.310640:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746065224.310641:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265560448 00010000:00010000:2.0:1746065224.310645:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.310645:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265560448 00000100:00100000:0.0:1746065224.310653:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265560576 00000100:00100000:0.0:1746065224.310657:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265560576 00010000:00010000:1.0:1746065224.310658:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc147a948 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a145 expref: 24 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.310671:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147a8df lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ff expref: 42 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.310675:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8399 00000100:00100000:2.0:1746065224.310678:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265560320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 535us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.310679:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2006:x1830881265560448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065224.310684:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8398 00010000:00010000:1.0:1746065224.310685:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065224.310687:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8400 00010000:00010000:1.0:1746065224.310688:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc147a948 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a145 expref: 24 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746065224.310692:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881265560576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.310695:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc147a948 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a145 expref: 24 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.310699:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065224.310702:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147a8df lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 15 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ff expref: 42 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.310706:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47e00/0xad6b7ddc147a948 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a145 expref: 24 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.310709:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147a8df lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 16 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ff expref: 42 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.310720:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147a8df lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ff expref: 42 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.310728:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.310731:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065224.310737:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065224.310742:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT flags: 0x50290000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065224.310749:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065224.310752:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065224.310756:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065224.310769:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265560576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.310788:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265560448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 93us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.310791:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8400 00010000:00010000:3.0:1746065224.310794:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746065224.310796:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8399 00010000:00010000:3.0:1746065224.310801:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.310805:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065224.310821:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065224.310919:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46c00/0xad6b7ddc147a9b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a192 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.310947:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a192 expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.310953:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.310955:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065224.310958:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d46400, rc 0) 00000100:00100000:3.0:1746065224.310990:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+17:2679:x1830881265560192:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5796us (6885us total) trans 8589937207 rc 0/0 00000100:00100000:3.0:1746065224.311450:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14676 00000100:00100000:0.0:1746065224.312922:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.313023:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265560704 00000100:00100000:3.0:1746065224.313028:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265560704 00000100:00100000:3.0:1746065224.313062:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14677 00000100:00100000:3.0:1746065224.313068:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+17:2679:x1830881265560704:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065224.313090:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.313103:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc147a9c6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a199 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.313165:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a9cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.313177:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a192 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.313183:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a9cd lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.313205:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a192 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.313214:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a192 expref: 18 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.313224:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264054656:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.313307:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603240 going to sleep for 11 seconds 00000100:00100000:3.0:1746065224.316638:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264054656:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.316658:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a9cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:0.0:1746065224.317099:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.317399:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265560832 00000100:00100000:1.0:1746065224.317405:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265560832 00010000:00010000:1.0:1746065224.317431:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a192 expref: 19 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.317462:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8401 00000100:00100000:1.0:1746065224.317469:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265560832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.317480:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.317485:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a192 expref: 19 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.317499:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a192 expref: 19 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.317517:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46400/0xad6b7ddc147a9b8 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 14 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a192 expref: 19 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.317527:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.317531:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a9cd lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065224.317539:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a9cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065224.317545:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a9cd lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:1.0:1746065224.317571:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065224.317668:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a9cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.317674:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a9cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065224.317720:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065224.317724:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000100:00100000:1.0:1746065224.317732:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265560832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 262us (633us total) trans 0 rc 0/0 00000004:00010000:3.0:1746065224.317738:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a9cd lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:1.0:1746065224.317738:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8401 00010000:00010000:3.0:1746065224.317761:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46800/0xad6b7ddc147a9c6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 12 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a199 expref: 18 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.317796:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a9cd lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a199 expref: 17 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.317803:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.317805:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065224.317807:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47200, rc 0) 00000100:00100000:3.0:1746065224.317888:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+17:2679:x1830881265560704:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4819us (4968us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.317894:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14677 00000100:00100000:0.0:1746065224.320081:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.320127:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.320212:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265561088 00000100:00100000:1.0:1746065224.320218:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265561088 00000100:00100000:1.0:1746065224.320257:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265560960 00000100:00100000:1.0:1746065224.320260:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265560960 00000100:00100000:1.0:1746065224.320275:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17931 00000100:00100000:1.0:1746065224.320280:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+15:2007:x1830881265561088:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:2.0:1746065224.320398:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17932 00000100:00100000:2.0:1746065224.320405:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265560960:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065224.320417:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.320431:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc147a9d4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1a0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.320478:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264054784:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065224.320596:0:3068:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065224.320607:0:3068:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a9db lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1a7 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.320631:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264054912:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.321013:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065224.321369:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.322455:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264054784:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.322478:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc147a9d4 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1a0 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.322489:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1400/0xad6b7ddc147a9d4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1a0 expref: 14 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.322506:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c1400, rc 0) 00000100:00100000:2.0:1746065224.322537:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265560960:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2133us (2410us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065224.322544:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17932 00000100:00100000:1.0:1746065224.322669:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264054912:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065224.322688:0:3068:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a9db lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1a7 expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.322696:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb0c00/0xad6b7ddc147a9db lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1a7 expref: 16 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.322710:0:3068:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0c00, rc 0) 00000100:00100000:1.0:1746065224.322731:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+15:2007:x1830881265561088:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2452us (2658us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065224.322736:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17931 00000100:00100000:0.0:1746065224.325949:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.326167:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265561344 00000100:00100000:3.0:1746065224.326174:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265561344 00000100:00100000:3.0:1746065224.326222:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14678 00000100:00100000:3.0:1746065224.326229:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+17:2679:x1830881265561344:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065224.326244:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.326259:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc147a9e2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 12 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1ae expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.326353:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc147a9e9 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 13 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.326367:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc147a9e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.326375:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc147a9e9 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 13 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065224.326384:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00010000:00010000:3.0:1746065224.326456:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d46200/0xad6b7ddc147a9e2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 13 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ae expref: 20 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.326482:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc147a9e9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 12 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ae expref: 19 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.326489:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.326491:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065224.326493:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47000, rc 0) 00000100:00100000:3.0:1746065224.326530:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+19:2679:x1830881265561344:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 302us (588us total) trans 8589937208 rc 0/0 00000100:00100000:3.0:1746065224.326535:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14678 00000100:00100000:0.0:1746065224.330531:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.331195:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.331221:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.331243:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.331255:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.331278:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.331338:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265561600 00000100:00100000:2.0:1746065224.331346:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265561600 00000100:00100000:2.0:1746065224.331377:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265561856 00000100:00100000:2.0:1746065224.331378:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265561856 00000100:00100000:2.0:1746065224.331387:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265562112 00000100:00100000:2.0:1746065224.331388:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265562112 00000100:00100000:2.0:1746065224.331395:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265561472 00000100:00100000:2.0:1746065224.331396:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265561472 00000100:00100000:2.0:1746065224.331404:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265561728 00000100:00100000:2.0:1746065224.331405:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265561728 00000100:00100000:2.0:1746065224.331413:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265561984 00000100:00100000:2.0:1746065224.331414:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265561984 00000100:00100000:2.0:1746065224.331424:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17933 00000100:00100000:2.0:1746065224.331429:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265561600:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065224.331462:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331477:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 15 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331484:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147a8b5 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ea expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.331490:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147a83e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0a4 expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.331496:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.331497:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.331500:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331525:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147a83e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0a4 expref: 17 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.331535:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147a83e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0a4 expref: 17 pid: 12260 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.331547:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264055040:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.331611:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147a8b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ea expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.331618:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147a8b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ea expref: 29 pid: 12260 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.331625:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264055168:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.331642:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 15 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331649:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 15 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.331660:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264055296:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.331673:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.331688:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17934 00000100:00100000:2.0:1746065224.331693:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265561856:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065224.331712:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331721:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331726:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a726 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fe0 expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.331731:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d06600/0xad6b7ddc147a6e7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fcb expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331735:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.331736:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.331738:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331751:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d06600/0xad6b7ddc147a6e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fcb expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331757:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d06600/0xad6b7ddc147a6e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fcb expref: 15 pid: 12260 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.331766:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264055424:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.331820:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a726 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fe0 expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.331828:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a726 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fe0 expref: 15 pid: 9550 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.331835:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264055552:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.331855:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 33 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331862:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 33 pid: 12260 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.331868:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264055680:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.331879:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.331893:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17935 00000100:00100000:2.0:1746065224.331898:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265562112:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065224.331911:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331920:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331928:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.331929:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.331931:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331944:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.331951:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 15 pid: 11461 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.331957:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264055808:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.331973:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.331987:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17936 00000100:00100000:2.0:1746065224.331991:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265561472:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065224.332003:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332012:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 33 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332018:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc147a99c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a17d expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.332023:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147a917 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a129 expref: 15 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.332028:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.332029:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.332031:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332044:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147a917 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a129 expref: 15 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.332051:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147a917 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a129 expref: 15 pid: 11461 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.332058:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264055936:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.332080:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc147a99c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a17d expref: 15 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.332087:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc147a99c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a17d expref: 15 pid: 9550 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.332093:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264056064:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.332107:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 33 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332114:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 33 pid: 3068 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.332124:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264056192:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.332135:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b2204240 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.332155:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17937 00000100:00100000:2.0:1746065224.332160:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265561728:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065224.332173:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332182:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332188:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147a8fb lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a10d expref: 17 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.332195:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147a8bc lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0f1 expref: 29 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.332199:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.332200:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.332202:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332215:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147a8bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0f1 expref: 29 pid: 3068 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.332222:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147a8bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0f1 expref: 29 pid: 3068 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.332229:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264056320:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.332247:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147a8fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a10d expref: 17 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.332253:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147a8fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a10d expref: 17 pid: 9550 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.332260:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264056448:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.332275:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 15 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332293:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 15 pid: 12260 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.332300:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264056576:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.332313:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.332326:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17938 00000100:00100000:2.0:1746065224.332331:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265561984:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065224.332344:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332352:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332362:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.332363:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.332365:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332377:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 15 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.332384:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 15 pid: 11461 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.332391:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881264056704:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.332404:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.338120:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264055040:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.338131:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264055168:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.338138:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264055296:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.338163:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.338187:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264055424:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.340811:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264056320:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.340822:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264056448:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.340829:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264056576:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.340846:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.340869:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264055808:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.340879:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.341431:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264055936:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.341439:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264056064:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.341445:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264056192:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.341459:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.348595:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009adf5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264055552:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065224.348768:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.348812:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.348829:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.348894:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264055680:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.348919:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065224.349009:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265562368 00000100:00100000:0.0:1746065224.349015:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265562368 00010000:00010000:0.0:1746065224.349044:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147a8b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ea expref: 30 pid: 12260 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746065224.349075:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265562240 00000100:00100000:0.0:1746065224.349077:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265562240 00010000:00010000:0.0:1746065224.349085:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147a83e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0a4 expref: 18 pid: 12260 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746065224.352874:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8402 00000100:00100000:0.0:1746065224.352888:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265562368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065224.352905:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065224.352925:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147a8b5 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ea expref: 30 pid: 12260 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.352937:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147a8b5 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ea expref: 30 pid: 12260 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.352954:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f72c00/0xad6b7ddc147a8b5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ea expref: 30 pid: 12260 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.352976:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065224.353020:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265562368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 137us (4253us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.353026:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8402 00000100:00100000:0.0:1746065224.353042:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8403 00000100:00100000:0.0:1746065224.353047:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+18:2007:x1830881265562240:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065224.353054:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065224.353060:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147a83e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0a4 expref: 18 pid: 12260 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.353068:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147a83e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0a4 expref: 18 pid: 12260 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.353078:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147a83e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0a4 expref: 18 pid: 12260 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.353085:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065224.353097:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+17:2007:x1830881265562240:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (4286us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.353102:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8403 00000100:00100000:1.0:1746065224.353275:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.355058:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265562624 00000100:00100000:3.0:1746065224.355068:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265562624 00010000:00010000:3.0:1746065224.355096:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 16 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.355126:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8404 00000100:00100000:3.0:1746065224.355132:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265562624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.355140:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.355154:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 16 pid: 9550 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.355163:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 16 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.355280:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.355319:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.355319:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265562880 00000100:00100000:0.0:1746065224.355324:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265562880 00000100:00100000:1.0:1746065224.355333:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065224.355338:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc147a99c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a17d expref: 16 pid: 9550 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746065224.355346:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.355355:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.355355:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265563136 00000100:00100000:0.0:1746065224.355357:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265563136 00010000:00010000:0.0:1746065224.355365:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147a8bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0f1 expref: 29 pid: 3068 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746065224.355366:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.355373:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265562752 00000100:00100000:0.0:1746065224.355375:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265562752 00000100:00100000:1.0:1746065224.355377:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065224.355382:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147a917 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a129 expref: 16 pid: 11461 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746065224.355388:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.355390:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265563008 00000100:00100000:0.0:1746065224.355392:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265563008 00000100:00100000:1.0:1746065224.355396:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065224.355399:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 34 pid: 3068 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746065224.355406:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265563264 00000100:00100000:0.0:1746065224.355407:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265563264 00010000:00010000:0.0:1746065224.355413:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147a8fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a10d expref: 17 pid: 9550 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746065224.355421:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265563520 00000100:00100000:0.0:1746065224.355423:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265563520 00000100:00100000:1.0:1746065224.355424:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065224.355429:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 35 pid: 12260 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746065224.355436:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265563392 00000100:00100000:1.0:1746065224.355437:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265563776 00000100:00100000:0.0:1746065224.355437:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265563392 00000100:00100000:1.0:1746065224.355439:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265563776 00010000:00010000:0.0:1746065224.355442:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a726 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fe0 expref: 17 pid: 9550 timeout: 920 lvb_type: 1 00000100:00100000:0.0:1746065224.355449:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265563904 00010000:00010000:1.0:1746065224.355451:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 17 pid: 12260 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746065224.355451:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265563904 00010000:00010000:0.0:1746065224.355457:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d06600/0xad6b7ddc147a6e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fcb expref: 17 pid: 12260 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.355463:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8405 00000100:00100000:1.0:1746065224.355467:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265562880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065224.355469:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8406 00010000:00010000:1.0:1746065224.355474:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065224.355474:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265563136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065224.355480:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.355484:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc147a99c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a17d expref: 17 pid: 9550 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.355488:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147a8bc lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0f1 expref: 29 pid: 3068 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.355491:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc147a99c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a17d expref: 17 pid: 9550 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.355495:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147a8bc lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0f1 expref: 29 pid: 3068 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.355504:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d44e00/0xad6b7ddc147a99c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a17d expref: 17 pid: 9550 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.355507:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147a8bc lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0f1 expref: 29 pid: 3068 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.355517:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065224.355519:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065224.355548:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fbb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265563136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.355552:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265562880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.355554:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8406 00000100:00100000:1.0:1746065224.355557:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8405 00000100:00100000:1.0:1746065224.355566:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8407 00000100:00100000:1.0:1746065224.355570:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265562752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065224.355570:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8408 00000100:00100000:0.0:1746065224.355574:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265563008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.355575:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.355580:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147a917 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a129 expref: 17 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.355580:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.355586:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147a917 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a129 expref: 17 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.355593:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 35 pid: 3068 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.355595:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72a00/0xad6b7ddc147a917 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a129 expref: 17 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.355600:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 35 pid: 3068 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.355645:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8409 00000100:00100000:2.0:1746065224.355651:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265563264:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.355657:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.355663:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147a8fb lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a10d expref: 17 pid: 9550 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.355673:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147a8fb lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a10d expref: 17 pid: 9550 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.355682:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147a8fb lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a10d expref: 17 pid: 9550 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.355692:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.355704:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265563264:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 54us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.355709:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8409 00000100:00100000:2.0:1746065224.355716:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8410 00000100:00100000:2.0:1746065224.355720:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265563520:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.355724:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.355731:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 35 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.355737:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 35 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.355745:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d06e00/0xad6b7ddc147a6d2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fbd expref: 35 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.355751:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.355759:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265563520:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 39us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.355763:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8410 00000100:00100000:2.0:1746065224.355769:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8411 00000100:00100000:2.0:1746065224.355787:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265563392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.355793:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.355797:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a726 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fe0 expref: 15 pid: 9550 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.355803:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a726 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fe0 expref: 15 pid: 9550 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.355812:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147a726 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fe0 expref: 15 pid: 9550 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.355818:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.355830:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265563392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.355835:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8411 00000100:00100000:2.0:1746065224.355843:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8412 00000100:00100000:2.0:1746065224.355847:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265563776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.355851:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.355857:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 17 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.355863:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 17 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.356099:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f3dc600/0xad6b7ddc147a814 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a08f expref: 17 pid: 9550 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.356114:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.356116:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.356119:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356127:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356144:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.356157:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265562624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1026us (2884us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.356162:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8404 00000100:00100000:3.0:1746065224.356194:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8413 00000100:00100000:3.0:1746065224.356198:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265563904:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.356203:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.356209:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d06600/0xad6b7ddc147a6e7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fcb expref: 16 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.356216:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d06600/0xad6b7ddc147a6e7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fcb expref: 16 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.356225:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d06600/0xad6b7ddc147a6e7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939fcb expref: 16 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.356231:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.356232:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.356235:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356240:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356251:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.356262:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265563904:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 64us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.356266:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8413 00010000:00010000:3.0:1746065224.356293:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356300:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356313:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356318:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356324:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356329:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097b60400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065224.356332:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356338:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356349:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356354:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b60400/0xad6b7ddc147a9f7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.356383:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265561600:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 24954us (25859us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.356389:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17933 00010000:00010000:3.0:1746065224.356405:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356410:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356419:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356423:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356428:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356433:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065224.356435:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356440:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356447:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.356451:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3200/0xad6b7ddc147a9fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.356471:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265561856:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 24778us (25278us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.356475:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17934 00010000:00010000:2.0:1746065224.356877:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147a861 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0ce expref: 17 pid: 12260 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.356887:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.356889:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.356891:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.356898:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.356910:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.356922:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265563776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1074us (1524us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.356926:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8412 00010000:00010000:1.0:1746065224.356927:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.356962:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881264056704:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.356974:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.356989:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bf200/0xad6b7ddc147a902 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a11b expref: 33 pid: 3068 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.356992:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265562496 00000100:00100000:2.0:1746065224.356995:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265562496 00010000:00010000:0.0:1746065224.356998:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.356999:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00002000:00100000:2.0:1746065224.357015:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_011: refresh rw locks for [0x280000401:0x96:0x0] (4087808->4194303) req@ffff88009c5f3100 x1830881265562496/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.357022:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3100 with x1830881265562496 ext(4087808->4194303) 00010000:00010000:2.0:1746065224.357028:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 14 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.357035:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 14 pid: 11461 timeout: 920 lvb_type: 0 00002000:00010000:2.0:1746065224.357040:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c5f3100 00000100:00100000:2.0:1746065224.357050:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265563648 00000100:00100000:2.0:1746065224.357051:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265563648 00002000:00100000:2.0:1746065224.357058:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4964351) req@ffff880091a92d80 x1830881265563648/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.357063:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92d80 with x1830881265563648 ext(4194304->4964351) 00010000:00010000:2.0:1746065224.357067:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 15 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.357073:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 15 pid: 11461 timeout: 920 lvb_type: 0 00002000:00010000:2.0:1746065224.357078:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091a92d80 00000100:00100000:2.0:1746065224.357091:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2119 00000100:00100000:2.0:1746065224.357095:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2007:x1830881265562496:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065224.357100:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2004:x1830881265562752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1526us (1763us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.357106:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8407 00010000:00010000:0.0:1746065224.357140:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.357147:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.357160:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.357163:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2120 00000100:00100000:2.0:1746065224.357167:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+14:2005:x1830881265563648:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065224.357173:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265563008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1598us (1826us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.357177:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8408 00010000:00010000:2.0:1746065224.357254:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.357260:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.357270:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.357275:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.357281:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.357298:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065224.357301:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.357307:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.357315:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.357320:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880097aa4400/0xad6b7ddc147aa0c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.357345:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265561472:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 25354us (26101us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.357350:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17936 00010000:00010000:3.0:1746065224.357402:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.357409:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.357419:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.357424:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.357429:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.357442:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009af08000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065224.357444:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.357450:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.357457:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.357462:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009af08000/0xad6b7ddc147aa13 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.357499:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265561728:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 25339us (26243us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.357504:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17937 00000100:00100000:2.0:1746065224.363595:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265562496:12345-192.168.202.27@tcp:4:cat.0 Request processed in 6489us (14754us total) trans 21474841760 rc 0/0 00000100:00100000:2.0:1746065224.363607:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2119 00002000:00100000:2.0:1746065224.363617:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (4087808->4194303) req@ffff88009c5f3100 x1830881265562496/t21474841760(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/448 e 0 to 0 dl 1746065235 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.363626:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009c5f3100 with x1830881265562496 ext(4087808->4194303) 00010000:00010000:2.0:1746065224.363635:0:9555:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.363647:0:9555:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00002000:00010000:2.0:1746065224.363653:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009c5f3100 00000100:00100000:0.0:1746065224.368726:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.371656:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265564032 00000100:00100000:1.0:1746065224.371666:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265564032 00010000:00010000:1.0:1746065224.371699:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.371738:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8414 00000100:00100000:1.0:1746065224.371746:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265564032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.371757:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.371784:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.371794:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.371812:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d44a00/0xad6b7ddc147a96b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4087808->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a161 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.371828:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.371829:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.371833:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.371840:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.371858:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.371895:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265564032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 150us (3177us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.371901:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8414 00010000:00010000:2.0:1746065224.371970:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.371979:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.371998:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.372004:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.372009:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.372015:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa4c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065224.372018:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.372024:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.372034:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.372039:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa4c00/0xad6b7ddc147aa05 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.372077:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2005:x1830881265562112:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 40178us (40855us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.372084:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17935 00000100:00100000:0.0:1746065224.374658:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265563648:12345-192.168.202.27@tcp:4:cat.0 Request processed in 17483us (19272us total) trans 17179874380 rc 0/0 00000100:00100000:0.0:1746065224.374668:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2120 00002000:00100000:0.0:1746065224.374679:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->4964351) req@ffff880091a92d80 x1830881265563648/t17179874380(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/448 e 0 to 0 dl 1746065235 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.374688:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091a92d80 with x1830881265563648 ext(4194304->4964351) 00010000:00010000:0.0:1746065224.374697:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.374710:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746065224.374716:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091a92d80 00000100:00100000:0.0:1746065224.380365:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.380451:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265564160 00000100:00100000:3.0:1746065224.380458:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265564160 00010000:00010000:3.0:1746065224.380486:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.380631:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8415 00000100:00100000:3.0:1746065224.380638:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2007:x1830881265564160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.380650:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.380665:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.380676:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.380693:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d45e00/0xad6b7ddc147a972 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 4194304->4964351) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a168 expref: 16 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.380706:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.380708:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.380711:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.380718:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.380733:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.380761:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2007:x1830881265564160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 123us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.380766:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8415 00010000:00010000:3.0:1746065224.380806:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.381070:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.381083:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.381094:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.381100:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.381105:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065224.381109:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.381115:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.381125:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.381131:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a96e00/0xad6b7ddc147aa1a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.381171:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265561984:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 48839us (49891us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.381178:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17938 00000100:00100000:0.0:1746065224.388038:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.388128:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265564416 00000100:00100000:2.0:1746065224.388136:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265564416 00000100:00100000:2.0:1746065224.388191:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14679 00000100:00100000:2.0:1746065224.388198:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+19:2679:x1830881265564416:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065224.388239:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1746065224.388262:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47200/0xad6b7ddc147a9cd lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a199 expref: 19 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388293:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1a200/0xad6b7ddc147a45c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e2e expref: 18 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388303:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065224.388307:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065224.388327:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 11 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.388337:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147a892 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0d5 expref: 40 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388343:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e0b expref: 22 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388348:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388353:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 22 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388358:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc147a7e3 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a073 expref: 22 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388367:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.388390:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc147a7e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a073 expref: 22 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388400:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc147a7e3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a073 expref: 22 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.388411:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264056832:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.388498:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 22 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388505:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 22 pid: 13395 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.388512:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264056960:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.388531:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 40 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388538:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 40 pid: 7205 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.388543:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264057088:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.388558:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e0b expref: 22 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388567:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e0b expref: 22 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.388572:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264057216:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.388584:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147a892 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0d5 expref: 40 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.388589:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147a892 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0d5 expref: 40 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.388594:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264057344:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.388605:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800ac528300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.395099:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.395120:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.395141:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.395152:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.395524:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264056832:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.395536:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264056960:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.395542:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264057088:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.395548:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264057216:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.395554:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264057344:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.395578:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065224.395656:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.395710:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265564544 00000100:00100000:1.0:1746065224.395716:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265564544 00010000:00010000:1.0:1746065224.395743:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 23 pid: 13395 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.395763:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265564800 00000100:00100000:1.0:1746065224.395765:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265564800 00010000:00010000:1.0:1746065224.395798:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e0b expref: 24 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.395812:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265564672 00000100:00100000:1.0:1746065224.395815:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265564672 00010000:00010000:1.0:1746065224.395824:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 41 pid: 7205 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.395831:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265564928 00000100:00100000:1.0:1746065224.395832:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265564928 00010000:00010000:1.0:1746065224.395838:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147a892 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0d5 expref: 42 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.395847:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8416 00000100:00100000:1.0:1746065224.395852:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265564544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.395863:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.395867:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 24 pid: 13395 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.395874:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 24 pid: 13395 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.395891:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f70be00/0xad6b7ddc147a46a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e3c expref: 24 pid: 13395 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.395910:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.395913:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.395921:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.395952:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265564544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.395958:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8416 00000100:00100000:1.0:1746065224.395971:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8417 00000100:00100000:1.0:1746065224.395976:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265564800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.395982:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.395985:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e0b expref: 22 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.395992:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e0b expref: 22 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.396001:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099cd3400/0xad6b7ddc147a439 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e0b expref: 22 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.396008:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.396011:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.396015:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.396027:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265564800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 52us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.396035:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8417 00000100:00100000:1.0:1746065224.396043:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8418 00000100:00100000:1.0:1746065224.396048:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265564672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.396053:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.396056:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 42 pid: 7205 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.396063:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 42 pid: 7205 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.396072:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835ce00/0xad6b7ddc147a463 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd939e35 expref: 42 pid: 7205 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.396078:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.396081:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.396085:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.396097:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265564672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 49us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.396101:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8418 00000100:00100000:1.0:1746065224.396109:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8419 00000100:00100000:1.0:1746065224.396113:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265564928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.396118:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.396121:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147a892 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0d5 expref: 40 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.396131:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147a892 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0d5 expref: 40 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.396138:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147a892 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a0d5 expref: 40 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.396145:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.396148:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.396152:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.396161:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881265564928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.396165:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8419 00000100:00100000:3.0:1746065224.396679:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265565184 00000100:00100000:3.0:1746065224.396684:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265565184 00000100:00100000:3.0:1746065224.396707:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5530 00000100:00100000:3.0:1746065224.396712:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:30399:x1830881265565184:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1746065224.396857:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:30399:x1830881265565184:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 144us (1200us total) trans 8589937209 rc 0/0 00000100:00100000:3.0:1746065224.396862:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5530 00000100:00100000:0.0:1746065224.399416:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.406765:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265565312 00000100:00100000:2.0:1746065224.406785:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265565312 00010000:00010000:2.0:1746065224.406814:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc147a7e3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a073 expref: 22 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.406846:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8420 00000100:00100000:2.0:1746065224.406853:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265565312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.406863:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.406868:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc147a7e3 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a073 expref: 22 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.406876:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc147a7e3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a073 expref: 22 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.406892:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835de00/0xad6b7ddc147a7e3 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a073 expref: 22 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.406905:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065224.406909:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.406917:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.406922:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.406939:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065224.406951:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.406956:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000040:00080000:2.0:1746065224.407128:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1119, 88 off106312 00000004:00080000:2.0:1746065224.407133:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820425359267ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065224.407153:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1129, 88 off107200 00000004:00080000:2.0:1746065224.407156:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820425382906ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065224.407165:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1130, 88 off107288 00000004:00080000:2.0:1746065224.407167:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820425393630ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065224.407173:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1120, 88 off106400 00000004:00080000:2.0:1746065224.407176:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820425402251ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065224.407256:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1122, 88 off106584 00000004:00080000:2.0:1746065224.407259:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820425485455ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065224.407268:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1131, 88 off107376 00000004:00080000:2.0:1746065224.407270:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820425496307ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065224.407275:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1132, 88 off107464 00000004:00080000:2.0:1746065224.407277:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820425503982ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065224.407295:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1133, 88 off107552 00000004:00080000:2.0:1746065224.407298:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820425524672ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065224.407305:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1123, 88 off106672 00000004:00080000:2.0:1746065224.407307:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820425533532ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065224.407313:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1134, 88 off107640 00000004:00080000:2.0:1746065224.407315:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820425541861ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065224.407321:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1124, 88 off106760 00000004:00080000:2.0:1746065224.407323:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820425549555ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065224.407328:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1135, 88 off107728 00000004:00080000:2.0:1746065224.407330:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820425556754ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065224.407335:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1125, 88 off106848 00000004:00080000:2.0:1746065224.407337:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820425563902ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065224.407343:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1126, 88 off106936 00000004:00080000:2.0:1746065224.407345:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820425571106ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065224.407351:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1127, 88 off107024 00000004:00080000:2.0:1746065224.407353:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820425579192ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065224.407358:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1128, 88 off107112 00000004:00080000:2.0:1746065224.407360:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820425586475ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065224.407365:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1136, 88 off107816 00000004:00080000:2.0:1746065224.407367:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820425593396ns, next at 761143559853ns, rc = 0 00000100:00100000:2.0:1746065224.407445:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265565312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 591us (8033us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.407450:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8420 00000001:00080000:1.0:1746065224.411596:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937210 is committed 00000004:00080000:1.0:1746065224.411604:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1114 committed 00010000:00010000:3.0:1746065224.412831:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.412841:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.412848:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.412852:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c0000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.412856:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.412861:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.412874:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.412876:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.412878:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.412883:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800999c0000/0xad6b7ddc147a543 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00000100:00100000:2.0:1746065224.413029:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264057856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.413074:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.413108:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264058368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.413120:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.413133:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065224.413136:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264057728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.413146:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.413153:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264058240:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.413163:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.413182:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264057856 00000100:00100000:2.0:1746065224.413188:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264057856 00000100:00100000:2.0:1746065224.413221:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264058368 00000100:00100000:2.0:1746065224.413224:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264058368 00000100:00100000:2.0:1746065224.413233:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264057728 00000100:00100000:2.0:1746065224.413235:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264057728 00000100:00100000:2.0:1746065224.413242:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264058240 00000100:00100000:2.0:1746065224.413244:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264058240 00000100:00100000:2.0:1746065224.413254:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17939 00000100:00100000:2.0:1746065224.413259:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3762:x1830881264057856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065224.413367:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065224.413369:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065224.413371:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.413373:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065224.413374:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:2.0:1746065224.413397:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3762:x1830881264057856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 137us (323us total) trans 21474841761 rc 0/0 00000100:00100000:2.0:1746065224.413402:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17939 00000100:00100000:2.0:1746065224.413413:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17940 00000100:00100000:2.0:1746065224.413416:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3762:x1830881264058368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.413457:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3762:x1830881264058368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 40us (335us total) trans 21474841762 rc 0/0 00000100:00100000:2.0:1746065224.413461:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17940 00000100:00100000:2.0:1746065224.413467:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17941 00000100:00100000:2.0:1746065224.413470:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3762:x1830881264057728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.413504:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3762:x1830881264057728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 33us (357us total) trans 21474841763 rc 0/0 00000100:00100000:2.0:1746065224.413508:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17941 00000100:00100000:2.0:1746065224.413514:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17942 00000100:00100000:2.0:1746065224.413517:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+40:3762:x1830881264058240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.413550:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e50e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+41:3762:x1830881264058240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 32us (385us total) trans 21474841764 rc 0/0 00000100:00100000:2.0:1746065224.413553:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17942 00000004:00080000:2.0:1746065224.413576:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e53800/2, rc 0, transno 21474841763 00000100:00100000:2.0:1746065224.413580:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264057728:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065224.413586:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e52a00/2, rc 0, transno 21474841764 00000100:00100000:2.0:1746065224.413588:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264058240:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065224.413592:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e50700/2, rc 0, transno 21474841761 00000100:00100000:2.0:1746065224.413594:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264057856:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065224.413598:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e50a80/2, rc 0, transno 21474841762 00000100:00100000:2.0:1746065224.413600:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264058368:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1746065224.413620:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065224.413682:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264057472:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.413701:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065224.413711:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264057984:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.413723:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065224.413730:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065224.413733:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264057600:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.413744:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065224.413750:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264058112:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.413759:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065224.413786:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264057472 00000100:00100000:0.0:1746065224.413788:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264057472 00000100:00100000:0.0:1746065224.413800:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264057984 00000100:00100000:0.0:1746065224.413802:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264057984 00000100:00100000:0.0:1746065224.413808:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264057600 00000100:00100000:0.0:1746065224.413809:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264057600 00000100:00100000:0.0:1746065224.413814:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264058112 00000100:00100000:0.0:1746065224.413816:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264058112 00000100:00100000:0.0:1746065224.413822:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17943 00000100:00100000:0.0:1746065224.413826:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3759:x1830881264057472:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.413872:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3759:x1830881264057472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (170us total) trans 21474841765 rc 0/0 00000100:00100000:0.0:1746065224.413877:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17943 00000100:00100000:0.0:1746065224.413884:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17944 00000100:00100000:0.0:1746065224.413887:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3759:x1830881264057984:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065224.413914:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065224.413916:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065224.413918:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065224.413920:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065224.413921:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:0.0:1746065224.413933:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3759:x1830881264057984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 46us (210us total) trans 21474841766 rc 0/0 00000100:00100000:0.0:1746065224.413937:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17944 00000100:00100000:0.0:1746065224.414030:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17945 00000100:00100000:0.0:1746065224.414033:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3759:x1830881264057600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.414068:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3759:x1830881264057600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 35us (323us total) trans 21474841767 rc 0/0 00000100:00100000:0.0:1746065224.414072:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17945 00000100:00100000:0.0:1746065224.414079:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17946 00000100:00100000:0.0:1746065224.414081:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+44:3759:x1830881264058112:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1746065224.414105:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:0.0:1746065224.414107:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065224.414109:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065224.414110:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:0.0:1746065224.414112:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:0.0:1746065224.414123:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+45:3759:x1830881264058112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (363us total) trans 21474841768 rc 0/0 00000100:00100000:0.0:1746065224.414127:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17946 00000004:00080000:0.0:1746065224.414142:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e51880/2, rc 0, transno 21474841767 00000100:00100000:0.0:1746065224.414145:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264057600:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065224.414150:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e53480/2, rc 0, transno 21474841768 00000100:00100000:0.0:1746065224.414153:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264058112:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065224.414157:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e50000/2, rc 0, transno 21474841765 00000100:00100000:0.0:1746065224.414160:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264057472:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065224.414164:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e51c00/2, rc 0, transno 21474841766 00000100:00100000:0.0:1746065224.414166:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264057984:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065224.414265:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1108 committed 00000004:00080000:1.0:1746065224.414291:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1107 committed 00000004:00080000:1.0:1746065224.414292:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1106 committed 00000004:00080000:1.0:1746065224.414294:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1105 committed 00000004:00080000:1.0:1746065224.414295:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1113 committed 00000004:00080000:1.0:1746065224.414296:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1104 committed 00000004:00080000:1.0:1746065224.414298:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1112 committed 00000004:00080000:1.0:1746065224.414299:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1103 committed 00000004:00080000:1.0:1746065224.414301:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1111 committed 00000004:00080000:1.0:1746065224.414302:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1110 committed 00000004:00080000:1.0:1746065224.414303:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1109 committed 00000004:00080000:1.0:1746065224.414304:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1102 committed 00000004:00080000:1.0:1746065224.414306:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1101 committed 00000004:00080000:1.0:1746065224.414307:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1108 committed 00000004:00080000:1.0:1746065224.414309:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1107 committed 00000004:00080000:1.0:1746065224.414312:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1100 committed 00000001:00080000:1.0:1746065224.414318:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937209 is committed 00000001:00080000:1.0:1746065224.414327:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937205 is committed 00000100:00100000:3.0:1746065224.414453:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264058880:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.414473:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.414487:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264059392:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.414496:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.414504:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065224.414507:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264058752:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.414515:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.414522:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264059264:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.414530:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.414541:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264058880 00000100:00100000:3.0:1746065224.414543:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264058880 00000100:00100000:3.0:1746065224.414558:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264059392 00000100:00100000:3.0:1746065224.414560:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264059392 00000100:00100000:3.0:1746065224.414566:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264058752 00000100:00100000:3.0:1746065224.414567:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264058752 00000100:00100000:3.0:1746065224.414572:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264059264 00000100:00100000:3.0:1746065224.414573:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264059264 00000100:00100000:3.0:1746065224.414580:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17947 00000100:00100000:3.0:1746065224.414583:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3762:x1830881264058880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.414639:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3762:x1830881264058880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (165us total) trans 17179874381 rc 0/0 00000100:00100000:3.0:1746065224.414643:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17947 00000100:00100000:3.0:1746065224.414651:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17948 00000100:00100000:3.0:1746065224.414654:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3762:x1830881264059392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065224.414680:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:3.0:1746065224.414682:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065224.414683:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.414685:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065224.414686:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:3.0:1746065224.414698:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3762:x1830881264059392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (201us total) trans 17179874382 rc 0/0 00000100:00100000:3.0:1746065224.414701:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17948 00000100:00100000:3.0:1746065224.414708:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17949 00000100:00100000:3.0:1746065224.414711:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3762:x1830881264058752:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.414742:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3762:x1830881264058752:12345-0@lo:2:osp-syn-1-0.0 Request processed in 31us (226us total) trans 17179874383 rc 0/0 00000100:00100000:3.0:1746065224.414746:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17949 00000100:00100000:3.0:1746065224.414752:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17950 00000100:00100000:3.0:1746065224.414755:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+35:3762:x1830881264059264:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065224.414803:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065224.414805:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065224.414807:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.414808:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065224.414810:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:3.0:1746065224.414827:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+36:3762:x1830881264059264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (296us total) trans 17179874384 rc 0/0 00000100:00100000:3.0:1746065224.414831:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17950 00000100:00080000:3.0:1746065224.414842:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1746065224.414848:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264058624:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.414864:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.414875:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264059136:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.414888:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.414899:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1746065224.414903:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264058496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.414915:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.414923:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264059008:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.414934:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.414949:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264058624 00000100:00100000:3.0:1746065224.414951:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264058624 00000100:00100000:3.0:1746065224.414960:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264059136 00000100:00100000:3.0:1746065224.414962:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264059136 00000100:00100000:3.0:1746065224.414967:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264058496 00000100:00100000:3.0:1746065224.414969:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264058496 00000100:00100000:3.0:1746065224.414973:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264059008 00000100:00100000:3.0:1746065224.414974:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264059008 00000100:00100000:3.0:1746065224.414980:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17951 00000100:00100000:3.0:1746065224.414983:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3760:x1830881264058624:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.415034:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800984da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3760:x1830881264058624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (169us total) trans 17179874385 rc 0/0 00000100:00100000:3.0:1746065224.415038:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17951 00000100:00100000:3.0:1746065224.415046:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17952 00000100:00100000:3.0:1746065224.415050:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3760:x1830881264059136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.415089:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3760:x1830881264059136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (200us total) trans 17179874386 rc 0/0 00000100:00100000:3.0:1746065224.415093:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17952 00000100:00100000:3.0:1746065224.415100:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17953 00000100:00100000:3.0:1746065224.415103:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3760:x1830881264058496:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.415141:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3760:x1830881264058496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (225us total) trans 17179874387 rc 0/0 00000100:00100000:3.0:1746065224.415145:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17953 00000100:00100000:3.0:1746065224.415152:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17954 00000100:00100000:3.0:1746065224.415156:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+39:3760:x1830881264059008:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065224.415188:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065224.415190:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.415192:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.415194:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.415195:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065224.415211:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+40:3760:x1830881264059008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (275us total) trans 17179874388 rc 0/0 00000100:00100000:3.0:1746065224.415215:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17954 00000004:00080000:3.0:1746065224.415236:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135139880/2, rc 0, transno 17179874383 00000100:00100000:3.0:1746065224.415242:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264058752:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065224.415249:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135138e00/2, rc 0, transno 17179874384 00000100:00100000:3.0:1746065224.415251:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264059264:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065224.415257:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135138a80/2, rc 0, transno 17179874381 00000100:00100000:3.0:1746065224.415259:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264058880:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065224.415265:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984db100/2, rc 0, transno 17179874382 00000100:00100000:3.0:1746065224.415267:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984db100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264059392:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065224.415492:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513bb80/2, rc 0, transno 17179874387 00000100:00100000:2.0:1746065224.415496:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264058496:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065224.415501:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135139180/2, rc 0, transno 17179874388 00000100:00100000:2.0:1746065224.415504:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135139180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264059008:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065224.415510:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135138000/2, rc 0, transno 17179874385 00000100:00100000:2.0:1746065224.415512:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135138000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264058624:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065224.415518:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88013513a300/2, rc 0, transno 17179874386 00000100:00100000:2.0:1746065224.415520:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013513a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264059136:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1746065224.419702:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff8800900f2a00 reply state ffff88009aa0d800 transno 8589937210 ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065224.419722:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065224.419730:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065224.419732:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065224.419735:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:0.0:1746065224.419834:0:7203:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065224.419857:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2679:x1830881265564416:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 31653us (31822us total) trans 8589937210 rc 0/0 00000100:00100000:0.0:1746065224.419865:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14679 00000100:00100000:0.0:1746065224.421468:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264059520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065224.421514:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.421590:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264059520 00000100:00100000:3.0:1746065224.421596:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264059520 00000100:00100000:3.0:1746065224.421625:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17955 00000100:00100000:3.0:1746065224.421630:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+40:3759:x1830881264059520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.421752:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+41:3759:x1830881264059520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (237us total) trans 17179874389 rc 0/0 00000100:00100000:3.0:1746065224.421757:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17955 00000100:00100000:1.0:1746065224.421874:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.421893:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265565440 00000100:00100000:1.0:1746065224.421896:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265565440 00000100:00100000:1.0:1746065224.421920:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14680 00000100:00100000:1.0:1746065224.421924:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2679:x1830881265565440:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065224.421936:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065224.421950:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147aa28 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1b5 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.421991:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147aa28 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1b5 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.422001:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147aa28 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1b5 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.422016:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.422018:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065224.422021:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb1600, rc 0) 00000100:00100000:1.0:1746065224.422046:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2679:x1830881265565440:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 121us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.422050:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14680 00010000:00010000:3.0:1746065224.425563:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.425579:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.425590:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.425595:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.425599:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.425605:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.425622:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.425624:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065224.425627:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.425632:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880091a96200/0xad6b7ddc147aa21 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065224.425901:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.426367:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265565568 00000100:00100000:3.0:1746065224.426374:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265565568 00000100:00100000:3.0:1746065224.426414:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14681 00000100:00100000:3.0:1746065224.426420:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2679:x1830881265565568:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065224.426435:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.426447:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147aa2f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1bc expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.426514:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147aa36 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.426524:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147aa36 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.426534:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147aa36 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065224.426553:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 16777217 00000004:00200000:3.0:1746065224.426557:0:7231:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065224.426567:0:7231:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147aa36 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.426583:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147aa2f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1bc expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.426593:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147aa36 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1bc expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.426599:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.426601:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065224.426604:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a200, rc 0) 00000100:00100000:3.0:1746065224.426653:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2679:x1830881265565568:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 233us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.426658:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14681 00000100:00100000:0.0:1746065224.430469:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.430506:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.431300:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.431517:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265565696 00000100:00100000:3.0:1746065224.431526:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265565696 00000100:00100000:3.0:1746065224.431565:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265565952 00000100:00100000:3.0:1746065224.431567:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265565952 00000100:00100000:3.0:1746065224.431577:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265566208 00000100:00100000:3.0:1746065224.431579:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265566208 00000100:00100000:3.0:1746065224.431591:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17956 00000100:00100000:3.0:1746065224.431599:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265565696:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065224.431617:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.431641:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc147aa3d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1c3 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065224.431666:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d748, atime: 0x6812d747, ctime: 0x6812d747, blocks: 0x800 00010000:00010000:3.0:1746065224.431686:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.431688:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.431697:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc147aa3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1c3 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.431711:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc147aa3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1c3 expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.431721:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174a00, rc 0) 00000100:00100000:3.0:1746065224.431765:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265565696:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 167us (1305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.431771:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17956 00000100:00100000:3.0:1746065224.431799:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17957 00000100:00100000:3.0:1746065224.431804:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265565952:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065224.431811:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.431821:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc147aa44 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1d1 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065224.431834:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d747, atime: 0x6812d746, ctime: 0x6812d747, blocks: 0x808 00010000:00010000:3.0:1746065224.431842:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.431843:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.431846:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc147aa44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d1 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.431860:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc147aa44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d1 expref: 14 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.431866:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a175000, rc 0) 00000100:00100000:3.0:1746065224.431881:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265565952:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 78us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.431887:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17957 00000100:00100000:3.0:1746065224.431896:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17958 00000100:00100000:3.0:1746065224.431900:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+12:2006:x1830881265566208:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065224.431905:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.431913:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a174000/0xad6b7ddc147aa4b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1df expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065224.431921:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 5034592, mtime: 0x6812d748, atime: 0x6812d748, ctime: 0x6812d748, blocks: 0x1678 00010000:00010000:3.0:1746065224.431928:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.431929:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.431932:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a174000/0xad6b7ddc147aa4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1df expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.431940:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a174000/0xad6b7ddc147aa4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1df expref: 13 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.431946:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174000, rc 0) 00000100:00100000:3.0:1746065224.431959:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265566208:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 58us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.431966:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17958 00000004:00080000:0.0:1746065224.432177:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac65f80/2, rc 0, transno 17179874389 00000100:00100000:0.0:1746065224.432185:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264059520:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065224.432220:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.432234:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265565824 00000100:00100000:0.0:1746065224.432236:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265565824 00000100:00100000:0.0:1746065224.432252:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17959 00000100:00100000:0.0:1746065224.432256:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265565824:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065224.432262:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065224.432270:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147aa52 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1ca expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065224.432279:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d747, atime: 0x6812d747, ctime: 0x6812d747, blocks: 0x800 00010000:00010000:0.0:1746065224.432299:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.432300:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.432304:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147aa52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ca expref: 15 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.432312:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147aa52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ca expref: 15 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.432323:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3de00, rc 0) 00000100:00100000:0.0:1746065224.432340:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+15:2006:x1830881265565824:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 83us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.432344:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17959 00000100:00100000:0.0:1746065224.432396:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.432406:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265566080 00000100:00100000:0.0:1746065224.432408:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265566080 00000100:00100000:0.0:1746065224.432419:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17960 00000100:00100000:0.0:1746065224.432423:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+13:2006:x1830881265566080:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065224.432429:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065224.432436:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc147aa59 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1d8 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065224.432445:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d746, atime: 0x6812d746, ctime: 0x6812d747, blocks: 0x808 00010000:00010000:0.0:1746065224.432451:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.432452:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.432456:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc147aa59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d8 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.432464:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc147aa59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d8 expref: 14 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.432470:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d800, rc 0) 00000100:00100000:0.0:1746065224.432483:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+14:2006:x1830881265566080:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 59us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.432490:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17960 00000100:00100000:0.0:1746065224.432528:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.432539:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265566336 00000100:00100000:0.0:1746065224.432542:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265566336 00000100:00100000:0.0:1746065224.432555:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17961 00000100:00100000:0.0:1746065224.432559:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+15:2006:x1830881265566336:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065224.432565:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065224.432571:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc147aa60 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1e6 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065224.432579:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d748, atime: 0x6812d748, ctime: 0x6812d748, blocks: 0x1008 00010000:00010000:0.0:1746065224.432586:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.432587:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.432591:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc147aa60 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1e6 expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.432598:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc147aa60 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1e6 expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.432604:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3ca00, rc 0) 00000100:00100000:0.0:1746065224.432619:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+16:2006:x1830881265566336:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 59us (91us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.432623:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17961 00000100:00100000:0.0:1746065224.438527:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.440620:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265566464 00000100:00100000:1.0:1746065224.440634:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265566464 00000100:00100000:1.0:1746065224.440695:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17962 00000100:00100000:1.0:1746065224.440702:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265566464:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065224.440827:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+14:2005:x1830881265566464:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 124us (2307us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.440832:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17962 00000100:00100000:0.0:1746065224.441840:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.442421:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.442448:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.442800:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.443249:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.443292:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265566592 00000100:00100000:2.0:1746065224.443298:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265566592 00000100:00100000:2.0:1746065224.443326:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265566848 00000100:00100000:2.0:1746065224.443328:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265566848 00000100:00100000:2.0:1746065224.443343:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265567104 00000100:00100000:2.0:1746065224.443345:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265567104 00000100:00100000:2.0:1746065224.443353:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265566720 00000100:00100000:2.0:1746065224.443354:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265566720 00000100:00100000:2.0:1746065224.443365:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17963 00000100:00100000:2.0:1746065224.443371:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265566592:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065224.443441:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265566592:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 69us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.443446:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17963 00000100:00100000:2.0:1746065224.443456:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17964 00000100:00100000:2.0:1746065224.443460:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265566848:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065224.443489:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265566848:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 28us (1069us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.443494:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17964 00000100:00100000:2.0:1746065224.443502:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17965 00000100:00100000:2.0:1746065224.443506:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265567104:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065224.443533:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265567104:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 26us (1084us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.443537:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17965 00000100:00100000:2.0:1746065224.443545:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17966 00000100:00100000:2.0:1746065224.443549:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265566720:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065224.443570:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265566720:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 21us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.443574:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17966 00000100:00100000:1.0:1746065224.444203:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265566976 00000100:00100000:1.0:1746065224.444208:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265566976 00000100:00100000:1.0:1746065224.444226:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17967 00000100:00100000:1.0:1746065224.444230:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265566976:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065224.444264:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265566976:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 34us (1016us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.444268:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17967 00000100:00100000:0.0:1746065224.447251:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.447544:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.447565:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.447576:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.447630:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.447760:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.447967:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265567360 00000100:00100000:1.0:1746065224.447975:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265567360 00000100:00100000:1.0:1746065224.448012:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265567616 00000100:00100000:1.0:1746065224.448013:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265567616 00000100:00100000:1.0:1746065224.448022:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265567872 00000100:00100000:1.0:1746065224.448024:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265567872 00000100:00100000:1.0:1746065224.448031:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265567232 00000100:00100000:1.0:1746065224.448032:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265567232 00000100:00100000:1.0:1746065224.448038:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265567488 00000100:00100000:1.0:1746065224.448039:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265567488 00000100:00100000:1.0:1746065224.448046:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265567744 00000100:00100000:1.0:1746065224.448047:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265567744 00000100:00100000:1.0:1746065224.448055:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17968 00000100:00100000:1.0:1746065224.448060:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265567360:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065224.448137:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265567360:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 77us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.448145:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17968 00000100:00100000:1.0:1746065224.448157:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17969 00000100:00100000:1.0:1746065224.448160:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265567616:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065224.448187:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265567616:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 26us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.448191:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17969 00000100:00100000:1.0:1746065224.448198:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17970 00000100:00100000:1.0:1746065224.448202:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265567872:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065224.448222:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265567872:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 20us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.448226:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17970 00000100:00100000:1.0:1746065224.448232:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17971 00000100:00100000:1.0:1746065224.448234:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265567232:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065224.448252:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265567232:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 16us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.448255:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17971 00000100:00100000:1.0:1746065224.448261:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17972 00000100:00100000:1.0:1746065224.448264:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265567488:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065224.448280:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265567488:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 16us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.448294:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17972 00000100:00100000:1.0:1746065224.448301:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17973 00000100:00100000:1.0:1746065224.448305:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265567744:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065224.448324:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265567744:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 19us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.448328:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17973 00000100:00100000:0.0:1746065224.450485:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.451296:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265568000 00000100:00100000:3.0:1746065224.451304:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265568000 00000100:00100000:3.0:1746065224.451621:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17974 00000100:00100000:3.0:1746065224.451629:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265568000:12345-192.168.202.27@tcp:22:lfs.0 00002000:00010000:3.0:1746065224.451763:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065224.451766:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065224.451767:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.451769:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065224.451770:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:3.0:1746065224.451830:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265568000:12345-192.168.202.27@tcp:22:lfs.0 Request processed in 202us (1351us total) trans 21474841769 rc 0/0 00000100:00100000:3.0:1746065224.451836:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17974 00000100:00100000:2.0:1746065224.454762:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.455428:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265568128 00000100:00100000:0.0:1746065224.455435:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265568128 00000100:00100000:0.0:1746065224.455480:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17975 00000100:00100000:0.0:1746065224.455487:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+14:2004:x1830881265568128:12345-192.168.202.27@tcp:22:lfs.0 00002000:00010000:0.0:1746065224.455628:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065224.455631:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065224.455633:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065224.455634:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065224.455636:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:0.0:1746065224.456280:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265568128:12345-192.168.202.27@tcp:22:lfs.0 Request processed in 791us (1522us total) trans 17179874390 rc 0/0 00000100:00100000:0.0:1746065224.456297:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17975 00000100:00100000:0.0:1746065224.462519:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.462558:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.462619:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265568512 00000100:00100000:2.0:1746065224.462627:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265568512 00000100:00100000:2.0:1746065224.462665:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265568640 00000100:00100000:2.0:1746065224.462667:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265568640 00000100:00100000:2.0:1746065224.462689:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6441 00000100:00100000:2.0:1746065224.462695:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265568512:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065224.462723:0:29490:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc147aa67 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.462734:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.462736:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.462739:0:29490:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc147aa67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.462750:0:29490:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc147aa67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.463522:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6442 00000100:00100000:3.0:1746065224.463530:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265568640:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:3.0:1746065224.463546:0:9555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc147aa6e lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.463553:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.463554:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.463557:0:9555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc147aa6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.463563:0:9555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc147aa6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065224.471531:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.472663:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265568896 00000100:00100000:2.0:1746065224.472672:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265568896 00000100:00100000:2.0:1746065224.473294:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6443 00000100:00100000:2.0:1746065224.473302:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265568896:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065224.473333:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a96c00/0xad6b7ddc147aa75 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.473345:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.473347:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.473351:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96c00/0xad6b7ddc147aa75 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.473363:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96c00/0xad6b7ddc147aa75 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.481800:0:29490:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc147aa67 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.481820:0:29490:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc147aa67 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.481827:0:29490:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc147aa67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.481833:0:29490:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880097aa5c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065224.481837:0:29490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc147aa67 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.481844:0:29490:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc147aa67 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.481859:0:29490:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc147aa67 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.481864:0:29490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097aa5c00/0xad6b7ddc147aa67 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.481996:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+19:2004:x1830881265568512:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 19293us (19477us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065224.482005:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6441 00000100:00100000:2.0:1746065224.483510:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.484262:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265569152 00000100:00100000:0.0:1746065224.484270:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265569152 00000100:00100000:0.0:1746065224.485022:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6444 00000100:00100000:0.0:1746065224.485031:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265569152:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065224.485061:0:29490:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147aa7c lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.485075:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.485076:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.485081:0:29490:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147aa7c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.485091:0:29490:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147aa7c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065224.490647:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.490700:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265569408 00000100:00100000:1.0:1746065224.490708:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265569408 00000100:00100000:1.0:1746065224.490763:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6445 00000100:00100000:1.0:1746065224.490770:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265569408:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065224.490813:0:29491:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa83 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.490824:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.490826:0:29491:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.490830:0:29491:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.490841:0:29491:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.491536:0:9555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc147aa6e lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.491546:0:9555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc147aa6e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.491553:0:9555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc147aa6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.491559:0:9555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065224.491562:0:9555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc147aa6e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.491567:0:9555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc147aa6e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.491579:0:9555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc147aa6e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.491584:0:9555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009c71a400/0xad6b7ddc147aa6e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.491627:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:02506576-29fe-43be-8266-ebca0ccafd52+19:2004:x1830881265568640:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 28097us (29067us total) trans 0 rc 1044480/1044480 00000100:00100000:3.0:1746065224.491633:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6442 00010000:00010000:2.0:1746065224.493574:0:13378:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a96c00/0xad6b7ddc147aa75 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.493587:0:13378:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96c00/0xad6b7ddc147aa75 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.493595:0:13378:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a96c00/0xad6b7ddc147aa75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.493600:0:13378:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065224.493603:0:13378:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a96c00/0xad6b7ddc147aa75 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.493608:0:13378:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a96c00/0xad6b7ddc147aa75 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.493622:0:13378:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a96c00/0xad6b7ddc147aa75 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.493628:0:13378:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96c00/0xad6b7ddc147aa75 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.493706:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265568896:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 20401us (22178us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065224.493714:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6443 00010000:00010000:1.0:1746065224.496992:0:29490:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147aa7c lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.497005:0:29490:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147aa7c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.497012:0:29490:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147aa7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.497023:0:29490:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800999c1a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065224.497026:0:29490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147aa7c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.497033:0:29490:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147aa7c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.497046:0:29490:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147aa7c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.497052:0:29490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c1a00/0xad6b7ddc147aa7c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.497127:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265569152:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 12093us (13618us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065224.497135:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6444 00000100:00100000:0.0:1746065224.501550:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.501585:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.501893:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265569664 00000100:00100000:2.0:1746065224.501902:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265569664 00000100:00100000:2.0:1746065224.501954:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265569920 00000100:00100000:2.0:1746065224.501957:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265569920 00000100:00100000:2.0:1746065224.501978:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6446 00000100:00100000:2.0:1746065224.501986:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265569664:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065224.502017:0:13378:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a96e00/0xad6b7ddc147aa8a lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.502031:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.502032:0:13378:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.502036:0:13378:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96e00/0xad6b7ddc147aa8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.502048:0:13378:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091a96e00/0xad6b7ddc147aa8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.502700:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6447 00000100:00100000:1.0:1746065224.502707:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265569920:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065224.502724:0:29490:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc147aa91 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.502732:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.502734:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.502737:0:29490:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc147aa91 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.502745:0:29490:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc147aa91 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065224.503637:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065224.504421:0:29491:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa83 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.504431:0:29491:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa83 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.504437:0:29491:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.504442:0:29491:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065224.504445:0:29491:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa83 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.504456:0:29491:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa83 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.504468:0:29491:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa83 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.504473:0:29491:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa83 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29491 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.504563:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265570176 00000100:00100000:1.0:1746065224.504569:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265570176 00000100:00100000:1.0:1746065224.506717:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6448 00000100:00100000:1.0:1746065224.506732:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:02506576-29fe-43be-8266-ebca0ccafd52+19:2004:x1830881265570176:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065224.506765:0:29488:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aa98 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.506790:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.506792:0:29488:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.506796:0:29488:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aa98 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.506807:0:29488:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aa98 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065224.507560:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265569408:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 16787us (16920us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065224.507568:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6445 00010000:00010000:2.0:1746065224.518009:0:13378:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880091a96e00/0xad6b7ddc147aa8a lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.518024:0:13378:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880091a96e00/0xad6b7ddc147aa8a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.518030:0:13378:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880091a96e00/0xad6b7ddc147aa8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.518036:0:13378:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091a96e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065224.518039:0:13378:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a96e00/0xad6b7ddc147aa8a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.518046:0:13378:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880091a96e00/0xad6b7ddc147aa8a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.518061:0:13378:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880091a96e00/0xad6b7ddc147aa8a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.518067:0:13378:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091a96e00/0xad6b7ddc147aa8a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13378 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.518135:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:02506576-29fe-43be-8266-ebca0ccafd52+19:2004:x1830881265569664:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 16146us (16590us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065224.518143:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6446 00010000:00010000:1.0:1746065224.521887:0:29490:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc147aa91 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.521901:0:29490:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc147aa91 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.521909:0:29490:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc147aa91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.521914:0:29490:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065224.521917:0:29490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc147aa91 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.521928:0:29490:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc147aa91 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.521942:0:29490:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc147aa91 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.521948:0:29490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb1200/0xad6b7ddc147aa91 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.522033:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:02506576-29fe-43be-8266-ebca0ccafd52+15:2005:x1830881265569920:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 19322us (20442us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065224.522042:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6447 00010000:00010000:1.0:1746065224.526635:0:29488:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aa98 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.526649:0:29488:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aa98 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.526656:0:29488:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aa98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.526662:0:29488:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065224.526666:0:29488:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aa98 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.526673:0:29488:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aa98 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.526692:0:29488:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aa98 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.526698:0:29488:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aa98 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29488 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.526799:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265570176:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 20044us (23135us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065224.526808:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6448 00000100:00100000:0.0:1746065224.533623:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.533719:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265570432 00000100:00100000:1.0:1746065224.533728:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265570432 00000100:00100000:1.0:1746065224.533793:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14682 00000100:00100000:1.0:1746065224.533800:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2679:x1830881265570432:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065224.533868:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.533888:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a200/0xad6b7ddc147aa36 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1bc expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.533926:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.533931:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065224.533968:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.533978:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.533984:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00010000:1.0:1746065224.534062:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099e11180 reply state ffff88011d891000 transno 8589937211 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.534069:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.534073:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.534075:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1746065224.534077:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1746065224.534361:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2679:x1830881265570432:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 561us (744us total) trans 8589937211 rc 0/0 00000100:00100000:1.0:1746065224.534367:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14682 00000100:00100000:0.0:1746065224.536047:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.536079:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.536888:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265570560 00000100:00100000:2.0:1746065224.536895:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265570560 00000100:00100000:0.0:1746065224.536906:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.536921:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265570816 00000100:00100000:0.0:1746065224.536922:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.536923:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265570816 00000100:00100000:2.0:1746065224.536935:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265571072 00000100:00100000:2.0:1746065224.536936:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265571072 00000100:00100000:0.0:1746065224.536941:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.537252:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265570688 00000100:00100000:1.0:1746065224.537252:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265570944 00000100:00100000:3.0:1746065224.537256:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265570688 00000100:00100000:1.0:1746065224.537256:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265570944 00000100:00100000:1.0:1746065224.537276:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17976 00000100:00100000:1.0:1746065224.537291:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265570560:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:1.0:1746065224.537396:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:1.0:1746065224.537399:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.537401:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065223 -> 1746065224 00002000:00010000:1.0:1746065224.537403:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065223 -> 1746065224 00002000:00010000:1.0:1746065224.537404:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065224.537436:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17977 00000100:00100000:1.0:1746065224.537438:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265570560:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 156us (1394us total) trans 17179874391 rc 0/0 00000100:00100000:0.0:1746065224.537442:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265570816:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:1.0:1746065224.537443:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17976 00000100:00100000:1.0:1746065224.537455:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17978 00000100:00100000:1.0:1746065224.537458:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265571072:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:1.0:1746065224.537491:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00002000:00010000:1.0:1746065224.537493:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:0.0:1746065224.537494:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065224.537495:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.537496:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:0.0:1746065224.537496:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065223 -> 1746065224 00002000:00010000:1.0:1746065224.537498:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00002000:00010000:0.0:1746065224.537498:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065222 -> 1746065224 00002000:00010000:0.0:1746065224.537499:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065223 -> 1746065224 00002000:00010000:0.0:1746065224.537501:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065224.537513:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265571072:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 54us (608us total) trans 17179874392 rc 0/0 00000100:00100000:0.0:1746065224.537513:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265570816:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 72us (1434us total) trans 21474841770 rc 0/0 00000100:00100000:1.0:1746065224.537518:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17978 00000100:00100000:0.0:1746065224.537721:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17977 00000100:00100000:2.0:1746065224.537728:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17979 00000100:00100000:0.0:1746065224.537731:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17980 00000100:00100000:2.0:1746065224.537734:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265570944:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:0.0:1746065224.537735:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265570688:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:0.0:1746065224.537785:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065224.537787:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065224.537787:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065223 -> 1746065224 00002000:00010000:2.0:1746065224.537789:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065222 -> 1746065224 00002000:00010000:0.0:1746065224.537789:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065223 -> 1746065224 00002000:00010000:2.0:1746065224.537790:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065222 -> 1746065224 00002000:00010000:0.0:1746065224.537791:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065223 -> 1746065224 00002000:00010000:2.0:1746065224.537792:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065223 -> 1746065224 00002000:00010000:0.0:1746065224.537793:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:2.0:1746065224.537794:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:0.0:1746065224.537809:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265570688:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 73us (886us total) trans 21474841771 rc 0/0 00000100:00100000:2.0:1746065224.537813:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265570944:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 80us (872us total) trans 17179874393 rc 0/0 00000100:00100000:0.0:1746065224.537813:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17980 00000100:00100000:2.0:1746065224.537817:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17979 00000100:00100000:0.0:1746065224.537854:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.537862:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265571200 00000100:00100000:2.0:1746065224.537864:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265571200 00000100:00100000:2.0:1746065224.537877:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17981 00000100:00100000:2.0:1746065224.537881:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265571200:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065224.537918:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065224.537920:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.537922:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.537924:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.537925:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746065224.537940:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+20:2005:x1830881265571200:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 58us (86us total) trans 21474841772 rc 0/0 00000100:00100000:2.0:1746065224.537945:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17981 00000100:00100000:0.0:1746065224.540105:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.540160:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265571456 00000100:00100000:1.0:1746065224.540165:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265571456 00000100:00100000:1.0:1746065224.540211:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5531 00000100:00100000:1.0:1746065224.540217:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2679:x1830881265571456:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:1.0:1746065224.540257:0:7206:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x31:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc147a9e9 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ae expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.540302:0:7206:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065224.540420:0:7206:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147aa28 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1b5 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.540426:0:7206:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065224.540451:0:7206:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147aa28 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1b5 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.540460:0:7206:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147aa28 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1b5 expref: 10 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.540472:0:7206:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7206:1830881264059648:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065224.540766:0:7206:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f480 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.543232:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.543260:0:7206:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:7206:1830881264059648:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065224.543277:0:7206:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT0 00000100:00100000:2.0:1746065224.543325:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265571584 00000100:00100000:2.0:1746065224.543330:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265571584 00010000:00010000:2.0:1746065224.543357:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147aa28 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1b5 expref: 11 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.543379:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8421 00000100:00100000:2.0:1746065224.543385:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265571584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.543395:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.543399:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147aa28 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1b5 expref: 11 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.543408:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147aa28 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1b5 expref: 11 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.543423:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1600/0xad6b7ddc147aa28 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1b5 expref: 11 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.543450:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065224.543454:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT0 00010000:00010000:2.0:1746065224.543461:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT0 00010000:00010000:2.0:1746065224.543467:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7206 initiator: MDT0 00010000:00010000:2.0:1746065224.543480:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.543507:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265571584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 122us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.543513:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8421 00010000:00010000:1.0:1746065224.543583:0:7206:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065224.543589:0:7206:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT0 00000040:00080000:1.0:1746065224.544223:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1129, 88 off107200 00000004:00080000:1.0:1746065224.544229:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820562455079ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065224.544256:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1137, 88 off107904 00000004:00080000:1.0:1746065224.544259:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820562485912ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065224.544290:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1138, 88 off107992 00000004:00080000:1.0:1746065224.544294:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820562520797ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065224.544303:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1130, 88 off107288 00000004:00080000:1.0:1746065224.544306:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820562532199ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065224.544312:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1131, 88 off107376 00000004:00080000:1.0:1746065224.544314:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820562540671ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065224.544321:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1139, 88 off108080 00000004:00080000:1.0:1746065224.544324:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820562550074ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065224.544330:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1140, 88 off108168 00000004:00080000:1.0:1746065224.544332:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820562558744ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065224.544339:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1141, 88 off108256 00000004:00080000:1.0:1746065224.544341:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820562567674ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065224.544348:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1132, 88 off107464 00000004:00080000:1.0:1746065224.544350:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820562576424ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065224.544357:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1142, 88 off108344 00000004:00080000:1.0:1746065224.544360:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820562586204ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065224.544367:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1133, 88 off107552 00000004:00080000:1.0:1746065224.544370:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820562596282ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065224.544377:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1143, 88 off108432 00000004:00080000:1.0:1746065224.544379:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820562605694ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065224.544386:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1134, 88 off107640 00000004:00080000:1.0:1746065224.544388:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820562614719ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065224.544395:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1135, 88 off107728 00000004:00080000:1.0:1746065224.544397:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820562623479ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065224.544404:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1136, 88 off107816 00000004:00080000:1.0:1746065224.544406:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820562633019ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065224.544413:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1137, 88 off107904 00000004:00080000:1.0:1746065224.544415:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820562641634ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065224.544422:0:7206:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1144, 88 off108520 00000004:00080000:1.0:1746065224.544425:0:7206:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820562651239ns, next at 761143559853ns, rc = 0 00000001:00080000:2.0:1746065224.548296:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937212 is committed 00000004:00080000:2.0:1746065224.548307:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1122 committed 00000004:00080000:2.0:1746065224.548315:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1117 committed 00000004:00080000:2.0:1746065224.548320:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1116 committed 00000004:00080000:2.0:1746065224.548321:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1115 committed 00000004:00080000:2.0:1746065224.548322:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1114 committed 00000004:00080000:2.0:1746065224.548324:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1121 committed 00000004:00080000:2.0:1746065224.548325:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1113 committed 00000004:00080000:2.0:1746065224.548326:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1120 committed 00010000:00010000:3.0:1746065224.548327:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00000004:00080000:2.0:1746065224.548328:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1112 committed 00000004:00080000:2.0:1746065224.548329:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1119 committed 00000004:00080000:2.0:1746065224.548331:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1118 committed 00000004:00080000:2.0:1746065224.548332:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1117 committed 00000004:00080000:2.0:1746065224.548334:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1111 committed 00000004:00080000:2.0:1746065224.548335:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1110 committed 00000004:00080000:2.0:1746065224.548336:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1116 committed 00010000:00010000:3.0:1746065224.548337:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00000004:00080000:2.0:1746065224.548338:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1115 committed 00000004:00080000:2.0:1746065224.548340:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1109 committed 00010000:00010000:3.0:1746065224.548343:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.548347:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb0a00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.548351:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.548357:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.548371:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.548373:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.548377:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.548381:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb0a00/0xad6b7ddc147aa9f lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065224.548439:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065224.548452:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264059776:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.548477:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264060288:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.548498:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.548521:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264060800:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.548534:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.548548:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264061312:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.548552:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.548561:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065224.548567:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264060160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.548576:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264060032:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065224.548579:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065224.548588:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264060672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.548590:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065224.548599:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.548600:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264060544:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065224.548607:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264061184:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.548611:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065224.548618:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.548619:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264061056:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.548627:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264061696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.548631:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.548640:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264061568:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.548652:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.548680:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264059904:0@lo:2:osp-syn-1-0.0 00000004:00010000:1.0:1746065224.548871:0:7206:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880099cf1c00 reply state ffff88008f1ad800 transno 8589937212 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065224.548883:0:7206:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065224.548888:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.548890:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065224.548893:0:7206:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1746065224.548897:0:7206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.548899:0:7206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065224.548904:0:7206:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d47000/0xad6b7ddc147a9e9 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ae expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00080000:1.0:1746065224.548967:0:7206:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065224.548976:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+7:2679:x1830881265571456:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 8759us (8876us total) trans 8589937212 rc 0/0 00000100:00100000:1.0:1746065224.549102:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5531 00010000:00010000:1.0:1746065224.549124:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065224.549129:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065224.549133:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065224.549137:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009abb1400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065224.549139:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065224.549144:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065224.549151:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.549153:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065224.549155:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT0 00010000:00010000:1.0:1746065224.549159:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb1400/0xad6b7ddc147aaa6 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7206 initiator: MDT0 00000100:00100000:0.0:1746065224.549269:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264060288 00000100:00100000:0.0:1746065224.549276:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264060288 00000100:00100000:2.0:1746065224.549457:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264060800 00000100:00100000:2.0:1746065224.549462:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264060800 00000100:00100000:2.0:1746065224.549476:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264059776 00000100:00100000:2.0:1746065224.549479:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264059776 00000100:00100000:2.0:1746065224.549485:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264061312 00000100:00100000:2.0:1746065224.549487:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264061312 00000100:00100000:2.0:1746065224.549492:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264060160 00000100:00100000:2.0:1746065224.549493:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264060160 00000100:00100000:2.0:1746065224.549498:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264060032 00000100:00100000:2.0:1746065224.549500:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264060032 00000100:00100000:2.0:1746065224.549505:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264060672 00000100:00100000:2.0:1746065224.549506:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264060672 00000100:00100000:2.0:1746065224.549511:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264060544 00000100:00100000:2.0:1746065224.549513:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264060544 00000100:00100000:2.0:1746065224.549517:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264061184 00000100:00100000:2.0:1746065224.549518:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264061184 00000100:00100000:2.0:1746065224.549524:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264061056 00000100:00100000:2.0:1746065224.549525:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264061056 00000100:00100000:2.0:1746065224.549531:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264061568 00000100:00100000:2.0:1746065224.549533:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264061568 00000100:00100000:2.0:1746065224.549540:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17982 00000100:00100000:2.0:1746065224.549546:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3760:x1830881264060288:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065224.549645:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065224.549648:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.549650:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.549651:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.549653:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065224.549680:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3760:x1830881264060288:12345-0@lo:2:osp-syn-1-0.0 Request processed in 134us (1182us total) trans 17179874394 rc 0/0 00000100:00100000:2.0:1746065224.549686:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17982 00000100:00100000:2.0:1746065224.549698:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17983 00000100:00100000:2.0:1746065224.549703:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3760:x1830881264060800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065224.549754:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065224.549757:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.549758:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.549760:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.549761:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746065224.549797:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3760:x1830881264060800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 93us (1261us total) trans 21474841773 rc 0/0 00000100:00100000:2.0:1746065224.549802:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17983 00000100:00100000:2.0:1746065224.549812:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17984 00000100:00100000:2.0:1746065224.549816:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3759:x1830881264059776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065224.549856:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065224.549858:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.549859:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.549861:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.549862:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746065224.549880:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3759:x1830881264059776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 63us (1326us total) trans 17179874395 rc 0/0 00000100:00100000:2.0:1746065224.549885:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17984 00000100:00100000:2.0:1746065224.549895:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17985 00000100:00100000:2.0:1746065224.549899:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+49:3760:x1830881264061312:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065224.549936:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065224.549938:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065224.549940:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.549942:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065224.549943:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:2.0:1746065224.549960:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3760:x1830881264061312:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (1397us total) trans 21474841774 rc 0/0 00000100:00100000:2.0:1746065224.549966:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17985 00000100:00100000:2.0:1746065224.549974:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17986 00000100:00100000:2.0:1746065224.549978:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3759:x1830881264060160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.550026:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3759:x1830881264060160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (1445us total) trans 17179874396 rc 0/0 00000100:00100000:2.0:1746065224.550030:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17986 00000100:00100000:2.0:1746065224.550039:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17987 00000100:00100000:2.0:1746065224.550043:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3762:x1830881264060032:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065224.550077:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00002000:00010000:2.0:1746065224.550079:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.550081:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.550082:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.550084:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00000100:00100000:2.0:1746065224.550105:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+47:3762:x1830881264060032:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (1513us total) trans 17179874397 rc 0/0 00000100:00100000:2.0:1746065224.550109:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17987 00000100:00100000:2.0:1746065224.550118:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17988 00000100:00100000:2.0:1746065224.550122:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+46:3759:x1830881264060672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065224.550156:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:2.0:1746065224.550158:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065224.550159:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.550161:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065224.550162:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:1.0:1746065224.550291:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17989 00000100:00100000:1.0:1746065224.550298:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+47:3762:x1830881264060544:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065224.550340:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065224.550342:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065224.550344:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065224.550345:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065224.550347:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:1.0:1746065224.550365:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+48:3762:x1830881264060544:12345-0@lo:2:osp-syn-1-0.0 Request processed in 69us (1753us total) trans 17179874399 rc 0/0 00000100:00100000:1.0:1746065224.550370:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17989 00000100:00100000:1.0:1746065224.550379:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17990 00000100:00100000:1.0:1746065224.550382:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3759:x1830881264061184:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065224.550420:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065224.550422:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065224.550424:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065224.550425:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065224.550426:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:1.0:1746065224.550444:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3759:x1830881264061184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 61us (1825us total) trans 21474841775 rc 0/0 00000100:00100000:1.0:1746065224.550449:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17990 00000100:00100000:1.0:1746065224.550458:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17991 00000100:00100000:1.0:1746065224.550462:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3762:x1830881264061056:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065224.550495:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065224.550498:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.550499:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.550501:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.550503:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:1.0:1746065224.550519:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881264061056:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (1887us total) trans 21474841776 rc 0/0 00000100:00100000:1.0:1746065224.550524:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17991 00000100:00100000:1.0:1746065224.550533:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17992 00000100:00100000:1.0:1746065224.550537:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+49:3762:x1830881264061568:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065224.550583:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+50:3762:x1830881264061568:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (1930us total) trans 21474841777 rc 0/0 00000100:00100000:1.0:1746065224.550588:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17992 00000100:00100000:0.0:1746065224.551038:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065224.551051:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad7800/2, rc 0, transno 21474841774 00000100:00100000:3.0:1746065224.551057:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264061312:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065224.551064:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cf2300/2, rc 0, transno 21474841773 00000004:00080000:0.0:1746065224.551065:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac67100/2, rc 0, transno 17179874395 00000100:00100000:3.0:1746065224.551066:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264060800:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.551071:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264059776:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065224.551072:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac64e00/2, rc 0, transno 17179874394 00000100:00100000:3.0:1746065224.551075:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264060288:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065224.551080:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac66a00/2, rc 0, transno 17179874396 00000100:00100000:0.0:1746065224.551083:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264060160:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065224.551088:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad4700/2, rc 0, transno 21474841775 00000100:00100000:0.0:1746065224.551090:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264061184:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.551101:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264061696 00000100:00100000:0.0:1746065224.551104:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264061696 00000100:00100000:3.0:1746065224.551109:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264061824:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065224.551120:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17993 00000100:00100000:0.0:1746065224.551123:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+50:3759:x1830881264061696:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.551127:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065224.551148:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac65c00/2, rc 0, transno 17179874397 00000100:00100000:3.0:1746065224.551150:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264060032:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065224.551156:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac67480/2, rc 0, transno 17179874399 00000100:00100000:3.0:1746065224.551159:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264060544:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065224.551164:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad6300/2, rc 0, transno 21474841776 00000100:00100000:3.0:1746065224.551167:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264061056:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065224.551172:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135221f80/2, rc 0, transno 21474841777 00000100:00100000:3.0:1746065224.551175:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135221f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264061568:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.551178:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+51:3759:x1830881264061696:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (141us total) trans 21474841778 rc 0/0 00000100:00100000:0.0:1746065224.551183:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17993 00000100:00100000:3.0:1746065224.551187:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264061824 00000100:00100000:3.0:1746065224.551189:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264061824 00000004:00080000:0.0:1746065224.551198:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135220000/2, rc 0, transno 21474841778 00000100:00100000:0.0:1746065224.551201:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264061696:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.551203:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17994 00000100:00100000:3.0:1746065224.551207:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+48:3760:x1830881264061824:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.551257:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+49:3760:x1830881264061824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (128us total) trans 17179874400 rc 0/0 00000100:00100000:3.0:1746065224.551262:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17994 00000004:00080000:3.0:1746065224.551277:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3d180/2, rc 0, transno 17179874400 00000100:00100000:3.0:1746065224.551291:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264061824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.551320:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.551334:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264060416:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.551350:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.551359:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264060928:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.551374:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.551384:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880135220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264061440:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.551395:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.551409:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264059904 00000100:00100000:3.0:1746065224.551412:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264059904 00000100:00100000:3.0:1746065224.551429:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264060416 00000100:00100000:3.0:1746065224.551431:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264060416 00000100:00100000:3.0:1746065224.551438:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264060928 00000100:00100000:3.0:1746065224.551440:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264060928 00000100:00100000:3.0:1746065224.551446:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264061440 00000100:00100000:3.0:1746065224.551447:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264061440 00000100:00100000:3.0:1746065224.551454:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17995 00000100:00100000:3.0:1746065224.551457:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3761:x1830881264059904:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065224.551493:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065224.551496:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:3.0:1746065224.551497:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:3.0:1746065224.551499:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:3.0:1746065224.551500:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065224.551520:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3761:x1830881264059904:12345-0@lo:2:osp-syn-1-0.0 Request processed in 62us (199us total) trans 17179874401 rc 0/0 00000100:00100000:3.0:1746065224.551525:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17995 00000100:00100000:3.0:1746065224.551534:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17996 00000100:00100000:3.0:1746065224.551537:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+50:3761:x1830881264060416:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.551581:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+51:3761:x1830881264060416:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (230us total) trans 17179874402 rc 0/0 00000100:00100000:3.0:1746065224.551585:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17996 00000100:00100000:3.0:1746065224.551593:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17997 00000100:00100000:3.0:1746065224.551597:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3761:x1830881264060928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065224.551628:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065224.551630:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:3.0:1746065224.551632:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:3.0:1746065224.551633:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:3.0:1746065224.551635:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065224.551651:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3761:x1830881264060928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (276us total) trans 21474841779 rc 0/0 00000100:00100000:3.0:1746065224.551655:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17997 00000100:00100000:3.0:1746065224.551663:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17998 00000100:00100000:3.0:1746065224.551667:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+52:3761:x1830881264061440:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065224.551701:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:3.0:1746065224.551703:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:3.0:1746065224.551705:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.551706:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:3.0:1746065224.551708:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:3.0:1746065224.551724:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3761:x1830881264061440:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (328us total) trans 21474841780 rc 0/0 00000100:00100000:3.0:1746065224.551729:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17998 00000004:00080000:3.0:1746065224.551748:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac64a80/2, rc 0, transno 17179874401 00000100:00100000:3.0:1746065224.551751:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264059904:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065224.551757:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac66d80/2, rc 0, transno 17179874402 00000100:00100000:3.0:1746065224.551759:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264060416:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065224.551764:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099cf0700/2, rc 0, transno 21474841779 00000100:00100000:3.0:1746065224.551767:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264060928:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065224.551791:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880135220700/2, rc 0, transno 21474841780 00000100:00100000:3.0:1746065224.551793:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880135220700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264061440:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.552615:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.552680:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+50:3759:x1830881264060672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2557us (4079us total) trans 17179874398 rc 0/0 00000100:00100000:2.0:1746065224.552686:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17988 00000004:00080000:1.0:1746065224.552734:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac66300/2, rc 0, transno 17179874398 00000100:00100000:1.0:1746065224.552738:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264060672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065224.554006:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265571712 00000100:00100000:1.0:1746065224.554012:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265571712 00000100:00100000:1.0:1746065224.554037:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14683 00000100:00100000:1.0:1746065224.554042:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+6:2679:x1830881265571712:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065224.554057:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065224.554069:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc147aaad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1ed expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.554106:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc147aaad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ed expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.554117:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc147aaad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ed expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.554129:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.554131:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065224.554134:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b60400, rc 0) 00000100:00100000:1.0:1746065224.554170:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+7:2679:x1830881265571712:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 128us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.554175:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14683 00000100:00100000:0.0:1746065224.559263:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.559544:0:7206:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265571968 00000100:00100000:1.0:1746065224.559552:0:7206:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265571968 00000100:00100000:1.0:1746065224.559598:0:7206:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5532 00000100:00100000:1.0:1746065224.559605:0:7206:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+7:2679:x1830881265571968:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065224.559770:0:7206:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2679:x1830881265571968:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 165us (514us total) trans 8589937213 rc 0/0 00000100:00100000:1.0:1746065224.559796:0:7206:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5532 00000100:00100000:0.0:1746065224.585573:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.585638:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265572224 00000100:00100000:3.0:1746065224.585646:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265572224 00000100:00100000:3.0:1746065224.585701:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14684 00000100:00100000:3.0:1746065224.585708:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2689:x1830881265572224:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065224.585731:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.585746:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46400/0xad6b7ddc147aab4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1f4 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.585844:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147aabb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.585858:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147aabb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.585866:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147aabb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.585875:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc147aac2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.585880:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc147aac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.585885:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc147aac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.585963:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc147aac9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.585971:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc147aac9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.585977:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc147aac9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065224.585985:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:3.0:1746065224.586039:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147aabb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586044:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147aabb lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586049:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147aabb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586054:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147aabb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586059:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.586062:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147aabb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586067:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147aabb lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586077:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065224.586079:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.586082:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147aabb lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586086:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46600/0xad6b7ddc147aabb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586104:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc147aac2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586108:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc147aac2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586111:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc147aac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586115:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f47400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.586117:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc147aac2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586121:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc147aac2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586126:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5800) 00010000:00010000:3.0:1746065224.586128:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.586130:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc147aac2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586134:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47400/0xad6b7ddc147aac2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.586164:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46400/0xad6b7ddc147aab4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1f4 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.586174:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc147aac9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1f4 expref: 9 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.586179:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.586181:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065224.586182:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46a00, rc 0) 00000100:00100000:3.0:1746065224.586220:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2689:x1830881265572224:12345-192.168.202.27@tcp:101:cat.0 Request processed in 513us (652us total) trans 8589937214 rc 0/0 00000100:00100000:3.0:1746065224.586226:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14684 00000100:00100000:2.0:1746065224.590951:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.591125:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.591198:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265572608 00000100:00100000:2.0:1746065224.591205:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265572608 00000100:00100000:2.0:1746065224.591256:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 17999 00000100:00100000:2.0:1746065224.591264:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2689:x1830881265572608:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.591278:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.591303:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc147aad7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a202 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.591326:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.591328:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.591335:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc147aad7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a202 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.591347:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc147aad7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a202 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.591356:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d857200, rc 0) 00000100:00100000:2.0:1746065224.591395:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2689:x1830881265572608:12345-192.168.202.27@tcp:101:cat.0 Request processed in 132us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.591400:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 17999 00000100:00100000:3.0:1746065224.591477:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265572480 00000100:00100000:3.0:1746065224.591481:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265572480 00000100:00100000:3.0:1746065224.591514:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14685 00000100:00100000:3.0:1746065224.591519:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2690:x1830881265572480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065224.591532:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.591542:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147aade lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a1fb expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.591590:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc147aae5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591600:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc147aae5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591607:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc147aae5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591616:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147aaec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591621:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147aaec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591625:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147aaec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591701:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147aaf3 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591708:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147aaf3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591714:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147aaf3 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065224.591721:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:3.0:1746065224.591795:0:7231:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc147aae5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591801:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc147aae5 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591806:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc147aae5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591810:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc147aae5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591814:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f47000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.591818:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc147aae5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591823:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc147aae5 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591832:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065224.591835:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.591837:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc147aae5 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591842:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47000/0xad6b7ddc147aae5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591853:0:7231:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147aaec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591857:0:7231:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147aaec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591861:0:7231:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147aaec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591864:0:7231:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.591866:0:7231:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147aaec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591870:0:7231:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147aaec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591875:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880090dc5000) 00010000:00010000:3.0:1746065224.591878:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.591880:0:7231:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147aaec lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591887:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46000/0xad6b7ddc147aaec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.591916:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147aade lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1fb expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.591925:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147aaf3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1fb expref: 28 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.591930:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.591932:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065224.591934:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008dbf6200, rc 0) 00000100:00100000:3.0:1746065224.591966:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2690:x1830881265572480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 447us (1022us total) trans 8589937215 rc 0/0 00000100:00100000:3.0:1746065224.591972:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14685 00000100:00100000:0.0:1746065224.593906:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.593974:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265572736 00000100:00100000:1.0:1746065224.593979:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265572736 00000100:00100000:1.0:1746065224.594012:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18000 00000100:00100000:1.0:1746065224.594017:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2690:x1830881265572736:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065224.594029:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065224.594041:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc147ab01 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a209 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.594055:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.594057:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.594063:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc147ab01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a209 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.594072:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc147ab01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a209 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.594078:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d47000, rc 0) 00000100:00100000:1.0:1746065224.594102:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2690:x1830881265572736:12345-192.168.202.27@tcp:101:cat.0 Request processed in 85us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.594107:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18000 00000100:00100000:0.0:1746065224.594627:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.594711:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265572992 00000100:00100000:3.0:1746065224.594715:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265572992 00000100:00100000:3.0:1746065224.594749:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14686 00000100:00100000:3.0:1746065224.594755:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2688:x1830881265572992:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065224.594767:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.594803:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ab08 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a210 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.594968:0:7231:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.594981:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc147aac9 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1f4 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.594991:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147aaf3 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1fb expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.594997:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 5/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.595021:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147aaf3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1fb expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.595031:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147aaf3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1fb expref: 29 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.595043:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264061952:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.595729:0:7231:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc147aac9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1f4 expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.595738:0:7231:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc147aac9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1f4 expref: 8 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.595745:0:7231:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264062080:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.595766:0:7231:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.598088:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.598115:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.598191:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.598203:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264061952:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065224.598211:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265573632 00000100:00100000:2.0:1746065224.598212:0:7231:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7231:1830881264062080:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065224.598216:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265573632 00010000:00010000:2.0:1746065224.598233:0:7231:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:0.0:1746065224.598239:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147aaf3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1fb expref: 30 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.598428:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265573504 00000100:00100000:1.0:1746065224.598434:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265573504 00002000:00100000:1.0:1746065224.598468:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009aec9180 x1830881265573504/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065224.598478:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9180 with x1830881265573504 ext(0->1048575) 00002000:00010000:1.0:1746065224.598484:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec9180 00000100:00100000:1.0:1746065224.598496:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6449 00000100:00100000:1.0:1746065224.598504:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265573504:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065224.599124:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265573248 00000100:00100000:1.0:1746065224.599128:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265573248 00000100:00100000:1.0:1746065224.599150:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14687 00000100:00100000:1.0:1746065224.599155:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2687:x1830881265573248:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065224.599168:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065224.599181:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147ab16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a217 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.599249:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.599259:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.599266:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065224.599757:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8422 00000100:00100000:0.0:1746065224.601301:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265573632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065224.601316:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065224.601324:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147aaf3 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1fb expref: 30 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.601339:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147aaf3 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1fb expref: 30 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.601345:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:0.0:1746065224.601357:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008dbf6200/0xad6b7ddc147aaf3 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1fb expref: 30 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.601528:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065224.601532:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065224.601536:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265573760 00010000:00010000:0.0:1746065224.601539:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000100:00100000:3.0:1746065224.601542:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265573760 00010000:00010000:0.0:1746065224.601543:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065224.601560:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc147aac9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1f4 expref: 11 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.601579:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8423 00000100:00100000:0.0:1746065224.601582:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265573632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 302us (3390us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.601584:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265573760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065224.601588:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8422 00010000:00010000:3.0:1746065224.601589:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.601593:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc147aac9 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1f4 expref: 11 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.601599:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc147aac9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1f4 expref: 11 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.601609:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46a00/0xad6b7ddc147aac9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1f4 expref: 11 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.601617:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.601620:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.601626:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.601631:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.601637:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.601641:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.601645:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.601665:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.601683:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265573760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 98us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.601690:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8423 00010000:00010000:3.0:1746065224.601705:0:7231:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00010000:00010000:3.0:1746065224.601710:0:7231:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7231 initiator: MDT0 00000004:00200000:3.0:1746065224.601723:0:7231:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:3.0:1746065224.601840:0:7231:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ab08 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a210 expref: 30 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.601851:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a210 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.601856:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.601859:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065224.601860:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8a00, rc 0) 00000100:00100000:3.0:1746065224.601878:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aecbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2688:x1830881265572992:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7124us (7252us total) trans 8589937216 rc 0/0 00000100:00100000:3.0:1746065224.601884:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14686 00010000:00010000:0.0:1746065224.602022:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065224.602029:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065224.602040:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:0.0:1746065224.602085:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852a200/0xad6b7ddc147ab16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a217 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.602095:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a217 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.602099:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065224.602102:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065224.602103:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a852b000, rc 0) 00000100:00100000:0.0:1746065224.602119:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2687:x1830881265573248:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 2964us (4038us total) trans 8589937217 rc 0/0 00000100:00100000:0.0:1746065224.602124:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14687 00000100:00100000:0.0:1746065224.605612:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.607884:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265574016 00000100:00100000:2.0:1746065224.607894:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265574016 00002000:00100000:2.0:1746065224.607935:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88008f7fd180 x1830881265574016/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.607945:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd180 with x1830881265574016 ext(0->1048575) 00002000:00010000:2.0:1746065224.607949:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd180 00000100:00100000:2.0:1746065224.607967:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6450 00000100:00100000:2.0:1746065224.607974:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265574016:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065224.611535:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265573504:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13022us (13411us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065224.611545:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6449 00002000:00100000:0.0:1746065224.611554:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88009aec9180 x1830881265573504/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.611562:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec9180 with x1830881265573504 ext(0->1048575) 00002000:00010000:0.0:1746065224.611567:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009aec9180 00000100:00100000:2.0:1746065224.616145:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265574016:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8162us (10530us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065224.616157:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6450 00002000:00100000:2.0:1746065224.616167:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88008f7fd180 x1830881265574016/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.616176:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fd180 with x1830881265574016 ext(0->1048575) 00002000:00010000:2.0:1746065224.616181:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fd180 00000100:00100000:0.0:1746065224.622222:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.622310:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265574144 00000100:00100000:2.0:1746065224.622317:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265574144 00000100:00100000:2.0:1746065224.623227:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18001 00000100:00100000:2.0:1746065224.623235:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2689:x1830881265574144:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.623250:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.623264:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ab32 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a21e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.623297:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.623299:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.623306:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ab32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a21e expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.623318:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ab32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a21e expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.623326:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b200, rc 0) 00000100:00100000:2.0:1746065224.623484:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2689:x1830881265574144:12345-192.168.202.27@tcp:101:cat.0 Request processed in 250us (1267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.623490:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18001 00000100:00100000:0.0:1746065224.627328:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.627380:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.627468:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265574400 00000100:00100000:1.0:1746065224.627476:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265574400 00000100:00100000:1.0:1746065224.627528:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14688 00000100:00100000:1.0:1746065224.627535:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2689:x1830881265574400:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065224.627555:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065224.627573:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0xad6b7ddc147ab39 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a22c expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.627619:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0xad6b7ddc147ab39 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a22c expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.627630:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0xad6b7ddc147ab39 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a22c expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.627643:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.627645:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065224.627648:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c7ad400, rc 0) 00000100:00100000:1.0:1746065224.627682:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2689:x1830881265574400:12345-192.168.202.27@tcp:101:cat.0 Request processed in 147us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.627688:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14688 00000100:00100000:2.0:1746065224.627757:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265574272 00000100:00100000:2.0:1746065224.627760:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265574272 00000100:00100000:2.0:1746065224.628233:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18002 00000100:00100000:2.0:1746065224.628240:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2690:x1830881265574272:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.628248:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.628258:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ab40 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a225 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.628274:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.628275:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.628291:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ab40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a225 expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.628301:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ab40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a225 expref: 29 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.628314:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ac00, rc 0) 00000100:00100000:2.0:1746065224.628463:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2690:x1830881265574272:12345-192.168.202.27@tcp:101:cat.0 Request processed in 223us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.628469:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18002 00000100:00100000:0.0:1746065224.631689:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.631762:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265574656 00000100:00100000:2.0:1746065224.631769:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265574656 00002000:00100000:2.0:1746065224.631828:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099bd4e00 x1830881265574656/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.631838:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4e00 with x1830881265574656 ext(1048576->2097151) 00002000:00010000:2.0:1746065224.631842:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4e00 00000100:00100000:2.0:1746065224.631857:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6451 00000100:00100000:2.0:1746065224.631862:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265574656:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065224.641370:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.641452:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265574784 00000100:00100000:2.0:1746065224.641460:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265574784 00000100:00100000:2.0:1746065224.641515:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14689 00000100:00100000:2.0:1746065224.641522:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2690:x1830881265574784:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.641543:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.641559:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ab47 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a233 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.641606:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ab47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a233 expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.641616:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ab47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a233 expref: 30 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.641631:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065224.641633:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065224.641636:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a000, rc 0) 00000100:00100000:2.0:1746065224.641686:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2690:x1830881265574784:12345-192.168.202.27@tcp:101:cat.0 Request processed in 164us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.641691:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14689 00000100:00100000:2.0:1746065224.648355:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265574656:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16483us (16663us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065224.648365:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6451 00002000:00100000:2.0:1746065224.648373:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099bd4e00 x1830881265574656/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.648382:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4e00 with x1830881265574656 ext(1048576->2097151) 00002000:00010000:2.0:1746065224.648386:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4e00 00000100:00100000:0.0:1746065224.652380:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.652469:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265575040 00000100:00100000:2.0:1746065224.652477:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265575040 00002000:00100000:2.0:1746065224.652514:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099bd4380 x1830881265575040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.652523:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4380 with x1830881265575040 ext(1048576->2097151) 00002000:00010000:2.0:1746065224.652527:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4380 00000100:00100000:2.0:1746065224.652544:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6452 00000100:00100000:2.0:1746065224.652549:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265575040:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065224.668964:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.669441:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265575168 00000100:00100000:2.0:1746065224.669449:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265575168 00000100:00100000:2.0:1746065224.669490:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18003 00000100:00100000:2.0:1746065224.669497:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2689:x1830881265575168:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.669511:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.669524:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147ab4e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a23a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.669543:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.669544:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.669550:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147ab4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a23a expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.669562:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147ab4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a23a expref: 17 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.669570:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a200, rc 0) 00000100:00100000:2.0:1746065224.669602:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2689:x1830881265575168:12345-192.168.202.27@tcp:101:cat.0 Request processed in 106us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.669607:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18003 00000100:00100000:3.0:1746065224.672147:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265575040:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19590us (19768us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065224.672157:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6452 00002000:00100000:3.0:1746065224.672166:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880099bd4380 x1830881265575040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.672174:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4380 with x1830881265575040 ext(1048576->2097151) 00002000:00010000:3.0:1746065224.672178:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4380 00000100:00100000:0.0:1746065224.672546:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.672603:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265575424 00000100:00100000:2.0:1746065224.672608:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265575424 00000100:00100000:2.0:1746065224.672644:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14690 00000100:00100000:2.0:1746065224.672650:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2687:x1830881265575424:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065224.672665:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.672668:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065224.672690:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c7ad400/0xad6b7ddc147ab39 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a22c expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.672712:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065224.672716:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065224.672724:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc147ab55 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a241 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.672755:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.672764:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc147aaad lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ed expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.672770:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ab47 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a233 expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.672791:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 5/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.672812:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ab47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a233 expref: 29 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.672820:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ab47 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a233 expref: 29 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.672829:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264062208:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.672892:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc147aaad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ed expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.672900:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc147aaad lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ed expref: 7 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.672907:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264062336:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.672928:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.676315:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.676360:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265575552 00000100:00100000:3.0:1746065224.676367:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265575552 00000100:00100000:3.0:1746065224.676414:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14691 00000100:00100000:3.0:1746065224.676421:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2689:x1830881265575552:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065224.676436:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.676452:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a248 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.676503:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.676510:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 4/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.676525:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 4/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.676535:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 13 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.676545:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.676548:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065224.676550:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.676556:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d800, rc 0) 00000100:00100000:3.0:1746065224.676608:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2689:x1830881265575552:12345-192.168.202.27@tcp:101:cat.0 Request processed in 187us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.676613:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14691 00000100:00100000:0.0:1746065224.677270:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.677339:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265575680 00000100:00100000:3.0:1746065224.677344:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265575680 00010000:00010000:3.0:1746065224.677362:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc147aaad lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ed expref: 8 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.677380:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8424 00000100:00100000:3.0:1746065224.677385:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2007:x1830881265575680:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.677392:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.677396:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc147aaad lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ed expref: 8 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.677405:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc147aaad lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ed expref: 8 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.677420:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.677423:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.677429:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.677434:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.677468:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2007:x1830881265575680:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.677474:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8424 00000100:00100000:2.0:1746065224.677570:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264062208:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.677580:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097b60400/0xad6b7ddc147aaad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ed expref: 7 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.677605:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264062336:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.677623:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00000100:00100000:0.0:1746065224.679767:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.679907:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.680016:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265575936 00000100:00100000:1.0:1746065224.680022:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265575936 00000100:00100000:2.0:1746065224.680028:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265575808 00000100:00100000:2.0:1746065224.680031:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265575808 00010000:00010000:2.0:1746065224.680050:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ab47 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a233 expref: 30 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.680055:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18004 00000100:00100000:1.0:1746065224.680061:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+29:2690:x1830881265575936:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065224.680065:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8425 00000100:00100000:2.0:1746065224.680069:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265575808:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.680072:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.680079:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.680083:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ab47 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a233 expref: 30 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.680084:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147ab6a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a24f expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.680092:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ab47 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a233 expref: 30 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.680103:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.680105:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.680106:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ab47 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a233 expref: 30 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.680110:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147ab6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a24f expref: 30 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.680116:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.680119:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147ab6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a24f expref: 30 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.680121:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.680127:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ab2d600, rc 0) 00010000:00010000:2.0:1746065224.680129:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.680134:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT flags: 0x40290400000020 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.680140:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.680152:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.680158:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2690:x1830881265575936:12345-192.168.202.27@tcp:101:cat.0 Request processed in 98us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.680164:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265575808:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.680164:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18004 00000100:00100000:2.0:1746065224.680168:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8425 00010000:00010000:2.0:1746065224.680182:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.680187:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7203 initiator: MDT0 00000040:00080000:2.0:1746065224.680419:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1138, 88 off107992 00000004:00080000:2.0:1746065224.680425:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820698651164ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065224.680450:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1145, 88 off108608 00000004:00080000:2.0:1746065224.680454:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820698680178ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065224.680467:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1146, 88 off108696 00000004:00080000:2.0:1746065224.680470:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820698696255ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065224.680478:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1139, 88 off108080 00000004:00080000:2.0:1746065224.680481:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820698707169ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065224.680488:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1140, 88 off108168 00000004:00080000:2.0:1746065224.680490:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820698716496ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.680811:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1147, 88 off108784 00000004:00080000:3.0:1746065224.680815:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820699041784ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.680827:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1148, 88 off108872 00000004:00080000:3.0:1746065224.680830:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820699056475ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.680838:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1149, 88 off108960 00000004:00080000:3.0:1746065224.680841:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820699067701ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.680852:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1141, 88 off108256 00000004:00080000:3.0:1746065224.680855:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820699081534ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.680861:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1150, 88 off109048 00000004:00080000:3.0:1746065224.680863:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820699090029ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.680871:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1142, 88 off108344 00000004:00080000:3.0:1746065224.680873:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820699099711ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.680880:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1151, 88 off109136 00000004:00080000:3.0:1746065224.680882:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820699108764ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.680890:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1143, 88 off108432 00000004:00080000:3.0:1746065224.680892:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820699118428ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.680899:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1144, 88 off108520 00000004:00080000:3.0:1746065224.680901:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820699127351ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.680906:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1145, 88 off108608 00000004:00080000:3.0:1746065224.680908:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820699135035ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.680914:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1146, 88 off108696 00000004:00080000:3.0:1746065224.680916:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820699142504ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.680922:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1152, 88 off109224 00000004:00080000:3.0:1746065224.680923:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820699149898ns, next at 761143559853ns, rc = 0 00000100:00100000:1.0:1746065224.683456:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000001:00080000:0.0:1746065224.684616:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937218 is committed 00000004:00080000:0.0:1746065224.684624:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1130 committed 00000100:00100000:2.0:1746065224.684692:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265576064 00000100:00100000:2.0:1746065224.684700:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265576064 00000100:00100000:2.0:1746065224.684743:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14692 00000100:00100000:2.0:1746065224.684749:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2690:x1830881265576064:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.684764:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.684798:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a256 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.684840:0:13395:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 30 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.684853:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 30 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.684863:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065224.684865:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065224.684868:0:13395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 12 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.684874:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009835d800, rc 0) 00000100:00100000:2.0:1746065224.684911:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2690:x1830881265576064:12345-192.168.202.27@tcp:101:cat.0 Request processed in 163us (1463us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.684916:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14692 00000004:00080000:0.0:1746065224.685633:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1126 committed 00000004:00080000:0.0:1746065224.685640:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1125 committed 00000004:00080000:0.0:1746065224.685642:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1124 committed 00000004:00080000:0.0:1746065224.685643:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1123 committed 00000004:00080000:0.0:1746065224.685644:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1129 committed 00000100:00100000:3.0:1746065224.685762:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264062464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.685811:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065224.685834:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264062720:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.685835:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264062848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.685849:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065224.685858:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264062464 00000100:00100000:1.0:1746065224.685861:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264062464 00000100:00100000:3.0:1746065224.685863:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264062592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.685876:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065224.685909:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1122 committed 00000004:00080000:0.0:1746065224.685912:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1128 committed 00000004:00080000:0.0:1746065224.685913:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1121 committed 00000004:00080000:0.0:1746065224.685914:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1127 committed 00000004:00080000:0.0:1746065224.685916:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1126 committed 00000004:00080000:0.0:1746065224.685917:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1125 committed 00000004:00080000:0.0:1746065224.685919:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1120 committed 00000004:00080000:0.0:1746065224.685921:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1119 committed 00000004:00080000:0.0:1746065224.685922:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1124 committed 00000004:00080000:0.0:1746065224.685923:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1123 committed 00000004:00080000:0.0:1746065224.685925:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1118 committed 00000001:00080000:0.0:1746065224.685931:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937216 is committed 00000001:00080000:0.0:1746065224.685937:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937213 is committed 00000100:00100000:2.0:1746065224.685991:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264063104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.686007:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065224.686137:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264062848 00000100:00100000:3.0:1746065224.686140:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264062592 00000100:00100000:1.0:1746065224.686140:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264062848 00000100:00100000:3.0:1746065224.686143:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264062592 00000100:00100000:3.0:1746065224.686151:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264062976:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065224.686157:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18005 00000100:00100000:1.0:1746065224.686161:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3761:x1830881264062464:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.686168:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264063360:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.686245:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18006 00000100:00100000:3.0:1746065224.686250:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:3760:x1830881264062848:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065224.686251:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065224.686253:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.686255:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.686257:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.686259:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746065224.686298:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3761:x1830881264062464:12345-0@lo:2:osp-syn-0-0.0 Request processed in 136us (486us total) trans 21474841781 rc 0/0 00000100:00100000:1.0:1746065224.686303:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18005 00000100:00100000:1.0:1746065224.686315:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18007 00000100:00100000:1.0:1746065224.686319:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+55:3762:x1830881264062592:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1746065224.686352:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a241 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065224.686355:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065224.686357:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.686359:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00010000:00010000:3.0:1746065224.686361:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00002000:00010000:1.0:1746065224.686361:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.686362:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00010000:00010000:3.0:1746065224.686363:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:3.0:1746065224.686366:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.686374:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.686378:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+56:3762:x1830881264062592:12345-0@lo:2:osp-syn-0-0.0 Request processed in 60us (502us total) trans 21474841782 rc 0/0 00010000:00010000:3.0:1746065224.686380:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.686383:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18007 00010000:00010000:3.0:1746065224.686386:0:7203:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 27 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.686392:0:7203:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 27 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.686397:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 27 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.686417:0:7203:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 27 pid: 13395 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.686424:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264064512:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065224.686475:0:7203:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 11 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.686483:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264064640:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065224.686497:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746065224.686528:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065224.686530:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065224.686531:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.686533:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065224.686534:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:3.0:1746065224.686555:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+56:3760:x1830881264062848:12345-0@lo:2:osp-syn-0-0.0 Request processed in 305us (705us total) trans 21474841783 rc 0/0 00000100:00100000:3.0:1746065224.686560:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18006 00000100:00100000:2.0:1746065224.687015:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264063616:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.687016:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.687030:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264063488:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.687033:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.687043:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.687044:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264064128:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.687052:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264064000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.687055:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.687063:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1746065224.687077:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a90380/2, rc 0, transno 21474841782 00000004:00080000:3.0:1746065224.687084:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a91180/2, rc 0, transno 21474841781 00000100:00100000:2.0:1746065224.687086:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264062592:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.687087:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264062464:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.687099:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264062976 00000100:00100000:2.0:1746065224.687099:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264063104 00000100:00100000:3.0:1746065224.687102:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264062976 00000100:00100000:2.0:1746065224.687102:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264063104 00000100:00100000:3.0:1746065224.687114:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264063616 00000100:00100000:3.0:1746065224.687115:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264063616 00000100:00100000:3.0:1746065224.687174:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264064128 00000100:00100000:2.0:1746065224.687174:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264063488 00000100:00100000:3.0:1746065224.687177:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264064128 00000100:00100000:2.0:1746065224.687177:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264063488 00000100:00100000:3.0:1746065224.687186:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264064000 00000100:00100000:3.0:1746065224.687188:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264064000 00000100:00100000:2.0:1746065224.687190:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18008 00000100:00100000:2.0:1746065224.687194:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+57:3761:x1830881264062976:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.687195:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18009 00000100:00100000:3.0:1746065224.687198:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+57:3762:x1830881264063104:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.687236:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18010 00002000:00010000:3.0:1746065224.687239:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00000100:00100000:2.0:1746065224.687240:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+53:3762:x1830881264063616:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065224.687241:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:3.0:1746065224.687243:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.687244:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:3.0:1746065224.687246:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:3.0:1746065224.687266:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+59:3762:x1830881264063104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 67us (1258us total) trans 21474841784 rc 0/0 00000100:00100000:3.0:1746065224.687271:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18009 00000100:00100000:3.0:1746065224.687294:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18011 00000100:00100000:3.0:1746065224.687298:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3762:x1830881264064128:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065224.687300:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065224.687301:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.687303:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.687304:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.687306:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065224.687324:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3762:x1830881264063616:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (290us total) trans 17179874403 rc 0/0 00000100:00100000:2.0:1746065224.687329:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18010 00000100:00100000:2.0:1746065224.687338:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18012 00000100:00100000:2.0:1746065224.687341:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3761:x1830881264063488:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.687348:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3762:x1830881264064128:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (292us total) trans 17179874404 rc 0/0 00000100:00100000:3.0:1746065224.687352:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18011 00000100:00100000:3.0:1746065224.687360:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18013 00000100:00100000:3.0:1746065224.687364:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+53:3761:x1830881264064000:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065224.687500:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:2.0:1746065224.689201:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065224.689205:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.689206:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.689208:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.689210:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:2.0:1746065224.689258:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+54:3761:x1830881264063488:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1914us (2211us total) trans 17179874405 rc 0/0 00000100:00100000:2.0:1746065224.689265:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18012 00000100:00100000:1.0:1746065224.689561:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264063232:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065224.689584:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.689935:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264062720 00000100:00100000:2.0:1746065224.689941:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264062720 00000100:00100000:2.0:1746065224.689958:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18014 00000100:00100000:2.0:1746065224.689963:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+59:3759:x1830881264062720:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065224.690043:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:2.0:1746065224.690045:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.690047:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.690048:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065224.690050:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:2.0:1746065224.690069:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+60:3759:x1830881264062720:12345-0@lo:2:osp-syn-0-0.0 Request processed in 106us (2569us total) trans 21474841786 rc 0/0 00000100:00100000:2.0:1746065224.690073:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18014 00002000:00010000:2.0:1746065224.690099:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065224.690101:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065224.690102:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.690104:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065224.690106:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:2.0:1746065224.690128:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3761:x1830881264062976:12345-0@lo:2:osp-syn-0-0.0 Request processed in 2934us (3113us total) trans 21474841785 rc 0/0 00000100:00100000:2.0:1746065224.690133:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18008 00000004:00080000:2.0:1746065224.690164:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d8700/2, rc 0, transno 17179874403 00000100:00100000:2.0:1746065224.690173:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264063616:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065224.690298:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800a4e50e00/2, rc 0, transno 17179874404 00000100:00100000:2.0:1746065224.690303:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264064128:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065224.690315:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a79c00/2, rc 0, transno 21474841784 00000100:00100000:2.0:1746065224.690318:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264063104:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.690365:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065224.690369:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264064768:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065224.690406:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d8a80/2, rc 0, transno 17179874405 00000100:00100000:2.0:1746065224.690409:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264063488:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065224.690415:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a78a80/2, rc 0, transno 21474841785 00000100:00100000:2.0:1746065224.690417:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a78a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264062976:0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065224.690465:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065224.690467:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.690469:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.690471:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.690473:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065224.690492:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+54:3761:x1830881264064000:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3128us (3428us total) trans 17179874406 rc 0/0 00000100:00100000:2.0:1746065224.690496:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18013 00000004:00080000:2.0:1746065224.690514:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984da680/2, rc 0, transno 17179874406 00000100:00100000:2.0:1746065224.690517:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264064000:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.690635:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.690662:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.690675:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265576192 00000100:00100000:2.0:1746065224.690678:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265576192 00000100:00100000:2.0:1746065224.690707:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265576320 00000100:00100000:2.0:1746065224.690710:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265576320 00000100:00100000:2.0:1746065224.690719:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5533 00000100:00100000:2.0:1746065224.690723:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4299850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2690:x1830881265576192:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:0.0:1746065224.691140:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.691369:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264063232 00000100:00100000:3.0:1746065224.691372:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264063232 00000100:00100000:3.0:1746065224.691386:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5534 00000100:00100000:3.0:1746065224.691392:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2689:x1830881265576320:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:1.0:1746065224.692400:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264063744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065224.692427:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065224.692443:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264063360 00000100:00100000:1.0:1746065224.692446:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264063360 00000100:00100000:1.0:1746065224.692462:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264063744 00000100:00100000:1.0:1746065224.692464:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264063744 00000100:00100000:1.0:1746065224.692474:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18015 00000100:00100000:1.0:1746065224.692478:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+60:3760:x1830881264063360:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065224.692562:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+61:3760:x1830881264063360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 84us (1423us total) trans 21474841787 rc 0/0 00000100:00100000:1.0:1746065224.692571:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18015 00000100:00100000:1.0:1746065224.692581:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18016 00000100:00100000:1.0:1746065224.692584:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+54:3759:x1830881264063744:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065224.692626:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00002000:00010000:1.0:1746065224.692629:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.692631:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.692633:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065224.692635:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00000100:00100000:1.0:1746065224.692648:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+55:3759:x1830881264063744:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (221us total) trans 17179874407 rc 0/0 00000100:00100000:1.0:1746065224.692653:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18016 00000004:00080000:1.0:1746065224.692678:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984d8380/2, rc 0, transno 17179874407 00000100:00100000:1.0:1746065224.692682:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264063744:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065224.692687:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264064256:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065224.692699:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1746065224.692713:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091a90000/2, rc 0, transno 21474841786 00000100:00100000:1.0:1746065224.692716:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264062720:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065224.692722:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065224.692726:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264063872:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065224.692736:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065224.692744:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f1a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264064384:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065224.692754:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065224.692761:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264064256 00000100:00100000:1.0:1746065224.692763:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264064256 00000100:00100000:1.0:1746065224.692786:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264063872 00000100:00100000:1.0:1746065224.692788:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264063872 00000100:00100000:1.0:1746065224.692797:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264064384 00000100:00100000:1.0:1746065224.692798:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264064384 00000100:00100000:1.0:1746065224.692806:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18017 00000100:00100000:1.0:1746065224.692809:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3759:x1830881264064256:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065224.692842:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065224.692844:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065224.692846:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065224.692848:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065224.692849:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:1.0:1746065224.692864:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3759:x1830881264064256:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (164us total) trans 17179874408 rc 0/0 00000100:00100000:1.0:1746065224.692868:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18017 00000100:00100000:1.0:1746065224.692875:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18018 00000100:00100000:1.0:1746065224.692879:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3759:x1830881264063872:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065224.692912:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3759:x1830881264063872:12345-0@lo:2:osp-syn-1-0.0 Request processed in 33us (175us total) trans 17179874409 rc 0/0 00000100:00100000:1.0:1746065224.692916:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18018 00000100:00100000:1.0:1746065224.692923:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18019 00000100:00100000:1.0:1746065224.692926:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+57:3759:x1830881264064384:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065224.692950:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:1.0:1746065224.692952:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065224.692954:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065224.692955:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065224.692957:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:1.0:1746065224.692969:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+58:3759:x1830881264064384:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (214us total) trans 17179874410 rc 0/0 00000100:00100000:1.0:1746065224.692974:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18019 00000004:00080000:1.0:1746065224.692994:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1a4380/2, rc 0, transno 17179874410 00000100:00100000:1.0:1746065224.692997:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264064384:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065224.693003:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f1a7800/2, rc 0, transno 17179874408 00000100:00100000:1.0:1746065224.693005:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f1a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264064256:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065224.693011:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800984dbb80/2, rc 0, transno 17179874409 00000100:00100000:1.0:1746065224.693013:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800984dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264063872:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.693075:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4299850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2690:x1830881265576192:12345-192.168.202.27@tcp:49:cat.0 Request processed in 2349us (2440us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.693082:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5533 00000100:00100000:2.0:1746065224.693122:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.693141:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264064768 00000100:00100000:2.0:1746065224.693143:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264064768 00000100:00100000:2.0:1746065224.693154:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18020 00000100:00100000:2.0:1746065224.693158:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+58:3762:x1830881264064768:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.693208:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+59:3762:x1830881264064768:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (86us total) trans 17179874411 rc 0/0 00000100:00100000:2.0:1746065224.693213:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18020 00000004:00080000:2.0:1746065224.693230:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f1180/2, rc 0, transno 17179874411 00000100:00100000:2.0:1746065224.693233:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264064768:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.693346:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264064512:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065224.693354:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264064640:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065224.693378:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc147ab55 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a241 expref: 12 pid: 7203 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065224.693395:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a241 expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.693420:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5be00, rc 0) 00000100:00100000:2.0:1746065224.693440:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2687:x1830881265575424:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 20791us (20894us total) trans 8589937218 rc 0/0 00000100:00100000:2.0:1746065224.693446:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14690 00000100:00100000:2.0:1746065224.693503:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18021 00000100:00100000:2.0:1746065224.693506:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+60:3759:x1830881264063232:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.693557:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+61:3759:x1830881264063232:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (3972us total) trans 21474841788 rc 0/0 00000100:00100000:2.0:1746065224.693561:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18021 00000004:00080000:0.0:1746065224.694311:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9500/2, rc 0, transno 21474841787 00000100:00100000:0.0:1746065224.694316:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264063360:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065224.694330:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880136a7a680/2, rc 0, transno 21474841783 00000100:00100000:0.0:1746065224.694332:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264062848:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.694389:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2689:x1830881265576320:12345-192.168.202.27@tcp:49:cat.0 Request processed in 2996us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.694395:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5534 00000004:00080000:1.0:1746065224.694574:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800957d9180/2, rc 0, transno 21474841788 00000100:00100000:1.0:1746065224.694578:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800957d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264063232:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065224.704419:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.705662:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265576832 00000100:00100000:3.0:1746065224.705674:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265576832 00002000:00100000:3.0:1746065224.705723:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099bd4000 x1830881265576832/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.705731:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4000 with x1830881265576832 ext(1048576->2097151) 00002000:00010000:3.0:1746065224.705737:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4000 00000100:00100000:3.0:1746065224.705804:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6453 00000100:00100000:3.0:1746065224.705814:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265576832:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065224.709304:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.709353:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.710223:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265576960 00000100:00100000:2.0:1746065224.710234:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265576960 00000100:00100000:2.0:1746065224.710297:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18022 00000100:00100000:2.0:1746065224.710304:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2687:x1830881265576960:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065224.710320:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.710335:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a25d expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.710360:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147aa52 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ca expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.710368:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ab40 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a225 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.710374:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ab32 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a21e expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.710380:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.710381:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.710384:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1228800->1855487] (req 1228800->1855487) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 18 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.710410:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ab32 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a21e expref: 18 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.710421:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ab32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a21e expref: 18 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.710431:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264064896:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.710514:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ab40 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a225 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.710521:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ab40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a225 expref: 31 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.710529:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264065024:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.710550:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147aa52 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ca expref: 19 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.710557:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147aa52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ca expref: 19 pid: 13375 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.710563:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264065152:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.710578:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099603f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065224.710675:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265576576 00000100:00100000:1.0:1746065224.710680:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265576576 00002000:00100000:1.0:1746065224.710702:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099bd4a80 x1830881265576576/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065224.710710:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4a80 with x1830881265576576 ext(1048576->2097151) 00002000:00010000:1.0:1746065224.710714:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4a80 00000100:00100000:1.0:1746065224.710739:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6454 00000100:00100000:1.0:1746065224.710745:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265576576:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065224.714706:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.714753:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.714815:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.715421:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265577088 00000100:00100000:2.0:1746065224.715429:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265577088 00010000:00010000:2.0:1746065224.715459:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ab32 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a21e expref: 21 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.715481:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265577216 00000100:00100000:2.0:1746065224.715483:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265577216 00010000:00010000:2.0:1746065224.715491:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ab40 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a225 expref: 32 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.715501:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265577344 00000100:00100000:2.0:1746065224.715503:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265577344 00010000:00010000:2.0:1746065224.715510:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147aa52 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ca expref: 20 pid: 13375 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.715521:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8426 00000100:00100000:2.0:1746065224.715527:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265577088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.715537:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.715553:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ab32 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a21e expref: 21 pid: 9550 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.715563:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ab32 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a21e expref: 21 pid: 9550 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.715582:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.715614:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265577088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (915us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.715619:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8426 00000100:00100000:2.0:1746065224.715630:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8427 00000100:00100000:2.0:1746065224.715634:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265577216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.715640:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.715646:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ab40 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a225 expref: 32 pid: 9550 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.715653:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ab40 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a225 expref: 32 pid: 9550 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.715662:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.715676:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265577216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.715680:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8427 00000100:00100000:2.0:1746065224.715712:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8428 00000100:00100000:2.0:1746065224.715717:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+20:2004:x1830881265577344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.715722:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.715727:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147aa52 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ca expref: 20 pid: 13375 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.715735:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147aa52 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ca expref: 20 pid: 13375 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.715745:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.715747:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.715753:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.715760:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.715813:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 20 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.715824:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264065280:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065224.716172:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00010000:00010000:2.0:1746065224.716200:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ab32 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a21e expref: 20 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.716219:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264064896:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.716229:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ab40 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a225 expref: 31 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.716236:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264065024:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.716245:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3de00/0xad6b7ddc147aa52 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1ca expref: 20 pid: 13375 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.716251:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264065152:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.716272:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 19 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.716292:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099c31a00, rc 0) 00000100:00100000:2.0:1746065224.716522:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2687:x1830881265576960:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6018us (7024us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.716532:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18022 00000100:00100000:1.0:1746065224.719229:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265576576:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8473us (9865us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065224.719240:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6454 00002000:00100000:1.0:1746065224.719250:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099bd4a80 x1830881265576576/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065224.719356:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4a80 with x1830881265576576 ext(1048576->2097151) 00002000:00010000:1.0:1746065224.719361:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4a80 00000100:00100000:2.0:1746065224.721698:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264065280:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065224.721718:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.721753:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+19:2004:x1830881265577344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6034us (6936us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.721761:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8428 00000100:00100000:3.0:1746065224.721889:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265576832:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16077us (17476us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065224.721897:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6453 00002000:00100000:3.0:1746065224.721904:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099bd4000 x1830881265576832/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.721911:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd4000 with x1830881265576832 ext(1048576->2097151) 00002000:00010000:3.0:1746065224.721915:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd4000 00000100:00100000:0.0:1746065224.724106:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.724168:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265577600 00000100:00100000:3.0:1746065224.724175:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265577600 00002000:00100000:3.0:1746065224.724208:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1228800->1232895) req@ffff88009252aa00 x1830881265577600/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.724222:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252aa00 with x1830881265577600 ext(1228800->1232895) 00002000:00010000:3.0:1746065224.724226:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009252aa00 00000100:00100000:3.0:1746065224.724700:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6455 00000100:00100000:3.0:1746065224.724708:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265577600:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065224.724863:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265577600:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 154us (763us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065224.724869:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6455 00002000:00100000:3.0:1746065224.724874:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x94:0x0] (1228800->1232895) req@ffff88009252aa00 x1830881265577600/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.724882:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252aa00 with x1830881265577600 ext(1228800->1232895) 00002000:00010000:3.0:1746065224.724885:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009252aa00 00000100:00100000:0.0:1746065224.730592:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.730660:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265577728 00000100:00100000:2.0:1746065224.730668:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265577728 00000100:00100000:2.0:1746065224.730715:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18023 00000100:00100000:2.0:1746065224.730721:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2689:x1830881265577728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.730735:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.730749:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc147ab7f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a264 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.730768:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.730770:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.730793:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc147ab7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a264 expref: 17 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.730806:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc147ab7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a264 expref: 17 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.730814:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6dc00, rc 0) 00000100:00100000:2.0:1746065224.730864:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2689:x1830881265577728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 142us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.730869:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18023 00000100:00100000:0.0:1746065224.733360:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.733423:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265577856 00000100:00100000:2.0:1746065224.733429:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265577856 00000100:00100000:2.0:1746065224.733457:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18024 00000100:00100000:2.0:1746065224.733462:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2690:x1830881265577856:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.733475:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.733486:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc147ab86 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a26b expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.733502:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.733504:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.733510:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc147ab86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a26b expref: 34 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.733519:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc147ab86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a26b expref: 34 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.733526:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d200, rc 0) 00000100:00100000:2.0:1746065224.733567:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2690:x1830881265577856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 105us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.733572:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18024 00000100:00100000:0.0:1746065224.739749:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.740408:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265578112 00000100:00100000:1.0:1746065224.740416:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265578112 00002000:00100000:1.0:1746065224.740455:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1851392->1855487) req@ffff880092529c00 x1830881265578112/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065224.740464:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529c00 with x1830881265578112 ext(1851392->1855487) 00002000:00010000:1.0:1746065224.740468:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092529c00 00000100:00100000:1.0:1746065224.740500:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6456 00000100:00100000:1.0:1746065224.740506:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2006:x1830881265578112:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065224.740627:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2006:x1830881265578112:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 120us (884us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065224.740633:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6456 00002000:00100000:1.0:1746065224.740638:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1851392->1855487) req@ffff880092529c00 x1830881265578112/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065224.740644:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529c00 with x1830881265578112 ext(1851392->1855487) 00002000:00010000:1.0:1746065224.740647:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880092529c00 00000100:00100000:0.0:1746065224.742342:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.742508:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265578368 00000100:00100000:1.0:1746065224.742513:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265578368 00002000:00100000:1.0:1746065224.742539:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009252b100 x1830881265578368/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065224.742547:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252b100 with x1830881265578368 ext(1048576->2097151) 00002000:00010000:1.0:1746065224.742551:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252b100 00000100:00100000:1.0:1746065224.742593:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6457 00000100:00100000:1.0:1746065224.742601:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265578368:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065224.752162:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.752227:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265578624 00000100:00100000:3.0:1746065224.752238:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265578624 00002000:00100000:3.0:1746065224.752288:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880092529880 x1830881265578624/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.752297:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529880 with x1830881265578624 ext(1048576->2097151) 00002000:00010000:3.0:1746065224.752302:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092529880 00000100:00100000:3.0:1746065224.752338:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6458 00000100:00100000:3.0:1746065224.752346:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265578624:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065224.758361:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265578368:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 15752us (16014us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065224.758372:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6457 00002000:00100000:1.0:1746065224.758382:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009252b100 x1830881265578368/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065224.758395:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252b100 with x1830881265578368 ext(1048576->2097151) 00002000:00010000:1.0:1746065224.758400:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252b100 00000100:00100000:3.0:1746065224.762963:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092529880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265578624:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10610us (10803us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065224.762974:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6458 00002000:00100000:3.0:1746065224.762983:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880092529880 x1830881265578624/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.762992:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092529880 with x1830881265578624 ext(1048576->2097151) 00002000:00010000:3.0:1746065224.762997:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880092529880 00000100:00100000:0.0:1746065224.770827:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.770860:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265578880 00000100:00100000:2.0:1746065224.770867:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265578880 00000100:00100000:0.0:1746065224.770872:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.770905:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.770917:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265578752 00000100:00100000:2.0:1746065224.770920:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265578752 00000100:00100000:0.0:1746065224.770929:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.770936:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265579008 00000100:00100000:2.0:1746065224.770937:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265579008 00000100:00100000:2.0:1746065224.770948:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265579136 00000100:00100000:2.0:1746065224.770950:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265579136 00000100:00100000:0.0:1746065224.771028:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18025 00000100:00100000:0.0:1746065224.771038:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265578880:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065224.771055:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065224.771071:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147ab8d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a279 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.771094:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.771096:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.771104:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147ab8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a279 expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.771119:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147ab8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a279 expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.771128:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993e200, rc 0) 00000100:00100000:0.0:1746065224.771172:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265578880:12345-192.168.202.27@tcp:101:cat.0 Request processed in 136us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.771178:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18025 00000100:00100000:0.0:1746065224.771196:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18026 00000100:00100000:0.0:1746065224.771202:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265578752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065224.771209:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065224.771210:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18027 00000100:00100000:2.0:1746065224.771216:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265579008:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065224.771218:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147ab94 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a272 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.771223:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065224.771228:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.771230:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.771231:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84ac00/0xad6b7ddc147ab9b lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a280 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.771235:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147ab94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a272 expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.771244:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147ab94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a272 expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.771255:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993e400, rc 0) 00000100:00100000:2.0:1746065224.771264:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264065408:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065224.771273:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265578752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 71us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.771289:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18026 00000100:00100000:0.0:1746065224.771300:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18028 00000100:00100000:0.0:1746065224.771304:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265579136:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065224.771310:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065224.771316:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147aba2 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a287 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.771320:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00010000:00010000:0.0:1746065224.771324:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.771325:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.771328:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147aba2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a287 expref: 35 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.771335:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147aba2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a287 expref: 35 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.771341:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993e600, rc 0) 00000100:00100000:0.0:1746065224.771356:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265579136:12345-192.168.202.27@tcp:101:cat.0 Request processed in 51us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.771360:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18028 00000100:00100000:2.0:1746065224.771371:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.771390:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265579264 00000100:00100000:0.0:1746065224.771392:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265579264 00000100:00100000:0.0:1746065224.771577:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18029 00000100:00100000:0.0:1746065224.771585:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265579264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065224.771591:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065224.771597:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc147aba9 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a28e expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.771606:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.771607:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.771611:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc147aba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a28e expref: 32 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.771619:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc147aba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a28e expref: 32 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065224.772257:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009993f200, rc 0) 00000100:00100000:0.0:1746065224.772288:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265579264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 693us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.772294:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18029 00000100:00100000:2.0:1746065224.778802:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264065408:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.778837:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84ac00/0xad6b7ddc147ab9b lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a280 expref: 31 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.778848:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84ac00/0xad6b7ddc147ab9b lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a280 expref: 31 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.778876:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84ac00, rc 0) 00000100:00100000:2.0:1746065224.778924:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265579008:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7707us (8018us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065224.778931:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18027 00000100:00100000:1.0:1746065224.798866:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.798915:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.798955:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265579520 00000100:00100000:0.0:1746065224.798961:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265579520 00000100:00100000:2.0:1746065224.798980:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265579776 00000100:00100000:2.0:1746065224.798985:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265579776 00002000:00100000:0.0:1746065224.798994:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880099ec6680 x1830881265579520/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.799002:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6680 with x1830881265579520 ext(2097152->4194303) 00002000:00100000:2.0:1746065224.799003:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880099ec5f80 x1830881265579776/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00010000:0.0:1746065224.799006:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec6680 00002000:00100000:2.0:1746065224.799011:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5f80 with x1830881265579776 ext(2097152->4194303) 00002000:00010000:2.0:1746065224.799014:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec5f80 00000100:00100000:0.0:1746065224.799022:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6459 00000100:00100000:2.0:1746065224.799027:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6460 00000100:00100000:0.0:1746065224.799027:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265579520:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065224.799033:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265579776:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065224.803501:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264065536:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746065224.803565:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065224.803668:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264065536 00000100:00100000:0.0:1746065224.803675:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264065536 00000100:00100000:0.0:1746065224.803712:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:0.0:1746065224.803719:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3762:x1830881264065536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065224.803746:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6438912 pending 0 free 1445683200 avail 1316220928 00000100:00100000:0.0:1746065224.807854:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3762:x1830881264065536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4128us (4282us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.807864:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1746065224.808098:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264065536:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065224.814867:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.814956:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.815001:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265580032 00000100:00100000:0.0:1746065224.815009:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265580032 00002000:00100000:0.0:1746065224.815044:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880097fa1180 x1830881265580032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.815053:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1180 with x1830881265580032 ext(2097152->4194303) 00002000:00010000:0.0:1746065224.815057:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1180 00000100:00100000:0.0:1746065224.815075:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265580288 00000100:00100000:0.0:1746065224.815078:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265580288 00002000:00100000:0.0:1746065224.815091:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097fa3800 x1830881265580288/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.815098:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3800 with x1830881265580288 ext(2097152->4194303) 00002000:00010000:0.0:1746065224.815101:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3800 00000100:00100000:0.0:1746065224.815113:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6461 00000100:00100000:0.0:1746065224.815119:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265580032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065224.815413:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6462 00000100:00100000:2.0:1746065224.815421:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265580288:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065224.827471:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.827589:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265580416 00000100:00100000:2.0:1746065224.827599:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265580416 00000100:00100000:2.0:1746065224.827675:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14693 00000100:00100000:2.0:1746065224.827683:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+6:2693:x1830881265580416:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065224.827712:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.827732:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147abb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a295 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.827814:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147abb7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.827827:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147abb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.827837:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147abb7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.827849:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147abbe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.827855:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147abbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.827862:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147abbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.827930:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.827939:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a210 expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.827946:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a217 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.827952:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 5/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.827981:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a217 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.827991:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a217 expref: 9 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.828001:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264065664:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065224.828012:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065224.828698:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a210 expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.828707:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a210 expref: 27 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.828715:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264065792:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.828737:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800a65663c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065224.831649:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265580544 00000100:00100000:3.0:1746065224.831659:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265580544 00000100:00100000:3.0:1746065224.831702:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18030 00000100:00100000:3.0:1746065224.831709:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2688:x1830881265580544:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065224.831722:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.831736:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a29c expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.831739:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881264066048:0@lo:400:kworker.0 00010000:00010000:3.0:1746065224.831757:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc147aa44 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d1 expref: 18 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.831765:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147ab6a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a24f expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.831785:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147ab4e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a23a expref: 19 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.831791:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:2.0:1746065224.831792:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1746065224.831793:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.831796:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1937408->2097151] (req 1937408->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.831813:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3760:1830881264066560:0@lo:400:kworker.0 00010000:00010000:3.0:1746065224.831817:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147ab4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a23a expref: 19 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.831826:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147ab4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a23a expref: 19 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.831830:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.831834:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264067200:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.831841:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3760:1830881264067072:0@lo:400:kworker.0 00010000:00010000:3.0:1746065224.831884:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147ab6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a24f expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.831891:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147ab6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a24f expref: 33 pid: 13375 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.831897:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264067328:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.832173:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.832192:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1746065224.832198:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ceddf226-8ddf-479f-9953-8a74c62285a9:3760:1830881264065920:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832218:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.832238:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881264066432:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832256:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.832268:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3760:1830881264066944:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832292:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.832311:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264066560 00000100:00100000:2.0:1746065224.832314:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264066560 00000100:00100000:2.0:1746065224.832345:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264067072 00000100:00100000:2.0:1746065224.832348:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264067072 00000100:00100000:2.0:1746065224.832358:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264066944 00000100:00100000:2.0:1746065224.832359:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264066944 00000100:00100000:2.0:1746065224.832369:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1746065224.832373:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3760:x1830881264066560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832402:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135220380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:3760:x1830881264066560:12345-0@lo:400:kworker.0 Request processed in 29us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.832407:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1746065224.832418:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1746065224.832421:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3760:x1830881264067072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832440:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135222d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:3760:x1830881264067072:12345-0@lo:400:kworker.0 Request processed in 18us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.832445:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1746065224.832452:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1746065224.832456:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3760:x1830881264066944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832472:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0001_UUID+5:3760:x1830881264066944:12345-0@lo:400:kworker.0 Request processed in 17us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.832476:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1746065224.832500:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3760:1830881264066944:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832508:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3760:1830881264066560:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832514:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3760:1830881264067072:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832530:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264066304:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832544:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.832555:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800a4e51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881264066816:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832565:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.832574:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065224.832578:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3762:1830881264066176:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832588:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.832595:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3762:1830881264066688:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832605:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.832615:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264066816 00000100:00100000:2.0:1746065224.832617:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264066816 00000100:00100000:2.0:1746065224.832628:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264066176 00000100:00100000:2.0:1746065224.832630:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264066176 00000100:00100000:2.0:1746065224.832635:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264066688 00000100:00100000:2.0:1746065224.832636:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264066688 00000100:00100000:2.0:1746065224.832643:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1746065224.832646:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881264066816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832665:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3762:x1830881264066816:12345-0@lo:400:kworker.0 Request processed in 18us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.832669:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:2.0:1746065224.832675:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1746065224.832678:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3762:x1830881264066176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832690:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3762:x1830881264066176:12345-0@lo:400:kworker.0 Request processed in 12us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.832694:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:2.0:1746065224.832700:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1746065224.832703:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3762:x1830881264066688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832714:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3762:x1830881264066688:12345-0@lo:400:kworker.0 Request processed in 11us (109us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.832718:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:2.0:1746065224.832730:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3762:1830881264066176:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832736:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3762:1830881264066688:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832742:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800a4e51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3762:1830881264066816:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832756:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264066432 00000100:00100000:2.0:1746065224.832758:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264066432 00000100:00100000:2.0:1746065224.832770:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264066304 00000100:00100000:2.0:1746065224.832785:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264066304 00000100:00100000:2.0:1746065224.832796:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1746065224.832800:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881264066432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832820:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881264066432:12345-0@lo:400:kworker.0 Request processed in 20us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.832824:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1746065224.832830:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1746065224.832833:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881264066304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832847:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881264066304:12345-0@lo:400:kworker.0 Request processed in 14us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.832851:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1746065224.832865:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881264066432:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832877:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264066304:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832929:0:8142:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264065920 00000100:00100000:2.0:1746065224.832931:0:8142:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264065920 00000100:00100000:2.0:1746065224.832945:0:8142:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1746065224.832949:0:8142:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3760:x1830881264065920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.832967:0:8142:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3760:x1830881264065920:12345-0@lo:400:kworker.0 Request processed in 19us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.832971:0:8142:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00080000:2.0:1746065224.832984:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1746065224.832987:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1746065224.832989:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1746065224.832990:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1746065224.833000:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ceddf226-8ddf-479f-9953-8a74c62285a9:3760:1830881264065920:0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.833032:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264066048 00000100:00100000:2.0:1746065224.833034:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264066048 00000100:00100000:2.0:1746065224.833054:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1746065224.833058:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881264066048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1746065224.833078:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3760:x1830881264066048:12345-0@lo:400:kworker.0 Request processed in 20us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.833083:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:2.0:1746065224.833095:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881264066048:0@lo:400:kworker.0 00010000:00010000:3.0:1746065224.833124:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc147aa44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d1 expref: 18 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.833133:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc147aa44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d1 expref: 18 pid: 9548 timeout: 920 lvb_type: 1 00000100:00100000:3.0:1746065224.833142:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264067456:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.833160:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065224.834767:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.834800:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265580800 00000100:00100000:3.0:1746065224.834805:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265580800 00000100:00100000:3.0:1746065224.834834:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5535 00000100:00100000:3.0:1746065224.834839:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:30399:x1830881265580800:12345-192.168.202.27@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1746065224.835046:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264065664:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065224.835056:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264065792:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065224.835073:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:3.0:1746065224.835605:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:30399:x1830881265580800:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 764us (841us total) trans 8589937219 rc 0/0 00000100:00100000:3.0:1746065224.835611:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5535 00000100:00100000:3.0:1746065224.835644:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.835795:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265580928 00000100:00100000:3.0:1746065224.835796:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265579776:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36761us (36880us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065224.835799:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265580928 00000100:00100000:3.0:1746065224.835803:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6460 00002000:00100000:3.0:1746065224.835810:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880099ec5f80 x1830881265579776/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065224.835816:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a210 expref: 28 pid: 7231 timeout: 920 lvb_type: 0 00002000:00100000:3.0:1746065224.835818:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5f80 with x1830881265579776 ext(2097152->4194303) 00002000:00010000:3.0:1746065224.835822:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099ec5f80 00000100:00100000:3.0:1746065224.836004:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265579520:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36976us (37145us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065224.836010:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6459 00002000:00100000:3.0:1746065224.836015:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880099ec6680 x1830881265579520/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.836022:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec6680 with x1830881265579520 ext(2097152->4194303) 00002000:00010000:3.0:1746065224.836025:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880099ec6680 00000100:00100000:2.0:1746065224.836237:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8429 00000100:00100000:2.0:1746065224.836244:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265580928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.836253:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.836258:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a210 expref: 28 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.836266:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a210 expref: 28 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.836294:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ab0f lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a210 expref: 28 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.838172:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065224.838180:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.838189:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.838197:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.838201:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.838254:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265580928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2008us (2607us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.838262:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8429 00000100:00100000:0.0:1746065224.846686:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.846708:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.846746:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.846827:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265581056 00000100:00100000:1.0:1746065224.846835:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265581056 00010000:00010000:1.0:1746065224.847088:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147ab4e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a23a expref: 18 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.848507:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907be680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264067200:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.848518:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264067328:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.848525:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264067456:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.848548:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1937408->2097151] (req 1937408->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.848562:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abaca00, rc 0) 00000100:00100000:3.0:1746065224.848607:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265581184 00000100:00100000:3.0:1746065224.848610:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265581184 00000100:00100000:1.0:1746065224.848616:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265581312 00000100:00100000:1.0:1746065224.848620:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265581312 00010000:00010000:3.0:1746065224.848628:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147ab6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a24f expref: 34 pid: 13375 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.848635:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc147aa44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d1 expref: 19 pid: 9548 timeout: 920 lvb_type: 1 00000100:00100000:3.0:1746065224.848649:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8430 00000100:00100000:3.0:1746065224.848655:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265581056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065224.848657:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8431 00000100:00100000:1.0:1746065224.848663:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881265581184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.848665:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.848669:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.848679:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147ab4e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a23a expref: 18 pid: 9550 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.848680:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147ab6a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a24f expref: 34 pid: 13375 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.848687:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147ab4e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a23a expref: 18 pid: 9550 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.848698:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147ab6a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a24f expref: 34 pid: 13375 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746065224.848770:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8432 00000100:00100000:0.0:1746065224.848788:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265581312:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065224.848794:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.849568:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147ab4e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a23a expref: 18 pid: 9550 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.849574:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ab2d600/0xad6b7ddc147ab6a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a24f expref: 34 pid: 13375 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.849581:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065224.849587:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.849604:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265581056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 949us (2926us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.849607:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265581184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 944us (2897us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.849610:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8430 00000100:00100000:1.0:1746065224.849613:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8431 00000100:00100000:3.0:1746065224.849631:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+32:2688:x1830881265580544:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 17923us (21620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.849636:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18030 00000100:00100000:3.0:1746065224.849697:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.849813:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265581440 00000100:00100000:3.0:1746065224.849817:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265581440 00010000:00010000:3.0:1746065224.849831:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a217 expref: 11 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.849845:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8433 00000100:00100000:3.0:1746065224.849849:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2006:x1830881265581440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.849856:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.849860:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a217 expref: 11 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.849867:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a217 expref: 11 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.849879:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a852b000/0xad6b7ddc147ab1d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a217 expref: 11 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.849887:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.849891:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.849898:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.849903:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.849918:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.849936:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2006:x1830881265581440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.849945:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8433 00010000:00010000:3.0:1746065224.849959:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.849964:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065224.850001:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00000004:00200000:3.0:1746065224.850005:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065224.850018:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850025:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850033:0:7203:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147abb7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850038:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147abb7 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850043:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147abb7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850047:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147abb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850051:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.850054:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147abb7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850059:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147abb7 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850069:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065224.850071:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.850073:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147abb7 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850076:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b200/0xad6b7ddc147abb7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850084:0:7203:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147abbe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850087:0:7203:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147abbe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850091:0:7203:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147abbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850095:0:7203:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f84b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.850097:0:7203:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147abbe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850100:0:7203:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147abbe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850104:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880095561c00) 00010000:00010000:3.0:1746065224.850106:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065224.850108:0:7203:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147abbe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850112:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b600/0xad6b7ddc147abbe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.850135:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84a200/0xad6b7ddc147abb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a295 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.850143:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a295 expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.850148:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.850150:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065224.850152:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b000, rc 0) 00000100:00100000:3.0:1746065224.850172:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+7:2693:x1830881265580416:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 22491us (22710us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.850177:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14693 00010000:00010000:0.0:1746065224.850650:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc147aa44 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d1 expref: 19 pid: 9548 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.850661:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc147aa44 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d1 expref: 19 pid: 9548 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.850673:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a175000/0xad6b7ddc147aa44 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d1 expref: 19 pid: 9548 timeout: 920 lvb_type: 1 00010000:00010000:0.0:1746065224.850690:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.850692:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065224.850697:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 31 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.850703:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 31 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.850730:0:9565:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 31 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065224.850741:0:9565:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881264067584:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065224.853058:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265580288:12345-192.168.202.27@tcp:3:cat.0 Request processed in 37633us (38096us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065224.853068:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6462 00002000:00100000:3.0:1746065224.853077:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097fa3800 x1830881265580288/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.853084:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa3800 with x1830881265580288 ext(2097152->4194303) 00002000:00010000:3.0:1746065224.853088:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa3800 00000100:00100000:1.0:1746065224.856515:0:9565:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64d80 going to sleep for 11 seconds 00000100:00100000:1.0:1746065224.857892:0:9565:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0000_UUID:9565:1830881264067584:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065224.857910:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.857959:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265581312:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9170us (11212us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.857969:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8432 00000100:00100000:2.0:1746065224.861261:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.861370:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.861400:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265581696 00000100:00100000:2.0:1746065224.861408:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265581696 00002000:00100000:2.0:1746065224.861447:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1937408->1941503) req@ffff8800a4e51f80 x1830881265581696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.861456:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51f80 with x1830881265581696 ext(1937408->1941503) 00002000:00010000:2.0:1746065224.861461:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e51f80 00000100:00100000:2.0:1746065224.861478:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6463 00000100:00100000:2.0:1746065224.861485:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265581696:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065224.861598:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265581696:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 112us (343us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065224.861604:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6463 00002000:00100000:2.0:1746065224.861610:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x95:0x0] (1937408->1941503) req@ffff8800a4e51f80 x1830881265581696/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.861616:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e51f80 with x1830881265581696 ext(1937408->1941503) 00002000:00010000:2.0:1746065224.861618:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800a4e51f80 00000100:00100000:2.0:1746065224.861637:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265581824 00000100:00100000:2.0:1746065224.861640:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265581824 00000100:00100000:2.0:1746065224.861659:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18031 00000100:00100000:2.0:1746065224.861664:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265581824:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065224.861672:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.861684:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d06600/0xad6b7ddc147abd3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2a3 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.861723:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264067712:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.861802:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.862247:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265580032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 47126us (47386us total) trans 0 rc 2097152/2097152 00000100:00100000:0.0:1746065224.862253:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6461 00002000:00100000:0.0:1746065224.862259:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880097fa1180 x1830881265580032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.862265:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1180 with x1830881265580032 ext(2097152->4194303) 00002000:00010000:0.0:1746065224.862269:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1180 00000100:00100000:0.0:1746065224.863368:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:2.0:1746065224.864707:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065224 -> 1746065225 00000100:00100000:2.0:1746065224.864724:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264067712:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.864750:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d06600/0xad6b7ddc147abd3 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2a3 expref: 19 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.864763:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d06600/0xad6b7ddc147abd3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2a3 expref: 19 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.864799:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06600, rc 0) 00000100:00100000:2.0:1746065224.864833:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265581824:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3168us (3462us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065224.864840:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18031 00000100:00100000:2.0:1746065224.864860:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265581952 00000100:00100000:2.0:1746065224.864864:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265581952 00000100:00100000:3.0:1746065224.864936:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18032 00000100:00100000:3.0:1746065224.864943:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265581952:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065224.864954:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.864965:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147abda lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2aa expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.864997:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264067840:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065224.865048:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.866711:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.866884:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265582208 00000100:00100000:2.0:1746065224.866889:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265582208 00000100:00100000:2.0:1746065224.866925:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18033 00000100:00100000:2.0:1746065224.866931:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2688:x1830881265582208:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065224.866942:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.866953:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2b8 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.866973:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc147aa59 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d8 expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.866980:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc147ab86 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a26b expref: 36 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.866987:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc147ab7f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a264 expref: 17 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.866992:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.866994:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.866997:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->1708031] (req 1048576->1708031) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 36 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.867019:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc147ab7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a264 expref: 17 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.867030:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc147ab7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a264 expref: 17 pid: 10219 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.867040:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264067968:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.867841:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc147ab86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a26b expref: 36 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.867854:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc147ab86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a26b expref: 36 pid: 10219 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.867861:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264068096:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.868087:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc147aa59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d8 expref: 17 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.868095:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc147aa59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d8 expref: 17 pid: 13375 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.868102:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264068224:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.868415:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c96c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.869289:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.869422:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265582080 00000100:00100000:2.0:1746065224.869428:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265582080 00000100:00100000:2.0:1746065224.869457:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18034 00000100:00100000:2.0:1746065224.869463:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265582080:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.869474:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.869484:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d06600/0xad6b7ddc147abe8 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2b1 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.869516:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264068352:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.869569:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00002000:00010000:3.0:1746065224.870818:0:10219:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065224 -> 1746065225 00002000:00010000:3.0:1746065224.870825:0:10219:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065224 -> 1746065225 00002000:00010000:3.0:1746065224.870827:0:10219:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065224 -> 1746065225 00000100:00100000:3.0:1746065224.870841:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264067840:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065224.870864:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147abda lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2aa expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.870875:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147abda lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2aa expref: 19 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.870887:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a800, rc 0) 00000100:00100000:3.0:1746065224.870923:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265581952:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5979us (7556us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065224.870929:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18032 00000100:00100000:3.0:1746065224.873009:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264068352:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065224.873037:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d06600/0xad6b7ddc147abe8 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b1 expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.873047:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d06600/0xad6b7ddc147abe8 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b1 expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.873055:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d06600, rc 0) 00000100:00100000:3.0:1746065224.873094:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265582080:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3630us (3817us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065224.873101:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18034 00000100:00100000:2.0:1746065224.874614:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264067968:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.874625:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264068096:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.874633:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264068224:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.874653:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->1708031] (req 1048576->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 36 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.874665:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07e00, rc 0) 00000100:00100000:2.0:1746065224.874709:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2688:x1830881265582208:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7776us (8001us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.874715:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18033 00000100:00100000:0.0:1746065224.875736:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.875762:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.875802:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.875830:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.875875:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265582720 00000100:00100000:3.0:1746065224.875881:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265582720 00000100:00100000:3.0:1746065224.875905:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265582848 00000100:00100000:3.0:1746065224.875906:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265582848 00000100:00100000:3.0:1746065224.875915:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18035 00000100:00100000:3.0:1746065224.875920:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265582720:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065224.875932:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.875942:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147abef lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2bf expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.875976:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264068480:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065224.876024:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065224.876036:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18036 00000100:00100000:3.0:1746065224.876040:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881265582848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065224.876046:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.876052:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc147abf6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2c6 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.876062:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.876068:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc147abf6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2c6 expref: 37 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.876075:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5ac00/0xad6b7ddc147abf6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2c6 expref: 37 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.876082:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ac00, rc 0) 00000100:00100000:3.0:1746065224.876093:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881265582848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 53us (263us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065224.876101:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18036 00000100:00100000:2.0:1746065224.876151:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265582336 00000100:00100000:2.0:1746065224.876153:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265582336 00010000:00010000:2.0:1746065224.876167:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc147ab86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a26b expref: 36 pid: 10219 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.876181:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265582464 00000100:00100000:2.0:1746065224.876183:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265582464 00010000:00010000:2.0:1746065224.876191:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc147aa59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d8 expref: 18 pid: 13375 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.876202:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8434 00000100:00100000:2.0:1746065224.876206:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+36:2007:x1830881265582336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.876213:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.876227:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc147ab86 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a26b expref: 36 pid: 10219 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.876234:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc147ab86 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a26b expref: 36 pid: 10219 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.876252:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6d200/0xad6b7ddc147ab86 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a26b expref: 36 pid: 10219 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.876263:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.876294:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265582336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 72us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.876300:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8434 00000100:00100000:2.0:1746065224.876338:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8435 00000100:00100000:2.0:1746065224.876343:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+18:2007:x1830881265582464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.876349:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.876354:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc147aa59 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d8 expref: 18 pid: 13375 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.876362:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc147aa59 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d8 expref: 18 pid: 13375 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.876373:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3d800/0xad6b7ddc147aa59 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1d8 expref: 18 pid: 13375 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.876380:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.876394:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+17:2007:x1830881265582464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 51us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.876399:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8435 00000100:00100000:3.0:1746065224.876911:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1746065224.876919:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264068608:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1746065224.876950:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065224.877003:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264068608 00000100:00100000:0.0:1746065224.877006:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264068608 00000100:00100000:0.0:1746065224.877025:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1746065224.877028:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a65ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881264068608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1746065224.877049:0:8357:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 6389760 pending 0 free 1445552128 avail 1316089856 00000100:00100000:0.0:1746065224.877077:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a65ba050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881264068608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 48us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.877082:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:3.0:1746065224.877378:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264068608:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065224.878629:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.878646:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.878672:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265582592 00000100:00100000:2.0:1746065224.878672:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265583104 00000100:00100000:3.0:1746065224.878676:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265582592 00000100:00100000:2.0:1746065224.878676:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265583104 00010000:00010000:3.0:1746065224.878695:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc147ab7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a264 expref: 18 pid: 10219 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.878709:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14694 00000100:00100000:2.0:1746065224.878714:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+7:2693:x1830881265583104:12345-192.168.202.27@tcp:101:lfs.0 00000100:00100000:3.0:1746065224.878723:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8436 00010000:00010000:2.0:1746065224.878725:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1746065224.878728:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265582592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.878735:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.878736:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131055800/0xad6b7ddc147abfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2cd expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.878747:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc147ab7f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a264 expref: 18 pid: 10219 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.878756:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc147ab7f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a264 expref: 18 pid: 10219 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.878770:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6dc00/0xad6b7ddc147ab7f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a264 expref: 18 pid: 10219 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.878799:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.878801:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.878808:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.878819:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.878837:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.878843:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.878849:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a295 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.878853:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264068736:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065224.878856:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.878873:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a295 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.878883:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a295 expref: 8 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.878890:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264068864:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.878903:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.878911:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9900 going to sleep for 11 seconds 00002000:00010000:3.0:1746065224.878926:0:1880:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065224 -> 1746065225 00002000:00010000:3.0:1746065224.878929:0:1880:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065224 -> 1746065225 00000100:00100000:3.0:1746065224.878937:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264068480:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065224.878953:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147abef lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2bf expref: 31 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.878961:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147abef lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2bf expref: 31 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.878968:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a800, rc 0) 00000100:00100000:3.0:1746065224.879005:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265582720:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3083us (3201us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065224.879012:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18035 00000100:00100000:0.0:1746065224.884631:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.884675:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.884696:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265583488 00000100:00100000:0.0:1746065224.884703:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265583488 00002000:00100000:0.0:1746065224.884739:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097d05880 x1830881265583488/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.884749:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05880 with x1830881265583488 ext(4194304->5038079) 00002000:00010000:0.0:1746065224.884754:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d05880 00000100:00100000:0.0:1746065224.884771:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6464 00000100:00100000:0.0:1746065224.884803:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265583488:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065224.885364:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264068736:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065224.885380:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.885405:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265582592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6676us (6779us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.885414:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8436 00000100:00100000:3.0:1746065224.885430:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265583232 00000100:00100000:3.0:1746065224.885432:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265583232 00010000:00010000:3.0:1746065224.885446:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a295 expref: 9 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.885462:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8437 00000100:00100000:3.0:1746065224.885467:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265583232:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.885476:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.885481:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a295 expref: 9 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.885491:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a295 expref: 9 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.885509:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.885514:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.885521:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.885526:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.885538:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.885553:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265583232:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.885558:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8437 00010000:00010000:2.0:1746065224.888044:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f84b000/0xad6b7ddc147abc5 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a295 expref: 8 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.888075:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264068864:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.888092:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.888099:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.888103:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:2.0:1746065224.888118:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:2.0:1746065224.888217:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131055800/0xad6b7ddc147abfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2cd expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.888227:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2cd expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.888233:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065224.888235:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065224.888237:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009580fa00, rc 0) 00000100:00100000:2.0:1746065224.888274:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2693:x1830881265583104:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 9558us (9628us total) trans 8589937220 rc 0/0 00000100:00100000:2.0:1746065224.888289:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14694 00000100:00100000:0.0:1746065224.890656:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.891865:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265583744 00000100:00100000:2.0:1746065224.891874:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265583744 00002000:00100000:2.0:1746065224.891907:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1703936->1708031) req@ffff880097d04380 x1830881265583744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.891915:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04380 with x1830881265583744 ext(1703936->1708031) 00002000:00010000:2.0:1746065224.891919:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d04380 00000100:00100000:2.0:1746065224.891935:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6465 00000100:00100000:2.0:1746065224.891941:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265583744:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065224.892053:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265583744:12345-192.168.202.27@tcp:3:cat.0 Request processed in 111us (1402us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065224.892058:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6465 00002000:00100000:2.0:1746065224.892062:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x77:0x0] (1703936->1708031) req@ffff880097d04380 x1830881265583744/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/4536 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.892068:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04380 with x1830881265583744 ext(1703936->1708031) 00002000:00010000:2.0:1746065224.892070:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d04380 00000100:00100000:2.0:1746065224.895597:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.895683:0:9555:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265584000 00000100:00100000:3.0:1746065224.895690:0:9555:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265584000 00002000:00100000:3.0:1746065224.895721:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800900f3100 x1830881265584000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.895730:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f3100 with x1830881265584000 ext(4194304->5038079) 00002000:00010000:3.0:1746065224.895734:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f3100 00000100:00100000:3.0:1746065224.895758:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6466 00000100:00100000:3.0:1746065224.895764:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265584000:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065224.896500:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265583488:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11696us (11823us total) trans 0 rc 843776/843776 00000100:00100000:0.0:1746065224.896507:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6464 00002000:00100000:0.0:1746065224.896513:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097d05880 x1830881265583488/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.896520:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d05880 with x1830881265583488 ext(4194304->5038079) 00002000:00010000:0.0:1746065224.896524:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d05880 00000100:00100000:0.0:1746065224.901158:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.901204:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.901291:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265584384 00000100:00100000:3.0:1746065224.901299:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265584384 00000100:00100000:3.0:1746065224.901334:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5536 00000100:00100000:3.0:1746065224.901340:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2688:x1830881265584384:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065224.901520:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2688:x1830881265584384:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 179us (314us total) trans 8589937221 rc 0/0 00000100:00100000:3.0:1746065224.901526:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5536 00000100:00100000:2.0:1746065224.901644:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265584128 00000100:00100000:2.0:1746065224.901648:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265584128 00000100:00100000:2.0:1746065224.901681:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14695 00000100:00100000:2.0:1746065224.901686:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2693:x1830881265584128:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065224.901696:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.901708:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147ac12 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2d4 expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.901753:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a600/0xad6b7ddc147ac19 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.901765:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2cd expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.901794:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a600/0xad6b7ddc147ac19 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.901815:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2cd expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.901828:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2cd expref: 9 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.901836:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264068992:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.901878:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.904080:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.904121:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.904245:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265584000:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8480us (8653us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065224.904253:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6466 00002000:00100000:3.0:1746065224.904261:0:9555:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800900f3100 x1830881265584000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/440 e 0 to 0 dl 1746065235 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.904269:0:9555:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f3100 with x1830881265584000 ext(4194304->5038079) 00002000:00010000:3.0:1746065224.904273:0:9555:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f3100 00000100:00100000:1.0:1746065224.904440:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265584512 00000100:00100000:1.0:1746065224.904446:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265584512 00000100:00100000:1.0:1746065224.904469:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265584640 00000100:00100000:1.0:1746065224.904471:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265584640 00000100:00100000:1.0:1746065224.904483:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18037 00000100:00100000:1.0:1746065224.904489:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265584512:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065224.904501:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065224.904517:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc147ac20 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2db expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.904555:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264069120:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065224.904598:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065224.904653:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18038 00000100:00100000:3.0:1746065224.904659:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265584640:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065224.904669:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.904681:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc147ac27 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2e2 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.904703:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264069248:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065224.904722:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.904903:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.905132:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265584768 00000100:00100000:1.0:1746065224.905135:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265584768 00010000:00010000:1.0:1746065224.905151:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2cd expref: 10 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.905168:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8438 00000100:00100000:1.0:1746065224.905172:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265584768:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.905179:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.905183:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2cd expref: 10 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.905191:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2cd expref: 10 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.905207:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.905211:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a600/0xad6b7ddc147ac19 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.905219:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a600/0xad6b7ddc147ac19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.905225:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a600/0xad6b7ddc147ac19 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT flags: 0x50290000000000 pid: 7203 initiator: MDT0 00010000:00010000:1.0:1746065224.905235:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.905265:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265584768:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 92us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.905270:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8438 00010000:00010000:3.0:1746065224.905488:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009580fa00/0xad6b7ddc147ac04 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2cd expref: 9 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.905509:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264068992:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.905524:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a600/0xad6b7ddc147ac19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.905530:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a600/0xad6b7ddc147ac19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.905534:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a600/0xad6b7ddc147ac19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065224.905570:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00000004:00200000:3.0:1746065224.905574:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065224.905587:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a600/0xad6b7ddc147ac19 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.905610:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147ac12 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2d4 expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.905618:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a600/0xad6b7ddc147ac19 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2d4 expref: 8 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.905628:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.905630:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065224.905632:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a600, rc 0) 00000100:00100000:3.0:1746065224.905666:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2693:x1830881265584128:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3980us (4515us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.905673:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14695 00002000:00010000:3.0:1746065224.906823:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime: 1746065224 -> 1746065225 00002000:00010000:3.0:1746065224.906827:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065224 -> 1746065225 00002000:00010000:3.0:1746065224.906829:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime: 1746065224 -> 1746065225 00000100:00100000:3.0:1746065224.906844:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264069248:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065224.906863:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc147ac27 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2e2 expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.906872:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d07200/0xad6b7ddc147ac27 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2e2 expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.906879:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07200, rc 0) 00000100:00100000:3.0:1746065224.906910:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265584640:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2251us (2789us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065224.906917:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18038 00000100:00100000:1.0:1746065224.907075:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264069120:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065224.907090:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc147ac20 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2db expref: 18 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.907098:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880091ae6000/0xad6b7ddc147ac20 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2db expref: 18 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.907106:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091ae6000, rc 0) 00000100:00100000:1.0:1746065224.907123:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265584512:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2635us (3050us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065224.907127:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18037 00000100:00100000:3.0:1746065224.909810:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264069376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1746065224.909863:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.909965:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.909996:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.910007:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.910023:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265585024 00000100:00100000:2.0:1746065224.910029:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265585024 00000100:00100000:2.0:1746065224.910056:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265585280 00000100:00100000:2.0:1746065224.910058:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265585280 00000100:00100000:2.0:1746065224.910068:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265585152 00000100:00100000:2.0:1746065224.910069:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265585152 00000100:00100000:2.0:1746065224.910082:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18039 00000100:00100000:2.0:1746065224.910088:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+19:2004:x1830881265585024:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065224.910101:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.910114:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147ac2e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2f0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.910147:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264069504:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.910196:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a5c9540 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.910210:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18040 00000100:00100000:2.0:1746065224.910215:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265585280:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065224.910222:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.910231:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac30200/0xad6b7ddc147ac35 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2fe expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.910253:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264069632:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.910271:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.910303:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18041 00000100:00100000:2.0:1746065224.910309:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+20:2004:x1830881265585152:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065224.910315:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.910320:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc147ac3c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2f7 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.910339:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264069760:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.910356:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.910383:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.910398:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265584896 00000100:00100000:2.0:1746065224.910401:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265584896 00000100:00100000:2.0:1746065224.910417:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18042 00000100:00100000:2.0:1746065224.910421:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265584896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.910428:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.910434:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac30a00/0xad6b7ddc147ac43 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a2e9 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.910453:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264069888:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.910471:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.910807:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264069376 00000100:00100000:0.0:1746065224.910811:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264069376 00000100:00100000:0.0:1746065224.910842:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:0.0:1746065224.910847:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3762:x1830881264069376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1746065224.910860:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 651264 granted 1067832768 pending 1986560 free 3910598656 avail 3679076352 00000100:00100000:0.0:1746065224.910894:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+61:3762:x1830881264069376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (1031us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.910899:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:3.0:1746065224.911579:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264069376:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065224.912631:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.912639:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264069760:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065224.912654:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:3.0:1746065224.912665:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc147ac3c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2f7 expref: 21 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.912675:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31600/0xad6b7ddc147ac3c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2f7 expref: 21 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.912684:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31600, rc 0) 00000100:00100000:3.0:1746065224.912731:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+20:2004:x1830881265585152:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2422us (2722us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065224.912738:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18041 00000100:00100000:3.0:1746065224.912755:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265585408 00000100:00100000:3.0:1746065224.912758:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265585408 00000100:00100000:3.0:1746065224.912804:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265585536 00000100:00100000:3.0:1746065224.912807:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265585536 00000100:00100000:3.0:1746065224.912821:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18043 00000100:00100000:3.0:1746065224.912826:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265585408:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065224.912835:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.912843:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07400/0xad6b7ddc147ac4a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a305 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.912873:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264070016:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.912934:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18044 00000100:00100000:2.0:1746065224.912941:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265585536:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.912948:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.912957:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc147ac51 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a30c expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.912979:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881264070144:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.913017:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.913043:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264069632:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065224.913047:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00010000:00010000:2.0:1746065224.913058:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30200/0xad6b7ddc147ac35 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2fe expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.913065:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30200/0xad6b7ddc147ac35 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2fe expref: 18 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.913075:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30200, rc 0) 00000100:00100000:2.0:1746065224.913093:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265585280:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2878us (3097us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065224.913098:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18040 00000100:00100000:2.0:1746065224.913600:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264069888:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.913615:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30a00/0xad6b7ddc147ac43 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2e9 expref: 31 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.913624:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30a00/0xad6b7ddc147ac43 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2e9 expref: 31 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.913631:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30a00, rc 0) 00000100:00100000:2.0:1746065224.913654:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265584896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3231us (3270us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065224.913659:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18042 00000100:00100000:2.0:1746065224.913688:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264069504:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.913702:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147ac2e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2f0 expref: 19 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.913709:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30e00/0xad6b7ddc147ac2e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2f0 expref: 19 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.913716:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30e00, rc 0) 00000100:00100000:2.0:1746065224.913731:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265585024:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3644us (3768us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065224.913736:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18039 00000100:00100000:2.0:1746065224.915188:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881264070144:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.915211:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc147ac51 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a30c expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.915220:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31800/0xad6b7ddc147ac51 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a30c expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.915227:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31800, rc 0) 00000100:00100000:3.0:1746065224.915344:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264070016:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065224.915360:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d07400/0xad6b7ddc147ac4a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a305 expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.915378:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07400/0xad6b7ddc147ac4a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a305 expref: 18 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065224.915385:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07400, rc 0) 00000100:00100000:3.0:1746065224.915478:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265585408:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2650us (2849us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065224.915478:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265585536:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2536us (2821us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065224.915484:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18043 00000100:00100000:2.0:1746065224.915657:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18044 00000100:00100000:0.0:1746065224.917573:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.917648:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265585664 00000100:00100000:2.0:1746065224.917654:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265585664 00000100:00100000:2.0:1746065224.917691:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18045 00000100:00100000:2.0:1746065224.917696:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265585664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065224.917710:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065224.917722:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147ac58 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a313 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.917759:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264070272:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065224.918290:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.918825:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.918969:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265585920 00000100:00100000:3.0:1746065224.918973:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265585920 00000100:00100000:3.0:1746065224.918999:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14696 00000100:00100000:3.0:1746065224.919004:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2693:x1830881265585920:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065224.919015:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065224.919025:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07c00/0xad6b7ddc147ac5f lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a31a expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.919098:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ac66 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.919115:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ac66 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.919124:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ac66 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:3.0:1746065224.919133:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:3.0:1746065224.919202:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07c00/0xad6b7ddc147ac5f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a31a expref: 11 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.919216:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ac66 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a31a expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.919223:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.919225:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065224.919227:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07800, rc 0) 00000100:00100000:3.0:1746065224.919264:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2693:x1830881265585920:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 259us (439us total) trans 8589937222 rc 0/0 00000100:00100000:3.0:1746065224.919268:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14696 00000100:00100000:0.0:1746065224.920107:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.920159:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265586176 00000100:00100000:1.0:1746065224.920163:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265586176 00000100:00100000:1.0:1746065224.920199:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5537 00000100:00100000:1.0:1746065224.920204:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2689:x1830881265586176:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:1.0:1746065224.920302:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2689:x1830881265586176:12345-192.168.202.27@tcp:35:cat.0 Request processed in 97us (196us total) trans 8589937223 rc 0/0 00000100:00100000:1.0:1746065224.920307:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5537 00000100:00100000:2.0:1746065224.920392:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264070272:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065224.920413:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147ac58 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a313 expref: 31 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.920423:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac30c00/0xad6b7ddc147ac58 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a313 expref: 31 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.920431:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30c00, rc 0) 00000100:00100000:2.0:1746065224.920448:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265585664:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2751us (2880us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065224.920454:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18045 00000100:00100000:0.0:1746065224.921030:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.921194:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.921235:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.921306:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.921400:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.921411:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265586432 00000100:00100000:2.0:1746065224.921414:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265586432 00000100:00100000:2.0:1746065224.921435:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265586688 00000100:00100000:2.0:1746065224.921437:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265586688 00000100:00100000:2.0:1746065224.921446:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265586944 00000100:00100000:2.0:1746065224.921447:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265586944 00000100:00100000:2.0:1746065224.921453:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265586304 00000100:00100000:2.0:1746065224.921455:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265586304 00000100:00100000:3.0:1746065224.921567:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18046 00000100:00100000:3.0:1746065224.921574:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+19:2004:x1830881265586432:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:3.0:1746065224.921597:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.921610:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.921617:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065224.921619:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065224.921621:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.921642:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 16 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.921652:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 16 pid: 10219 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.921663:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264070400:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.921700:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.922196:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.922229:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265586560 00000100:00100000:2.0:1746065224.922233:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265586560 00000100:00100000:2.0:1746065224.922255:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18047 00000100:00100000:2.0:1746065224.922260:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265586688:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065224.922287:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922296:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922301:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.922302:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.922304:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922319:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922326:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 34 pid: 1880 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.922334:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009252b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264070528:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.922362:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5900 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.922377:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18048 00000100:00100000:2.0:1746065224.922382:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+20:2004:x1830881265586944:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065224.922397:0:9548:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922406:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc147aa60 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1e6 expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.922412:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc147aba9 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a28e expref: 29 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.922418:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147ab8d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a279 expref: 16 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.922422:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.922424:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.922426:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922439:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147ab8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a279 expref: 16 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.922445:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147ab8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a279 expref: 16 pid: 11461 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.922452:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264070656:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.922474:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc147aba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a28e expref: 29 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.922481:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc147aba9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a28e expref: 29 pid: 11461 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.922492:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264070784:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.922511:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc147aa60 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1e6 expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.922517:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc147aa60 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1e6 expref: 20 pid: 13375 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.922523:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264070912:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.922534:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.922547:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18049 00000100:00100000:2.0:1746065224.922552:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265586304:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065224.922566:0:1880:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922573:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc147aa3d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1c3 expref: 18 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.922579:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc147ab01 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a209 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922584:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc147aad7 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a202 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922588:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.922590:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.922591:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922602:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc147aad7 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a202 expref: 16 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922609:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc147aad7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a202 expref: 16 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.922615:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264071040:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.922633:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc147ab01 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a209 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922639:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc147ab01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a209 expref: 34 pid: 13375 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.922645:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264071168:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.922661:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc147aa3d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1c3 expref: 18 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065224.922667:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc147aa3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1c3 expref: 18 pid: 9548 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.922673:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264071296:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.922682:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5d80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065224.922693:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18050 00000100:00100000:2.0:1746065224.922698:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+20:2004:x1830881265586560:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065224.922710:0:9550:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922718:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922723:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.922724:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065224.922726:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922738:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.922744:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 29 pid: 11461 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.922751:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264071424:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065224.922802:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5f00 going to sleep for 11 seconds 00000100:00100000:1.0:1746065224.923248:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265586816 00000100:00100000:1.0:1746065224.923252:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265586816 00000100:00100000:1.0:1746065224.923271:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18051 00000100:00100000:1.0:1746065224.923275:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+19:2004:x1830881265586816:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065224.923300:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.923309:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a174000/0xad6b7ddc147aa4b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1df expref: 19 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.923315:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147aba2 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a287 expref: 34 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.923320:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147ab94 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a272 expref: 16 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.923324:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.923325:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.923327:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.923340:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147ab94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a272 expref: 16 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.923347:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147ab94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a272 expref: 16 pid: 11461 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746065224.923354:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264071552:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065224.923380:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147aba2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a287 expref: 34 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.923387:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147aba2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a287 expref: 34 pid: 11461 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746065224.923393:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264071680:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065224.923410:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a174000/0xad6b7ddc147aa4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1df expref: 19 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065224.923420:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a174000/0xad6b7ddc147aa4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1df expref: 19 pid: 9548 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746065224.923426:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264071808:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065224.923437:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.928611:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.928671:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265587200 00000100:00100000:3.0:1746065224.928679:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265587200 00000100:00100000:3.0:1746065224.928916:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5538 00000100:00100000:3.0:1746065224.928924:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2690:x1830881265587200:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065224.929083:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2690:x1830881265587200:12345-192.168.202.27@tcp:35:cat.0 Request processed in 159us (479us total) trans 8589937224 rc 0/0 00000100:00100000:3.0:1746065224.929089:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5538 00000100:00100000:3.0:1746065224.932149:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264070400:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.932168:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.932372:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009252b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264070528:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.932384:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.932532:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092528380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264070656:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.932540:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264070784:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.932548:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d28a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264070912:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.932568:0:9548:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.932659:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.932697:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.932725:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.932738:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.932754:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265587584 00000100:00100000:1.0:1746065224.932759:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265587584 00010000:00010000:1.0:1746065224.932797:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc147aa60 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1e6 expref: 21 pid: 13375 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746065224.932814:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265587840 00000100:00100000:1.0:1746065224.932816:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265587840 00010000:00010000:1.0:1746065224.932824:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc147ab01 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a209 expref: 35 pid: 13375 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.932835:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8439 00000100:00100000:1.0:1746065224.932840:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+21:2004:x1830881265587584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.932848:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.932863:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc147aa60 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1e6 expref: 21 pid: 13375 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.932875:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc147aa60 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1e6 expref: 21 pid: 13375 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.932893:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012ef3ca00/0xad6b7ddc147aa60 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1e6 expref: 21 pid: 13375 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.932906:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.932934:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+20:2004:x1830881265587584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.932939:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8439 00000100:00100000:1.0:1746065224.932951:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8440 00000100:00100000:1.0:1746065224.932955:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265587840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.932961:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.932969:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc147ab01 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a209 expref: 35 pid: 13375 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.932976:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc147ab01 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a209 expref: 35 pid: 13375 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.932986:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.932996:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265587840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 41us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.933001:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8440 00000100:00100000:1.0:1746065224.933024:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.933049:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.933057:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265587712 00000100:00100000:1.0:1746065224.933059:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265587712 00010000:00010000:1.0:1746065224.933067:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc147aad7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a202 expref: 17 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:1.0:1746065224.933079:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8441 00000100:00100000:1.0:1746065224.933082:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265587712:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.933087:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.933092:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc147aad7 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a202 expref: 17 pid: 9550 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.933099:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc147aad7 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a202 expref: 17 pid: 9550 timeout: 920 lvb_type: 0 00010000:00010000:1.0:1746065224.933109:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.933118:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265587712:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 36us (69us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.933123:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8441 00000100:00100000:1.0:1746065224.933169:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.933178:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265587968 00000100:00100000:1.0:1746065224.933180:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265587968 00010000:00010000:1.0:1746065224.933188:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc147aa3d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1c3 expref: 20 pid: 9548 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746065224.933198:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8442 00000100:00100000:1.0:1746065224.933202:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+20:2004:x1830881265587968:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.933206:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.933212:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc147aa3d lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1c3 expref: 20 pid: 9548 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.933219:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc147aa3d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1c3 expref: 20 pid: 9548 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.933227:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.933229:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.933232:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.933238:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.933249:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.933259:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+20:2004:x1830881265587968:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 56us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.933263:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8442 00000100:00100000:1.0:1746065224.933304:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.933313:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265588224 00000100:00100000:1.0:1746065224.933316:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265588224 00010000:00010000:1.0:1746065224.933325:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147ab8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a279 expref: 17 pid: 11461 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746065224.933335:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8443 00000100:00100000:1.0:1746065224.933338:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265588224:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.933343:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.933348:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147ab8d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a279 expref: 17 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.933355:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147ab8d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a279 expref: 17 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.933364:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993e200/0xad6b7ddc147ab8d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a279 expref: 17 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.933371:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.933383:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265588224:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 43us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.933388:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8443 00000100:00100000:1.0:1746065224.933433:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264071552:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065224.933502:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264071680:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065224.933524:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264071808:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065224.933538:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065224.933574:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.933582:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265588352 00000100:00100000:1.0:1746065224.933585:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265588352 00010000:00010000:1.0:1746065224.933595:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc147aba9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a28e expref: 30 pid: 11461 timeout: 920 lvb_type: 1 00000100:00100000:1.0:1746065224.933608:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8444 00000100:00100000:1.0:1746065224.933612:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265588352:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065224.933617:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065224.933623:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc147aba9 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a28e expref: 30 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.933630:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc147aba9 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a28e expref: 30 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.933640:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009993f200/0xad6b7ddc147aba9 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a28e expref: 30 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:1.0:1746065224.933647:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.933648:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065224.933650:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.933655:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.933665:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.933678:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265588352:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 66us (105us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.933683:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8444 00010000:00010000:2.0:1746065224.933807:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008d857200/0xad6b7ddc147aad7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a202 expref: 16 pid: 9550 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.933823:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d29500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264071040:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065224.933830:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265587328 00010000:00010000:2.0:1746065224.933831:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d47000/0xad6b7ddc147ab01 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a209 expref: 34 pid: 13375 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746065224.933833:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265587328 00000100:00100000:2.0:1746065224.933837:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264071168:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.933844:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a174a00/0xad6b7ddc147aa3d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1c3 expref: 19 pid: 9548 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.933850:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264071296:192.168.202.27@tcp:104: 00002000:00100000:0.0:1746065224.933856:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1228800->1855487) req@ffff880099ec5180 x1830881265587328/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065224.933863:0:1880:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065224.933863:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5180 with x1830881265587328 ext(1228800->1855487) 00010000:00010000:0.0:1746065224.933868:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 16 pid: 10219 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.933869:0:1880:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.933875:0:1880:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.933876:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 16 pid: 10219 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746065224.933881:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec5180 00010000:00010000:2.0:1746065224.933889:0:1880:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065224.933891:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265587456 00000100:00100000:0.0:1746065224.933893:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265587456 00010000:00010000:2.0:1746065224.933895:0:1880:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065224.933901:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1708031) req@ffff880099ec5c00 x1830881265587456/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00010000:00010000:2.0:1746065224.933905:0:1880:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065224.933907:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5c00 with x1830881265587456 ext(1048576->1708031) 00010000:00010000:2.0:1746065224.933910:0:1880:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880091baf200 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065224.933911:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 34 pid: 1880 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.933913:0:1880:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.933917:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 34 pid: 1880 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.933920:0:1880:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065224.933921:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec5c00 00000100:00100000:0.0:1746065224.933927:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265588096 00010000:00010000:2.0:1746065224.933929:0:1880:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065224.933929:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265588096 00010000:00010000:2.0:1746065224.933934:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091baf200/0xad6b7ddc147ac89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00002000:00100000:0.0:1746065224.933935:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1937408->2097151) req@ffff880099ec4700 x1830881265588096/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/0 e 0 to 0 dl 1746065235 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.933940:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4700 with x1830881265588096 ext(1937408->2097151) 00010000:00010000:0.0:1746065224.933944:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 29 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.933950:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 29 pid: 11461 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746065224.933954:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec4700 00000100:00100000:0.0:1746065224.933962:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2121 00000100:00100000:2.0:1746065224.933966:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265586304:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 11414us (12660us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.933967:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265587328:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065224.933972:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18049 00000100:00100000:2.0:1746065224.933990:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2122 00000100:00100000:2.0:1746065224.933995:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265587456:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:2.0:1746065224.934075:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264071424:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065224.934084:0:9550:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.934104:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2123 00000100:00100000:2.0:1746065224.934851:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265588096:12345-192.168.202.27@tcp:4:cat.0 00010000:00010000:3.0:1746065224.935961:0:9548:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.935971:0:9548:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.935986:0:9548:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.935993:0:9548:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.936000:0:9548:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.936005:0:9548:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065224.936008:0:9548:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.936014:0:9548:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.936027:0:9548:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.936033:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31400/0xad6b7ddc147ac82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065224.936072:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+19:2004:x1830881265586944:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 13689us (14835us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.936079:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18048 00000100:00100000:0.0:1746065224.936741:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.936790:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265588480 00000100:00100000:3.0:1746065224.936797:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265588480 00010000:00010000:3.0:1746065224.936821:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a174000/0xad6b7ddc147aa4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1df expref: 18 pid: 9548 timeout: 920 lvb_type: 1 00000100:00100000:3.0:1746065224.936839:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8445 00000100:00100000:3.0:1746065224.936845:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+18:2007:x1830881265588480:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.936854:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.936865:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a174000/0xad6b7ddc147aa4b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1df expref: 18 pid: 9548 timeout: 920 lvb_type: 1 00010000:00010000:3.0:1746065224.936874:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a174000/0xad6b7ddc147aa4b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1df expref: 18 pid: 9548 timeout: 920 lvb_type: 1 00010000:00010000:3.0:1746065224.936887:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a174000/0xad6b7ddc147aa4b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a1df expref: 18 pid: 9548 timeout: 920 lvb_type: 1 00010000:00010000:3.0:1746065224.936897:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.936917:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+17:2007:x1830881265588480:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 71us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.936922:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8445 00000100:00100000:0.0:1746065224.939942:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.940199:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265588608 00000100:00100000:2.0:1746065224.940206:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265588608 00010000:00010000:2.0:1746065224.940235:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147aba2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a287 expref: 36 pid: 11461 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.940717:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8446 00000100:00100000:2.0:1746065224.940725:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265588608:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.940735:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.940750:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147aba2 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a287 expref: 36 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.940760:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147aba2 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a287 expref: 36 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.940816:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993e600/0xad6b7ddc147aba2 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a287 expref: 36 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.940831:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065224.940849:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264071936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065224.940863:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265588608:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 139us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.940868:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8446 00000100:00100000:1.0:1746065224.940880:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065224.940926:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264071936 00000100:00100000:1.0:1746065224.940929:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264071936 00000100:00100000:1.0:1746065224.940948:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:1.0:1746065224.941359:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3759:x1830881264071936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1746065224.941374:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 1073305920 pending 4935680 free 3906572288 avail 3675049984 00000100:00100000:1.0:1746065224.941402:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+59:3759:x1830881264071936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.942242:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264071936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1746065224.942310:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1746065224.946058:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.946257:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265588736 00000100:00100000:2.0:1746065224.946264:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265588736 00010000:00010000:2.0:1746065224.946299:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147ab94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a272 expref: 16 pid: 11461 timeout: 920 lvb_type: 1 00000100:00100000:2.0:1746065224.946324:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8447 00000100:00100000:2.0:1746065224.946331:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265588736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.946341:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.946356:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147ab94 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a272 expref: 16 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.946367:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147ab94 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a272 expref: 16 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.946386:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009993e400/0xad6b7ddc147ab94 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a272 expref: 16 pid: 11461 timeout: 920 lvb_type: 1 00010000:00010000:2.0:1746065224.946398:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.946400:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.946404:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.946410:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.946429:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.946462:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265588736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 132us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.946471:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8447 00010000:00010000:0.0:1746065224.946981:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.946990:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.947005:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.947011:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.947017:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.947023:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800a656ee00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065224.947026:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.947036:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.947046:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065224.947052:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147ac97 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065224.950133:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265586816:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 26850us (27930us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.950144:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18051 00000100:00100000:0.0:1746065224.954907:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265587328:12345-192.168.202.27@tcp:4:cat.0 Request processed in 20928us (22238us total) trans 21474841789 rc 0/0 00000100:00100000:0.0:1746065224.954918:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2121 00002000:00100000:0.0:1746065224.954929:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1228800->1855487) req@ffff880099ec5180 x1830881265587328/t21474841789(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:140/0 lens 488/448 e 0 to 0 dl 1746065235 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065224.954938:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5180 with x1830881265587328 ext(1228800->1855487) 00010000:00010000:0.0:1746065224.954947:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 18 pid: 10219 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.954959:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 18 pid: 10219 timeout: 920 lvb_type: 0 00002000:00010000:0.0:1746065224.954965:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec5180 00000100:00100000:0.0:1746065224.960276:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065224.960350:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265588864 00000100:00100000:2.0:1746065224.960358:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265588864 00010000:00010000:2.0:1746065224.960386:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 18 pid: 10219 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.960425:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8448 00000100:00100000:2.0:1746065224.960432:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265588864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.960442:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.960458:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 18 pid: 10219 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.960468:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 18 pid: 10219 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.960488:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099c31a00/0xad6b7ddc147ab78 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1228800->1855487) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a25d expref: 18 pid: 10219 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.960503:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.960505:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065224.960509:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.960516:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.960535:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.960571:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137709c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2004:x1830881265588864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 140us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.960578:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8448 00010000:00010000:2.0:1746065224.960676:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.960682:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.960696:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.960702:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.960708:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.960713:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06800 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065224.960716:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.960722:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.960731:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.960741:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d06800/0xad6b7ddc147ac74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.960794:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265586432:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 39220us (39764us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.960802:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18046 00000100:00100000:3.0:1746065224.963597:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265588096:12345-192.168.202.27@tcp:4:cat.0 Request processed in 29480us (30564us total) trans 21474841790 rc 0/0 00000100:00100000:3.0:1746065224.963610:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2123 00002000:00100000:3.0:1746065224.963619:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1937408->2097151) req@ffff880099ec4700 x1830881265588096/t21474841790(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/448 e 0 to 0 dl 1746065235 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065224.963631:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec4700 with x1830881265588096 ext(1937408->2097151) 00010000:00010000:3.0:1746065224.963640:0:29488:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.963650:0:29488:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00002000:00010000:3.0:1746065224.963656:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880099ec4700 00000100:00100000:2.0:1746065224.964151:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265587456:12345-192.168.202.27@tcp:4:cat.0 Request processed in 30153us (31450us total) trans 17179874412 rc 0/0 00000100:00100000:2.0:1746065224.964158:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2122 00002000:00100000:2.0:1746065224.964163:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1708031) req@ffff880099ec5c00 x1830881265587456/t17179874412(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:140/0 lens 488/448 e 0 to 0 dl 1746065235 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065224.964322:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099ec5c00 with x1830881265587456 ext(1048576->1708031) 00010000:00010000:2.0:1746065224.964330:0:13378:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 35 pid: 1880 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.964338:0:13378:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 35 pid: 1880 timeout: 920 lvb_type: 0 00002000:00010000:2.0:1746065224.964344:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099ec5c00 00000100:00100000:0.0:1746065224.966577:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.966634:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265588992 00000100:00100000:3.0:1746065224.966644:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265588992 00010000:00010000:3.0:1746065224.966670:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.966727:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8449 00000100:00100000:3.0:1746065224.966733:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265588992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.966746:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.966762:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.966799:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.966819:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abaca00/0xad6b7ddc147abcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1937408->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a29c expref: 31 pid: 11461 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.966839:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.966841:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.966845:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.966857:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.966876:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.966919:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265588992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 186us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.966924:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8449 00010000:00010000:2.0:1746065224.967299:0:9550:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.967311:0:9550:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.967331:0:9550:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.967338:0:9550:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.967344:0:9550:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.967349:0:9550:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129fe9000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065224.967352:0:9550:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.967358:0:9550:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.967368:0:9550:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.967373:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129fe9000/0xad6b7ddc147ac90 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.967411:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265586560:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 44712us (46009us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.967418:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18050 00000100:00100000:0.0:1746065224.967964:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.968402:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265589120 00000100:00100000:3.0:1746065224.968407:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265589120 00010000:00010000:3.0:1746065224.968427:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 35 pid: 1880 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.968458:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8450 00000100:00100000:3.0:1746065224.968464:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265589120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065224.968472:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.968485:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 35 pid: 1880 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.968493:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 35 pid: 1880 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.968507:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880099d07e00/0xad6b7ddc147abe1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1708031) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2b8 expref: 35 pid: 1880 timeout: 920 lvb_type: 0 00010000:00010000:3.0:1746065224.968516:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.968519:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065224.968522:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.968528:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.968543:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065224.968576:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265589120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 112us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065224.968581:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8450 00010000:00010000:2.0:1746065224.968706:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.968714:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.968726:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.968733:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.968743:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.968747:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065224.968750:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.968755:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.968764:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065224.968769:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31a00/0xad6b7ddc147ac7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065224.968826:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:02506576-29fe-43be-8266-ebca0ccafd52+15:2004:x1830881265586688:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 46566us (47631us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.968834:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18047 00000100:00100000:0.0:1746065224.970875:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.970931:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265589376 00000100:00100000:3.0:1746065224.970936:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265589376 00000100:00100000:3.0:1746065224.971051:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14697 00000100:00100000:3.0:1746065224.971059:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+10:2693:x1830881265589376:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:3.0:1746065224.971101:0:7203:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065224.971118:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a600/0xad6b7ddc147ac19 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a2d4 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.971131:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.971134:0:7203:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065224.971154:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.971163:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a241 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.971169:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.971179:0:7203:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 28 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.971184:0:7203:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 6/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.971207:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 28 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.971216:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 28 pid: 13395 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.971227:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264072064:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.972414:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.972425:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 10 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.972433:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264072192:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.972475:0:7203:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a241 expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065224.972482:0:7203:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a241 expref: 10 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:3.0:1746065224.972492:0:7203:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264072320:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065224.972509:0:7203:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065224.975499:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264072064:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065224.975564:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.975605:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265589504 00000100:00100000:0.0:1746065224.975610:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265589504 00010000:00010000:0.0:1746065224.975635:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 29 pid: 13395 timeout: 920 lvb_type: 0 00000100:00100000:0.0:1746065224.975665:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8451 00000100:00100000:0.0:1746065224.975672:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265589504:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065224.975682:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065224.975686:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 29 pid: 13395 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.975696:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 29 pid: 13395 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.975714:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009835d800/0xad6b7ddc147ab71 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a256 expref: 29 pid: 13395 timeout: 920 lvb_type: 0 00010000:00010000:0.0:1746065224.975736:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065224.975740:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065224.975748:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065224.975798:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265589504:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 127us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065224.975805:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8451 00000100:00100000:3.0:1746065224.976296:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264072320:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065224.976984:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065224.979556:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.979770:0:7203:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:7203:1830881264072192:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065224.979812:0:7203:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000100:00100000:2.0:1746065224.980076:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265589632 00000100:00100000:2.0:1746065224.980082:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265589632 00010000:00010000:2.0:1746065224.980106:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a241 expref: 11 pid: 7203 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.980124:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265589760 00000100:00100000:2.0:1746065224.980126:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265589760 00010000:00010000:2.0:1746065224.980133:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 12 pid: 7231 timeout: 920 lvb_type: 0 00000100:00100000:2.0:1746065224.980156:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8452 00000100:00100000:2.0:1746065224.980162:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+12:2004:x1830881265589632:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.980173:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.980178:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a241 expref: 12 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.980186:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a241 expref: 12 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.980203:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147ab5c lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a241 expref: 12 pid: 7203 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.980216:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065224.980220:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.980226:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.980258:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2004:x1830881265589632:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 96us (3276us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.980264:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8452 00000100:00100000:2.0:1746065224.980286:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8453 00000100:00100000:2.0:1746065224.980295:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2007:x1830881265589760:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.980300:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.980304:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 10 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.980312:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 10 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.980326:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6d800/0xad6b7ddc147ab63 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a248 expref: 10 pid: 7231 timeout: 920 lvb_type: 0 00010000:00010000:2.0:1746065224.980333:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065224.980336:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.980342:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.980348:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7203 initiator: MDT0 00010000:00010000:2.0:1746065224.980371:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.980386:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265589760:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.980392:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8453 00010000:00010000:3.0:1746065224.980505:0:7203:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.980511:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000040:00080000:3.0:1746065224.980702:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1147, 88 off108784 00000004:00080000:3.0:1746065224.980706:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820998932409ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.980741:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1153, 88 off109312 00000004:00080000:3.0:1746065224.980744:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820998970405ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.980769:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1154, 88 off109400 00000004:00080000:3.0:1746065224.980797:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820999022953ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.980818:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1148, 88 off108872 00000004:00080000:3.0:1746065224.980821:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820999047649ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.980834:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1149, 88 off108960 00000004:00080000:3.0:1746065224.980837:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820999063139ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.980849:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1155, 88 off109488 00000004:00080000:3.0:1746065224.980851:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820999077640ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.980865:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1156, 88 off109576 00000004:00080000:3.0:1746065224.980868:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820999094554ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.980881:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1157, 88 off109664 00000004:00080000:3.0:1746065224.980884:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820999110303ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.980897:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1150, 88 off109048 00000004:00080000:3.0:1746065224.980900:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820999126126ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.980910:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1158, 88 off109752 00000004:00080000:3.0:1746065224.980913:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820999139113ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.980919:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1151, 88 off109136 00000004:00080000:3.0:1746065224.980931:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820999157171ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.980948:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1159, 88 off109840 00000004:00080000:3.0:1746065224.980950:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820999176940ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065224.980960:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1152, 88 off109224 00000004:00080000:3.0:1746065224.980962:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820999188030ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.980970:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1153, 88 off109312 00000004:00080000:3.0:1746065224.980973:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820999199085ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.980981:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1154, 88 off109400 00000004:00080000:3.0:1746065224.980983:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820999209826ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.980992:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1155, 88 off109488 00000004:00080000:3.0:1746065224.980994:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 820999220780ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065224.981003:0:7203:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1160, 88 off109928 00000004:00080000:3.0:1746065224.981005:0:7203:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 820999231593ns, next at 761143559853ns, rc = 0 00000001:00080000:0.0:1746065224.984835:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937225 is committed 00000004:00080000:0.0:1746065224.984845:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1138 committed 00000004:00080000:0.0:1746065224.984860:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1135 committed 00000004:00080000:0.0:1746065224.984865:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1134 committed 00000004:00080000:0.0:1746065224.984867:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1133 committed 00000004:00080000:0.0:1746065224.984868:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1132 committed 00000004:00080000:0.0:1746065224.984869:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1137 committed 00000004:00080000:0.0:1746065224.984871:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1131 committed 00000004:00080000:0.0:1746065224.984872:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1136 committed 00000004:00080000:0.0:1746065224.984880:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1130 committed 00000004:00080000:0.0:1746065224.984882:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1135 committed 00000004:00080000:0.0:1746065224.984883:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1134 committed 00000004:00080000:0.0:1746065224.984884:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1133 committed 00000004:00080000:0.0:1746065224.984886:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1129 committed 00000004:00080000:0.0:1746065224.984887:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1128 committed 00000004:00080000:0.0:1746065224.984888:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1132 committed 00000004:00080000:0.0:1746065224.984889:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1131 committed 00000004:00080000:0.0:1746065224.984891:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1127 committed 00000001:00080000:0.0:1746065224.984894:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937224 is committed 00000001:00080000:0.0:1746065224.984897:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937223 is committed 00000100:00100000:3.0:1746065224.985485:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264072704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.985485:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264072448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.985558:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.985596:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264072960:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.985611:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.985622:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264073472:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.985635:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.985646:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264073984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.985657:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.985672:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:2.0:1746065224.985675:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264072832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.985686:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.985695:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264073344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.985705:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.985715:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264073856:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.985728:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.985738:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264074368:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.985749:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065224.985787:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264072448 00000100:00100000:1.0:1746065224.985793:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264072448 00000100:00100000:1.0:1746065224.985823:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264072960 00000100:00100000:1.0:1746065224.985825:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264072960 00000100:00100000:1.0:1746065224.985838:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264073472 00000100:00100000:1.0:1746065224.985840:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264073472 00000100:00100000:1.0:1746065224.985848:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264073984 00000100:00100000:1.0:1746065224.985849:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264073984 00000100:00100000:1.0:1746065224.985854:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264072832 00000100:00100000:1.0:1746065224.985856:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264072832 00000100:00100000:1.0:1746065224.985860:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264073344 00000100:00100000:1.0:1746065224.985861:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264073344 00000100:00100000:1.0:1746065224.985865:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264073856 00000100:00100000:1.0:1746065224.985866:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264073856 00000100:00100000:1.0:1746065224.985870:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264072704 00000100:00100000:1.0:1746065224.985871:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264072704 00000100:00100000:1.0:1746065224.985879:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18052 00000100:00100000:1.0:1746065224.985883:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+63:3760:x1830881264072448:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.986027:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.986028:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264073216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.986042:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.986045:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264072576:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.986048:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264073728:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.986058:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.986065:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264074368 00000100:00100000:3.0:1746065224.986067:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264074368 00000100:00100000:2.0:1746065224.986069:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264073088:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.986078:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264073216 00000100:00100000:3.0:1746065224.986080:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264073216 00000100:00100000:2.0:1746065224.986081:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.986086:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264072576 00000100:00100000:3.0:1746065224.986087:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264072576 00000100:00100000:2.0:1746065224.986087:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264073600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.986093:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264073088 00000100:00100000:3.0:1746065224.986094:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264073088 00000100:00100000:2.0:1746065224.986098:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065224.986100:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18053 00000100:00100000:3.0:1746065224.986104:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3760:x1830881264072960:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.986104:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264074112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.986116:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.986131:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264073600 00000100:00100000:2.0:1746065224.986133:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264073600 00000100:00100000:2.0:1746065224.986144:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264074112 00000100:00100000:2.0:1746065224.986145:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264074112 00002000:00010000:3.0:1746065224.986150:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1746065224.986152:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00000100:00100000:2.0:1746065224.986152:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18054 00002000:00010000:3.0:1746065224.986154:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:2.0:1746065224.986155:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3760:x1830881264073472:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065224.986156:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.986158:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1746065224.986180:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3760:x1830881264072960:12345-0@lo:2:osp-syn-1-0.0 Request processed in 75us (568us total) trans 17179874414 rc 0/0 00000100:00100000:3.0:1746065224.986185:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18053 00000100:00100000:3.0:1746065224.986199:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18055 00000100:00100000:3.0:1746065224.986202:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3760:x1830881264073984:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.986222:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3760:x1830881264073472:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (585us total) trans 21474841791 rc 0/0 00000100:00100000:2.0:1746065224.986227:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18054 00000100:00100000:2.0:1746065224.986236:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18056 00002000:00010000:3.0:1746065224.986237:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:3.0:1746065224.986239:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00000100:00100000:2.0:1746065224.986240:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3760:x1830881264072832:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065224.986241:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.986242:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065224.986244:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:3.0:1746065224.986260:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3760:x1830881264073984:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (601us total) trans 21474841792 rc 0/0 00000100:00100000:3.0:1746065224.986264:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18055 00000100:00100000:3.0:1746065224.986273:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18057 00000100:00100000:3.0:1746065224.986288:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3760:x1830881264073344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.986294:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3760:x1830881264072832:12345-0@lo:2:osp-syn-1-0.0 Request processed in 54us (606us total) trans 17179874415 rc 0/0 00000100:00100000:2.0:1746065224.986298:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18056 00000100:00100000:2.0:1746065224.986307:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18058 00000100:00100000:2.0:1746065224.986312:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3760:x1830881264073856:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065224.986347:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065224.986349:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065224.986351:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.986352:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065224.986354:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00002000:00010000:3.0:1746065224.986416:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:3.0:1746065224.986418:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065224.986420:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.986421:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065224.986423:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:2.0:1746065224.986730:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3760:x1830881264073856:12345-0@lo:2:osp-syn-0-0.0 Request processed in 416us (999us total) trans 21474841793 rc 0/0 00000100:00100000:3.0:1746065224.986733:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3760:x1830881264073344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 457us (1027us total) trans 17179874416 rc 0/0 00000100:00100000:2.0:1746065224.986735:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18058 00000100:00100000:3.0:1746065224.986738:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18057 00000100:00100000:3.0:1746065224.986745:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18059 00000100:00100000:3.0:1746065224.986749:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3762:x1830881264072704:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.986752:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18060 00000100:00100000:2.0:1746065224.986756:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3760:x1830881264074368:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.986815:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3762:x1830881264072704:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (1065us total) trans 17179874417 rc 0/0 00000100:00100000:2.0:1746065224.986815:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3760:x1830881264074368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 59us (788us total) trans 21474841794 rc 0/0 00000100:00100000:3.0:1746065224.986819:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18059 00000100:00100000:2.0:1746065224.986821:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18060 00000100:00100000:3.0:1746065224.986828:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18061 00000100:00100000:2.0:1746065224.986830:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18062 00000100:00100000:3.0:1746065224.986831:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+67:3762:x1830881264073216:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.986833:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3761:x1830881264072576:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065224.986876:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1c00/2, rc 0, transno 17179874415 00000100:00100000:2.0:1746065224.986881:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+69:3761:x1830881264072576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (821us total) trans 17179874418 rc 0/0 00000100:00100000:3.0:1746065224.986883:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264072832:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.986885:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18062 00000004:00080000:3.0:1746065224.986889:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d29500/2, rc 0, transno 17179874416 00000100:00100000:3.0:1746065224.986892:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264073344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.986894:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18063 00000100:00100000:2.0:1746065224.986897:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+68:3761:x1830881264073088:12345-0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065224.986898:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f3b80/2, rc 0, transno 21474841793 00000100:00100000:3.0:1746065224.986901:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264073856:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065224.986906:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bf800/2, rc 0, transno 21474841794 00000100:00100000:3.0:1746065224.986908:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264074368:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065224.986914:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f2a00/2, rc 0, transno 17179874414 00000100:00100000:3.0:1746065224.986917:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264072960:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065224.986922:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d28a80/2, rc 0, transno 21474841791 00000100:00100000:3.0:1746065224.986924:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264073472:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065224.986930:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f0e00/2, rc 0, transno 21474841792 00000100:00100000:3.0:1746065224.986932:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264073984:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.986941:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+69:3761:x1830881264073088:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (859us total) trans 17179874420 rc 0/0 00000100:00100000:2.0:1746065224.986945:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18063 00000100:00100000:2.0:1746065224.986952:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18064 00000100:00100000:2.0:1746065224.986956:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3761:x1830881264073600:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.986963:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264074496:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.986981:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.987001:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3761:x1830881264073600:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (902us total) trans 21474841795 rc 0/0 00000100:00100000:2.0:1746065224.987006:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18064 00002000:00010000:3.0:1746065224.987010:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065224.987013:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00000100:00100000:2.0:1746065224.987014:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264074496 00002000:00010000:3.0:1746065224.987015:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065224.987016:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00000100:00100000:2.0:1746065224.987016:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264074496 00002000:00010000:3.0:1746065224.987018:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:2.0:1746065224.987024:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18065 00000100:00100000:2.0:1746065224.987027:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009856ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+66:3761:x1830881264074112:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.987032:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:3762:x1830881264073216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 201us (989us total) trans 17179874419 rc 0/0 00000100:00100000:3.0:1746065224.987036:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18061 00000100:00100000:3.0:1746065224.987044:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18066 00000100:00100000:3.0:1746065224.987048:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3760:x1830881264074496:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065224.987061:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:2.0:1746065224.987063:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:2.0:1746065224.987064:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065224.987067:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:2.0:1746065224.987068:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:2.0:1746065224.987085:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009856ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+67:3761:x1830881264074112:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (968us total) trans 21474841796 rc 0/0 00000100:00100000:3.0:1746065224.987090:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+69:3760:x1830881264074496:12345-0@lo:2:osp-syn-1-0.0 Request processed in 42us (109us total) trans 17179874421 rc 0/0 00000100:00100000:2.0:1746065224.987090:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18065 00000100:00100000:3.0:1746065224.987094:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18066 00000004:00080000:3.0:1746065224.987109:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098ddb100/2, rc 0, transno 17179874421 00000004:00080000:2.0:1746065224.987110:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1180/2, rc 0, transno 17179874418 00000100:00100000:3.0:1746065224.987112:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264074496:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.987112:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264072576:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065224.987118:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3b80/2, rc 0, transno 17179874420 00000100:00100000:3.0:1746065224.987120:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.987120:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264073088:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065224.987127:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d2b800/2, rc 0, transno 21474841795 00000100:00100000:2.0:1746065224.987129:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264073600:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.987131:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264074240:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065224.987134:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bfb80/2, rc 0, transno 21474841796 00000100:00100000:2.0:1746065224.987136:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264074112:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065224.987145:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264073728 00000100:00100000:3.0:1746065224.987146:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065224.987147:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264073728 00000100:00100000:2.0:1746065224.987158:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264074240 00000004:00080000:3.0:1746065224.987160:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f0a80/2, rc 0, transno 17179874417 00000100:00100000:2.0:1746065224.987160:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264074240 00000100:00100000:3.0:1746065224.987163:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264072704:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065224.987167:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18067 00000004:00080000:3.0:1746065224.987168:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1f80/2, rc 0, transno 17179874419 00000100:00100000:2.0:1746065224.987170:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+68:3762:x1830881264073728:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.987171:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264073216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.987181:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18068 00000100:00100000:3.0:1746065224.987185:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+68:3762:x1830881264074240:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065224.987222:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+70:3762:x1830881264074240:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (76us total) trans 21474841798 rc 0/0 00000100:00100000:2.0:1746065224.987222:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+70:3762:x1830881264073728:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (101us total) trans 21474841797 rc 0/0 00000100:00100000:2.0:1746065224.987226:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18067 00000100:00100000:3.0:1746065224.987228:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18068 00000004:00080000:3.0:1746065224.987242:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800900f0000/2, rc 0, transno 21474841797 00000100:00100000:3.0:1746065224.987244:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800900f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264073728:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065224.987250:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff8800907bf480/2, rc 0, transno 21474841798 00000100:00100000:3.0:1746065224.987252:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff8800907bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264074240:0@lo:2:osp-syn-0-0.0 00000004:00010000:3.0:1746065224.987291:0:7203:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880097a6f800 reply state ffff88009a574000 transno 8589937225 ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.987307:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.987314:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.987675:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065224.987681:0:7203:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:3.0:1746065224.987741:0:7203:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065224.987752:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2693:x1830881265589376:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 16693us (16881us total) trans 8589937225 rc 0/0 00000100:00100000:3.0:1746065224.987758:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14697 00010000:00010000:3.0:1746065224.987796:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.987803:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.987808:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.987813:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065224.987816:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.987821:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.987830:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065224.987832:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065224.987834:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00010000:00010000:3.0:1746065224.987839:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ac9e lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7203 initiator: MDT0 00000100:00100000:1.0:1746065224.987942:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+68:3760:x1830881264072448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2058us (2384us total) trans 17179874413 rc 0/0 00000100:00100000:1.0:1746065224.987948:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18052 00000004:00080000:3.0:1746065224.988098:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1500/2, rc 0, transno 17179874413 00000100:00100000:3.0:1746065224.988102:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264072448:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065224.990528:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065224.990592:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.990833:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265589888 00000100:00100000:1.0:1746065224.990840:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265589888 00000100:00100000:1.0:1746065224.990873:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265590144 00000100:00100000:1.0:1746065224.990875:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265590144 00000100:00100000:1.0:1746065224.990890:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14698 00000100:00100000:1.0:1746065224.990895:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2693:x1830881265589888:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065224.990912:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065224.990925:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc147aca5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a321 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.990966:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc147aca5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a321 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.990975:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc147aca5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a321 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.990987:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.990990:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065224.990992:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009d358600, rc 0) 00000100:00100000:1.0:1746065224.991020:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2693:x1830881265589888:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 126us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065224.991025:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14698 00000100:00100000:1.0:1746065224.991037:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14699 00000100:00100000:1.0:1746065224.991041:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2699:x1830881265590144:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065224.991049:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065224.991054:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147acac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a328 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.991094:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc147acb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.991101:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc147acb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.991107:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc147acb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.991118:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.991122:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.991127:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.991197:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.991205:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ac66 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a31a expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.991211:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.991231:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ac66 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a31a expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.991239:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ac66 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a31a expref: 7 pid: 7203 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065224.991248:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099ec7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264074624:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065224.991296:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065224.993691:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.993822:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099ec7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264074624:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065224.993841:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:2.0:1746065224.994014:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265590272 00000100:00100000:2.0:1746065224.994019:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265590272 00010000:00010000:2.0:1746065224.994043:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ac66 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a31a expref: 8 pid: 7203 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065224.994067:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8454 00000100:00100000:2.0:1746065224.994073:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2006:x1830881265590272:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065224.994084:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065224.994088:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ac66 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a31a expref: 8 pid: 7203 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065224.994097:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ac66 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a31a expref: 8 pid: 7203 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065224.994113:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ac66 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a31a expref: 8 pid: 7203 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065224.994125:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065224.994128:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065224.994135:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065224.994140:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065224.994153:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065224.994190:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+7:2006:x1830881265590272:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065224.994195:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8454 00010000:00010000:1.0:1746065224.994437:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994443:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065224.994455:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:1.0:1746065224.994526:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994532:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994537:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994541:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065224.994544:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994549:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994556:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065224.994558:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065224.994560:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 2/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994564:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147acc1 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994592:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc147acb3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994600:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc147acb3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994604:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc147acb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994608:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc147acb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994612:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012f877000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065224.994614:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc147acb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994618:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc147acb3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994624:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065224.994626:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065224.994628:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc147acb3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994632:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012f877000/0xad6b7ddc147acb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994639:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994643:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994647:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994651:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065224.994653:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994657:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994662:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800929fd900) 00010000:00010000:1.0:1746065224.994663:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065224.994665:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994669:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065224.994702:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147acac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a328 expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.994708:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800906d0a00/0xad6b7ddc147acac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a328 expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065224.994715:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906d0a00, rc 0) 00000100:00100000:1.0:1746065224.994736:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2699:x1830881265590144:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3694us (4144us total) trans 8589937226 rc 301/301 00000100:00100000:1.0:1746065224.994741:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14699 00000100:00100000:0.0:1746065224.994954:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065224.995182:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265590528 00000100:00100000:1.0:1746065224.995186:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265590528 00000100:00100000:1.0:1746065224.995328:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5539 00000100:00100000:1.0:1746065224.995335:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4299450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2693:x1830881265590528:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065224.996116:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4299450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2693:x1830881265590528:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 779us (1160us total) trans 8589937227 rc 0/0 00000100:00100000:1.0:1746065224.996127:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5539 00000100:00100000:0.0:1746065225.002812:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.004334:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265590784 00000100:00100000:1.0:1746065225.004343:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265590784 00000100:00100000:1.0:1746065225.004381:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5540 00000100:00100000:1.0:1746065225.004387:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2693:x1830881265590784:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065225.004552:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2693:x1830881265590784:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 164us (1746us total) trans 8589937228 rc 0/0 00000100:00100000:1.0:1746065225.004558:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5540 00000100:00080000:3.0:1746065225.005135:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065225.024910:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.024976:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265591040 00000100:00100000:1.0:1746065225.024984:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265591040 00000100:00100000:1.0:1746065225.025053:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14700 00000100:00100000:1.0:1746065225.025061:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2702:x1830881265591040:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065225.025079:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.025094:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc147accf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a32f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.025146:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc147acd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025157:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc147acd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025166:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc147acd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025178:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025183:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025188:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025264:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147ace4 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025271:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147ace4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025287:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147ace4 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065225.025295:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:1.0:1746065225.025355:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc147acd6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025361:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc147acd6 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025367:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc147acd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025372:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc147acd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025377:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c539e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065225.025380:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc147acd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025386:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc147acd6 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025395:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065225.025398:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065225.025402:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc147acd6 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025407:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539e00/0xad6b7ddc147acd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025434:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025439:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acdd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025444:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025448:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c538600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065225.025450:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025454:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acdd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025460:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff88009554f900) 00010000:00010000:1.0:1746065225.025462:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065225.025464:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acdd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025469:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538600/0xad6b7ddc147acdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.025497:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c539800/0xad6b7ddc147accf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a32f expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.025507:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147ace4 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a32f expref: 28 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.025513:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065225.025515:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065225.025517:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538800, rc 0) 00000100:00100000:1.0:1746065225.025550:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2702:x1830881265591040:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 490us (648us total) trans 8589937229 rc 0/0 00000100:00100000:1.0:1746065225.025557:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14700 00000100:00080000:3.0:1746065225.025743:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065225.082680:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.089576:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265591296 00000100:00100000:2.0:1746065225.089597:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265591296 00000100:00100000:2.0:1746065225.089694:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14701 00000100:00100000:2.0:1746065225.089717:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2702:x1830881265591296:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065225.089748:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.089751:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065225.089814:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c538800/0xad6b7ddc147ace4 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a32f expref: 28 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.089851:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.089857:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065225.089871:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4600/0xad6b7ddc147acf2 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a336 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.089932:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.089948:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc147aca5 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a321 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.089955:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 4/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.089991:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc147aca5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a321 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.090005:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc147aca5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a321 expref: 8 pid: 7204 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.090017:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264074752:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.090163:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5d80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.097118:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.097263:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264074752:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.097299:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:1.0:1746065225.097393:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265591424 00000100:00100000:1.0:1746065225.097401:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265591424 00010000:00010000:1.0:1746065225.097432:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc147aca5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a321 expref: 9 pid: 7204 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.097772:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8455 00000100:00100000:1.0:1746065225.097947:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265591424:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065225.097963:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065225.097971:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc147aca5 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a321 expref: 9 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.097982:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc147aca5 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a321 expref: 9 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.098002:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009d358600/0xad6b7ddc147aca5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a321 expref: 9 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.099612:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065225.099622:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065225.099636:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065225.099643:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.101170:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.101180:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000040:00080000:2.0:1746065225.101445:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1156, 88 off109576 00000004:00080000:2.0:1746065225.101455:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821119680496ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065225.101510:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1161, 88 off110016 00000004:00080000:2.0:1746065225.101518:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821119744581ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065225.101539:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1162, 88 off110104 00000004:00080000:2.0:1746065225.101543:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821119769489ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065225.101556:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1157, 88 off109664 00000004:00080000:2.0:1746065225.101560:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821119786481ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065225.101571:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1158, 88 off109752 00000004:00080000:2.0:1746065225.101575:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821119801446ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065225.101586:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1163, 88 off110192 00000004:00080000:2.0:1746065225.101589:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821119815374ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065225.101598:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1164, 88 off110280 00000004:00080000:2.0:1746065225.101601:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821119827926ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065225.101610:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1165, 88 off110368 00000004:00080000:2.0:1746065225.101613:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821119839603ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065225.101624:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1159, 88 off109840 00000004:00080000:2.0:1746065225.101627:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821119853296ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065225.101637:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1166, 88 off110456 00000004:00080000:2.0:1746065225.101641:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821119867683ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065225.101652:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1160, 88 off109928 00000004:00080000:2.0:1746065225.101655:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821119881259ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065225.101665:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1167, 88 off110544 00000004:00080000:2.0:1746065225.101668:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821119894296ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065225.101677:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1161, 88 off110016 00000004:00080000:2.0:1746065225.101681:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821119907081ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065225.101691:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1162, 88 off110104 00000004:00080000:2.0:1746065225.101694:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821119920133ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065225.101703:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1163, 88 off110192 00000004:00080000:2.0:1746065225.101707:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821119933889ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065225.101718:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1164, 88 off110280 00000004:00080000:2.0:1746065225.101722:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 821119947992ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065225.101878:0:7205:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1168, 88 off110632 00000004:00080000:2.0:1746065225.101884:0:7205:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 821120110839ns, next at 761143559853ns, rc = 0 00010000:00010000:1.0:1746065225.106454:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065225.106534:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2004:x1830881265591424:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 8583us (9416us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.106546:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8455 00000001:00080000:2.0:1746065225.108021:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937230 is committed 00000004:00080000:2.0:1746065225.108027:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1146 committed 00000004:00080000:2.0:1746065225.108041:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1144 committed 00000004:00080000:2.0:1746065225.108050:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1143 committed 00000004:00080000:2.0:1746065225.108052:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1142 committed 00000004:00080000:2.0:1746065225.108053:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1141 committed 00000004:00080000:2.0:1746065225.108054:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1145 committed 00000004:00080000:2.0:1746065225.108056:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1140 committed 00000004:00080000:2.0:1746065225.108057:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1144 committed 00000004:00080000:2.0:1746065225.108058:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1139 committed 00000004:00080000:2.0:1746065225.108059:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1143 committed 00000004:00080000:2.0:1746065225.108060:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1142 committed 00000004:00080000:2.0:1746065225.108061:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1141 committed 00000004:00080000:2.0:1746065225.108062:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1138 committed 00000004:00080000:2.0:1746065225.108064:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1137 committed 00000004:00080000:2.0:1746065225.108066:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1140 committed 00000004:00080000:2.0:1746065225.108067:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1139 committed 00000004:00080000:2.0:1746065225.108068:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1136 committed 00000001:00080000:2.0:1746065225.108073:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937228 is committed 00000001:00080000:2.0:1746065225.108077:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937226 is committed 00010000:00010000:2.0:1746065225.108124:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a336 expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.108134:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.108137:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065225.108149:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa4600/0xad6b7ddc147acf2 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a336 expref: 28 pid: 7205 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065225.108160:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a336 expref: 27 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.108183:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.108184:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065225.108186:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097aa5800, rc 0) 00000100:00100000:2.0:1746065225.108227:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2702:x1830881265591296:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 18525us (25563us total) trans 8589937230 rc 0/0 00000100:00100000:2.0:1746065225.108233:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14701 00000100:00100000:2.0:1746065225.108339:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264074880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.108372:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.108406:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264075136:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.108421:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.108439:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264074880 00000100:00100000:2.0:1746065225.108445:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264074880 00000100:00100000:2.0:1746065225.108473:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264075136 00000100:00100000:2.0:1746065225.108475:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264075136 00000100:00100000:2.0:1746065225.108487:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18069 00000100:00100000:2.0:1746065225.108492:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3761:x1830881264074880:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.108597:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+70:3761:x1830881264074880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 105us (225us total) trans 17179874422 rc 0/0 00000100:00100000:2.0:1746065225.108602:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18069 00000100:00100000:2.0:1746065225.108611:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18070 00000100:00100000:2.0:1746065225.108615:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+69:3759:x1830881264075136:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.108657:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+70:3759:x1830881264075136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (234us total) trans 17179874423 rc 0/0 00000100:00100000:2.0:1746065225.108661:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18070 00000100:00100000:2.0:1746065225.108679:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264075008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.108693:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.108703:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264075264:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.108713:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.108720:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264075008 00000100:00100000:2.0:1746065225.108722:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264075008 00000100:00100000:2.0:1746065225.108731:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264075264 00000100:00100000:2.0:1746065225.108733:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264075264 00000100:00100000:2.0:1746065225.108740:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18071 00000100:00100000:2.0:1746065225.108744:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+71:3762:x1830881264075008:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.108805:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3762:x1830881264075008:12345-0@lo:2:osp-syn-1-0.0 Request processed in 60us (111us total) trans 17179874424 rc 0/0 00000100:00100000:2.0:1746065225.108809:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18071 00000100:00100000:2.0:1746065225.108816:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18072 00000100:00100000:2.0:1746065225.108820:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+71:3760:x1830881264075264:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.108857:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+72:3760:x1830881264075264:12345-0@lo:2:osp-syn-1-0.0 Request processed in 37us (144us total) trans 17179874425 rc 0/0 00000100:00100000:2.0:1746065225.108861:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18072 00000004:00080000:2.0:1746065225.114841:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856ed80/2, rc 0, transno 17179874422 00000100:00100000:2.0:1746065225.114855:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264074880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.114864:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264075392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.114907:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.114964:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264075904:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065225.114984:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.114997:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264076416:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065225.115010:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.115022:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1746065225.115027:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264076032:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065225.115040:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.115052:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264076544:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065225.115066:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.115088:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264075392 00000100:00100000:2.0:1746065225.115092:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264075392 00000100:00100000:2.0:1746065225.115126:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264075904 00000100:00100000:2.0:1746065225.115128:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264075904 00000100:00100000:2.0:1746065225.115143:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264076416 00000100:00100000:2.0:1746065225.115146:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264076416 00000100:00100000:2.0:1746065225.115157:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264076032 00000100:00100000:2.0:1746065225.115159:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264076032 00000100:00100000:2.0:1746065225.115171:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264076544 00000100:00100000:2.0:1746065225.115172:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264076544 00000100:00100000:2.0:1746065225.115186:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18073 00000100:00100000:2.0:1746065225.115191:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+72:3761:x1830881264075392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065225.115307:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1746065225.115310:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065225.115312:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065225.115314:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065225.115315:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1746065225.115341:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:3761:x1830881264075392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 149us (433us total) trans 17179874426 rc 0/0 00000100:00100000:2.0:1746065225.115347:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18073 00000100:00100000:2.0:1746065225.115358:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18074 00000100:00100000:2.0:1746065225.115362:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+72:3761:x1830881264075904:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065225.115423:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:3761:x1830881264075904:12345-0@lo:2:osp-syn-0-0.0 Request processed in 62us (439us total) trans 21474841799 rc 0/0 00000100:00100000:2.0:1746065225.115428:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18074 00000100:00100000:2.0:1746065225.115436:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18075 00000100:00100000:2.0:1746065225.115440:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+72:3761:x1830881264076416:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065225.115483:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:2.0:1746065225.115486:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065225.115487:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065225.115489:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065225.115490:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:2.0:1746065225.115515:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:3761:x1830881264076416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (503us total) trans 21474841800 rc 0/0 00000100:00100000:2.0:1746065225.115521:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18075 00000100:00100000:2.0:1746065225.115535:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18076 00000100:00100000:2.0:1746065225.115540:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+72:3761:x1830881264076032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065225.115614:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009a6dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:3761:x1830881264076032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 73us (571us total) trans 21474841801 rc 0/0 00000100:00100000:2.0:1746065225.115620:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18076 00000100:00100000:2.0:1746065225.115634:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18077 00000100:00100000:2.0:1746065225.115640:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+72:3761:x1830881264076544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065225.115693:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:2.0:1746065225.115696:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:2.0:1746065225.115698:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065225.115699:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:2.0:1746065225.115701:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:2.0:1746065225.115727:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+73:3761:x1830881264076544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 87us (659us total) trans 21474841802 rc 0/0 00000100:00100000:2.0:1746065225.115733:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18077 00000004:00080000:2.0:1746065225.115846:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856d880/2, rc 0, transno 17179874424 00000100:00100000:2.0:1746065225.115851:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264075008:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.115858:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264075520:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.115882:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.115904:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065225.115910:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264076928:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.115932:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.115959:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264075520 00000100:00100000:2.0:1746065225.115963:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264075520 00000100:00100000:2.0:1746065225.115983:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264076928 00000100:00100000:2.0:1746065225.115987:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264076928 00000100:00100000:2.0:1746065225.116004:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18078 00000100:00100000:2.0:1746065225.116011:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+74:3762:x1830881264075520:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.116096:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3762:x1830881264075520:12345-0@lo:2:osp-syn-1-0.0 Request processed in 84us (212us total) trans 17179874427 rc 0/0 00000100:00100000:2.0:1746065225.116101:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18078 00000100:00100000:2.0:1746065225.116114:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18079 00000100:00100000:2.0:1746065225.116120:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+74:3762:x1830881264076928:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065225.116186:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+75:3762:x1830881264076928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (253us total) trans 17179874428 rc 0/0 00000100:00100000:2.0:1746065225.116191:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18079 00000004:00080000:2.0:1746065225.116224:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012dc3f800/2, rc 0, transno 17179874428 00000100:00100000:2.0:1746065225.116229:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264076928:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065225.116238:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6de680/2, rc 0, transno 17179874427 00000100:00100000:2.0:1746065225.116241:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264075520:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065225.116268:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a6e680/2, rc 0, transno 21474841801 00000100:00100000:2.0:1746065225.116273:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264076032:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065225.116298:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a6f100/2, rc 0, transno 21474841802 00000100:00100000:2.0:1746065225.116300:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264076544:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065225.116307:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a6d880/2, rc 0, transno 21474841799 00000100:00100000:2.0:1746065225.116309:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264075904:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065225.116316:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a6df80/2, rc 0, transno 21474841800 00000100:00100000:2.0:1746065225.116318:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264076416:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065225.116326:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856f800/2, rc 0, transno 17179874426 00000100:00100000:2.0:1746065225.116328:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264075392:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065225.120322:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856f100/2, rc 0, transno 17179874423 00000100:00100000:0.0:1746065225.120334:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264075136:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065225.120346:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264075648:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065225.120405:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065225.120497:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264075648 00000100:00100000:0.0:1746065225.120504:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264075648 00000100:00100000:0.0:1746065225.120546:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18080 00000100:00100000:0.0:1746065225.120554:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+75:3759:x1830881264075648:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065225.120683:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065225.120687:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065225.120689:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065225.120691:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065225.120692:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:0.0:1746065225.120731:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3759:x1830881264075648:12345-0@lo:2:osp-syn-1-0.0 Request processed in 176us (326us total) trans 17179874429 rc 0/0 00000100:00100000:0.0:1746065225.120738:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18080 00000004:00080000:1.0:1746065225.120919:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009856ca80/2, rc 0, transno 17179874425 00000100:00100000:1.0:1746065225.120925:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009856ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264075264:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065225.120932:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009a6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264075776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065225.120961:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065225.121641:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264075776 00000100:00100000:0.0:1746065225.121645:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264075776 00000100:00100000:0.0:1746065225.121662:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18081 00000100:00100000:0.0:1746065225.121666:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+76:3760:x1830881264075776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065225.121717:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:0.0:1746065225.121720:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065225.121722:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065225.121724:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065225.121725:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:0.0:1746065225.121748:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+77:3760:x1830881264075776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 81us (788us total) trans 17179874430 rc 0/0 00000100:00100000:0.0:1746065225.121753:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18081 00000100:00100000:1.0:1746065225.121870:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.122586:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265591552 00000100:00100000:0.0:1746065225.122590:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265591552 00000100:00100000:0.0:1746065225.122627:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18082 00000100:00100000:0.0:1746065225.122632:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2702:x1830881265591552:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:0.0:1746065225.122640:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065225.122655:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a33d expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065225.122667:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d749, atime: 0x6812d748, ctime: 0x6812d749, blocks: 0x808 00010000:00010000:0.0:1746065225.122679:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065225.122681:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065225.122687:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 35 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.122700:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 35 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.122708:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800906d0a00, rc 0) 00000100:00100000:0.0:1746065225.122736:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2702:x1830881265591552:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 104us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065225.122741:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18082 00000100:00080000:3.0:1746065225.122795:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065225.125941:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.126023:0:13378:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265591808 00000100:00100000:3.0:1746065225.126030:0:13378:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265591808 00002000:00100000:3.0:1746065225.126063:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1921024->1925119) req@ffff88009ac64380 x1830881265591808/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.126071:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac64380 with x1830881265591808 ext(1921024->1925119) 00002000:00010000:3.0:1746065225.126075:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac64380 00000100:00100000:3.0:1746065225.126091:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6467 00000100:00100000:3.0:1746065225.126097:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265591808:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065225.126211:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265591808:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 114us (276us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065225.126217:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6467 00002000:00100000:3.0:1746065225.126221:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x77:0x0] (1921024->1925119) req@ffff88009ac64380 x1830881265591808/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.126228:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac64380 with x1830881265591808 ext(1921024->1925119) 00002000:00010000:3.0:1746065225.126230:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac64380 00010000:00010000:3.0:1746065225.131678:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1746065225.137721:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6dd880/2, rc 0, transno 17179874429 00000100:00100000:1.0:1746065225.137732:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264075648:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065225.137749:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264076160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065225.137813:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065225.138569:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264076160 00000100:00100000:2.0:1746065225.138575:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264076160 00000100:00100000:2.0:1746065225.138605:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18083 00000100:00100000:2.0:1746065225.138611:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+73:3759:x1830881264076160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065225.138728:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+74:3759:x1830881264076160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 117us (915us total) trans 21474841803 rc 0/0 00000100:00100000:2.0:1746065225.138734:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18083 00000004:00080000:1.0:1746065225.138848:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a6c700/2, rc 0, transno 21474841803 00000100:00100000:1.0:1746065225.138852:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264076160:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065225.138858:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264076672:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065225.138875:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065225.138891:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1746065225.138896:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264076288:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065225.138909:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065225.138918:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009ac66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264076800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065225.138928:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065225.138944:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264076672 00000100:00100000:1.0:1746065225.138946:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264076672 00000100:00100000:1.0:1746065225.138959:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264076288 00000100:00100000:1.0:1746065225.138961:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264076288 00000100:00100000:1.0:1746065225.138968:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264076800 00000100:00100000:1.0:1746065225.138969:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264076800 00000100:00100000:1.0:1746065225.138978:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18084 00000100:00100000:1.0:1746065225.138982:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3759:x1830881264076672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065225.139034:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:3759:x1830881264076672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 51us (158us total) trans 21474841804 rc 0/0 00000100:00100000:1.0:1746065225.139038:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18084 00000100:00100000:1.0:1746065225.139047:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18085 00000100:00100000:1.0:1746065225.139050:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3759:x1830881264076288:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065225.139083:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065225.139085:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065225.139087:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065225.139089:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065225.139091:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:1.0:1746065225.139105:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:3759:x1830881264076288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (195us total) trans 21474841805 rc 0/0 00000100:00100000:1.0:1746065225.139109:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18085 00000100:00100000:1.0:1746065225.139116:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18086 00000100:00100000:1.0:1746065225.139120:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+76:3759:x1830881264076800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065225.139159:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+77:3759:x1830881264076800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 39us (230us total) trans 21474841806 rc 0/0 00000100:00100000:1.0:1746065225.139164:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18086 00000004:00080000:1.0:1746065225.139183:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097a6c380/2, rc 0, transno 21474841805 00000100:00100000:1.0:1746065225.139186:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097a6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264076288:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065225.139192:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac66680/2, rc 0, transno 21474841806 00000100:00100000:1.0:1746065225.139195:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264076800:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065225.139200:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009ac65180/2, rc 0, transno 21474841804 00000100:00100000:1.0:1746065225.139202:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009ac65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264076672:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065225.139257:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009a6ddf80/2, rc 0, transno 17179874430 00000100:00100000:2.0:1746065225.139260:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009a6ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264075776:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065225.145548:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.145622:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265591936 00000100:00100000:2.0:1746065225.145630:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265591936 00000100:00100000:2.0:1746065225.145671:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18087 00000100:00100000:2.0:1746065225.145677:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2702:x1830881265591936:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065225.145690:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.145705:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a344 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065225.145723:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 5034592, mtime: 0x6812d748, atime: 0x6812d748, ctime: 0x6812d748, blocks: 0x1678 00010000:00010000:2.0:1746065225.145736:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.145738:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.145744:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 36 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.145755:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 36 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.145767:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800999c0c00, rc 0) 00000100:00100000:2.0:1746065225.145820:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2702:x1830881265591936:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 144us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.145825:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18087 00000100:00100000:0.0:1746065225.159439:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.159536:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.161446:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265592448 00000100:00100000:3.0:1746065225.161456:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265592448 00000100:00100000:3.0:1746065225.161512:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14702 00000100:00100000:3.0:1746065225.161520:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2705:x1830881265592448:12345-192.168.202.27@tcp:101:cat.0 00000100:00080000:2.0:1746065225.161550:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1746065225.161616:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265592192 00000100:00100000:1.0:1746065225.161620:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265592192 00002000:00100000:1.0:1746065225.161646:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2465792->2469887) req@ffff88009ac67b80 x1830881265592192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.161654:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac67b80 with x1830881265592192 ext(2465792->2469887) 00002000:00010000:1.0:1746065225.161659:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac67b80 00000100:00100000:1.0:1746065225.161678:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6468 00000100:00100000:1.0:1746065225.161682:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265592192:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065225.161797:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265592192:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 114us (2365us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065225.161802:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6468 00002000:00100000:1.0:1746065225.161806:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2465792->2469887) req@ffff88009ac67b80 x1830881265592192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.161812:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009ac67b80 with x1830881265592192 ext(2465792->2469887) 00002000:00010000:1.0:1746065225.161815:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009ac67b80 00010000:00010000:3.0:1746065225.162230:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.162244:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ad0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a34b expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.162304:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ad15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162315:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ad15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162324:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ad15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162333:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc147ad1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162338:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc147ad1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162342:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc147ad1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162412:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc147ad23 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162418:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc147ad23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162422:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc147ad23 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065225.162429:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:3.0:1746065225.162480:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ad15 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162485:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ad15 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162489:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ad15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162494:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ad15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162498:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d06e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065225.162501:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ad15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162507:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ad15 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162514:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065225.162516:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065225.162519:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ad15 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162523:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d06e00/0xad6b7ddc147ad15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162539:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc147ad1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162543:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc147ad1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162547:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc147ad1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162550:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880099d07400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065225.162551:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc147ad1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162555:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc147ad1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162559:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099cafe00) 00010000:00010000:3.0:1746065225.162560:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065225.162562:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc147ad1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162569:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07400/0xad6b7ddc147ad1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.162594:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880099d07800/0xad6b7ddc147ad0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a34b expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.162601:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc147ad23 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a34b expref: 9 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.162606:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065225.162608:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065225.162610:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012ef3d800, rc 0) 00000100:00100000:3.0:1746065225.162630:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2705:x1830881265592448:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1111us (3093us total) trans 8589937231 rc 0/0 00000100:00100000:3.0:1746065225.162634:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14702 00000100:00100000:0.0:1746065225.176947:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.177012:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265592704 00000100:00100000:3.0:1746065225.177020:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265592704 00000100:00100000:3.0:1746065225.177071:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5541 00000100:00100000:3.0:1746065225.177078:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009ac65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2702:x1830881265592704:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065225.177249:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009ac65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2702:x1830881265592704:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 171us (309us total) trans 8589937232 rc 0/0 00000100:00100000:3.0:1746065225.177263:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5541 00000100:00100000:1.0:1746065225.183195:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.183228:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.183255:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.183310:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.183349:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265592832 00000100:00100000:1.0:1746065225.183356:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265592832 00000100:00100000:1.0:1746065225.183401:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265592960 00000100:00100000:1.0:1746065225.183403:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265592960 00000100:00100000:1.0:1746065225.183415:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265593216 00000100:00100000:1.0:1746065225.183417:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265593216 00000100:00100000:1.0:1746065225.183424:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265593472 00000100:00100000:1.0:1746065225.183425:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265593472 00000100:00100000:1.0:1746065225.183435:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18088 00000100:00100000:1.0:1746065225.183441:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265592832:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065225.183455:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.183470:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147ad31 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a352 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065225.183488:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d748, atime: 0x6812d748, ctime: 0x6812d748, blocks: 0x800 00010000:00010000:1.0:1746065225.183503:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.183505:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.183511:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147ad31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a352 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.183523:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147ad31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a352 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.183531:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539a00, rc 0) 00000100:00100000:1.0:1746065225.183564:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265592832:12345-192.168.202.27@tcp:101:cat.0 Request processed in 124us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.183569:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18088 00000100:00100000:1.0:1746065225.183582:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18089 00000100:00100000:1.0:1746065225.183586:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265592960:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065225.183591:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.183599:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147ad38 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a359 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065225.183609:0:9549:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d749, atime: 0x6812d748, ctime: 0x6812d748, blocks: 0x800 00010000:00010000:1.0:1746065225.183617:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.183618:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.183621:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147ad38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a359 expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.183629:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147ad38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a359 expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.183634:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538a00, rc 0) 00000100:00100000:1.0:1746065225.183645:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265592960:12345-192.168.202.27@tcp:101:cat.0 Request processed in 59us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.183649:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18089 00000100:00100000:1.0:1746065225.183657:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18090 00000100:00100000:1.0:1746065225.183661:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265593216:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065225.183665:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.183670:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c539e00/0xad6b7ddc147ad3f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a367 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065225.183699:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881264077056:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065225.183751:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:1.0:1746065225.183770:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18091 00000100:00100000:1.0:1746065225.183793:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2004:x1830881265593472:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065225.183799:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.183805:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc147ad46 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a375 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065225.183813:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d748, atime: 0x6812d748, ctime: 0x6812d748, blocks: 0x1008 00010000:00010000:1.0:1746065225.183820:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.183821:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.183825:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc147ad46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a375 expref: 19 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.183833:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc147ad46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a375 expref: 19 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.183838:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009aa50800, rc 0) 00000100:00100000:1.0:1746065225.183851:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800907bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265593472:12345-192.168.202.27@tcp:101:cat.0 Request processed in 58us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.183856:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18091 00000100:00080000:1.0:1746065225.183959:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065225.183962:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065225.184627:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.184651:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.184692:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265593088 00000100:00100000:3.0:1746065225.184697:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265593088 00000100:00100000:2.0:1746065225.184704:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265593344 00000100:00100000:2.0:1746065225.184707:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265593344 00000100:00100000:3.0:1746065225.184720:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18092 00000100:00100000:3.0:1746065225.184725:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265593088:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:2.0:1746065225.184732:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18093 00010000:00010000:3.0:1746065225.184734:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065225.184736:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265593344:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065225.184741:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.184742:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147ad4d lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a360 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.184747:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc147ad54 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a36e expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00002000:00010000:3.0:1746065225.184754:0:11461:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d749, atime: 0x6812d748, ctime: 0x6812d749, blocks: 0x808 00010000:00010000:3.0:1746065225.184760:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.184761:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.184766:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147ad4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a360 expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065225.184769:0:12258:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264077184:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065225.184791:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147ad4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a360 expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.184798:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07e00, rc 0) 00000100:00100000:3.0:1746065225.184811:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265593088:12345-192.168.202.27@tcp:101:cat.0 Request processed in 87us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.184816:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18092 00000100:00100000:2.0:1746065225.184821:0:12258:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.187285:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.187347:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265593728 00000100:00100000:3.0:1746065225.187354:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265593728 00000100:00100000:3.0:1746065225.187403:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14703 00000100:00100000:3.0:1746065225.187410:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2708:x1830881265593728:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.187430:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.187445:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a37c expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.187501:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad62 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187514:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187522:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad62 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187532:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc147ad69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187537:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc147ad69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187542:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc147ad69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187617:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc147ad70 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187624:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc147ad70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187629:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc147ad70 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065225.187635:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:3.0:1746065225.187692:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad62 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187698:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad62 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187703:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad62 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187709:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187714:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065225.187717:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad62 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187722:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad62 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187731:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065225.187734:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065225.187738:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad62 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187742:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187770:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc147ad69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187796:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc147ad69 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187800:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc147ad69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187803:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012b4f3600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065225.187805:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc147ad69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187808:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc147ad69 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187813:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099cafe00) 00010000:00010000:3.0:1746065225.187815:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065225.187817:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc147ad69 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187821:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3600/0xad6b7ddc147ad69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.187849:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a37c expref: 31 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.187857:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc147ad70 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a37c expref: 30 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.187862:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065225.187864:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065225.187865:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2c00, rc 0) 00000100:00100000:3.0:1746065225.187897:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2708:x1830881265593728:12345-192.168.202.27@tcp:101:cat.0 Request processed in 487us (632us total) trans 8589937233 rc 0/0 00000100:00100000:3.0:1746065225.187902:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14703 00002000:00010000:2.0:1746065225.192952:0:12258:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime: 1746065224 -> 1746065225 00002000:00010000:2.0:1746065225.192960:0:12258:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime: 1746065224 -> 1746065225 00000100:00100000:2.0:1746065225.192982:0:12258:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012dc3df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_008:lustre-OST0001_UUID:12258:1830881264077184:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065225.193015:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc147ad54 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a36e expref: 19 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.193027:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abb0600/0xad6b7ddc147ad54 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a36e expref: 19 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.193045:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb0600, rc 0) 00000100:00100000:2.0:1746065225.193097:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265593344:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8358us (8443us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065225.193104:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18093 00000100:00100000:1.0:1746065225.193199:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:9549:1830881264077056:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065225.193216:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c539e00/0xad6b7ddc147ad3f lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a367 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.193225:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539e00/0xad6b7ddc147ad3f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a367 expref: 17 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.193234:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539e00, rc 0) 00000100:00100000:1.0:1746065225.193253:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099ec7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2004:x1830881265593216:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9592us (9997us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065225.193258:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18090 00000100:00100000:2.0:1746065225.198758:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.198860:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.199394:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.199911:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.200169:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265593856 00000100:00100000:3.0:1746065225.200177:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265593856 00000100:00100000:3.0:1746065225.200211:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265593984 00000100:00100000:3.0:1746065225.200213:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265593984 00000100:00100000:3.0:1746065225.200229:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265594112 00000100:00100000:3.0:1746065225.200230:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265594112 00000100:00100000:3.0:1746065225.200239:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265594240 00000100:00100000:3.0:1746065225.200240:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265594240 00000100:00100000:3.0:1746065225.200250:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18094 00000100:00100000:3.0:1746065225.200258:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265593856:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.200272:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.200297:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad7e lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a383 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.200321:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.200323:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.200330:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a383 expref: 37 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.200342:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a383 expref: 37 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.200350:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3800, rc 0) 00000100:00100000:3.0:1746065225.200387:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265593856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 130us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.200393:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18094 00000100:00100000:3.0:1746065225.200407:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18095 00000100:00100000:3.0:1746065225.200412:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265593984:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.200418:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.200426:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147ad85 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a38a expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.200441:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.200443:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.200447:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147ad85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a38a expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.200456:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147ad85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a38a expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.200466:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2000, rc 0) 00000100:00100000:3.0:1746065225.200480:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012dc3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265593984:12345-192.168.202.27@tcp:101:cat.0 Request processed in 68us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.200484:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18095 00000100:00100000:3.0:1746065225.200493:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18096 00000100:00100000:3.0:1746065225.200497:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265594112:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.200503:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.200508:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147ad8c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a391 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.200518:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.200519:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.200523:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147ad8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a391 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.200530:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147ad8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a391 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.200536:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f2200, rc 0) 00000100:00100000:3.0:1746065225.200552:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265594112:12345-192.168.202.27@tcp:101:cat.0 Request processed in 54us (1159us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.200556:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18096 00000100:00100000:3.0:1746065225.200565:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18097 00000100:00100000:3.0:1746065225.200568:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265594240:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.200575:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.200581:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad93 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a398 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.200588:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.200590:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.200593:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a398 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.200600:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a398 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.200606:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012b4f3200, rc 0) 00000100:00100000:3.0:1746065225.200618:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265594240:12345-192.168.202.27@tcp:101:cat.0 Request processed in 50us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.200622:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18097 00000100:00080000:1.0:1746065225.201007:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065225.217287:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.217354:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.217390:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.217412:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265594624 00000100:00100000:0.0:1746065225.217420:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265594624 00002000:00100000:0.0:1746065225.217460:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff8800957d9880 x1830881265594624/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065225.217468:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9880 with x1830881265594624 ext(0->1048575) 00002000:00010000:0.0:1746065225.217473:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d9880 00000100:00100000:0.0:1746065225.217485:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265594880 00000100:00100000:0.0:1746065225.217487:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265594880 00002000:00100000:0.0:1746065225.217498:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800957db100 x1830881265594880/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065225.217504:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db100 with x1830881265594880 ext(1048576->2097151) 00002000:00010000:0.0:1746065225.217507:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957db100 00000100:00100000:0.0:1746065225.219374:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265594752 00000100:00100000:0.0:1746065225.219380:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265594752 00002000:00100000:0.0:1746065225.219410:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800957da680 x1830881265594752/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065225.219417:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da680 with x1830881265594752 ext(1048576->2097151) 00002000:00010000:0.0:1746065225.219421:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957da680 00000100:00100000:2.0:1746065225.219488:0:13378:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6469 00000100:00100000:2.0:1746065225.219498:0:13378:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265594624:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065225.220947:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6470 00000100:00100000:2.0:1746065225.220956:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265594880:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065225.222087:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6471 00000100:00100000:1.0:1746065225.222096:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265594752:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065225.231972:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.233808:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265595264 00000100:00100000:2.0:1746065225.233820:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265595264 00002000:00100000:2.0:1746065225.233860:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880098dd9500 x1830881265595264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065225.233870:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9500 with x1830881265595264 ext(0->1048575) 00002000:00010000:2.0:1746065225.233875:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9500 00000100:00100000:2.0:1746065225.233910:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6472 00000100:00100000:2.0:1746065225.233917:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265595264:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065225.235128:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.235702:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.235743:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.235767:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265595520 00000100:00100000:0.0:1746065225.235789:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265595520 00002000:00100000:0.0:1746065225.235817:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800957d8700 x1830881265595520/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065225.235825:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8700 with x1830881265595520 ext(1048576->2097151) 00002000:00010000:0.0:1746065225.235829:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d8700 00000100:00100000:0.0:1746065225.235841:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265595776 00000100:00100000:0.0:1746065225.235844:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265595776 00002000:00100000:0.0:1746065225.235852:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800957d8380 x1830881265595776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065225.235859:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8380 with x1830881265595776 ext(1048576->2097151) 00002000:00010000:0.0:1746065225.235861:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d8380 00000100:00100000:0.0:1746065225.235869:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265596032 00000100:00100000:0.0:1746065225.235871:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265596032 00002000:00100000:0.0:1746065225.235879:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1921023) req@ffff8800957d8e00 x1830881265596032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065225.235885:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8e00 with x1830881265596032 ext(1048576->1921023) 00002000:00010000:0.0:1746065225.235888:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d8e00 00000100:00100000:0.0:1746065225.235897:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6473 00000100:00100000:0.0:1746065225.235903:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265595520:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065225.236259:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6474 00000100:00100000:1.0:1746065225.236266:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265595776:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065225.236696:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6475 00000100:00100000:3.0:1746065225.236705:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+39:2005:x1830881265596032:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065225.238681:0:13378:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_011:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265594624:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19179us (21406us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065225.238690:0:13378:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6469 00002000:00100000:3.0:1746065225.238698:0:13378:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_011: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff8800957d9880 x1830881265594624/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.238707:0:13378:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d9880 with x1830881265594624 ext(0->1048575) 00002000:00010000:3.0:1746065225.238713:0:13378:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d9880 00000100:00100000:3.0:1746065225.244168:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265594880:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23204us (26804us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065225.244180:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6470 00002000:00100000:3.0:1746065225.244190:0:29492:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_008: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800957db100 x1830881265594880/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.244200:0:29492:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957db100 with x1830881265594880 ext(1048576->2097151) 00002000:00010000:3.0:1746065225.244206:0:29492:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957db100 00000100:00100000:1.0:1746065225.251230:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265594752:12345-192.168.202.27@tcp:3:cat.0 Request processed in 29127us (33831us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065225.251240:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6471 00002000:00100000:1.0:1746065225.251251:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800957da680 x1830881265594752/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.251260:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957da680 with x1830881265594752 ext(1048576->2097151) 00002000:00010000:1.0:1746065225.251266:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957da680 00000100:00100000:1.0:1746065225.261040:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265595776:12345-192.168.202.27@tcp:3:cat.0 Request processed in 24765us (25329us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065225.261051:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6474 00002000:00100000:1.0:1746065225.261062:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff8800957d8380 x1830881265595776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.261070:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8380 with x1830881265595776 ext(1048576->2097151) 00002000:00010000:1.0:1746065225.261075:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d8380 00000100:00100000:2.0:1746065225.261357:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+39:2004:x1830881265595264:12345-192.168.202.27@tcp:3:cat.0 Request processed in 27439us (29391us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065225.261366:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6472 00002000:00100000:2.0:1746065225.261370:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff880098dd9500 x1830881265595264/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065225.261377:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9500 with x1830881265595264 ext(0->1048575) 00002000:00010000:2.0:1746065225.261380:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9500 00000100:00100000:3.0:1746065225.268582:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265596032:12345-192.168.202.27@tcp:3:cat.0 Request processed in 31870us (32830us total) trans 0 rc 872448/872448 00000100:00100000:3.0:1746065225.268591:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6475 00002000:00100000:3.0:1746065225.268600:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1921023) req@ffff8800957d8e00 x1830881265596032/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 872448/872448 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.268609:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8e00 with x1830881265596032 ext(1048576->1921023) 00002000:00010000:3.0:1746065225.268614:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800957d8e00 00000100:00100000:0.0:1746065225.270199:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.270239:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.270262:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265596160 00000100:00100000:2.0:1746065225.270269:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265596160 00000100:00100000:2.0:1746065225.270444:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265596288 00000100:00100000:2.0:1746065225.270448:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265596288 00000100:00100000:2.0:1746065225.270487:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18098 00000100:00100000:2.0:1746065225.270494:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2705:x1830881265596160:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065225.270509:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.270522:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a39f expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065225.270525:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18099 00000100:00100000:3.0:1746065225.270531:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2699:x1830881265596288:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065225.270537:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.270543:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3a6 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.270544:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 36 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.270550:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065225.270552:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065225.270554:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 36 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.270555:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.270560:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065225.270561:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065225.270563:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3530752->4194303] (req 3530752->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.270577:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 36 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.270577:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 36 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.270587:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 36 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.270598:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264077312:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.270652:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.272099:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800957d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265595520:12345-192.168.202.27@tcp:3:cat.0 Request processed in 36191us (36968us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065225.272107:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6473 00002000:00100000:0.0:1746065225.272114:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800957d8700 x1830881265595520/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065225.272127:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800957d8700 with x1830881265595520 ext(1048576->2097151) 00002000:00010000:0.0:1746065225.272131:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800957d8700 00010000:00010000:3.0:1746065225.272514:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 36 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746065225.272526:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264077440:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065225.272580:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065225.273328:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264077312:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.273346:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.273364:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47000, rc 0) 00000100:00100000:2.0:1746065225.273385:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2705:x1830881265596160:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2892us (3191us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.273391:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18098 00000100:00100000:0.0:1746065225.274524:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.276566:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265596416 00000100:00100000:1.0:1746065225.276577:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265596416 00002000:00100000:1.0:1746065225.276621:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1921024->2097151) req@ffff880099cf1c00 x1830881265596416/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.276630:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1c00 with x1830881265596416 ext(1921024->2097151) 00010000:00010000:1.0:1746065225.276638:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 37 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.276650:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 37 pid: 11461 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746065225.276657:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cf1c00 00000100:00100000:1.0:1746065225.276691:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2124 00000100:00100000:1.0:1746065225.276699:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+37:2004:x1830881265596416:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065225.286941:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.287071:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264077440:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065225.287095:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3530752->4194303] (req 3530752->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 18 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.287110:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61a00, rc 0) 00000100:00100000:3.0:1746065225.287143:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2699:x1830881265596288:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 16613us (16904us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.287151:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18099 00000100:00100000:3.0:1746065225.287172:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265596544 00000100:00100000:3.0:1746065225.287176:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265596544 00000100:00100000:3.0:1746065225.287196:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18100 00000100:00100000:3.0:1746065225.287201:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+39:2708:x1830881265596544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.287212:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.287223:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3ad expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.287244:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065225.287247:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.287255:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 40 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.287261:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60600, rc 0) 00000100:00100000:3.0:1746065225.287272:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+40:2708:x1830881265596544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 72us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.287288:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18100 00000100:00100000:0.0:1746065225.298938:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.301806:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265596672 00000100:00100000:3.0:1746065225.301816:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265596672 00002000:00100000:3.0:1746065225.301854:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2469887) req@ffff88009aec8700 x1830881265596672/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.301863:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8700 with x1830881265596672 ext(2097152->2469887) 00010000:00010000:3.0:1746065225.301871:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 40 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.301882:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 40 pid: 11461 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746065225.301888:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aec8700 00000100:00100000:3.0:1746065225.301914:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2125 00000100:00100000:3.0:1746065225.301919:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265596672:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065225.308845:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265596416:12345-192.168.202.27@tcp:4:cat.0 Request processed in 32136us (34313us total) trans 17179874431 rc 0/0 00000100:00100000:1.0:1746065225.308857:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2124 00002000:00100000:1.0:1746065225.308868:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1921024->2097151) req@ffff880099cf1c00 x1830881265596416/t17179874431(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/448 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.308877:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099cf1c00 with x1830881265596416 ext(1921024->2097151) 00010000:00010000:1.0:1746065225.308886:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 42 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.308899:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 42 pid: 11461 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746065225.308905:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880099cf1c00 00000100:00100000:3.0:1746065225.313522:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265596672:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11593us (14581us total) trans 17179874432 rc 0/0 00000100:00100000:3.0:1746065225.313533:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2125 00002000:00100000:3.0:1746065225.313543:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->2469887) req@ffff88009aec8700 x1830881265596672/t17179874432(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/448 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.313551:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009aec8700 with x1830881265596672 ext(2097152->2469887) 00010000:00010000:3.0:1746065225.313560:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 42 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.313571:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 42 pid: 11461 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746065225.313576:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88009aec8700 00000100:00100000:0.0:1746065225.324040:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.324112:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265596928 00000100:00100000:2.0:1746065225.324122:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265596928 00000100:00100000:2.0:1746065225.325071:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14704 00000100:00100000:2.0:1746065225.325080:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2711:x1830881265596928:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065225.325101:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.325117:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46400/0xad6b7ddc147adaf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3b4 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.325218:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.325231:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc147ad23 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a34b expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.325236:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc147ad70 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a37c expref: 31 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.325242:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 5/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.325267:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc147ad70 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a37c expref: 31 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.325289:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc147ad70 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a37c expref: 31 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.325299:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264077568:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065225.325935:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.326492:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265597056 00000100:00100000:1.0:1746065225.326498:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265597056 00000100:00100000:0.0:1746065225.326512:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065225.326522:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 42 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.326541:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265597184 00000100:00100000:1.0:1746065225.326543:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265597184 00010000:00010000:1.0:1746065225.326551:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 43 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.326563:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8456 00000100:00100000:1.0:1746065225.326568:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265597056:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065225.326576:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065225.326591:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 43 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.326599:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 43 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.326616:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800999c0c00/0xad6b7ddc147ad07 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->2469887) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a344 expref: 43 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.326647:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.326649:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.326655:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.326661:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.326682:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 17 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065225.326690:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264077696:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065225.326939:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8457 00000100:00100000:3.0:1746065225.326947:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265597184:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065225.326954:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065225.326964:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 42 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.326972:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 42 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.326983:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800906d0a00/0xad6b7ddc147ad00 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1921024->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a33d expref: 42 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.327006:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.327007:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.327011:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.327018:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.327023:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.327024:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.327027:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.327033:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.327051:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 41 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065225.327059:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264077824:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065225.327205:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc147ad23 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a34b expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.327214:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc147ad23 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a34b expref: 8 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.327222:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264077952:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.328095:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.328172:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00010000:00010000:3.0:1746065225.328227:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 17 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065225.328237:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264078080:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065225.329131:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.329586:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.329836:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265597312 00000100:00100000:3.0:1746065225.329842:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265597312 00000100:00100000:3.0:1746065225.329876:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14705 00000100:00100000:3.0:1746065225.329882:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+6:2712:x1830881265597312:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065225.329899:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.329912:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147adbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3bb expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.329956:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147adc4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.329967:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147adc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.329974:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147adc4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.329985:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147adcb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.329991:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147adcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.329995:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147adcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.330048:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.330055:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065225.330061:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.330077:0:7205:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065225.330084:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065225.330694:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264077696:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065225.330709:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.330740:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aeca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265597056:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4171us (4807us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.330748:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8456 00000100:00100000:2.0:1746065225.330822:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264077952:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065225.331139:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264077824:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065225.336131:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.336191:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.336194:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265597440 00000100:00100000:1.0:1746065225.336202:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265597440 00000100:00100000:0.0:1746065225.336211:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265597696 00000100:00100000:0.0:1746065225.336214:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265597696 00000100:00100000:3.0:1746065225.336237:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264078080:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065225.336239:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14706 00000100:00100000:0.0:1746065225.336245:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2705:x1830881265597696:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065225.336248:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18101 00000100:00100000:1.0:1746065225.336253:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2699:x1830881265597440:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065225.336255:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065225.336263:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065225.336263:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.336287:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3c2 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.336288:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc147add9 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3c9 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.336310:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc147ad46 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a375 expref: 21 pid: 3067 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065225.336312:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265597184:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9366us (9800us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065225.336319:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad93 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a398 expref: 32 pid: 12258 timeout: 0 lvb_type: 1 00000100:00100000:3.0:1746065225.336320:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8457 00010000:00010000:0.0:1746065225.336328:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc147add9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c9 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.336330:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.336331:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.336334:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->3448831] (req 3145728->3448831) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.336338:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc147add9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c9 expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.336351:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065225.336354:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065225.336355:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a398 expref: 32 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065225.336357:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abb3400, rc 0) 00010000:00010000:1.0:1746065225.336362:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a398 expref: 32 pid: 12258 timeout: 921 lvb_type: 1 00000100:00100000:1.0:1746065225.336370:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264078208:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065225.336374:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2705:x1830881265597696:12345-192.168.202.27@tcp:101:cat.0 Request processed in 130us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065225.336379:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14706 00010000:00010000:1.0:1746065225.336421:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc147ad46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a375 expref: 21 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.336428:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc147ad46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a375 expref: 21 pid: 3067 timeout: 921 lvb_type: 1 00000100:00100000:3.0:1746065225.336434:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f43480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264077568:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.336436:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264078336:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065225.336449:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00000100:00100000:1.0:1746065225.336456:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.339165:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.339482:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265597952 00000100:00100000:3.0:1746065225.339488:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265597952 00002000:00100000:3.0:1746065225.339528:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880090ddb480 x1830881265597952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.339537:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddb480 with x1830881265597952 ext(1048576->2097151) 00002000:00010000:3.0:1746065225.339541:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090ddb480 00000100:00100000:3.0:1746065225.339573:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6476 00000100:00100000:3.0:1746065225.339580:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881265597952:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065225.344896:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.345103:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265597568 00000100:00100000:3.0:1746065225.345113:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265597568 00010000:00010000:3.0:1746065225.345142:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc147ad23 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a34b expref: 10 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746065225.345182:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8458 00000100:00100000:3.0:1746065225.345189:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2005:x1830881265597568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065225.345201:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065225.345206:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc147ad23 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a34b expref: 10 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.345215:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc147ad23 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a34b expref: 10 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.345234:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012ef3d800/0xad6b7ddc147ad23 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a34b expref: 10 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.345263:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065225.345268:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065225.345284:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.345289:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065225.345293:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.345297:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065225.345333:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2005:x1830881265597568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 144us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.345340:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8458 00000100:00100000:0.0:1746065225.345953:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.346128:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265598080 00000100:00100000:2.0:1746065225.346133:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265598080 00010000:00010000:2.0:1746065225.346149:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc147ad70 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a37c expref: 32 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.346163:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8459 00000100:00100000:2.0:1746065225.346168:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265598080:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065225.346175:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065225.346179:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc147ad70 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a37c expref: 32 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.346186:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc147ad70 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a37c expref: 32 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.346197:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012b4f2c00/0xad6b7ddc147ad70 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a37c expref: 32 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.346209:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.346212:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.346218:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.346224:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290400000020 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.346229:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.346233:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.346240:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 4 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.346257:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.346286:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265598080:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 107us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.346292:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8459 00010000:00010000:2.0:1746065225.346309:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.346315:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065225.346329:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:2.0:1746065225.347095:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46400/0xad6b7ddc147adaf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3b4 expref: 32 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.347110:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3b4 expref: 31 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.347116:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3b4 expref: 31 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.347122:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47a00, rc 0) 00000100:00100000:2.0:1746065225.347325:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aec9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2711:x1830881265596928:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 22246us (23293us total) trans 8589937234 rc 0/0 00000100:00100000:2.0:1746065225.347332:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14704 00000100:00100000:0.0:1746065225.350503:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.350521:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.350543:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.350596:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265598592 00000100:00100000:1.0:1746065225.350602:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265598592 00002000:00100000:1.0:1746065225.350629:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012edaf800 x1830881265598592/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.350635:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf800 with x1830881265598592 ext(1048576->2097151) 00002000:00010000:1.0:1746065225.350639:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf800 00000100:00100000:1.0:1746065225.350652:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6477 00000100:00100000:1.0:1746065225.350656:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265598592:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065225.351131:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264078208:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.351137:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10219:1830881264078336:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065225.351156:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->3448831] (req 3145728->3448831) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 21 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.351166:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099524000, rc 0) 00000100:00100000:1.0:1746065225.351181:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2699:x1830881265597440:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 14928us (15058us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.351185:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18101 00000100:00100000:3.0:1746065225.352076:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265598336 00000100:00100000:3.0:1746065225.352081:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265598336 00010000:00010000:3.0:1746065225.352104:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc147ad46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a375 expref: 21 pid: 3067 timeout: 921 lvb_type: 1 00000100:00100000:3.0:1746065225.352123:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265598208 00000100:00100000:3.0:1746065225.352125:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265598208 00010000:00010000:3.0:1746065225.352134:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a398 expref: 33 pid: 12258 timeout: 921 lvb_type: 1 00000100:00100000:3.0:1746065225.352147:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8460 00000100:00100000:3.0:1746065225.352152:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265598336:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065225.352160:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065225.352174:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc147ad46 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a375 expref: 21 pid: 3067 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.352181:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc147ad46 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a375 expref: 21 pid: 3067 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.352197:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009aa50800/0xad6b7ddc147ad46 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a375 expref: 21 pid: 3067 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.352207:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065225.352230:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265598336:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 77us (1733us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.352235:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8460 00000100:00100000:3.0:1746065225.352245:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8461 00000100:00100000:3.0:1746065225.352250:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265598208:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065225.352256:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065225.352262:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad93 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a398 expref: 33 pid: 12258 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.352270:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad93 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a398 expref: 33 pid: 12258 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.352292:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f3200/0xad6b7ddc147ad93 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a398 expref: 33 pid: 12258 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.352301:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.352302:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.352307:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 19 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.352315:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 19 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.352338:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 19 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065225.352348:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264078464:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065225.352398:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1746065225.354578:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+40:2007:x1830881265597952:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14991us (15413us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065225.354591:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6476 00002000:00100000:3.0:1746065225.354601:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff880090ddb480 x1830881265597952/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.354610:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880090ddb480 with x1830881265597952 ext(1048576->2097151) 00002000:00010000:3.0:1746065225.354614:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880090ddb480 00000100:00100000:0.0:1746065225.358203:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.361459:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265598720 00000100:00100000:1.0:1746065225.361471:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265598720 00010000:00010000:1.0:1746065225.361505:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3b4 expref: 31 pid: 7204 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.361544:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8462 00000100:00100000:1.0:1746065225.361551:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2006:x1830881265598720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065225.361565:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065225.361569:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3b4 expref: 31 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.361579:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3b4 expref: 31 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.361603:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47a00/0xad6b7ddc147adb6 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3b4 expref: 31 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.361620:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065225.361624:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065225.361633:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065225.361638:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:1.0:1746065225.361656:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065225.361697:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880137708c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265598720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 146us (3501us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.361703:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8462 00000100:00100000:2.0:1746065225.362138:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264078464:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065225.362153:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.362176:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265598208:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 9924us (11652us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.362182:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8461 00010000:00010000:2.0:1746065225.362225:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362231:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065225.362287:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00000004:00200000:2.0:1746065225.362291:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065225.362306:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362315:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362324:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147adc4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362329:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147adc4 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362334:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147adc4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362339:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147adc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362344:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065225.362347:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147adc4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362355:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147adc4 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362362:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065225.362365:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065225.362367:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147adc4 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362372:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147adc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362380:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147adcb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362384:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147adcb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362389:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147adcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362392:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065225.362394:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147adcb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362398:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147adcb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362403:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880099caf000) 00010000:00010000:2.0:1746065225.362405:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065225.362406:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147adcb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362410:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147adcb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.362436:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147adbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3bb expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.362447:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3bb expref: 7 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.362452:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.362454:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065225.362456:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60000, rc 0) 00000100:00100000:2.0:1746065225.362479:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+7:2712:x1830881265597312:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 32597us (32895us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.362485:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14705 00000100:00100000:1.0:1746065225.364353:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265598592:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13691us (13803us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065225.364362:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6477 00002000:00100000:1.0:1746065225.364370:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88012edaf800 x1830881265598592/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.364380:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaf800 with x1830881265598592 ext(1048576->2097151) 00002000:00010000:1.0:1746065225.364384:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaf800 00000100:00100000:0.0:1746065225.368159:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.368238:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.368298:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265598848 00000100:00100000:2.0:1746065225.368306:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265598848 00000100:00100000:2.0:1746065225.368597:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265598976 00000100:00100000:2.0:1746065225.368600:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265598976 00000100:00100000:2.0:1746065225.368793:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18102 00000100:00100000:2.0:1746065225.368800:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265598848:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065225.368814:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.368827:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f46e00/0xad6b7ddc147adee lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3d0 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.368870:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264078592:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065225.368972:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18103 00000100:00100000:3.0:1746065225.368980:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265598976:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.368987:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.368995:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147adf5 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3d7 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065225.369016:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264078720:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065225.370687:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065225.371373:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.377562:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.377613:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.377629:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.377648:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265599360 00000100:00100000:0.0:1746065225.377656:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265599360 00000100:00100000:0.0:1746065225.377694:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265599616 00000100:00100000:0.0:1746065225.377696:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265599616 00000100:00100000:0.0:1746065225.377714:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18104 00000100:00100000:0.0:1746065225.377720:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+15:2006:x1830881265599360:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065225.377735:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065225.377751:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc147adfc lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3de expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.377790:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065225.377793:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065225.377801:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc147adfc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3de expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065225.377813:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc147adfc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3de expref: 16 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065225.377823:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d9400, rc 0) 00000100:00100000:0.0:1746065225.377858:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+16:2006:x1830881265599360:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 138us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065225.377862:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18104 00000100:00100000:0.0:1746065225.377877:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18105 00000100:00100000:0.0:1746065225.377882:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+17:2006:x1830881265599616:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065225.377888:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065225.377897:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ae03 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3ec expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.377906:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065225.377907:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065225.377911:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ae03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ec expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065225.377919:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ae03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ec expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065225.377926:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8c00, rc 0) 00000100:00100000:0.0:1746065225.377938:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265599616:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 56us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065225.377945:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18105 00000100:00100000:0.0:1746065225.377968:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.377977:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265599872 00000100:00100000:0.0:1746065225.377980:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265599872 00000100:00080000:1.0:1746065225.378032:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1746065225.378036:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065225.378464:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18106 00000100:00100000:0.0:1746065225.378471:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+16:2006:x1830881265599872:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065225.378477:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065225.378484:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ae0a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3fa expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065225.378516:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881264078848:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065225.378554:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64240 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.378593:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.378703:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.378719:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265599488 00000100:00100000:1.0:1746065225.378723:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265599488 00000100:00100000:1.0:1746065225.378743:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18107 00000100:00100000:1.0:1746065225.378748:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265599488:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:1.0:1746065225.378754:0:9549:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.378760:0:9549:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc147ae11 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3e5 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.378771:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.378789:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.378795:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc147ae11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3e5 expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.378803:0:9549:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc147ae11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3e5 expref: 19 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.378810:0:9549:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008d926e00, rc 0) 00000100:00100000:1.0:1746065225.378828:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265599488:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.378833:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18107 00000100:00100000:1.0:1746065225.378850:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265599232 00000100:00100000:1.0:1746065225.378852:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265599232 00002000:00100000:1.0:1746065225.378869:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3444736->3448831) req@ffff88012edadc00 x1830881265599232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.378877:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edadc00 with x1830881265599232 ext(3444736->3448831) 00002000:00010000:1.0:1746065225.378881:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edadc00 00000100:00100000:1.0:1746065225.378890:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6478 00000100:00100000:1.0:1746065225.378894:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265599232:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065225.378970:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265599232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 75us (1416us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065225.378975:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6478 00002000:00100000:1.0:1746065225.378978:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (3444736->3448831) req@ffff88012edadc00 x1830881265599232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.378984:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edadc00 with x1830881265599232 ext(3444736->3448831) 00002000:00010000:1.0:1746065225.378986:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012edadc00 00000100:00100000:2.0:1746065225.381130:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265599744 00000100:00100000:2.0:1746065225.381138:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265599744 00000100:00100000:2.0:1746065225.381170:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18108 00000100:00100000:2.0:1746065225.381177:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265599744:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065225.381189:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.381202:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147ae18 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a3f3 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.381222:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.381224:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.381230:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147ae18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3f3 expref: 19 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.381240:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147ae18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3f3 expref: 19 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.381248:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47a00, rc 0) 00000100:00100000:2.0:1746065225.381296:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265599744:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 119us (2593us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.381301:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18108 00000100:00100000:2.0:1746065225.381344:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.381357:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265600000 00000100:00100000:2.0:1746065225.381360:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265600000 00000100:00100000:2.0:1746065225.381372:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18109 00000100:00100000:2.0:1746065225.381377:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265600000:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065225.381383:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.381391:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc147ae1f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a401 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.381420:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264078976:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065225.381471:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00002000:00010000:2.0:1746065225.381532:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime: 1746065224 -> 1746065225 00000100:00100000:2.0:1746065225.381546:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264078592:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065225.381566:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f46e00/0xad6b7ddc147adee lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3d0 expref: 41 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.381575:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f46e00/0xad6b7ddc147adee lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3d0 expref: 41 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.381583:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46e00, rc 0) 00000100:00100000:2.0:1746065225.381596:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2006:x1830881265598848:12345-192.168.202.27@tcp:101:cat.0 Request processed in 12797us (13445us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065225.381602:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18102 00000100:00100000:2.0:1746065225.385884:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.385909:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.385937:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:3.0:1746065225.386109:0:1880:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime: 1746065224 -> 1746065225 00002000:00010000:3.0:1746065225.386113:0:1880:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime: 1746065224 -> 1746065225 00002000:00010000:3.0:1746065225.386115:0:1880:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime: 1746065224 -> 1746065225 00000100:00100000:3.0:1746065225.386130:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264078720:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065225.386157:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147adf5 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3d7 expref: 33 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.386168:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f877000/0xad6b7ddc147adf5 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3d7 expref: 33 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.386181:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f877000, rc 0) 00000100:00100000:3.0:1746065225.386221:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+32:2006:x1830881265598976:12345-192.168.202.27@tcp:101:cat.0 Request processed in 17241us (17981us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065225.386229:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18103 00000100:00100000:1.0:1746065225.386371:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265600384 00000100:00100000:1.0:1746065225.386377:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265600384 00002000:00100000:1.0:1746065225.386406:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3530751) req@ffff880129f40a80 x1830881265600384/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.386414:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40a80 with x1830881265600384 ext(2097152->3530751) 00002000:00010000:1.0:1746065225.386417:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880129f40a80 00000100:00100000:1.0:1746065225.386428:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265600512 00000100:00100000:1.0:1746065225.386430:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265600512 00002000:00100000:1.0:1746065225.386440:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880129f41f80 x1830881265600512/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.386445:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41f80 with x1830881265600512 ext(2097152->3145727) 00002000:00010000:1.0:1746065225.386447:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f41f80 00000100:00100000:1.0:1746065225.386456:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6479 00000100:00100000:1.0:1746065225.386461:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265600384:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065225.387160:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265600768 00000100:00100000:1.0:1746065225.387164:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265600768 00000100:00100000:1.0:1746065225.387183:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5542 00000100:00100000:1.0:1746065225.387188:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2699:x1830881265600768:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065225.387322:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2699:x1830881265600768:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 132us (1383us total) trans 8589937235 rc 0/0 00000100:00100000:1.0:1746065225.387327:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5542 00000100:00100000:0.0:1746065225.387517:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091b64e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0001_UUID:13375:1830881264078848:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065225.387535:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ae0a lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3fa expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065225.387545:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a4d8a00/0xad6b7ddc147ae0a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3fa expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065225.387557:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a4d8a00, rc 0) 00000100:00100000:0.0:1746065225.387573:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+17:2006:x1830881265599872:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 9103us (9604us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065225.387578:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18106 00000100:00100000:0.0:1746065225.387603:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6480 00000100:00100000:0.0:1746065225.387608:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265600512:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065225.392178:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264078976:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065225.392212:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc147ae1f lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a401 expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065225.392226:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f47c00/0xad6b7ddc147ae1f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a401 expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065225.392236:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f47c00, rc 0) 00000100:00100000:0.0:1746065225.392287:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265600000:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 10898us (10930us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065225.392295:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18109 00000100:00100000:0.0:1746065225.392745:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.396620:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265600896 00000100:00100000:2.0:1746065225.396632:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265600896 00000100:00100000:2.0:1746065225.396684:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18110 00000100:00100000:2.0:1746065225.396691:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+40:2708:x1830881265600896:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065225.396706:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.396722:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a408 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.396748:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.396759:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065225.396760:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065225.396763:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.396805:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.396815:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 19 pid: 1880 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.396825:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264079104:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.396905:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065225.402474:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2006:x1830881265600384:12345-192.168.202.27@tcp:3:cat.0 Request processed in 16004us (16588us total) trans 0 rc 1433600/1433600 00000100:00100000:1.0:1746065225.402485:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6479 00002000:00100000:1.0:1746065225.402494:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3530751) req@ffff880129f40a80 x1830881265600384/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1433600/1433600 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.402502:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f40a80 with x1830881265600384 ext(2097152->3530751) 00010000:00010000:1.0:1746065225.402511:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 18 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.402523:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 18 pid: 1880 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746065225.402529:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880129f40a80 00000100:00100000:2.0:1746065225.405588:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.405614:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265601280 00000100:00100000:2.0:1746065225.405621:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265601280 00000100:00100000:2.0:1746065225.405661:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14707 00000100:00100000:2.0:1746065225.405667:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+7:2712:x1830881265601280:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065225.405684:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.405700:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47c00/0xad6b7ddc147ae2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a40f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.405806:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc147ae34 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.405818:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3bb expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.405825:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc147ae34 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.405849:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3bb expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.405857:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3bb expref: 8 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.405867:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264079232:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065225.406307:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264079104:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065225.406326:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.406337:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46000, rc 0) 00000100:00100000:2.0:1746065225.406422:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:3.0:1746065225.406913:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2708:x1830881265600896:12345-192.168.202.27@tcp:101:cat.0 Request processed in 10221us (14168us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.406921:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18110 00000100:00100000:1.0:1746065225.407579:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.407684:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265601024 00000100:00100000:2.0:1746065225.407688:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265601024 00002000:00100000:2.0:1746065225.407717:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3530752->4194303) req@ffff880091aa4e00 x1830881265601024/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065225.407725:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa4e00 with x1830881265601024 ext(3530752->4194303) 00010000:00010000:2.0:1746065225.407731:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 18 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.407741:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 18 pid: 1880 timeout: 921 lvb_type: 0 00002000:00010000:2.0:1746065225.407748:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091aa4e00 00000100:00100000:2.0:1746065225.407761:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2126 00000100:00100000:2.0:1746065225.407768:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265601024:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065225.422149:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265600512:12345-192.168.202.27@tcp:3:cat.0 Request processed in 34533us (36230us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065225.422159:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6480 00002000:00100000:0.0:1746065225.422168:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->3145727) req@ffff880129f41f80 x1830881265600512/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065225.422177:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880129f41f80 with x1830881265600512 ext(2097152->3145727) 00002000:00010000:0.0:1746065225.422183:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880129f41f80 00000100:00100000:3.0:1746065225.424912:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.424945:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.424966:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265601664 00000100:00100000:3.0:1746065225.424973:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265601664 00010000:00010000:3.0:1746065225.425003:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3bb expref: 9 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746065225.425028:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8463 00000100:00100000:3.0:1746065225.425034:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265601664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065225.425046:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065225.425051:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 5/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3bb expref: 9 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.425061:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3bb expref: 9 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.425085:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065225.425089:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc147ae34 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.425096:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc147ae34 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.425103:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc147ae34 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.425118:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065225.425150:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2004:x1830881265601664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 116us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.425155:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8463 00000100:00100000:1.0:1746065225.425282:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265601536 00000100:00100000:1.0:1746065225.425286:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265601536 00002000:00100000:1.0:1746065225.425312:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3448832->4194303) req@ffff880098dd8700 x1830881265601536/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.425321:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8700 with x1830881265601536 ext(3448832->4194303) 00002000:00010000:1.0:1746065225.425325:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8700 00000100:00100000:1.0:1746065225.425338:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6481 00000100:00100000:1.0:1746065225.425343:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265601536:12345-192.168.202.27@tcp:3:cat.0 00010000:00010000:0.0:1746065225.427638:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60000/0xad6b7ddc147add2 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3bb expref: 8 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746065225.427839:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264079232:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065225.427864:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc147ae34 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.427872:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc147ae34 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.427877:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc147ae34 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065225.427894:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:0.0:1746065225.427994:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f47c00/0xad6b7ddc147ae2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a40f expref: 9 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.428006:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc147ae34 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a40f expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.428013:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065225.428015:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1746065225.428018:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46e00, rc 0) 00000100:00100000:0.0:1746065225.429375:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2712:x1830881265601280:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 23702us (23788us total) trans 8589937236 rc 0/0 00000100:00100000:0.0:1746065225.429383:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14707 00000100:00100000:0.0:1746065225.433362:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.433803:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265601536:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8457us (8895us total) trans 0 rc 745472/745472 00000100:00100000:0.0:1746065225.433813:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6481 00002000:00100000:0.0:1746065225.433822:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3448832->4194303) req@ffff880098dd8700 x1830881265601536/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 745472/745472 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065225.433830:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd8700 with x1830881265601536 ext(3448832->4194303) 00002000:00010000:0.0:1746065225.433836:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd8700 00000100:00100000:3.0:1746065225.434065:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265601792 00000100:00100000:3.0:1746065225.434071:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265601792 00000100:00100000:3.0:1746065225.434109:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18111 00000100:00100000:3.0:1746065225.434115:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2705:x1830881265601792:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.434128:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.434142:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a416 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.434162:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065225.434164:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065225.434168:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 21 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.434178:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 21 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.434191:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f2e00, rc 0) 00000100:00100000:3.0:1746065225.434212:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2705:x1830881265601792:12345-192.168.202.27@tcp:101:cat.0 Request processed in 96us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.434217:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18111 00000100:00100000:1.0:1746065225.438292:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.443607:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265602048 00000100:00100000:0.0:1746065225.443619:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265602048 00000100:00100000:0.0:1746065225.443701:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14708 00000100:00100000:0.0:1746065225.443709:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2712:x1830881265602048:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065225.443730:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065225.443733:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1746065225.443756:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f46e00/0xad6b7ddc147ae34 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a40f expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.443788:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065225.443791:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065225.443800:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147ae49 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a41d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.443873:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc147ae50 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.443884:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc147ae50 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.443891:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc147ae50 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.443902:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc147ae50 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.443907:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc147ae50 lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.443912:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc147ae50 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.443917:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800b52b0400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065225.443920:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc147ae50 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.443926:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc147ae50 lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.443932:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065225.443934:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065225.443937:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc147ae50 lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.443941:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800b52b0400/0xad6b7ddc147ae50 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.443962:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147ae49 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a41d expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.443968:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012db9c000/0xad6b7ddc147ae49 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a41d expref: 8 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.443975:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012db9c000, rc 0) 00000100:00100000:0.0:1746065225.444027:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+7:2712:x1830881265602048:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 319us (5742us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065225.444033:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14708 00000100:00100000:3.0:1746065225.444296:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265601024:12345-192.168.202.27@tcp:4:cat.0 Request processed in 36527us (36717us total) trans 17179874433 rc 0/0 00000100:00100000:3.0:1746065225.444304:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2126 00002000:00100000:3.0:1746065225.444310:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3530752->4194303) req@ffff880091aa4e00 x1830881265601024/t17179874433(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/448 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.444318:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa4e00 with x1830881265601024 ext(3530752->4194303) 00010000:00010000:3.0:1746065225.444325:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 21 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.444336:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 21 pid: 1880 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746065225.444341:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091aa4e00 00000100:00100000:0.0:1746065225.451313:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.451402:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265602304 00000100:00100000:1.0:1746065225.451410:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265602304 00000100:00100000:1.0:1746065225.451457:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5543 00000100:00100000:1.0:1746065225.451464:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2712:x1830881265602304:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:1.0:1746065225.451644:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2712:x1830881265602304:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 179us (338us total) trans 8589937237 rc 0/0 00000100:00100000:1.0:1746065225.451650:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5543 00000100:00100000:0.0:1746065225.458338:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.458419:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265602432 00000100:00100000:2.0:1746065225.458427:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265602432 00010000:00010000:2.0:1746065225.458458:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 21 pid: 1880 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.458495:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8464 00000100:00100000:2.0:1746065225.458503:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265602432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065225.458516:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065225.458534:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 21 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.458543:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 21 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.458561:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147ada1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3530752->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3a6 expref: 21 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.458590:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.458592:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.458597:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.458604:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.458611:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.458612:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.458614:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.458624:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.458648:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.458658:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264079360:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065225.458741:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.458748:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264079488:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065225.458765:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065225.469372:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.469444:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265602688 00000100:00100000:3.0:1746065225.469452:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265602688 00002000:00100000:3.0:1746065225.469488:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880091aa7800 x1830881265602688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.469497:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa7800 with x1830881265602688 ext(2097152->3145727) 00002000:00010000:3.0:1746065225.469502:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa7800 00000100:00100000:3.0:1746065225.469520:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6482 00000100:00100000:3.0:1746065225.469527:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265602688:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065225.471131:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264079360:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065225.471143:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:7192:1830881264079488:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065225.471161:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.474435:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265602432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 15922us (16093us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.474448:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8464 00000100:00100000:0.0:1746065225.482046:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.483507:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265602944 00000100:00100000:1.0:1746065225.483516:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265602944 00002000:00100000:1.0:1746065225.483552:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009adf6a00 x1830881265602944/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.483562:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf6a00 with x1830881265602944 ext(3145728->4194303) 00002000:00010000:1.0:1746065225.483567:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf6a00 00000100:00100000:1.0:1746065225.483600:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6483 00000100:00100000:1.0:1746065225.483608:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265602944:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065225.498103:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+41:2006:x1830881265602688:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28567us (28731us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065225.498113:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6482 00002000:00100000:3.0:1746065225.498122:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff880091aa7800 x1830881265602688/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.498131:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa7800 with x1830881265602688 ext(2097152->3145727) 00002000:00010000:3.0:1746065225.498136:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091aa7800 00000100:00100000:1.0:1746065225.498259:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265602944:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14651us (16229us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065225.498265:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6483 00002000:00100000:1.0:1746065225.498270:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009adf6a00 x1830881265602944/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.498288:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf6a00 with x1830881265602944 ext(3145728->4194303) 00002000:00010000:1.0:1746065225.498291:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009adf6a00 00000100:00100000:0.0:1746065225.499678:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.501707:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265603072 00000100:00100000:2.0:1746065225.501716:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265603072 00000100:00100000:2.0:1746065225.501765:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18112 00000100:00100000:2.0:1746065225.501785:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2711:x1830881265603072:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065225.501799:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.501813:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a424 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.501838:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147ad4d lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a360 expref: 19 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.501846:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ae03 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ec expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.501852:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147ad8c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a391 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.501858:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.501859:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.501862:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1388544->2097151] (req 1388544->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.501887:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147ad8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a391 expref: 33 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.501897:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147ad8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a391 expref: 33 pid: 12258 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746065225.501907:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264079616:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.502992:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ae03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ec expref: 18 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.503002:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ae03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ec expref: 18 pid: 13375 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746065225.503010:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264079744:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.503980:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147ad4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a360 expref: 19 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.503989:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147ad4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a360 expref: 19 pid: 11461 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746065225.503997:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264079872:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.504959:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.512360:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.512414:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.512450:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265603200 00000100:00100000:0.0:1746065225.512457:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265603200 00010000:00010000:0.0:1746065225.512492:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147ad8c lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a391 expref: 34 pid: 12258 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746065225.512700:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264079616:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.512709:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264079744:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.512716:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264079872:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.512740:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1388544->2097151] (req 1388544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.512754:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880097b61400, rc 0) 00000100:00100000:2.0:1746065225.512813:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2711:x1830881265603072:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11041us (13137us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.512820:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18112 00000100:00100000:3.0:1746065225.514327:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265603328 00000100:00100000:3.0:1746065225.514333:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265603328 00010000:00010000:3.0:1746065225.514355:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ae03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ec expref: 19 pid: 13375 timeout: 921 lvb_type: 1 00000100:00100000:3.0:1746065225.514377:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8465 00000100:00100000:3.0:1746065225.514383:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265603200:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1746065225.514391:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8466 00010000:00010000:3.0:1746065225.514393:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1746065225.514397:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265603328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065225.514403:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065225.514409:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147ad8c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a391 expref: 33 pid: 12258 timeout: 921 lvb_type: 1 00010000:00010000:1.0:1746065225.514410:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ae03 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ec expref: 19 pid: 13375 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.514417:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147ad8c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a391 expref: 33 pid: 12258 timeout: 921 lvb_type: 1 00010000:00010000:1.0:1746065225.514437:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ae03 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ec expref: 19 pid: 13375 timeout: 921 lvb_type: 1 00010000:00010000:1.0:1746065225.514453:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a4d8c00/0xad6b7ddc147ae03 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ec expref: 19 pid: 13375 timeout: 921 lvb_type: 1 00010000:00010000:1.0:1746065225.514471:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065225.514498:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265603328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 102us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.514504:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8466 00010000:00010000:3.0:1746065225.514533:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2200/0xad6b7ddc147ad8c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a391 expref: 33 pid: 12258 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.514699:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065225.514719:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265603200:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 336us (2367us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.514725:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8465 00000100:00100000:1.0:1746065225.514800:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.514838:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.514946:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265603456 00000100:00100000:3.0:1746065225.514949:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265603456 00000100:00100000:3.0:1746065225.514970:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18113 00000100:00100000:3.0:1746065225.514974:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+32:2708:x1830881265603456:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.514986:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.514996:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a42b expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.515013:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 19 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.515019:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065225.515021:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065225.515024:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 4/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.515046:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 19 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.515055:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 19 pid: 10219 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746065225.515069:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264080000:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065225.515114:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0ea80 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.515173:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265603712 00000100:00100000:0.0:1746065225.515176:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265603712 00002000:00100000:0.0:1746065225.515200:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88008f7fc700 x1830881265603712/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065225.515209:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fc700 with x1830881265603712 ext(4194304->5038079) 00002000:00010000:0.0:1746065225.515212:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fc700 00000100:00100000:0.0:1746065225.515225:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6484 00000100:00100000:0.0:1746065225.515230:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265603712:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065225.518326:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.518530:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265603840 00000100:00100000:3.0:1746065225.518537:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265603840 00010000:00010000:3.0:1746065225.518564:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147ad4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a360 expref: 20 pid: 11461 timeout: 921 lvb_type: 1 00000100:00100000:3.0:1746065225.518594:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8467 00000100:00100000:3.0:1746065225.518600:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265603840:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065225.518610:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065225.518625:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147ad4d lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a360 expref: 20 pid: 11461 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.518634:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147ad4d lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a360 expref: 20 pid: 11461 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.518651:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147ad4d lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a360 expref: 20 pid: 11461 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.518662:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.518663:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.518669:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.518676:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.518702:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065225.518713:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264080128:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065225.518804:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae0e840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.523698:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.523765:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264080000:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065225.523799:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 3/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.523812:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f3400, rc 0) 00000100:00100000:3.0:1746065225.523845:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2708:x1830881265603456:12345-192.168.202.27@tcp:101:cat.0 Request processed in 8871us (9046us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.523852:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18113 00000100:00100000:0.0:1746065225.523985:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.524078:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265603712:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8847us (9239us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746065225.524085:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6484 00002000:00100000:1.0:1746065225.524092:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff88008f7fc700 x1830881265603712/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.524100:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fc700 with x1830881265603712 ext(4194304->5038079) 00002000:00010000:1.0:1746065225.524104:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f7fc700 00000100:00100000:2.0:1746065225.524249:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264080128:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065225.524258:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.524283:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265603840:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5674us (5955us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.524291:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8467 00000100:00100000:1.0:1746065225.524694:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265604224 00000100:00100000:1.0:1746065225.524700:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265604224 00002000:00100000:1.0:1746065225.524723:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x95:0x0] (1388544->1392639) req@ffff88009adf5c00 x1830881265604224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.524731:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5c00 with x1830881265604224 ext(1388544->1392639) 00002000:00010000:1.0:1746065225.524734:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf5c00 00000100:00100000:1.0:1746065225.524751:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265603968 00000100:00100000:1.0:1746065225.524753:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265603968 00002000:00100000:1.0:1746065225.524762:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3448831) req@ffff88009adf7480 x1830881265603968/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.524767:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7480 with x1830881265603968 ext(3145728->3448831) 00010000:00010000:1.0:1746065225.524787:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 20 pid: 10219 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.524797:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 20 pid: 10219 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746065225.524803:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009adf7480 00000100:00100000:1.0:1746065225.524813:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2127 00000100:00100000:1.0:1746065225.524818:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265603968:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065225.524913:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6485 00000100:00100000:1.0:1746065225.524917:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265604224:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065225.524978:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265604224:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 60us (1286us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065225.524982:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6485 00002000:00100000:1.0:1746065225.524986:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1388544->1392639) req@ffff88009adf5c00 x1830881265604224/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.524992:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf5c00 with x1830881265604224 ext(1388544->1392639) 00002000:00010000:1.0:1746065225.524995:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88009adf5c00 00000100:00100000:1.0:1746065225.532245:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.532263:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.532915:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265604352 00000100:00100000:2.0:1746065225.532924:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265604352 00000100:00100000:2.0:1746065225.532956:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265604480 00000100:00100000:2.0:1746065225.532958:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265604480 00000100:00100000:2.0:1746065225.532971:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18114 00000100:00100000:2.0:1746065225.532977:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265604352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065225.532992:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.533006:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147ae65 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a432 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.533048:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264080256:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065225.533111:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065225.533129:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18115 00000100:00100000:2.0:1746065225.533134:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265604480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065225.533141:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.533149:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6000/0xad6b7ddc147ae6c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a439 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.533170:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264080384:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065225.533188:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.536649:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2006:x1830881265603968:12345-192.168.202.27@tcp:4:cat.0 Request processed in 11823us (12656us total) trans 21474841807 rc 0/0 00000100:00100000:0.0:1746065225.536659:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2127 00002000:00100000:0.0:1746065225.536668:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (3145728->3448831) req@ffff88009adf7480 x1830881265603968/t21474841807(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/448 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065225.536677:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009adf7480 with x1830881265603968 ext(3145728->3448831) 00010000:00010000:0.0:1746065225.536685:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 25 pid: 10219 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746065225.536703:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 25 pid: 10219 timeout: 921 lvb_type: 0 00002000:00010000:0.0:1746065225.536709:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88009adf7480 00002000:00010000:2.0:1746065225.547032:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065224 -> 1746065225 00000100:00100000:2.0:1746065225.547055:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264080256:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065225.547082:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147ae65 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a432 expref: 24 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.547099:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c539800/0xad6b7ddc147ae65 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a432 expref: 24 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.547122:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c539800, rc 0) 00000100:00100000:2.0:1746065225.547163:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265604352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14185us (14924us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065225.547171:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18114 00000100:00100000:2.0:1746065225.547261:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264080384:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065225.547283:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065225.547289:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6000/0xad6b7ddc147ae6c lrc: 1/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a439 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.547297:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f6000/0xad6b7ddc147ae6c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a439 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065225.547300:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265604608 00010000:00010000:2.0:1746065225.547304:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f7f6000, rc 0) 00000100:00100000:1.0:1746065225.547304:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265604608 00000100:00100000:2.0:1746065225.547320:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265604480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 14186us (15056us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065225.547325:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18115 00000100:00100000:1.0:1746065225.547329:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18116 00000100:00100000:1.0:1746065225.547335:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2711:x1830881265604608:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065225.547346:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.547357:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a440 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.547377:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.547384:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147ae18 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3f3 expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.547390:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.547396:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.547397:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.547400:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->1110015] (req 1048576->1110015) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 42 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.547425:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.547431:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065225.547433:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 42 pid: 1880 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.547442:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264080512:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.547447:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265604736 00000100:00100000:2.0:1746065225.547450:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265604736 00010000:00010000:2.0:1746065225.547465:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 21 pid: 10219 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.547483:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8468 00000100:00100000:2.0:1746065225.547488:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265604736:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065225.547495:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065225.547568:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 21 pid: 10219 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.547577:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 21 pid: 10219 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.547589:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099524000/0xad6b7ddc147ade0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->3448831) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c2 expref: 21 pid: 10219 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.547598:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.547600:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.547605:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.547611:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.547628:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.547632:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147ae18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3f3 expref: 16 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065225.547640:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880129f40700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881264080640:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065225.547640:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147ae18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3f3 expref: 16 pid: 9550 timeout: 921 lvb_type: 1 00000100:00100000:1.0:1746065225.547647:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264080768:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.547660:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5b40 going to sleep for 11 seconds 00010000:00010000:1.0:1746065225.547673:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.547679:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 19 pid: 9548 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.547687:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264080896:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.547699:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.554813:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.554848:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.554866:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.554887:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.555134:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265604992 00000100:00100000:2.0:1746065225.555142:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265604992 00000100:00100000:2.0:1746065225.555173:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265605120 00000100:00100000:2.0:1746065225.555175:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265605120 00000100:00100000:2.0:1746065225.555187:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18117 00000100:00100000:2.0:1746065225.555192:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009adf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265604992:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065225.555207:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.555220:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c538800/0xad6b7ddc147ae7a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a447 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.555265:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264081024:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065225.555514:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264080512:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.555525:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264080768:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.555532:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264080896:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065225.555558:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [1048576->1110015] (req 1048576->1110015) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 42 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.555569:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f72c00, rc 0) 00000100:00100000:0.0:1746065225.556075:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.556084:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18118 00000100:00100000:3.0:1746065225.556092:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265605120:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.556100:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.556108:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc147ae81 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a44e expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.556119:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.556121:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.556128:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc147ae81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a44e expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.556139:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc147ae81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a44e expref: 24 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.556147:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31800, rc 0) 00000100:00100000:2.0:1746065225.556229:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065225.556248:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265604864 00000100:00100000:2.0:1746065225.556251:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265604864 00010000:00010000:2.0:1746065225.556266:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 43 pid: 1880 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.556402:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f09ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+43:2711:x1830881265604608:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 9065us (9128us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.556408:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18116 00000100:00100000:1.0:1746065225.556431:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265605248 00000100:00100000:1.0:1746065225.556434:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265605248 00010000:00010000:1.0:1746065225.556444:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147ae18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3f3 expref: 17 pid: 9550 timeout: 921 lvb_type: 1 00000100:00100000:1.0:1746065225.556460:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265605376 00000100:00100000:1.0:1746065225.556462:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265605376 00010000:00010000:1.0:1746065225.556470:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 20 pid: 9548 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746065225.556493:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265605120:12345-192.168.202.27@tcp:101:cat.0 Request processed in 400us (1624us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.556498:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18118 00000100:00100000:3.0:1746065225.556519:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8469 00000100:00100000:3.0:1746065225.556524:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+17:2006:x1830881265605248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065225.556533:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065225.556548:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147ae18 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3f3 expref: 17 pid: 9550 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.556557:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147ae18 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3f3 expref: 17 pid: 9550 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.556571:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f47a00/0xad6b7ddc147ae18 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3f3 expref: 17 pid: 9550 timeout: 921 lvb_type: 1 00010000:00010000:3.0:1746065225.556592:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065225.556609:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+16:2006:x1830881265605248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 84us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.556614:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8469 00000100:00100000:3.0:1746065225.556648:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880129f40700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:7190:1830881264080640:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065225.556723:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8470 00000100:00100000:2.0:1746065225.556729:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+42:2005:x1830881265604864:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065225.556737:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065225.556745:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 42 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.556754:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 42 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.556765:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f60600/0xad6b7ddc147ada8 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3ad expref: 42 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.556788:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.556805:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88013770bc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265604864:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 76us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.556811:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8470 00000100:00100000:1.0:1746065225.557302:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8471 00000100:00100000:1.0:1746065225.557309:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265605376:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065225.557316:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065225.557323:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 20 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.557331:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 20 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.557343:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f47000/0xad6b7ddc147ad9a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a39f expref: 20 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.557361:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.557363:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.557367:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.557373:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.557394:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065225.557404:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264081152:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065225.557444:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f000 going to sleep for 11 seconds 00010000:00010000:3.0:1746065225.557595:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065225.557616:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880129f41880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265604736:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 10127us (10185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065225.557625:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8468 00000100:00100000:0.0:1746065225.560093:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264081024:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065225.560128:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008c538800/0xad6b7ddc147ae7a lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a447 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065225.560140:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538800/0xad6b7ddc147ae7a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a447 expref: 22 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065225.560365:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538800, rc 0) 00000100:00100000:0.0:1746065225.560968:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009adf4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265604992:12345-192.168.202.27@tcp:101:cat.0 Request processed in 5773us (6116us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065225.560977:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18117 00000100:00100000:0.0:1746065225.561596:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264081152:192.168.202.27@tcp:105: 00010000:00010000:0.0:1746065225.561609:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065225.561646:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265605376:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4337us (5572us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065225.561657:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8471 00000100:00100000:3.0:1746065225.561690:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.561750:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.561766:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265605632 00000100:00100000:3.0:1746065225.561785:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265605632 00002000:00100000:3.0:1746065225.561812:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880098dd9180 x1830881265605632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.561820:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9180 with x1830881265605632 ext(2097152->4194303) 00002000:00010000:3.0:1746065225.561824:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd9180 00000100:00100000:3.0:1746065225.561834:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265605888 00000100:00100000:3.0:1746065225.561836:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265605888 00002000:00100000:3.0:1746065225.561845:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880098dd9c00 x1830881265605888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.561852:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9c00 with x1830881265605888 ext(3145728->4194303) 00002000:00010000:3.0:1746065225.561854:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9c00 00000100:00100000:3.0:1746065225.561879:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6486 00000100:00100000:3.0:1746065225.561885:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265605632:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065225.561955:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6487 00000100:00100000:2.0:1746065225.561964:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265605888:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065225.562911:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.563293:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265606144 00000100:00100000:1.0:1746065225.563297:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265606144 00002000:00100000:1.0:1746065225.563317:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1105920->1110015) req@ffff880097fa1f80 x1830881265606144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.563325:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1f80 with x1830881265606144 ext(1105920->1110015) 00002000:00010000:1.0:1746065225.563328:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1f80 00000100:00100000:1.0:1746065225.563340:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6488 00000100:00100000:1.0:1746065225.563345:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265606144:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065225.563408:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265606144:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 62us (498us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065225.563414:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6488 00002000:00100000:1.0:1746065225.563419:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x77:0x0] (1105920->1110015) req@ffff880097fa1f80 x1830881265606144/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.563425:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa1f80 with x1830881265606144 ext(1105920->1110015) 00002000:00010000:1.0:1746065225.563427:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa1f80 00000100:00100000:0.0:1746065225.571734:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.571869:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265606400 00000100:00100000:3.0:1746065225.571879:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265606400 00000100:00100000:3.0:1746065225.571934:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5544 00000100:00100000:3.0:1746065225.571940:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2705:x1830881265606400:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065225.572633:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2705:x1830881265606400:12345-192.168.202.27@tcp:35:cat.0 Request processed in 690us (905us total) trans 8589937238 rc 0/0 00000100:00100000:3.0:1746065225.572640:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5544 00000100:00100000:2.0:1746065225.575362:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265605888:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 13391us (13602us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065225.575373:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6487 00002000:00100000:2.0:1746065225.575383:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff880098dd9c00 x1830881265605888/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065225.575560:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9c00 with x1830881265605888 ext(3145728->4194303) 00002000:00010000:2.0:1746065225.575566:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098dd9c00 00000100:00100000:0.0:1746065225.583633:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.584464:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265606656 00000100:00100000:3.0:1746065225.584472:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265606656 00000100:00100000:3.0:1746065225.584527:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5545 00000100:00100000:3.0:1746065225.584535:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4299050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2711:x1830881265606656:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:2.0:1746065225.585000:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265605632:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 23113us (23309us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065225.585008:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6486 00002000:00100000:2.0:1746065225.585015:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880098dd9180 x1830881265605632/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065225.585024:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098dd9180 with x1830881265605632 ext(2097152->4194303) 00002000:00010000:2.0:1746065225.585029:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098dd9180 00000100:00100000:3.0:1746065225.585427:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4299050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2711:x1830881265606656:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 893us (1802us total) trans 8589937239 rc 0/0 00000100:00100000:3.0:1746065225.585433:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5545 00000100:00100000:0.0:1746065225.589530:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.589648:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265606784 00000100:00100000:2.0:1746065225.589657:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265606784 00000100:00100000:2.0:1746065225.589709:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14709 00000100:00100000:2.0:1746065225.589717:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2716:x1830881265606784:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065225.589737:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.589754:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ae88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a455 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.589824:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ae8f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.589835:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ae8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.589844:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ae8f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.589854:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147ae96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.589859:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147ae96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.589864:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147ae96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.589924:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.589932:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.589938:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065225.589969:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00000004:00200000:2.0:1746065225.589973:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065225.589987:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.589996:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590003:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ae8f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590008:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ae8f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590013:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ae8f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590019:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ae8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590024:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5a000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065225.590027:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ae8f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590034:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ae8f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590043:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065225.590046:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065225.590049:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ae8f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590054:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147ae8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590079:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147ae96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590085:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147ae96 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590089:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147ae96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590094:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5a400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065225.590096:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147ae96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590100:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147ae96 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590106:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5d900) 00010000:00010000:2.0:1746065225.590108:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065225.590110:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147ae96 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590114:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147ae96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.590135:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147ae88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a455 expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.590145:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a455 expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.590151:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.590154:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065225.590156:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5ac00, rc 0) 00000100:00100000:2.0:1746065225.590197:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+9:2716:x1830881265606784:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 482us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.590203:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14709 00000100:00100000:0.0:1746065225.594150:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.594192:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.594220:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.594248:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.594488:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265607040 00000100:00100000:2.0:1746065225.594497:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265607040 00002000:00100000:2.0:1746065225.594536:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097fa0a80 x1830881265607040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065225.594546:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0a80 with x1830881265607040 ext(4194304->5038079) 00002000:00010000:2.0:1746065225.594551:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0a80 00000100:00100000:2.0:1746065225.594577:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6489 00000100:00100000:2.0:1746065225.594584:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265607040:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065225.595134:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265607168 00000100:00100000:2.0:1746065225.595138:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265607168 00000100:00100000:2.0:1746065225.595161:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265607296 00000100:00100000:2.0:1746065225.595163:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265607296 00000100:00100000:2.0:1746065225.595173:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265607552 00000100:00100000:2.0:1746065225.595174:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265607552 00000100:00100000:2.0:1746065225.595186:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18119 00000100:00100000:2.0:1746065225.595191:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+19:2007:x1830881265607168:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065225.595200:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.595212:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147aea4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a45c expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.595252:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264081280:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065225.595316:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065225.595334:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18120 00000100:00100000:2.0:1746065225.595339:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+16:2006:x1830881265607296:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065225.595346:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.595356:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc147aeab lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a463 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.595378:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264081408:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065225.595399:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065225.595410:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18121 00000100:00100000:2.0:1746065225.595414:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+20:2006:x1830881265607552:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065225.595420:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.595426:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc147aeb2 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a471 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.595436:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.595438:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.595444:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc147aeb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a471 expref: 21 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.595457:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc147aeb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a471 expref: 21 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.595465:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090685400, rc 0) 00000100:00100000:2.0:1746065225.595484:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+21:2006:x1830881265607552:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 69us (1235us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.595489:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18121 00000100:00100000:0.0:1746065225.597226:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.598118:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265607424 00000100:00100000:1.0:1746065225.598126:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265607424 00000100:00100000:1.0:1746065225.598171:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18122 00000100:00100000:1.0:1746065225.598177:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265607424:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065225.598191:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.598204:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147aeb9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a46a expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.598223:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.598224:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.598232:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147aeb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a46a expref: 19 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.598244:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147aeb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a46a expref: 19 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.598252:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656ee00, rc 0) 00000100:00100000:1.0:1746065225.598299:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265607424:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 121us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.598304:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18122 00000100:00100000:3.0:1746065225.602736:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264081280:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065225.602763:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147aea4 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a45c expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065225.602882:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+41:2007:x1830881265607040:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8296us (8736us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065225.602893:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6489 00002000:00100000:2.0:1746065225.602901:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880097fa0a80 x1830881265607040/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065225.602909:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa0a80 with x1830881265607040 ext(4194304->5038079) 00002000:00010000:2.0:1746065225.602913:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097fa0a80 00010000:00010000:3.0:1746065225.603078:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008ec5b200/0xad6b7ddc147aea4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a45c expref: 20 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.603100:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b200, rc 0) 00000100:00100000:3.0:1746065225.603120:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+19:2007:x1830881265607168:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7928us (8928us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065225.603127:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18119 00002000:00010000:2.0:1746065225.605260:0:1880:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime: 1746065224 -> 1746065225 00000100:00100000:2.0:1746065225.605290:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aba7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264081408:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065225.605316:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc147aeab lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a463 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.605327:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880130105000/0xad6b7ddc147aeab lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a463 expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.606659:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130105000, rc 0) 00000100:00100000:2.0:1746065225.606716:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c45a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+17:2006:x1830881265607296:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 11374us (12493us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065225.606724:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18120 00000100:00100000:0.0:1746065225.611542:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.611880:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265607808 00000100:00100000:3.0:1746065225.611888:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265607808 00000100:00100000:3.0:1746065225.611925:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5546 00000100:00100000:3.0:1746065225.611931:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2708:x1830881265607808:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:0.0:1746065225.611949:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.611964:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265608064 00000100:00100000:0.0:1746065225.611967:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265608064 00000100:00100000:0.0:1746065225.611989:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14710 00000100:00100000:0.0:1746065225.611993:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+9:2716:x1830881265608064:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065225.612001:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065225.612015:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc147aec0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a478 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.612069:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.612081:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a455 expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065225.612083:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c458000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2708:x1830881265607808:12345-192.168.202.27@tcp:35:cat.0 Request processed in 152us (550us total) trans 8589937240 rc 0/0 00010000:00010000:0.0:1746065225.612088:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00000100:00100000:3.0:1746065225.612089:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5546 00010000:00010000:0.0:1746065225.612115:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a455 expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.612123:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a455 expref: 10 pid: 7204 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746065225.612134:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880136a7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264081536:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065225.612183:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065225.615013:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880136a7b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264081536:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.615032:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065225.615687:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.615735:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265608192 00000100:00100000:0.0:1746065225.615740:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265608192 00010000:00010000:0.0:1746065225.615763:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a455 expref: 11 pid: 7204 timeout: 921 lvb_type: 0 00000100:00100000:0.0:1746065225.615819:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8472 00000100:00100000:0.0:1746065225.615826:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2004:x1830881265608192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065225.615837:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065225.615842:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a455 expref: 11 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746065225.615852:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a455 expref: 11 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746065225.615871:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ac00/0xad6b7ddc147ae9d lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a455 expref: 11 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:0.0:1746065225.615890:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065225.615895:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.615904:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.615909:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.615935:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065225.615962:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2004:x1830881265608192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 136us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065225.615967:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8472 00010000:00010000:3.0:1746065225.617040:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.617048:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:3.0:1746065225.617063:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:3.0:1746065225.617152:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abac800/0xad6b7ddc147aec0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a478 expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.617163:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a478 expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.617169:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065225.617171:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1746065225.617173:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abaca00, rc 0) 00000100:00100000:3.0:1746065225.617211:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2716:x1830881265608064:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 5216us (5261us total) trans 8589937241 rc 0/0 00000100:00100000:3.0:1746065225.617217:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14710 00000100:00100000:0.0:1746065225.620318:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.620624:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265608320 00000100:00100000:3.0:1746065225.620632:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265608320 00000100:00100000:3.0:1746065225.620752:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14711 00000100:00100000:3.0:1746065225.621084:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2716:x1830881265608320:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065225.621105:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.621119:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31200/0xad6b7ddc147aed5 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a47f expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.621191:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.621207:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a478 expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.621214:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065225.621242:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a478 expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.621252:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a478 expref: 11 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746065225.621263:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264081664:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065225.621340:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.629317:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.629411:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265608448 00000100:00100000:2.0:1746065225.629419:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265608448 00010000:00010000:2.0:1746065225.629451:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a478 expref: 12 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.629477:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8473 00000100:00100000:2.0:1746065225.629483:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265608448:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065225.629495:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065225.629501:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 5/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a478 expref: 12 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.629516:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a478 expref: 12 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.629536:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.629540:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.629549:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.629555:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.629570:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.631934:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+12:2005:x1830881265608448:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2443us (2617us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.631943:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8473 00010000:00010000:2.0:1746065225.631992:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abaca00/0xad6b7ddc147aec7 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a478 expref: 11 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.632016:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264081664:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.632031:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.632038:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.632043:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065225.632084:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00000004:00200000:2.0:1746065225.632088:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065225.632101:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.632126:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31200/0xad6b7ddc147aed5 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a47f expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.632136:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a47f expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.632143:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.632146:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065225.632149:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30000, rc 0) 00000100:00100000:2.0:1746065225.633976:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880136a7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2716:x1830881265608320:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 13208us (14194us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.633985:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14711 00000100:00100000:0.0:1746065225.638083:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.638122:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.638181:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265608704 00000100:00100000:2.0:1746065225.638188:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265608704 00000100:00100000:2.0:1746065225.638219:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265608576 00000100:00100000:2.0:1746065225.638221:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265608576 00000100:00100000:2.0:1746065225.638244:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18123 00000100:00100000:2.0:1746065225.638251:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+17:2006:x1830881265608704:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065225.638267:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065225.638267:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18124 00000100:00100000:1.0:1746065225.638282:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265608576:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065225.638288:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.638290:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc147aee3 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a48d expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.638415:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc147aeea lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a486 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065225.638452:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264081792:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065225.638516:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065225.638710:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264081920:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065225.639040:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065225.640734:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264081792:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065225.640756:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc147aeea lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a486 expref: 20 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.640767:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a656ec00/0xad6b7ddc147aeea lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a486 expref: 20 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.640808:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656ec00, rc 0) 00000100:00100000:1.0:1746065225.641758:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c528a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265608576:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3482us (3632us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065225.641766:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18124 00000100:00100000:0.0:1746065225.641797:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.641957:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264081920:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065225.641975:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc147aee3 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a48d expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.641983:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdbe00/0xad6b7ddc147aee3 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a48d expref: 18 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.641994:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdbe00, rc 0) 00000100:00100000:2.0:1746065225.642013:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c529f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:02506576-29fe-43be-8266-ebca0ccafd52+17:2006:x1830881265608704:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3763us (3938us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065225.642019:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18123 00000100:00100000:2.0:1746065225.642050:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265608960 00000100:00100000:2.0:1746065225.642055:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265608960 00000100:00100000:2.0:1746065225.642092:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14712 00000100:00100000:2.0:1746065225.642098:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2720:x1830881265608960:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065225.642112:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.642307:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147aef1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a494 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.643103:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda800/0xad6b7ddc147aef8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643114:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda800/0xad6b7ddc147aef8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643123:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda800/0xad6b7ddc147aef8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643137:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc147aeff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643142:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc147aeff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643147:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc147aeff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643221:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880130105000/0xad6b7ddc147af06 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643229:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880130105000/0xad6b7ddc147af06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643234:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880130105000/0xad6b7ddc147af06 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065225.643241:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:2.0:1746065225.643307:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda800/0xad6b7ddc147aef8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643313:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda800/0xad6b7ddc147aef8 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643317:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda800/0xad6b7ddc147aef8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643322:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda800/0xad6b7ddc147aef8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643327:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fda800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065225.643329:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda800/0xad6b7ddc147aef8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643337:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda800/0xad6b7ddc147aef8 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643346:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065225.643348:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065225.643351:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda800/0xad6b7ddc147aef8 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643355:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fda800/0xad6b7ddc147aef8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643362:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc147aeff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643944:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc147aeff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643949:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc147aeff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643954:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095fdb800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065225.643957:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc147aeff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643962:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc147aeff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643969:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5d700) 00010000:00010000:2.0:1746065225.643971:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065225.643973:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc147aeff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.643977:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdb800/0xad6b7ddc147aeff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.644010:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095fdaa00/0xad6b7ddc147aef1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a494 expref: 14 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.644019:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880130105000/0xad6b7ddc147af06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a494 expref: 13 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.644025:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.644026:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065225.644028:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880130105000, rc 0) 00000100:00100000:2.0:1746065225.644071:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2720:x1830881265608960:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1972us (2274us total) trans 8589937242 rc 0/0 00000100:00100000:2.0:1746065225.644078:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14712 00000100:00100000:0.0:1746065225.644827:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.644913:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265609216 00000100:00100000:2.0:1746065225.644919:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265609216 00000100:00100000:2.0:1746065225.645243:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14713 00000100:00100000:2.0:1746065225.645252:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2716:x1830881265609216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065225.645264:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.645286:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147af14 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a49b expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.645343:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a1e800/0xad6b7ddc147af1b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.645352:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880092a1e800/0xad6b7ddc147af1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.645358:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880092a1e800/0xad6b7ddc147af1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.645370:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff880092a1e800/0xad6b7ddc147af1b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.645374:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880092a1e800/0xad6b7ddc147af1b lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.645378:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880092a1e800/0xad6b7ddc147af1b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.645382:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880092a1e800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065225.645385:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a1e800/0xad6b7ddc147af1b lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.645390:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880092a1e800/0xad6b7ddc147af1b lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.645396:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.645398:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065225.645400:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880092a1e800/0xad6b7ddc147af1b lrc: 2/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.645404:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880092a1e800/0xad6b7ddc147af1b lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065225.645419:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147af14 lrc: 1/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a49b expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.645425:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147af14 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a49b expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.645430:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f04b600, rc 0) 00000100:00100000:2.0:1746065225.645458:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008c52aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2716:x1830881265609216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 208us (632us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065225.645463:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14713 00000100:00100000:0.0:1746065225.650105:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.650192:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265609472 00000100:00100000:1.0:1746065225.650200:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265609472 00000100:00100000:1.0:1746065225.650248:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5547 00000100:00100000:1.0:1746065225.650255:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+10:2716:x1830881265609472:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:1.0:1746065225.652032:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+11:2716:x1830881265609472:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 1773us (1930us total) trans 8589937243 rc 0/0 00000100:00100000:1.0:1746065225.652040:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5547 00000100:00100000:0.0:1746065225.678394:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.678483:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265609600 00000100:00100000:2.0:1746065225.678491:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265609600 00000100:00100000:2.0:1746065225.678541:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18125 00000100:00100000:2.0:1746065225.678548:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2720:x1830881265609600:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065225.678563:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.678582:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4a2 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.678608:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.678617:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147aeb9 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a46a expref: 16 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.678624:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.678630:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.678632:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.678636:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 6/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2383872->2691071] (req 2383872->2691071) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.678664:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.678673:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 20 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.678685:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264082048:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.678801:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147aeb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a46a expref: 16 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.678809:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147aeb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a46a expref: 16 pid: 9548 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746065225.678816:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264082176:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.678852:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 40 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.678860:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 40 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.678866:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264082304:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.678882:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065225.681675:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264082048:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.681685:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264082176:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.681692:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264082304:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.681718:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [2383872->2691071] (req 2383872->2691071) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.681736:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fdaa00, rc 0) 00000100:00100000:2.0:1746065225.681769:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2720:x1830881265609600:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 3221us (3382us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.681807:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18125 00000100:00100000:0.0:1746065225.687882:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.687922:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.688008:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.688597:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265609856 00000100:00100000:2.0:1746065225.688605:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265609856 00010000:00010000:2.0:1746065225.688636:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147aeb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a46a expref: 17 pid: 9548 timeout: 921 lvb_type: 1 00000100:00100000:2.0:1746065225.688865:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265609728 00000100:00100000:2.0:1746065225.688869:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265609728 00010000:00010000:2.0:1746065225.688881:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 20 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.688947:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265609984 00000100:00100000:1.0:1746065225.688951:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265609984 00010000:00010000:1.0:1746065225.688965:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 41 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.688983:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8474 00000100:00100000:1.0:1746065225.688990:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+17:2004:x1830881265609856:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065225.689002:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065225.689019:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147aeb9 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a46a expref: 17 pid: 9548 timeout: 921 lvb_type: 1 00010000:00010000:1.0:1746065225.689028:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147aeb9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a46a expref: 17 pid: 9548 timeout: 921 lvb_type: 1 00010000:00010000:1.0:1746065225.689043:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a656ee00/0xad6b7ddc147aeb9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a46a expref: 17 pid: 9548 timeout: 921 lvb_type: 1 00010000:00010000:1.0:1746065225.689059:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065225.689094:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+16:2004:x1830881265609856:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 104us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.689100:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8474 00000100:00100000:1.0:1746065225.689114:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8475 00000100:00100000:1.0:1746065225.689118:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265609728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065225.689124:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065225.689130:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 20 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.689141:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 20 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.689152:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f7f2e00/0xad6b7ddc147ae42 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a416 expref: 20 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.689161:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065225.689176:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265609728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 57us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.689180:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8475 00000100:00100000:1.0:1746065225.689189:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8476 00000100:00100000:1.0:1746065225.689193:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+41:2004:x1830881265609984:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065225.689200:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065225.689206:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 41 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.689213:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 41 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.689222:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f46000/0xad6b7ddc147ae26 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a408 expref: 41 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.689228:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.689230:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.689235:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 18 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.689242:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 18 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.689267:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 18 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065225.694314:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264082432:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065225.694670:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009ae3f180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.703597:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.709196:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264082432:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065225.709221:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.709235:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265610240 00000100:00100000:2.0:1746065225.709243:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265610240 00002000:00100000:2.0:1746065225.709290:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2383872->2387967) req@ffff88012f1a6d80 x1830881265610240/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00000100:00100000:1.0:1746065225.709291:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+40:2004:x1830881265609984:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 20094us (21281us total) trans 0 rc 0/0 00002000:00100000:2.0:1746065225.709299:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6d80 with x1830881265610240 ext(2383872->2387967) 00000100:00100000:1.0:1746065225.709302:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8476 00002000:00010000:2.0:1746065225.709303:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a6d80 00000100:00100000:2.0:1746065225.709320:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6490 00000100:00100000:2.0:1746065225.709327:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265610240:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:2.0:1746065225.710399:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2004:x1830881265610240:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 1071us (6807us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065225.710406:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6490 00002000:00100000:2.0:1746065225.710412:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2383872->2387967) req@ffff88012f1a6d80 x1830881265610240/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065225.710419:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a6d80 with x1830881265610240 ext(2383872->2387967) 00002000:00010000:2.0:1746065225.710422:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a6d80 00000100:00100000:0.0:1746065225.714057:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.714103:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.714142:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265610752 00000100:00100000:0.0:1746065225.714150:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265610752 00000100:00100000:0.0:1746065225.714189:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14714 00000100:00100000:0.0:1746065225.714195:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+13:2724:x1830881265610752:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065225.714218:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065225.714232:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc147af29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4a9 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.714314:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc147af30 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.714325:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc147af30 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:0.0:1746065225.714333:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc147af30 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:0.0:1746065225.714341:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:0.0:1746065225.714410:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abad600/0xad6b7ddc147af29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a9 expref: 16 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.714438:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc147af30 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a9 expref: 15 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.714444:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065225.714446:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1746065225.714449:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abadc00, rc 0) 00000100:00100000:0.0:1746065225.714480:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2724:x1830881265610752:12345-192.168.202.27@tcp:101:cat.0 Request processed in 285us (377us total) trans 8589937244 rc 0/0 00000100:00100000:0.0:1746065225.714484:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14714 00000100:00100000:3.0:1746065225.714621:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265610496 00000100:00100000:3.0:1746065225.714624:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265610496 00002000:00100000:3.0:1746065225.714645:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2686976->2691071) req@ffff88012f1a5500 x1830881265610496/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.714654:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5500 with x1830881265610496 ext(2686976->2691071) 00002000:00010000:3.0:1746065225.714657:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a5500 00000100:00100000:3.0:1746065225.715325:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6491 00000100:00100000:3.0:1746065225.715332:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265610496:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065225.715590:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265610496:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 257us (1539us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065225.715596:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6491 00002000:00100000:3.0:1746065225.715601:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x78:0x0] (2686976->2691071) req@ffff88012f1a5500 x1830881265610496/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.715609:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f1a5500 with x1830881265610496 ext(2686976->2691071) 00002000:00010000:3.0:1746065225.715612:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f1a5500 00000100:00100000:0.0:1746065225.719830:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.719896:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265611136 00000100:00100000:1.0:1746065225.719905:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265611136 00000100:00100000:1.0:1746065225.719951:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5548 00000100:00100000:1.0:1746065225.719958:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2720:x1830881265611136:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:1.0:1746065225.720116:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2720:x1830881265611136:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 157us (291us total) trans 8589937245 rc 0/0 00000100:00100000:1.0:1746065225.720122:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5548 00000100:00100000:0.0:1746065225.720144:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.720299:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265610880 00000100:00100000:2.0:1746065225.720303:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265610880 00000100:00100000:2.0:1746065225.720326:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18126 00000100:00100000:2.0:1746065225.720330:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265610880:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065225.720339:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.720351:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008f70be00/0xad6b7ddc147af3e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4b0 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.720388:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264082560:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065225.721624:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:1.0:1746065225.722161:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.722230:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265611264 00000100:00100000:2.0:1746065225.722234:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265611264 00000100:00100000:2.0:1746065225.722264:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18127 00000100:00100000:2.0:1746065225.722269:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881265611264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065225.722288:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.722298:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147af45 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4b7 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.722449:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264082688:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065225.722917:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065225.724311:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264082560:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065225.724334:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88008f70be00/0xad6b7ddc147af3e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4b0 expref: 22 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.724346:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f70be00/0xad6b7ddc147af3e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4b0 expref: 22 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.724368:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f70be00, rc 0) 00000100:00100000:2.0:1746065225.724393:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265610880:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4062us (4250us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065225.724400:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18126 00000100:00100000:2.0:1746065225.725362:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264082688:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065225.725380:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147af45 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4b7 expref: 20 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.725390:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fda800/0xad6b7ddc147af45 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4b7 expref: 20 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065225.725398:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095fda800, rc 0) 00000100:00100000:2.0:1746065225.725431:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2006:x1830881265611264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3162us (3271us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065225.725437:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18127 00000100:00100000:0.0:1746065225.729164:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.729572:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265611392 00000100:00100000:2.0:1746065225.729579:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265611392 00000100:00100000:2.0:1746065225.729626:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18128 00000100:00100000:2.0:1746065225.729632:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2724:x1830881265611392:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065225.729645:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.729658:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4be expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.729684:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.729691:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065225.729693:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065225.729696:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 4/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 22 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.729719:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 32 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.729728:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 32 pid: 13375 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.729739:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264082816:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065225.729828:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065225.733604:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264082816:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.733632:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 3/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 22 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.733646:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07800, rc 0) 00000100:00100000:2.0:1746065225.733692:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2724:x1830881265611392:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4059us (4533us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.733700:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18128 00000100:00100000:1.0:1746065225.735870:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.737381:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265611520 00000100:00100000:3.0:1746065225.737391:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265611520 00002000:00100000:3.0:1746065225.737430:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1388544->2097151) req@ffff88008f3e4a80 x1830881265611520/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.737439:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4a80 with x1830881265611520 ext(1388544->2097151) 00010000:00010000:3.0:1746065225.737447:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 33 pid: 13375 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.737460:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 33 pid: 13375 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746065225.737467:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3e4a80 00000100:00100000:3.0:1746065225.737499:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2128 00000100:00100000:3.0:1746065225.737505:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265611520:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:0.0:1746065225.751539:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.751825:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265611776 00000100:00100000:1.0:1746065225.751833:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265611776 00000100:00100000:1.0:1746065225.751872:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14715 00000100:00100000:1.0:1746065225.751878:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2728:x1830881265611776:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065225.751898:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.751912:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc147af53 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4c5 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.751970:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147af5a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.751981:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147af5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.751991:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147af5a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752002:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc147af61 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752007:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc147af61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752012:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc147af61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752082:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc147af68 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752089:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc147af68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752094:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc147af68 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065225.752101:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:1.0:1746065225.752153:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147af5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752159:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147af5a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752164:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147af5a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752169:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147af5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752173:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c719c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065225.752176:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147af5a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752181:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147af5a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752365:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065225.752369:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065225.752372:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147af5a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752378:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719c00/0xad6b7ddc147af5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752943:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc147af61 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752949:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc147af61 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752954:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc147af61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752961:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c718800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065225.752964:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc147af61 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752968:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc147af61 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.752975:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b4999f00) 00010000:00010000:1.0:1746065225.752977:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065225.752979:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc147af61 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.753051:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718800/0xad6b7ddc147af61 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.753085:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c718400/0xad6b7ddc147af53 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4c5 expref: 35 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.753095:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc147af68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4c5 expref: 34 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.753101:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065225.753103:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065225.753105:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c719800, rc 0) 00000100:00100000:1.0:1746065225.753152:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2728:x1830881265611776:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1274us (1621us total) trans 8589937246 rc 0/0 00000100:00100000:1.0:1746065225.753159:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14715 00000100:00100000:3.0:1746065225.754143:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2006:x1830881265611520:12345-192.168.202.27@tcp:4:cat.0 Request processed in 16635us (18276us total) trans 21474841808 rc 0/0 00000100:00100000:3.0:1746065225.754152:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2128 00002000:00100000:3.0:1746065225.754160:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1388544->2097151) req@ffff88008f3e4a80 x1830881265611520/t21474841808(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/448 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.754169:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e4a80 with x1830881265611520 ext(1388544->2097151) 00010000:00010000:3.0:1746065225.754176:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 35 pid: 13375 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.754187:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 35 pid: 13375 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746065225.754194:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff88008f3e4a80 00000100:00100000:2.0:1746065225.756252:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.756372:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.756415:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265611904 00000100:00100000:1.0:1746065225.756422:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265611904 00000100:00100000:0.0:1746065225.756434:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265612032 00000100:00100000:0.0:1746065225.756438:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265612032 00000100:00100000:1.0:1746065225.756454:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18129 00000100:00100000:1.0:1746065225.756460:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265611904:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:0.0:1746065225.756468:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18130 00010000:00010000:1.0:1746065225.756473:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1746065225.756473:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265612032:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065225.756480:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.756485:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147af76 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4cc expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065225.756489:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc147af7d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4d3 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065225.756521:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264082944:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065225.756579:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.756734:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264083072:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065225.756891:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.756920:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265612160 00000100:00100000:1.0:1746065225.756924:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265612160 00010000:00010000:1.0:1746065225.756939:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 37 pid: 13375 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.756969:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8477 00000100:00100000:1.0:1746065225.756974:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+37:2007:x1830881265612160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065225.756981:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065225.756994:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 37 pid: 13375 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.757004:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 37 pid: 13375 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.757019:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.757020:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.757026:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 21 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.757036:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 21 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.757054:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 21 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065225.757063:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264083200:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065225.757821:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d640c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065225.757930:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00010000:00010000:1.0:1746065225.758606:0:1880:0:(ldlm_lockd.c:742:ldlm_handle_ast_error()) ### client (nid 192.168.202.27@tcp) returned -22 from glimpse AST (req@ffff88008f3e5180 x1830881264082944) - normal race ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 37 pid: 13375 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.758627:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880097b61400/0xad6b7ddc147ae57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1388544->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a424 expref: 37 pid: 13375 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.758639:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264082944:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065225.758658:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147af76 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4cc expref: 36 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.758668:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800a656e600/0xad6b7ddc147af76 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4cc expref: 36 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065225.758674:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a656e600, rc 0) 00000100:00100000:1.0:1746065225.758710:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265611904:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2250us (2463us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065225.758720:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18129 00000100:00100000:1.0:1746065225.761998:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264083200:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065225.762017:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065225.762506:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265612160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5528us (5612us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.762515:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8477 00000100:00100000:3.0:1746065225.763602:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264083072:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065225.763625:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc147af7d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4d3 expref: 41 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.763638:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abace00/0xad6b7ddc147af7d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4d3 expref: 41 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.763651:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abace00, rc 0) 00000100:00100000:3.0:1746065225.764061:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880090ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265612032:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7585us (7687us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065225.764067:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18130 00000100:00100000:0.0:1746065225.766845:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.767836:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265612416 00000100:00100000:3.0:1746065225.767846:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265612416 00002000:00100000:3.0:1746065225.767880:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099bd5880 x1830881265612416/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.767889:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5880 with x1830881265612416 ext(1048576->2097151) 00002000:00010000:3.0:1746065225.767893:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd5880 00000100:00100000:3.0:1746065225.768427:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6492 00000100:00100000:3.0:1746065225.768435:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265612416:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065225.773600:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.773899:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265612544 00000100:00100000:2.0:1746065225.773906:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265612544 00000100:00100000:2.0:1746065225.773944:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18131 00000100:00100000:2.0:1746065225.773951:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2728:x1830881265612544:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065225.773967:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065225.773982:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147af84 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4da expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.774004:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.774005:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.774011:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147af84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4da expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.774023:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147af84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4da expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.774031:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880099d07e00, rc 0) 00000100:00100000:2.0:1746065225.774065:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2728:x1830881265612544:12345-192.168.202.27@tcp:101:cat.0 Request processed in 115us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.774070:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18131 00000100:00100000:3.0:1746065225.779987:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265612416:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11545us (13141us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065225.779997:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6492 00002000:00100000:3.0:1746065225.780005:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880099bd5880 x1830881265612416/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.780013:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880099bd5880 with x1830881265612416 ext(1048576->2097151) 00002000:00010000:3.0:1746065225.780018:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880099bd5880 00000100:00100000:0.0:1746065225.780914:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.781056:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265612800 00000100:00100000:3.0:1746065225.781062:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265612800 00002000:00100000:3.0:1746065225.781088:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880091bc1c00 x1830881265612800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.781095:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1c00 with x1830881265612800 ext(1048576->2097151) 00002000:00010000:3.0:1746065225.781098:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc1c00 00000100:00100000:3.0:1746065225.781122:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6493 00000100:00100000:3.0:1746065225.781127:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265612800:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065225.785104:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.785253:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265613056 00000100:00100000:2.0:1746065225.785261:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265613056 00002000:00100000:2.0:1746065225.785308:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1110016->2097151) req@ffff880091bc0380 x1830881265613056/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065225.785316:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc0380 with x1830881265613056 ext(1110016->2097151) 00002000:00010000:2.0:1746065225.785320:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880091bc0380 00000100:00100000:2.0:1746065225.785349:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6494 00000100:00100000:2.0:1746065225.785356:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+40:2005:x1830881265613056:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065225.792119:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.792308:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265613184 00000100:00100000:1.0:1746065225.792317:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265613184 00000100:00100000:3.0:1746065225.792498:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265612800:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11369us (11584us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065225.792507:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6493 00002000:00100000:3.0:1746065225.792516:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880091bc1c00 x1830881265612800/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.792525:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc1c00 with x1830881265612800 ext(1048576->2097151) 00002000:00010000:3.0:1746065225.792529:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc1c00 00000100:00100000:1.0:1746065225.792570:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18132 00000100:00100000:1.0:1746065225.792577:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2724:x1830881265613184:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065225.792589:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.792601:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4e1 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.792623:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.792630:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065225.792631:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065225.792634:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.792657:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 41 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.792666:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 41 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.792676:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264083328:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.792721:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065225.795306:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264083328:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065225.795329:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.795341:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880091a97a00, rc 0) 00000100:00100000:1.0:1746065225.795384:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2724:x1830881265613184:12345-192.168.202.27@tcp:101:cat.0 Request processed in 2807us (3273us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.795391:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18132 00000100:00100000:0.0:1746065225.795805:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.795915:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265613312 00000100:00100000:3.0:1746065225.795921:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265613312 00002000:00100000:3.0:1746065225.795942:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1110015) req@ffff880091bc3800 x1830881265613312/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.795949:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc3800 with x1830881265613312 ext(1048576->1110015) 00010000:00010000:3.0:1746065225.795955:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 41 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.795963:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265613056:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10608us (10866us total) trans 0 rc 987136/987136 00010000:00010000:3.0:1746065225.795964:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 41 pid: 11461 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746065225.795970:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bc3800 00000100:00100000:2.0:1746065225.795970:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6494 00002000:00100000:2.0:1746065225.795974:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x77:0x0] (1110016->2097151) req@ffff880091bc0380 x1830881265613056/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 987136/987136 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065225.795980:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc0380 with x1830881265613056 ext(1110016->2097151) 00010000:00010000:2.0:1746065225.795984:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 41 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746065225.795988:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2129 00010000:00010000:2.0:1746065225.795991:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 41 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746065225.795993:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+41:2005:x1830881265613312:12345-192.168.202.27@tcp:4:cat.0 00002000:00010000:2.0:1746065225.795996:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bc0380 00000100:00100000:0.0:1746065225.796451:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.796651:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265613440 00000100:00100000:1.0:1746065225.796655:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265613440 00000100:00100000:1.0:1746065225.796684:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18133 00000100:00100000:1.0:1746065225.796689:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+42:2728:x1830881265613440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065225.796697:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.796707:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4e8 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.796721:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065225.796725:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 43 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.796733:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 43 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.796745:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800a852a200, rc 0) 00000100:00100000:1.0:1746065225.796803:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+43:2728:x1830881265613440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 113us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.796808:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18133 00000100:00100000:3.0:1746065225.798513:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265613312:12345-192.168.202.27@tcp:4:cat.0 Request processed in 2515us (2703us total) trans 17179874434 rc 0/0 00000100:00100000:3.0:1746065225.798522:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2129 00002000:00100000:3.0:1746065225.798529:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->1110015) req@ffff880091bc3800 x1830881265613312/t17179874434(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/448 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.798537:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc3800 with x1830881265613312 ext(1048576->1110015) 00010000:00010000:3.0:1746065225.798543:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 43 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.798554:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 43 pid: 11461 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746065225.798564:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880091bc3800 00000100:00100000:0.0:1746065225.801316:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.801399:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265613568 00000100:00100000:1.0:1746065225.801406:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265613568 00010000:00010000:1.0:1746065225.801433:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 43 pid: 11461 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.801466:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8478 00000100:00100000:1.0:1746065225.801472:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265613568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065225.801483:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065225.801498:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 43 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.801509:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 43 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.801527:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f72c00/0xad6b7ddc147ae73 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1110015) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a440 expref: 43 pid: 11461 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.801571:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.801573:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.801580:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.801592:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.801599:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.801600:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.801603:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.801608:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.801633:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 42 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065225.801642:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264083456:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065225.801722:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 19 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065225.801730:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264083584:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065225.801747:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065225.803869:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264083456:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065225.803877:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8352:1830881264083584:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065225.803889:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065225.803912:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881265613568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2439us (2602us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.803919:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8478 00000100:00100000:0.0:1746065225.805841:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.806056:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265613824 00000100:00100000:3.0:1746065225.806062:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265613824 00002000:00100000:3.0:1746065225.806094:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009252a300 x1830881265613824/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.806102:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252a300 with x1830881265613824 ext(1048576->2097151) 00002000:00010000:3.0:1746065225.806107:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252a300 00000100:00100000:3.0:1746065225.806128:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6495 00000100:00100000:3.0:1746065225.806134:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265613824:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065225.812495:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.812593:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265614080 00000100:00100000:2.0:1746065225.812603:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265614080 00002000:00100000:2.0:1746065225.812649:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f3e5180 x1830881265614080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065225.812660:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5180 with x1830881265614080 ext(1048576->2097151) 00002000:00010000:2.0:1746065225.812665:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e5180 00000100:00100000:2.0:1746065225.812696:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6496 00000100:00100000:2.0:1746065225.812704:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265614080:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065225.815282:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265613824:12345-192.168.202.27@tcp:3:cat.0 Request processed in 9133us (9430us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065225.815292:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6495 00002000:00100000:3.0:1746065225.815301:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009252a300 x1830881265613824/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.815309:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252a300 with x1830881265613824 ext(1048576->2097151) 00002000:00010000:3.0:1746065225.815367:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252a300 00000100:00100000:0.0:1746065225.817949:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.818006:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265614336 00000100:00100000:1.0:1746065225.818013:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265614336 00000100:00100000:1.0:1746065225.818063:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14716 00000100:00100000:1.0:1746065225.818069:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2730:x1830881265614336:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065225.818088:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.818103:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a600/0xad6b7ddc147af99 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4ef expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.818196:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.818209:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a47f expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.818217:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880130105000/0xad6b7ddc147af06 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a494 expref: 15 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.818223:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc147af68 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4c5 expref: 35 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.818229:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 6/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.818256:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc147af68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4c5 expref: 35 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.818266:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc147af68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4c5 expref: 35 pid: 7204 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.818289:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264083712:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065225.818423:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880130105000/0xad6b7ddc147af06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a494 expref: 15 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.818431:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880130105000/0xad6b7ddc147af06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a494 expref: 15 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.818438:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264083840:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065225.818465:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a47f expref: 10 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.818472:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a47f expref: 10 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.818478:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264083968:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.818755:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065225.818844:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+42:2004:x1830881265614080:12345-192.168.202.27@tcp:3:cat.0 Request processed in 6139us (6355us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065225.818852:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6496 00002000:00100000:3.0:1746065225.818859:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88008f3e5180 x1830881265614080/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.818867:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e5180 with x1830881265614080 ext(1048576->2097151) 00002000:00010000:3.0:1746065225.818871:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88008f3e5180 00000100:00100000:0.0:1746065225.822971:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.823003:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.823041:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.823133:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264083712:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.823142:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264083840:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.823149:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264083968:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065225.823170:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:2.0:1746065225.823239:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265614464 00000100:00100000:2.0:1746065225.823244:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265614464 00010000:00010000:2.0:1746065225.823282:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc147af68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4c5 expref: 36 pid: 7204 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.823301:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265614720 00000100:00100000:2.0:1746065225.823303:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265614720 00010000:00010000:2.0:1746065225.823312:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a47f expref: 11 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.823323:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265614592 00000100:00100000:2.0:1746065225.823325:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265614592 00010000:00010000:2.0:1746065225.823332:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880130105000/0xad6b7ddc147af06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a494 expref: 16 pid: 7205 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.823342:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8479 00000100:00100000:2.0:1746065225.823347:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265614464:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065225.823358:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065225.823362:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc147af68 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4c5 expref: 36 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.823370:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc147af68 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4c5 expref: 36 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.823387:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c719800/0xad6b7ddc147af68 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4c5 expref: 36 pid: 7204 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.823399:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.823403:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.823410:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.823414:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.823444:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265614464:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.823450:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8479 00000100:00100000:2.0:1746065225.823461:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8480 00000100:00100000:2.0:1746065225.823465:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+11:2005:x1830881265614720:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065225.823469:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065225.823472:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a47f expref: 11 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.823478:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a47f expref: 11 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.823487:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147aedc lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a47f expref: 11 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.823494:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.823497:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.823501:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.823504:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.823515:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+10:2005:x1830881265614720:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 50us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.823519:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8480 00000100:00100000:2.0:1746065225.823528:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8481 00000100:00100000:2.0:1746065225.823532:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+16:2005:x1830881265614592:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065225.823537:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065225.823540:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880130105000/0xad6b7ddc147af06 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a494 expref: 16 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.823548:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880130105000/0xad6b7ddc147af06 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a494 expref: 16 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.823557:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880130105000/0xad6b7ddc147af06 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a494 expref: 16 pid: 7205 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.823564:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065225.823567:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.823572:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.823577:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065225.823591:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.823602:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2005:x1830881265614592:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 70us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.823607:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8481 00010000:00010000:1.0:1746065225.824049:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.824059:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065225.824074:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:1.0:1746065225.824168:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577a600/0xad6b7ddc147af99 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4ef expref: 36 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.824466:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4ef expref: 35 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.824473:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065225.824474:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065225.824477:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577bc00, rc 0) 00000100:00100000:1.0:1746065225.824501:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2730:x1830881265614336:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 6432us (6558us total) trans 8589937247 rc 0/0 00000100:00100000:1.0:1746065225.824507:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14716 00000100:00100000:0.0:1746065225.828500:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.828687:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265614976 00000100:00100000:3.0:1746065225.828694:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265614976 00000100:00100000:0.0:1746065225.828704:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:3.0:1746065225.828727:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880097d28000 x1830881265614976/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 504/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.828735:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d28000 with x1830881265614976 ext(2097152->4194303) 00002000:00010000:3.0:1746065225.828740:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d28000 00000100:00100000:3.0:1746065225.828753:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265615232 00000100:00100000:3.0:1746065225.828755:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265615232 00002000:00100000:3.0:1746065225.828765:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097d2bb80 x1830881265615232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.828771:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2bb80 with x1830881265615232 ext(2097152->4194303) 00000100:00100000:0.0:1746065225.828799:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.828838:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265615360 00000100:00100000:1.0:1746065225.828842:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265615360 00000100:00100000:1.0:1746065225.828865:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18134 00000100:00100000:1.0:1746065225.828871:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+42:2728:x1830881265615360:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065225.828882:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.828894:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4f6 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.828914:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.828925:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065225.828930:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065225.828933:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 43 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.828961:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 20 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.828971:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 20 pid: 1880 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.828981:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264084096:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.829048:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00002000:00010000:3.0:1746065225.829113:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d2bb80 00000100:00100000:3.0:1746065225.829128:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2130 00000100:00100000:3.0:1746065225.829133:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265614976:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065225.830048:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6498 00000100:00100000:3.0:1746065225.830054:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265615232:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065225.835652:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.835654:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264084096:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065225.835679:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 43 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.835695:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ba00, rc 0) 00000100:00100000:1.0:1746065225.835722:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265615488 00000100:00100000:1.0:1746065225.835729:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265615488 00002000:00100000:1.0:1746065225.835766:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2383872->2691071) req@ffff8800900f1f80 x1830881265615488/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.835804:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1f80 with x1830881265615488 ext(2383872->2691071) 00010000:00010000:1.0:1746065225.835812:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 22 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.835828:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 22 pid: 1880 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746065225.835833:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800900f1f80 00000100:00100000:1.0:1746065225.835882:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2131 00000100:00100000:1.0:1746065225.835892:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265615488:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:1.0:1746065225.836040:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2728:x1830881265615360:12345-192.168.202.27@tcp:101:cat.0 Request processed in 7166us (7238us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.836048:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18134 00000100:00100000:1.0:1746065225.852512:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881265615488:12345-192.168.202.27@tcp:4:cat.0 Request processed in 16615us (16859us total) trans 17179874435 rc 0/0 00000100:00100000:1.0:1746065225.852522:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2131 00002000:00100000:1.0:1746065225.852531:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x78:0x0] (2383872->2691071) req@ffff8800900f1f80 x1830881265615488/t17179874435(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/448 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.852540:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1f80 with x1830881265615488 ext(2383872->2691071) 00010000:00010000:1.0:1746065225.852547:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 24 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.852560:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 24 pid: 1880 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746065225.852566:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff8800900f1f80 00000100:00100000:3.0:1746065225.852949:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265614976:12345-192.168.202.27@tcp:3:cat.0 Request processed in 23814us (24453us total) trans 0 rc 1789952/1789952 00000100:00100000:3.0:1746065225.852955:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2130 00002000:00100000:3.0:1746065225.852960:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880097d28000 x1830881265614976/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 504/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 1789952/1789952 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.852967:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d28000 with x1830881265614976 ext(2097152->4194303) 00010000:00010000:3.0:1746065225.852972:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 22 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.852981:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 22 pid: 1880 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746065225.852987:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880097d28000 00000100:00100000:3.0:1746065225.861953:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265615232:12345-192.168.202.27@tcp:3:cat.0 Request processed in 31886us (33235us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065225.861965:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6498 00002000:00100000:3.0:1746065225.861977:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880097d2bb80 x1830881265615232/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.861986:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d2bb80 with x1830881265615232 ext(2097152->4194303) 00002000:00010000:3.0:1746065225.861992:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097d2bb80 00000100:00100000:0.0:1746065225.863309:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.863432:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265615616 00000100:00100000:2.0:1746065225.863438:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265615616 00010000:00010000:2.0:1746065225.863464:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 22 pid: 1880 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.863499:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8482 00000100:00100000:2.0:1746065225.863506:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265615616:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065225.863516:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065225.863531:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 22 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.863542:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 22 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.863559:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095fdaa00/0xad6b7ddc147af22 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2383872->2691071) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a2 expref: 22 pid: 1880 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.863574:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.863576:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.863582:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.863588:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.863615:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.863625:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264084224:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065225.863689:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.869964:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.870278:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0001_UUID:10893:1830881264084224:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065225.870301:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.870346:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265615616:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6837us (7038us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.870356:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8482 00000100:00100000:1.0:1746065225.870987:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265615744 00000100:00100000:1.0:1746065225.870993:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265615744 00000100:00100000:1.0:1746065225.871037:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18135 00000100:00100000:1.0:1746065225.871043:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2724:x1830881265615744:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065225.871059:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.871072:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a4fd expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.871091:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.871092:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.871097:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 22 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.871107:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 22 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.871115:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b600, rc 0) 00000100:00100000:1.0:1746065225.871144:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2724:x1830881265615744:12345-192.168.202.27@tcp:101:cat.0 Request processed in 101us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.871149:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18135 00000100:00100000:0.0:1746065225.880424:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.880497:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265616000 00000100:00100000:3.0:1746065225.880506:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265616000 00002000:00100000:3.0:1746065225.880543:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff8800900f0380 x1830881265616000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.880552:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0380 with x1830881265616000 ext(2097152->4194303) 00002000:00010000:3.0:1746065225.880557:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f0380 00000100:00100000:3.0:1746065225.880585:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6499 00000100:00100000:3.0:1746065225.880592:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265616000:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065225.886661:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.886894:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265616256 00000100:00100000:1.0:1746065225.886901:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265616256 00002000:00100000:1.0:1746065225.886935:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff8800900f1880 x1830881265616256/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.886944:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1880 with x1830881265616256 ext(3145728->4194303) 00002000:00010000:1.0:1746065225.886950:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f1880 00000100:00100000:1.0:1746065225.886969:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6500 00000100:00100000:1.0:1746065225.886975:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265616256:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065225.900513:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265616000:12345-192.168.202.27@tcp:3:cat.0 Request processed in 19913us (20090us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065225.900524:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6499 00002000:00100000:3.0:1746065225.900534:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff8800900f0380 x1830881265616000/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.900542:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0380 with x1830881265616000 ext(2097152->4194303) 00002000:00010000:3.0:1746065225.900548:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f0380 00000100:00100000:1.0:1746065225.907807:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265616256:12345-192.168.202.27@tcp:3:cat.0 Request processed in 20823us (21144us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065225.907819:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6500 00002000:00100000:1.0:1746065225.907829:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff8800900f1880 x1830881265616256/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.907837:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f1880 with x1830881265616256 ext(3145728->4194303) 00002000:00010000:1.0:1746065225.907841:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f1880 00000100:00100000:0.0:1746065225.908102:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.908403:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265616512 00000100:00100000:1.0:1746065225.908410:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265616512 00002000:00100000:1.0:1746065225.908437:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800900f2d80 x1830881265616512/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.908444:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2d80 with x1830881265616512 ext(4194304->5038079) 00002000:00010000:1.0:1746065225.908447:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f2d80 00000100:00100000:1.0:1746065225.908469:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6501 00000100:00100000:1.0:1746065225.908474:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265616512:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065225.916556:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2005:x1830881265616512:12345-192.168.202.27@tcp:3:cat.0 Request processed in 8073us (8446us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746065225.916567:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6501 00002000:00100000:1.0:1746065225.916578:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff8800900f2d80 x1830881265616512/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.916587:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2d80 with x1830881265616512 ext(4194304->5038079) 00002000:00010000:1.0:1746065225.916592:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f2d80 00000100:00100000:0.0:1746065225.924244:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.924303:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.924382:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265616768 00000100:00100000:3.0:1746065225.924390:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265616768 00000100:00100000:3.0:1746065225.924426:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5549 00000100:00100000:3.0:1746065225.924431:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+35:2728:x1830881265616768:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065225.924589:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+36:2728:x1830881265616768:12345-192.168.202.27@tcp:35:cat.0 Request processed in 156us (352us total) trans 8589937248 rc 0/0 00000100:00100000:3.0:1746065225.924595:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5549 00000100:00100000:1.0:1746065225.924910:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265616896 00000100:00100000:1.0:1746065225.924914:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265616896 00000100:00100000:1.0:1746065225.924944:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18136 00000100:00100000:1.0:1746065225.924948:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+43:2730:x1830881265616896:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065225.924957:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.924968:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a504 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.924986:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.924993:0:9548:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 21 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.924997:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.924998:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065225.925001:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2195456->2768895] (req 2195456->2768895) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.925022:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 21 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.925031:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 21 pid: 9548 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.925040:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264084352:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065225.925092:0:9548:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.925098:0:9548:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 44 pid: 9548 timeout: 921 lvb_type: 0 00000100:00100000:1.0:1746065225.925108:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264084480:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.925123:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.926029:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.926143:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265617152 00000100:00100000:1.0:1746065225.926146:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265617152 00002000:00100000:1.0:1746065225.926169:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880092744a80 x1830881265617152/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.926177:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744a80 with x1830881265617152 ext(4194304->5038079) 00010000:00010000:1.0:1746065225.926182:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 22 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.926190:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 22 pid: 9548 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746065225.926195:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092744a80 00000100:00100000:3.0:1746065225.927390:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2132 00000100:00100000:3.0:1746065225.927401:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265617152:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065225.931937:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264084352:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065225.931948:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:9548:1830881264084480:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065225.931974:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2195456->2768895] (req 2195456->2768895) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 44 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.931988:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ae00, rc 0) 00000100:00100000:1.0:1746065225.932025:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+44:2730:x1830881265616896:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 7076us (7721us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065225.932033:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18136 00000100:00100000:0.0:1746065225.940839:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.941249:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2005:x1830881265617152:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13849us (15218us total) trans 0 rc 843776/843776 00000100:00100000:3.0:1746065225.941259:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2132 00002000:00100000:3.0:1746065225.941277:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880092744a80 x1830881265617152/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/440 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.941284:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744a80 with x1830881265617152 ext(4194304->5038079) 00010000:00010000:3.0:1746065225.941293:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 22 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.941304:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 22 pid: 9548 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746065225.941310:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092744a80 00000100:00100000:2.0:1746065225.941401:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265617280 00000100:00100000:2.0:1746065225.941407:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265617280 00010000:00010000:2.0:1746065225.941427:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 44 pid: 9548 timeout: 921 lvb_type: 0 00000100:00100000:2.0:1746065225.941457:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8483 00000100:00100000:2.0:1746065225.941464:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+44:2004:x1830881265617280:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065225.941474:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065225.941487:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 44 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.941495:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 44 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.941513:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577ba00/0xad6b7ddc147afae lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4f6 expref: 44 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:2.0:1746065225.941527:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.941544:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+43:2004:x1830881265617280:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 81us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.941549:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8483 00000100:00100000:0.0:1746065225.947708:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.949198:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065225.949230:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265617664 00000100:00100000:0.0:1746065225.949239:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265617664 00000100:00100000:1.0:1746065225.949498:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265617536 00000100:00100000:1.0:1746065225.949502:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265617536 00000100:00100000:1.0:1746065225.949537:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14717 00000100:00100000:1.0:1746065225.949543:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+15:2733:x1830881265617536:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065225.949565:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065225.949580:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147afc3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a50b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.949639:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147afca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.949650:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147afca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.949660:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147afca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.949670:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147afd1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.949675:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147afd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.949680:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147afd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.949757:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147afd8 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.949766:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147afd8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.949786:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147afd8 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065225.949798:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00000100:00100000:3.0:1746065225.950718:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18137 00000100:00100000:3.0:1746065225.950727:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265617664:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.950737:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.950747:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac30000/0xad6b7ddc147afe6 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a512 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.950761:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.950770:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30000/0xad6b7ddc147afe6 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a512 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.950799:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30000/0xad6b7ddc147afe6 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a512 expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065225.950820:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30000, rc 0) 00010000:00010000:1.0:1746065225.950821:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147afca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950828:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147afca lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950832:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147afca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950837:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147afca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950841:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065225.950844:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147afca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950848:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147afca lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950857:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065225.950860:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1746065225.950863:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265617664:12345-192.168.202.27@tcp:101:cat.0 Request processed in 138us (1668us total) trans 0 rc 301/301 00010000:00010000:1.0:1746065225.950863:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147afca lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950866:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147afca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00000100:00100000:3.0:1746065225.950869:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18137 00010000:00010000:1.0:1746065225.950877:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147afd1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950881:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147afd1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950888:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147afd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950892:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065225.950893:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147afd1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950897:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147afd1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950901:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b4999600) 00010000:00010000:1.0:1746065225.950903:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065225.950904:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147afd1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950907:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147afd1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065225.950935:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147afc3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a50b expref: 18 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.950943:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147afd8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a50b expref: 17 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065225.950947:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065225.950949:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065225.950950:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489a00, rc 0) 00000100:00100000:1.0:1746065225.950971:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2733:x1830881265617536:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 1428us (3270us total) trans 8589937249 rc 0/0 00000100:00100000:1.0:1746065225.950976:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14717 00000100:00100000:0.0:1746065225.952910:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.953014:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265617792 00000100:00100000:3.0:1746065225.953022:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265617792 00010000:00010000:3.0:1746065225.953052:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 22 pid: 9548 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746065225.954285:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8484 00000100:00100000:3.0:1746065225.954297:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265617792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065225.954309:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065225.954328:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 22 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.954340:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 22 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.954363:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577b600/0xad6b7ddc147afb5 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 3145728->4194303) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4fd expref: 22 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.954376:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.954378:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065225.954385:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.954393:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.954427:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065225.954440:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264084608:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065225.956091:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.960255:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.960391:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264084608:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065225.960407:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.960449:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265617792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6156us (7545us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.960458:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8484 00000100:00100000:3.0:1746065225.960573:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265617920 00000100:00100000:3.0:1746065225.960578:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265617920 00000100:00100000:3.0:1746065225.960609:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18138 00000100:00100000:3.0:1746065225.960615:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2724:x1830881265617920:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065225.960628:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065225.960640:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a519 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.960662:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.960674:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065225.960675:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:3.0:1746065225.960678:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 4/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [5033984->5242879] (req 5033984->5242879) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.960701:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 42 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065225.960710:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 42 pid: 9548 timeout: 921 lvb_type: 0 00000100:00100000:3.0:1746065225.960719:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264084736:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065225.960770:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065225.963295:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.963963:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265618176 00000100:00100000:3.0:1746065225.963970:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265618176 00002000:00100000:3.0:1746065225.964003:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2195456->2199551) req@ffff880092744700 x1830881265618176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.964012:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744700 with x1830881265618176 ext(2195456->2199551) 00010000:00010000:3.0:1746065225.964019:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 43 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.964029:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 43 pid: 9548 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746065225.964035:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092744700 00000100:00100000:3.0:1746065225.964860:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2133 00000100:00100000:3.0:1746065225.964868:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265618176:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065225.964971:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092744700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265618176:12345-192.168.202.27@tcp:3:cat.0 Request processed in 105us (2199us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065225.964976:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2133 00002000:00100000:3.0:1746065225.964981:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2195456->2199551) req@ffff880092744700 x1830881265618176/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.964987:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092744700 with x1830881265618176 ext(2195456->2199551) 00010000:00010000:3.0:1746065225.964992:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 43 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.965001:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 43 pid: 9548 timeout: 921 lvb_type: 0 00002000:00010000:3.0:1746065225.965006:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092744700 00000100:00100000:2.0:1746065225.967305:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0001_UUID:1880:1830881264084736:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065225.967327:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 3/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [5033984->5242879] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.967339:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac30c00, rc 0) 00000100:00100000:2.0:1746065225.967434:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2724:x1830881265617920:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6817us (7184us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.967441:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18138 00000100:00100000:0.0:1746065225.974102:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065225.975700:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265618432 00000100:00100000:1.0:1746065225.975713:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265618432 00002000:00100000:1.0:1746065225.975760:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (2764800->2768895) req@ffff880092745c00 x1830881265618432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.975770:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745c00 with x1830881265618432 ext(2764800->2768895) 00010000:00010000:1.0:1746065225.975807:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 43 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.975822:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 43 pid: 9548 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746065225.975828:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092745c00 00000100:00100000:1.0:1746065225.975877:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2134 00000100:00100000:1.0:1746065225.975887:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881265618432:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065225.976054:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092745c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881265618432:12345-192.168.202.27@tcp:3:cat.0 Request processed in 169us (1958us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065225.976060:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2134 00002000:00100000:1.0:1746065225.976065:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (2764800->2768895) req@ffff880092745c00 x1830881265618432/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065225.976073:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092745c00 with x1830881265618432 ext(2764800->2768895) 00010000:00010000:1.0:1746065225.976077:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 43 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:1.0:1746065225.976084:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 43 pid: 9548 timeout: 921 lvb_type: 0 00002000:00010000:1.0:1746065225.976094:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092745c00 00000100:00100000:0.0:1746065225.982536:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.983144:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265618688 00000100:00100000:3.0:1746065225.983153:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265618688 00002000:00100000:3.0:1746065225.983191:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2195456->2768895) req@ffff880092747800 x1830881265618688/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.983200:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747800 with x1830881265618688 ext(2195456->2768895) 00010000:00010000:3.0:1746065225.983208:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 43 pid: 9548 timeout: 921 lvb_type: 0 00010000:00010000:3.0:1746065225.983221:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 43 pid: 9548 timeout: 922 lvb_type: 0 00002000:00010000:3.0:1746065225.983232:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092747800 00000100:00100000:3.0:1746065225.983265:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2135 00000100:00100000:3.0:1746065225.983279:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881265618688:12345-192.168.202.27@tcp:4:cat.0 00000100:00100000:3.0:1746065225.993905:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092747800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881265618688:12345-192.168.202.27@tcp:4:cat.0 Request processed in 10616us (11369us total) trans 17179874436 rc 0/0 00000100:00100000:3.0:1746065225.993916:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2135 00002000:00100000:3.0:1746065225.993925:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (2195456->2768895) req@ffff880092747800 x1830881265618688/t17179874436(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:141/0 lens 488/448 e 0 to 0 dl 1746065236 ref 1 fl Complete:H/200/0 rc 0/0 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.993933:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880092747800 with x1830881265618688 ext(2195456->2768895) 00010000:00010000:3.0:1746065225.993942:0:13377:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 45 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065225.993955:0:13377:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 45 pid: 9548 timeout: 922 lvb_type: 0 00002000:00010000:3.0:1746065225.993961:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff880092747800 00000100:00100000:0.0:1746065225.995923:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065225.996491:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265618816 00000100:00100000:2.0:1746065225.996499:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265618816 00010000:00010000:2.0:1746065225.996526:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 45 pid: 9548 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065225.996614:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8485 00000100:00100000:2.0:1746065225.996619:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881265618816:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065225.996629:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1746065225.996639:0:7190:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065225 -> 1746065226 00002000:00010000:2.0:1746065225.996641:0:7190:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065225 -> 1746065226 00010000:00010000:2.0:1746065225.996644:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 45 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065225.996651:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 45 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065225.996667:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009577ae00/0xad6b7ddc147afbc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2195456->2768895) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a504 expref: 45 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065225.996688:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.996690:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065225.996699:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.996706:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065225.996733:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065225.996744:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264084864:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065225.996834:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065225.998080:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264084864:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065225.998096:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065225.998334:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+44:2005:x1830881265618816:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1713us (2416us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065225.998342:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8485 00000100:00100000:0.0:1746065225.998648:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065225.998722:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265619072 00000100:00100000:3.0:1746065225.998727:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265619072 00002000:00100000:3.0:1746065225.998757:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff880097d04000 x1830881265619072/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/0 e 0 to 0 dl 1746065236 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.998765:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04000 with x1830881265619072 ext(5033984->5038079) 00002000:00010000:3.0:1746065225.998769:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d04000 00000100:00100000:3.0:1746065225.998872:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6502 00000100:00100000:3.0:1746065225.998880:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265619072:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065225.998972:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265619072:12345-192.168.202.27@tcp:3:cat.0 Request processed in 93us (325us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065225.998981:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6502 00002000:00100000:3.0:1746065225.998986:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (5033984->5038079) req@ffff880097d04000 x1830881265619072/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:141/0 lens 488/4536 e 0 to 0 dl 1746065236 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065225.998992:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097d04000 with x1830881265619072 ext(5033984->5038079) 00002000:00010000:3.0:1746065225.998994:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880097d04000 00000100:00100000:0.0:1746065226.040323:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.042209:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265619200 00000100:00100000:2.0:1746065226.042218:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265619200 00000100:00100000:2.0:1746065226.042305:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18139 00000100:00100000:2.0:1746065226.042313:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2733:x1830881265619200:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065226.042330:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.042344:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a520 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.042364:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147ad38 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a359 expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.042372:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc147ae11 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3e5 expref: 18 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.042379:0:1880:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147ad85 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a38a expref: 34 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.042385:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.042386:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.042389:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1372160->2097151] (req 1372160->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 23 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.042413:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147ad85 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a38a expref: 34 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.042423:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147ad85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a38a expref: 34 pid: 12258 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746065226.042433:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264084992:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065226.042710:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc147ae11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3e5 expref: 18 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.042722:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc147ae11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3e5 expref: 18 pid: 9549 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746065226.042730:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264085120:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065226.042813:0:1880:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147ad38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a359 expref: 23 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.042823:0:1880:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147ad38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a359 expref: 23 pid: 9549 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746065226.042831:0:1880:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264085248:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.042872:0:1880:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065226.048036:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264085120:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.048049:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264085248:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065226.048993:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.049023:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.049057:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.049085:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265619328 00000100:00100000:0.0:1746065226.049090:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265619328 00000100:00100000:3.0:1746065226.049095:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265619456 00000100:00100000:3.0:1746065226.049099:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265619456 00010000:00010000:3.0:1746065226.049115:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147ad38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a359 expref: 24 pid: 9549 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.049115:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc147ae11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3e5 expref: 19 pid: 9549 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746065226.049134:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265619584 00000100:00100000:0.0:1746065226.049136:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265619584 00000100:00100000:3.0:1746065226.049141:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8486 00010000:00010000:0.0:1746065226.049144:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147ad85 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a38a expref: 35 pid: 12258 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746065226.049147:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265619328:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065226.049156:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8487 00010000:00010000:3.0:1746065226.049157:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1746065226.049161:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2005:x1830881265619456:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065226.049166:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065226.049173:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc147ae11 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3e5 expref: 19 pid: 9549 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.049174:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147ad38 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a359 expref: 24 pid: 9549 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746065226.049182:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc147ae11 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3e5 expref: 19 pid: 9549 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746065226.049234:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8488 00000100:00100000:1.0:1746065226.049241:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265619584:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065226.049253:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065226.049304:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147ad38 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a359 expref: 24 pid: 9549 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746065226.049325:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008d926e00/0xad6b7ddc147ae11 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3e5 expref: 19 pid: 9549 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.049330:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c538a00/0xad6b7ddc147ad38 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 9 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a359 expref: 24 pid: 9549 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.049333:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147ad85 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 10 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a38a expref: 35 pid: 12258 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.049344:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147ad85 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a38a expref: 35 pid: 12258 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746065226.049353:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065226.049358:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.049360:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.049365:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 23 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.049372:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 23 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.049379:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065226.049388:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265619328:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 241us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.049396:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8486 00000100:00100000:1.0:1746065226.049397:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265619584:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 156us (339us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065226.049397:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 23 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065226.049403:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8488 00000100:00100000:0.0:1746065226.049407:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264085376:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065226.049529:0:1880:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012b4f2000/0xad6b7ddc147ad85 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a38a expref: 34 pid: 12258 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746065226.049696:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64600 going to sleep for 11 seconds 00000100:00100000:2.0:1746065226.049751:0:1880:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:1880:1830881264084992:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065226.050173:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 23 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.050183:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174a00, rc 0) 00000100:00100000:3.0:1746065226.050502:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2733:x1830881265619200:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8189us (10185us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.050508:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18139 00000100:00100000:0.0:1746065226.054062:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.054124:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265619840 00000100:00100000:3.0:1746065226.054131:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265619840 00000100:00100000:2.0:1746065226.054155:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d05f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264085376:192.168.202.27@tcp:105: 00002000:00100000:3.0:1746065226.054165:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1372160->1376255) req@ffff880135139500 x1830881265619840/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00010000:00010000:2.0:1746065226.054170:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00002000:00100000:3.0:1746065226.054173:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139500 with x1830881265619840 ext(1372160->1376255) 00002000:00010000:3.0:1746065226.054176:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135139500 00000100:00100000:2.0:1746065226.054206:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265619456:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5044us (5181us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.054207:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6503 00000100:00100000:2.0:1746065226.054213:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8487 00000100:00100000:3.0:1746065226.054214:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880135139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265619840:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065226.054325:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880135139500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265619840:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 111us (270us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065226.054330:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6503 00002000:00100000:3.0:1746065226.054335:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x94:0x0] (1372160->1376255) req@ffff880135139500 x1830881265619840/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/4536 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065226.054950:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880135139500 with x1830881265619840 ext(1372160->1376255) 00002000:00010000:3.0:1746065226.054954:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880135139500 00000100:00100000:0.0:1746065226.057369:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.057422:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265620096 00000100:00100000:1.0:1746065226.057429:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265620096 00000100:00100000:1.0:1746065226.057479:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14718 00000100:00100000:1.0:1746065226.057486:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2738:x1830881265620096:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065226.057505:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065226.057521:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc147affb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a527 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.057593:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc147b002 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057605:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc147b002 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057616:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc147b002 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057628:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b009 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057633:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b009 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057637:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b009 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057714:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147b010 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057722:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147b010 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057727:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147b010 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065226.057734:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:1.0:1746065226.057834:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc147b002 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057840:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc147b002 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057845:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc147b002 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057850:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc147b002 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057855:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065226.057859:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc147b002 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057864:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc147b002 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057874:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:1.0:1746065226.057876:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065226.057879:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc147b002 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057883:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489400/0xad6b7ddc147b002 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057909:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b009 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057913:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b009 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057917:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b009 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057921:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c489e00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065226.057923:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b009 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057928:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b009 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057932:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800b4999f00) 00010000:00010000:1.0:1746065226.057934:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065226.057936:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b009 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057943:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b009 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.057973:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488a00/0xad6b7ddc147affb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a527 expref: 39 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.057983:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147b010 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a527 expref: 38 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.057988:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065226.057989:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1746065226.057991:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489000, rc 0) 00000100:00100000:1.0:1746065226.058029:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2738:x1830881265620096:12345-192.168.202.27@tcp:101:cat.0 Request processed in 543us (667us total) trans 8589937250 rc 0/0 00000100:00100000:1.0:1746065226.058034:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14718 00000100:00100000:0.0:1746065226.068585:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.068619:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.068643:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265620352 00000100:00100000:0.0:1746065226.068643:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.068652:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265620352 00000100:00100000:0.0:1746065226.068678:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.068690:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14719 00000100:00100000:2.0:1746065226.068697:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+10:2739:x1830881265620352:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:1.0:1746065226.068749:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265620224 00000100:00100000:1.0:1746065226.068753:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265620224 00000100:00100000:1.0:1746065226.068798:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265620480 00000100:00100000:1.0:1746065226.068801:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265620480 00000100:00100000:1.0:1746065226.068813:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265620608 00000100:00100000:1.0:1746065226.068814:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265620608 00000100:00100000:1.0:1746065226.068827:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18140 00000100:00100000:1.0:1746065226.068831:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265620224:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065226.068842:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065226.068856:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147b01e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a52e expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065226.068900:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264085504:192.168.202.27@tcp:106: 00000100:00100000:1.0:1746065226.068969:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4540 going to sleep for 11 seconds 00010000:00010000:2.0:1746065226.069030:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.069042:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a000/0xad6b7ddc147b025 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a535 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.069085:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc147b02c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.069094:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc147b02c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.069102:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc147b02c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.069113:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147b033 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.069117:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147b033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.069122:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147b033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.069176:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.069185:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4ef expref: 37 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.069191:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.069209:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4ef expref: 37 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.069219:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4ef expref: 37 pid: 7204 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.069227:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264085632:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.069247:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065226.069262:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18141 00000100:00100000:2.0:1746065226.069281:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+44:2007:x1830881265620480:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065226.069288:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.069296:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc147b041 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a53c expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.069306:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.069308:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.069314:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc147b041 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a53c expref: 45 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.069322:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc147b041 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a53c expref: 45 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.069333:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683a800, rc 0) 00000100:00100000:2.0:1746065226.069354:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2007:x1830881265620480:12345-192.168.202.27@tcp:101:cat.0 Request processed in 86us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.069359:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18141 00000100:00100000:2.0:1746065226.069373:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18142 00000100:00100000:2.0:1746065226.069378:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2733:x1830881265620608:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065226.069383:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.069389:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a543 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.069400:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 23 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.069406:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147af84 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4da expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.069411:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.069413:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.069415:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 5/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 23 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.069434:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147af84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4da expref: 35 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.069454:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147af84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4da expref: 35 pid: 9548 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.069462:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264085760:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065226.069490:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 23 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.069496:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 23 pid: 9548 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.069503:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264085888:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.069518:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065226.073296:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:1.0:1746065226.073300:0:9548:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime: 1746065225 -> 1746065226 00002000:00010000:1.0:1746065226.073304:0:9548:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime: 1746065224 -> 1746065226 00002000:00010000:1.0:1746065226.073306:0:9548:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime: 1746065224 -> 1746065226 00000100:00100000:0.0:1746065226.073319:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265620864 00000100:00100000:1.0:1746065226.073321:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264085504:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065226.073323:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265620864 00010000:00010000:1.0:1746065226.073346:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147b01e lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a52e expref: 35 pid: 9548 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065226.073355:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5550 00010000:00010000:1.0:1746065226.073359:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488600/0xad6b7ddc147b01e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a52e expref: 35 pid: 9548 timeout: 0 lvb_type: 1 00000100:00100000:0.0:1746065226.073361:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+38:31232:x1830881265620864:12345-192.168.202.27@tcp:35:ldlm_bl.0 00010000:00010000:1.0:1746065226.073373:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488600, rc 0) 00000100:00100000:1.0:1746065226.073405:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265620224:12345-192.168.202.27@tcp:101:cat.0 Request processed in 4573us (4785us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065226.073411:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18140 00000100:00100000:3.0:1746065226.073508:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264085632:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065226.073517:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+39:31232:x1830881265620864:12345-192.168.202.27@tcp:35:ldlm_bl.0 Request processed in 156us (228us total) trans 8589937251 rc 0/0 00000100:00100000:0.0:1746065226.073521:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5550 00010000:00010000:3.0:1746065226.073522:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:2.0:1746065226.073896:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264085760:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.073904:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264085888:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065226.073919:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->1064959] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 23 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.073929:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683bc00, rc 0) 00000100:00100000:2.0:1746065226.073952:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2733:x1830881265620608:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4573us (5272us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.073957:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18142 00000100:00100000:0.0:1746065226.075719:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.075755:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.075921:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265620992 00000100:00100000:2.0:1746065226.075926:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265620992 00010000:00010000:2.0:1746065226.075948:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147af84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4da expref: 34 pid: 9548 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.075968:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265621120 00000100:00100000:2.0:1746065226.075971:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265621120 00010000:00010000:2.0:1746065226.075981:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 23 pid: 9548 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746065226.076147:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.079191:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.079872:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265621248 00000100:00100000:2.0:1746065226.079880:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265621248 00010000:00010000:2.0:1746065226.079909:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4ef expref: 39 pid: 7204 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.079934:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8489 00000100:00100000:2.0:1746065226.079941:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265620992:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.079950:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.079969:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147af84 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4da expref: 34 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.079979:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147af84 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4da expref: 34 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.079997:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07e00/0xad6b7ddc147af84 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4da expref: 34 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.080014:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.080130:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265620992:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 188us (4412us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.080136:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8489 00000100:00100000:2.0:1746065226.080150:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8490 00000100:00100000:2.0:1746065226.080156:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265621120:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.080166:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.080172:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 23 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.080180:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 23 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.080191:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880099d07800/0xad6b7ddc147af4c lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4be expref: 23 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.080198:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.080200:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.080205:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.080212:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.080237:0:7192:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.080247:0:7192:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264086016:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065226.080396:0:7192:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5780 going to sleep for 11 seconds 00000100:00100000:2.0:1746065226.080416:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265621376 00000100:00100000:2.0:1746065226.080419:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265621376 00000100:00100000:2.0:1746065226.080439:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18143 00000100:00100000:2.0:1746065226.080443:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2738:x1830881265621376:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065226.080453:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.080461:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a54a expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.080475:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.080480:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065226.080481:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:2.0:1746065226.080483:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 4/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 34 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.080496:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 22 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.080503:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 22 pid: 1880 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.080510:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264086144:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.080529:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009d2e5840 going to sleep for 11 seconds 00000100:00100000:2.0:1746065226.080555:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8491 00000100:00100000:2.0:1746065226.080561:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+39:2006:x1830881265621248:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.080568:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.080574:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4ef expref: 39 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.080580:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4ef expref: 39 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.080592:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577bc00/0xad6b7ddc147afa0 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4ef expref: 39 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.080600:0:7190:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.080604:0:7190:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x48 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080610:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080615:0:7190:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080627:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.080639:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b03100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+38:2006:x1830881265621248:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 79us (4493us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.080644:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8491 00010000:00010000:2.0:1746065226.080663:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080668:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065226.080704:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00000004:00200000:2.0:1746065226.080708:0:7205:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065226.080722:0:7205:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080730:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080739:0:7205:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc147b02c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080749:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc147b02c lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080754:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc147b02c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080759:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc147b02c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080763:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683a200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065226.080765:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc147b02c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080788:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc147b02c lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080796:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065226.080798:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065226.080801:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc147b02c lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080804:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a200/0xad6b7ddc147b02c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080963:0:7205:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147b033 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080969:0:7205:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147b033 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080973:0:7205:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147b033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080976:0:7205:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683be00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065226.080979:0:7205:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147b033 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080983:0:7205:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147b033 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080990:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5db00) 00010000:00010000:2.0:1746065226.080992:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065226.080994:0:7205:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147b033 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.080998:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683be00/0xad6b7ddc147b033 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.081025:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683a000/0xad6b7ddc147b025 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a535 expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.081034:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a535 expref: 11 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.081039:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.081041:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065226.081043:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683b800, rc 0) 00000100:00100000:2.0:1746065226.081065:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2739:x1830881265620352:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 12369us (12487us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.081070:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14719 00000100:00100000:0.0:1746065226.086291:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.086310:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.086767:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264086144:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065226.086824:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 3/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 34 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.086845:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf200, rc 0) 00000100:00100000:2.0:1746065226.086884:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2738:x1830881265621376:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6438us (7696us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.086892:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18143 00000100:00100000:3.0:1746065226.086987:0:7192:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:7192:1830881264086016:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065226.086997:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065226.087017:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265621120:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 6861us (11261us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.087024:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8490 00000100:00100000:0.0:1746065226.088017:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.088083:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.088087:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265621760 00000100:00100000:2.0:1746065226.088093:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265621760 00000100:00100000:2.0:1746065226.088105:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265621888 00000100:00100000:0.0:1746065226.088105:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.088108:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265621888 00000100:00100000:2.0:1746065226.088127:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265622144 00000100:00100000:2.0:1746065226.088129:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265622144 00000100:00100000:0.0:1746065226.088132:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.088203:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265621632 00000100:00100000:1.0:1746065226.088207:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265621632 00002000:00100000:1.0:1746065226.088229:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x280000401:0x94:0x0] (1372160->2097151) req@ffff880134b00a80 x1830881265621632/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.088237:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00a80 with x1830881265621632 ext(1372160->2097151) 00010000:00010000:1.0:1746065226.088243:0:9554:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 23 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.088253:0:9554:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 23 pid: 1880 timeout: 922 lvb_type: 0 00002000:00010000:1.0:1746065226.088263:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b00a80 00000100:00100000:1.0:1746065226.088288:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2136 00000100:00100000:1.0:1746065226.088293:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265621632:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065226.090413:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265622016 00000100:00100000:2.0:1746065226.090421:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265622016 00000100:00100000:0.0:1746065226.090424:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265622272 00000100:00100000:0.0:1746065226.090426:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265622272 00000100:00100000:2.0:1746065226.090450:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18144 00000100:00100000:2.0:1746065226.090456:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+19:2004:x1830881265621888:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065226.090467:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.090481:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147b056 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a551 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.090519:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264086272:192.168.202.27@tcp:106: 00000100:00100000:2.0:1746065226.090575:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065226.090579:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18145 00000100:00100000:3.0:1746065226.090585:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265622144:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:2.0:1746065226.090591:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18146 00010000:00010000:3.0:1746065226.090593:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1746065226.090595:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+20:2004:x1830881265622016:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065226.090599:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065226.090602:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f67200/0xad6b7ddc147b05d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a55f expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.090604:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b064 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a558 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.090613:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.090615:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.090622:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67200/0xad6b7ddc147b05d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a55f expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00000100:00100000:2.0:1746065226.090625:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264086400:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065226.090633:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f67200/0xad6b7ddc147b05d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a55f expref: 18 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.090641:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f67200, rc 0) 00000100:00100000:2.0:1746065226.090643:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065226.090655:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18147 00000100:00100000:3.0:1746065226.090657:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265622144:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 73us (2574us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.090659:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265622272:12345-192.168.202.27@tcp:101:mirror_io.0 00000100:00100000:3.0:1746065226.090662:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18145 00010000:00010000:2.0:1746065226.090664:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.090669:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc147b06b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a566 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.090678:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.090680:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.090684:0:12258:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc147b06b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a566 expref: 18 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.090692:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc147b06b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a566 expref: 18 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.090697:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5b200, rc 0) 00002000:00100000:3.0:1746065226.092033:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1060864->1064959) req@ffff880134b01180 x1830881265621760/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065226.092042:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01180 with x1830881265621760 ext(1060864->1064959) 00002000:00010000:3.0:1746065226.092046:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b01180 00000100:00100000:3.0:1746065226.092059:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6504 00000100:00100000:3.0:1746065226.092065:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265621760:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065226.092147:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2007:x1830881265621760:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 82us (5863us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065226.092153:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6504 00002000:00100000:3.0:1746065226.092158:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x95:0x0] (1060864->1064959) req@ffff880134b01180 x1830881265621760/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/4536 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065226.092164:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b01180 with x1830881265621760 ext(1060864->1064959) 00002000:00010000:3.0:1746065226.092166:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880134b01180 00000100:00100000:2.0:1746065226.095239:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265622272:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 4571us (7098us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.095249:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18147 00000100:00100000:2.0:1746065226.095806:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264086272:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065226.095829:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147b056 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a551 expref: 21 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.095841:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a174000/0xad6b7ddc147b056 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a551 expref: 21 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.095864:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174000, rc 0) 00000100:00100000:2.0:1746065226.095884:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:02506576-29fe-43be-8266-ebca0ccafd52+20:2004:x1830881265621888:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 5429us (7869us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065226.095891:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18144 00002000:00010000:2.0:1746065226.097348:0:9550:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime: 1746065225 -> 1746065226 00002000:00010000:2.0:1746065226.097353:0:9550:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime: 1746065225 -> 1746065226 00002000:00010000:2.0:1746065226.097355:0:9550:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime: 1746065225 -> 1746065226 00000100:00100000:2.0:1746065226.097366:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e13480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264086400:192.168.202.27@tcp:106: 00010000:00010000:2.0:1746065226.097385:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b064 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a558 expref: 19 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.097395:0:9550:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b064 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a558 expref: 19 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.097402:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ac31000, rc 0) 00000100:00100000:2.0:1746065226.097575:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:02506576-29fe-43be-8266-ebca0ccafd52+18:2004:x1830881265622016:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 6977us (9468us total) trans 0 rc 301/301 00000100:00100000:2.0:1746065226.097582:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18146 00000100:00100000:0.0:1746065226.097716:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.097737:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265622528 00000100:00100000:0.0:1746065226.097742:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265622528 00000100:00100000:0.0:1746065226.097797:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5551 00000100:00100000:0.0:1746065226.097804:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4298c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2733:x1830881265622528:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:0.0:1746065226.097941:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4298c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2733:x1830881265622528:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 137us (225us total) trans 8589937252 rc 0/0 00000100:00100000:0.0:1746065226.097946:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5551 00000100:00100000:2.0:1746065226.104607:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.104634:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265622784 00000100:00100000:2.0:1746065226.104641:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265622784 00000100:00100000:2.0:1746065226.104678:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14720 00000100:00100000:2.0:1746065226.104684:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+11:2739:x1830881265622784:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065226.104700:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.104715:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc147b072 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a56d expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.104813:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147b079 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.104825:0:7205:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a535 expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.104833:0:7205:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147b079 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.104858:0:7205:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a535 expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.104866:0:7205:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a535 expref: 12 pid: 7205 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.104877:0:7205:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264086528:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.107157:0:7205:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065226.109283:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b00a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2007:x1830881265621632:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 20972us (22954us total) trans 21474841809 rc 0/0 00000100:00100000:1.0:1746065226.109295:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2136 00002000:00100000:1.0:1746065226.109305:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1372160->2097151) req@ffff880134b00a80 x1830881265621632/t21474841809(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/448 e 0 to 0 dl 1746065237 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.109315:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880134b00a80 with x1830881265621632 ext(1372160->2097151) 00010000:00010000:1.0:1746065226.109324:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 24 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.109335:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 24 pid: 1880 timeout: 922 lvb_type: 0 00002000:00010000:1.0:1746065226.109342:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880134b00a80 00000100:00100000:2.0:1746065226.110736:0:7205:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e11f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:7205:1830881264086528:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065226.110756:0:7205:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147b079 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000100:00100000:0.0:1746065226.111902:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.112013:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265622912 00000100:00100000:3.0:1746065226.112018:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265622912 00010000:00010000:3.0:1746065226.112043:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a535 expref: 13 pid: 7205 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.112072:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8492 00000100:00100000:3.0:1746065226.112078:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2007:x1830881265622912:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065226.112087:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065226.112092:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a535 expref: 13 pid: 7205 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.112100:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a535 expref: 13 pid: 7205 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.112120:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b03a lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a535 expref: 13 pid: 7205 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.112135:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065226.112138:0:7192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147b079 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065226.112146:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147b079 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065226.112151:0:7192:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147b079 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT flags: 0x40290000000000 pid: 7205 initiator: MDT0 00010000:00010000:3.0:1746065226.112173:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065226.112199:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2007:x1830881265622912:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 121us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.112204:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8492 00010000:00010000:2.0:1746065226.112846:0:7205:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147b079 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.112854:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147b079 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065226.112874:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:2.0:1746065226.112992:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5ba00/0xad6b7ddc147b072 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a56d expref: 13 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.113021:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147b079 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a56d expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.113027:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.113030:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1746065226.113032:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a800, rc 0) 00000100:00100000:2.0:1746065226.113060:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2739:x1830881265622784:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 8376us (8460us total) trans 8589937253 rc 0/0 00000100:00100000:2.0:1746065226.113065:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14720 00000100:00100000:0.0:1746065226.116395:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.116535:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265623040 00000100:00100000:1.0:1746065226.116542:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265623040 00010000:00010000:1.0:1746065226.116566:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 24 pid: 1880 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746065226.116599:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8493 00000100:00100000:1.0:1746065226.116605:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2006:x1830881265623040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065226.117039:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065226.117058:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 24 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.117069:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 24 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.117088:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009a174a00/0xad6b7ddc147aff4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1372160->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a520 expref: 24 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.117112:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.117114:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.117121:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.117128:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.117157:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 33 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065226.117168:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264086656:192.168.202.27@tcp:105: 00000100:00100000:1.0:1746065226.117234:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065226.118085:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.118293:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265623296 00000100:00100000:2.0:1746065226.118298:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265623296 00000100:00100000:2.0:1746065226.118330:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14721 00000100:00100000:2.0:1746065226.118336:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+12:2739:x1830881265623296:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:2.0:1746065226.118353:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.118355:0:7205:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1746065226.118369:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a800/0xad6b7ddc147b079 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a56d expref: 12 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.118381:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.118384:0:7205:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065226.118394:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147b087 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a574 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.118463:0:7205:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b08e lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.118476:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b08e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7205 initiator: MDT0 00010000:00010000:2.0:1746065226.118483:0:7205:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b08e lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7205 initiator: MDT0 00000004:00200000:2.0:1746065226.118492:0:7205:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:2.0:1746065226.118566:0:7205:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a000/0xad6b7ddc147b087 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 10 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a574 expref: 14 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.118576:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b08e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a574 expref: 13 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.118582:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.118584:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065226.118586:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a200, rc 0) 00000100:00100000:2.0:1746065226.118613:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2739:x1830881265623296:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 277us (528us total) trans 8589937254 rc 0/0 00000100:00100000:2.0:1746065226.118618:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14721 00000100:00100000:1.0:1746065226.120555:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264086656:192.168.202.27@tcp:105: 00010000:00010000:1.0:1746065226.120569:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065226.120607:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2006:x1830881265623040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4001us (4218us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.120616:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8493 00000100:00100000:0.0:1746065226.120871:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.121040:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265623552 00000100:00100000:2.0:1746065226.121044:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265623552 00000100:00100000:2.0:1746065226.121108:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14722 00000100:00100000:2.0:1746065226.121115:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2743:x1830881265623552:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065226.121129:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.121141:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a175000/0xad6b7ddc147b09c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a57b expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.121191:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147b0a3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121202:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147b0a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121210:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147b0a3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121221:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b0aa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121226:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121231:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121319:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147b0b1 lrc: 3/1,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121327:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147b0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121333:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147b0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065226.121339:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:2.0:1746065226.121379:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147b0b1 lrc: 3/1,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121384:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147b0b1 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121388:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147b0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121393:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac30000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065226.121396:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147b0b1 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121402:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147b0b1 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121409:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.121411:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065226.121413:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147b0b1 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121418:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac30000/0xad6b7ddc147b0b1 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121427:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147b0a3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121431:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147b0a3 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121435:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147b0a3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121438:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147b0a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121442:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f04b600 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065226.121443:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147b0a3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121447:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147b0a3 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121451:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065226.121452:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065226.121454:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147b0a3 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121458:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f04b600/0xad6b7ddc147b0a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121463:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b0aa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121466:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b0aa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121469:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b0aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121473:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31000 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065226.121475:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b0aa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121478:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b0aa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121482:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880091b5da00) 00010000:00010000:2.0:1746065226.121483:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065226.121485:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b0aa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121489:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009ac31000/0xad6b7ddc147b0aa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.121511:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a175000/0xad6b7ddc147b09c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a57b expref: 20 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.121516:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a175000/0xad6b7ddc147b09c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a57b expref: 20 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.121522:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a175000, rc 0) 00000100:00100000:2.0:1746065226.121553:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2743:x1830881265623552:12345-192.168.202.27@tcp:101:cat.0 Request processed in 438us (682us total) trans 8589937255 rc 301/301 00000100:00100000:2.0:1746065226.121558:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14722 00000100:00100000:2.0:1746065226.126314:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.127746:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265623680 00000100:00100000:0.0:1746065226.127759:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265623680 00000100:00100000:0.0:1746065226.127860:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14723 00000100:00100000:0.0:1746065226.127868:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+13:2739:x1830881265623680:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065226.127889:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.127905:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc147b0bf lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a582 expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.127955:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc147b0bf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a582 expref: 14 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.127967:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc147b0bf lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a582 expref: 14 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.127982:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065226.127985:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065226.127988:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f44e00, rc 0) 00000100:00100000:0.0:1746065226.128041:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:02506576-29fe-43be-8266-ebca0ccafd52+14:2739:x1830881265623680:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 174us (1734us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.128047:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14723 00000100:00100000:0.0:1746065226.129832:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.129858:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265624064 00000100:00100000:2.0:1746065226.129864:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265624064 00000100:00100000:2.0:1746065226.129891:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5552 00000100:00100000:2.0:1746065226.129897:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2743:x1830881265624064:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:2.0:1746065226.130051:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2743:x1830881265624064:12345-192.168.202.27@tcp:35:cat.0 Request processed in 154us (222us total) trans 8589937256 rc 0/0 00000100:00100000:2.0:1746065226.130056:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5552 00000100:00100000:0.0:1746065226.131604:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.131642:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.131668:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.131672:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265624192 00000100:00100000:1.0:1746065226.131677:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265624192 00000100:00100000:0.0:1746065226.131679:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.131690:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.131704:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00100000:1.0:1746065226.131705:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880097fa8000 x1830881265624192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.131714:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8000 with x1830881265624192 ext(1048576->2097151) 00000100:00100000:0.0:1746065226.131715:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265624320 00000100:00100000:0.0:1746065226.131717:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265624320 00002000:00010000:1.0:1746065226.131719:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fa8000 00000100:00100000:1.0:1746065226.131733:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6505 00000100:00100000:1.0:1746065226.131738:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265624192:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065226.131740:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265624576 00000100:00100000:0.0:1746065226.131742:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265624576 00000100:00100000:0.0:1746065226.131751:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265624832 00000100:00100000:0.0:1746065226.131752:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265624832 00000100:00100000:0.0:1746065226.131765:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265624448 00000100:00100000:0.0:1746065226.131766:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265624448 00000100:00100000:0.0:1746065226.131786:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265624704 00000100:00100000:0.0:1746065226.131787:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265624704 00000100:00100000:1.0:1746065226.131790:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18148 00000100:00100000:1.0:1746065226.131795:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+20:2006:x1830881265624320:12345-192.168.202.27@tcp:1:mirror_io.0 00000100:00100000:0.0:1746065226.131799:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18149 00000100:00100000:0.0:1746065226.131802:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265624576:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:1.0:1746065226.131817:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.131817:0:13375:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.131830:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147ad31 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a352 expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.131830:0:13375:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.131837:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc147adfc lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3de expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.131841:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065226.131842:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065226.131843:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad7e lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a383 expref: 44 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.131845:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 4/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.131848:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.131849:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.131851:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.131867:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a383 expref: 44 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.131867:0:13375:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 22 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.131877:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a383 expref: 44 pid: 12258 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.131877:0:13375:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 22 pid: 11461 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746065226.131887:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264086912:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065226.131887:0:13375:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264086784:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.131941:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18150 00000100:00100000:2.0:1746065226.131947:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+20:2006:x1830881265624832:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:2.0:1746065226.131963:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.131972:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.131978:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc147b06b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a566 expref: 20 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.131984:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc147b041 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a53c expref: 44 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.131988:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.131990:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.131991:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.132005:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc147b041 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a53c expref: 44 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.132012:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc147b041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a53c expref: 44 pid: 11461 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746065226.132018:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264087040:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.132088:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18151 00000100:00100000:3.0:1746065226.132095:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265624448:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065226.132109:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.132118:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 34 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.132123:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.132124:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.132125:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 4/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.132140:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 34 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.132146:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 34 pid: 11461 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.132153:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264087168:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065226.132624:0:13375:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64e40 going to sleep for 11 seconds 00010000:00010000:1.0:1746065226.132630:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc147adfc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3de expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.132638:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc147adfc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3de expref: 20 pid: 13375 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746065226.132645:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264087296:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065226.132658:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065226.132666:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147ad31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a352 expref: 21 pid: 9549 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.132673:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147ad31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a352 expref: 21 pid: 9549 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746065226.132680:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264087424:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065226.132693:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2deb40 going to sleep for 11 seconds 00000100:00100000:1.0:1746065226.132705:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265624960 00000100:00100000:1.0:1746065226.132708:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265624960 00000100:00100000:3.0:1746065226.132757:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800905340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065226.132789:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18152 00000100:00100000:3.0:1746065226.132795:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+20:2006:x1830881265624704:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065226.132811:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.132820:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.132825:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f67200/0xad6b7ddc147b05d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a55f expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.132830:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.132835:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.132836:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.132838:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 6/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.132851:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 44 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.132858:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 44 pid: 1880 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.132865:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264087552:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065226.132952:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1746065226.133057:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18153 00000100:00100000:1.0:1746065226.133062:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+20:2006:x1830881265624960:12345-192.168.202.27@tcp:1:mirror_io.0 00010000:00010000:3.0:1746065226.133128:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880095f67200/0xad6b7ddc147b05d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a55f expref: 20 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.133128:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc147b06b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a566 expref: 20 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.133136:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880095f67200/0xad6b7ddc147b05d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a55f expref: 20 pid: 11461 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.133136:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc147b06b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a566 expref: 20 pid: 12258 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746065226.133144:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264087680:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.133144:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264087808:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065226.133167:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.133175:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 21 pid: 1880 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.133189:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264087936:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.133405:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.133432:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b240 going to sleep for 11 seconds 00010000:00010000:1.0:1746065226.134131:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.134138:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 21 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.134140:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc147aeb2 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a471 expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.134146:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc147ae81 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a44e expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.134147:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 21 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.134151:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.134153:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.134155:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 6/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065226.134156:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264088064:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.134173:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc147ae81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a44e expref: 22 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.134180:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc147ae81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a44e expref: 22 pid: 13375 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746065226.134203:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534900 going to sleep for 11 seconds 00000100:00100000:1.0:1746065226.134422:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264088192:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.134467:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc147aeb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a471 expref: 20 pid: 13375 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.134476:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc147aeb2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a471 expref: 20 pid: 13375 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746065226.134483:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264088320:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.134692:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.134700:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 34 pid: 13375 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746065226.134707:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264088448:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065226.134736:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065226.139599:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264086912:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065226.139612:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264087296:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065226.139619:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264087424:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.139641:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065226.139665:0:13375:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_010:lustre-OST0000_UUID:13375:1830881264086784:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.139673:0:13375:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065226.145411:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.145441:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264087040:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.145476:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264087808:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065226.145479:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.145491:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264087552:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.145498:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264087680:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065226.145501:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.145513:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.145542:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.145551:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265625728 00000100:00100000:1.0:1746065226.145556:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265625728 00000100:00100000:0.0:1746065226.145557:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.145574:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065226.145585:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc147b06b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a566 expref: 21 pid: 12258 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746065226.145586:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.145596:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.145602:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265625344 00000100:00100000:1.0:1746065226.145603:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265625344 00010000:00010000:1.0:1746065226.145612:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc147adfc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3de expref: 22 pid: 13375 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746065226.145612:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265625984 00000100:00100000:0.0:1746065226.145615:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265625984 00000100:00100000:1.0:1746065226.145619:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265625600 00000100:00100000:1.0:1746065226.145621:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265625600 00010000:00010000:1.0:1746065226.145628:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc147b041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a53c expref: 45 pid: 11461 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746065226.145634:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265626368 00000100:00100000:1.0:1746065226.145636:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265626368 00000100:00100000:0.0:1746065226.145637:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18154 00010000:00010000:1.0:1746065226.145642:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 46 pid: 1880 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746065226.145643:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265625984:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065226.145648:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265625216 00000100:00100000:1.0:1746065226.145649:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265625216 00010000:00010000:1.0:1746065226.145655:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a383 expref: 47 pid: 12258 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.145656:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065226.145661:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265625472 00000100:00100000:1.0:1746065226.145662:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265625472 00010000:00010000:0.0:1746065226.145668:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009ae1f200/0xad6b7ddc147b0f0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a590 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.145669:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147ad31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a352 expref: 22 pid: 9549 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746065226.145675:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265626240 00000100:00100000:1.0:1746065226.145677:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265626240 00010000:00010000:1.0:1746065226.145682:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880095f67200/0xad6b7ddc147b05d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a55f expref: 23 pid: 11461 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.145685:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00000100:00100000:1.0:1746065226.145690:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8494 00010000:00010000:0.0:1746065226.145693:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009ae1f200/0xad6b7ddc147b0f0 lrc: 1/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a590 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00000100:00100000:1.0:1746065226.145694:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+23:2005:x1830881265625728:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065226.145701:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ae1f200/0xad6b7ddc147b0f0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a590 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.145702:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065226.145712:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009ae1f200, rc 0) 00010000:00010000:1.0:1746065226.145717:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc147b06b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a566 expref: 23 pid: 12258 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.145725:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc147b06b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a566 expref: 23 pid: 12258 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.145739:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008ec5b200/0xad6b7ddc147b06b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a566 expref: 23 pid: 12258 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746065226.145741:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265625984:12345-192.168.202.27@tcp:101:cat.0 Request processed in 98us (143us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065226.145745:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18154 00010000:00010000:1.0:1746065226.145753:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065226.145803:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.145813:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009834d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+22:2005:x1830881265625728:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 117us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.145814:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265625856 00000100:00100000:0.0:1746065226.145816:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265625856 00000100:00100000:1.0:1746065226.145818:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8494 00000100:00100000:0.0:1746065226.145827:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18155 00000100:00100000:1.0:1746065226.145830:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8495 00000100:00100000:0.0:1746065226.145831:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265625856:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065226.145834:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+21:2006:x1830881265625344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065226.145837:0:12258:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065226.145840:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065226.145842:0:12258:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b0f7 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a589 expref: -99 pid: 12258 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.145848:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc147adfc lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3de expref: 21 pid: 13375 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.145850:0:12258:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.145856:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc147adfc lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3de expref: 21 pid: 13375 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.145856:0:12258:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b0f7 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 8 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a589 expref: 24 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.145862:0:12258:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b0f7 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a589 expref: 24 pid: 12258 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.145865:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009a4d9400/0xad6b7ddc147adfc lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 8 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3de expref: 21 pid: 13375 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.145868:0:12258:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b000, rc 0) 00010000:00010000:1.0:1746065226.145873:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065226.145880:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265625856:12345-192.168.202.27@tcp:101:cat.0 Request processed in 48us (77us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065226.145884:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18155 00000100:00100000:1.0:1746065226.145888:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+20:2006:x1830881265625344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.145892:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8495 00000100:00100000:1.0:1746065226.145901:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8496 00000100:00100000:1.0:1746065226.145905:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265625600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065226.145910:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065226.145916:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc147b041 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a53c expref: 47 pid: 11461 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.145923:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc147b041 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a53c expref: 47 pid: 11461 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.145931:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683a800/0xad6b7ddc147b041 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a53c expref: 47 pid: 11461 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.145938:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065226.145951:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+46:2006:x1830881265625600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.145956:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8496 00000100:00100000:1.0:1746065226.145964:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8497 00000100:00100000:1.0:1746065226.145968:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881265626368:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065226.145975:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065226.145981:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 45 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.145988:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 45 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.145996:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800a852a200/0xad6b7ddc147af92 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e8 expref: 45 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.146003:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065226.146016:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012b3e7050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+44:2006:x1830881265626368:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 48us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.146021:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8497 00000100:00100000:1.0:1746065226.146053:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8498 00000100:00100000:1.0:1746065226.146057:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+43:2006:x1830881265625216:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065226.146063:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065226.146069:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad7e lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a383 expref: 43 pid: 12258 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746065226.146833:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.146846:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265626112 00000100:00100000:0.0:1746065226.146849:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265626112 00000100:00100000:0.0:1746065226.146864:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18156 00000100:00100000:0.0:1746065226.146868:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265626112:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065226.146875:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.146882:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc147b0fe lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a597 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065226.146920:0:9548:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264088576:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065226.146964:0:9548:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099d64600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065226.147308:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0000_UUID:3067:1830881264087168:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.147323:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065226.147323:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264088192:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065226.147332:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264088320:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065226.147339:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264088448:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.147343:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8499 00000100:00100000:3.0:1746065226.147349:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2006:x1830881265625472:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065226.147355:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065226.147355:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.147366:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147ad31 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a352 expref: 22 pid: 9549 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746065226.147373:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147ad31 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a352 expref: 22 pid: 9549 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746065226.147384:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539a00/0xad6b7ddc147ad31 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 7 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a352 expref: 22 pid: 9549 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746065226.147397:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065226.147422:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265625472:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 73us (1847us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.147426:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8499 00000100:00100000:0.0:1746065226.147430:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265624192:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15691us (15829us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065226.147437:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8500 00000100:00100000:0.0:1746065226.147437:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6505 00000100:00100000:3.0:1746065226.147441:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265626240:12345-192.168.202.27@tcp:103:ldlm_bl.0 00002000:00100000:0.0:1746065226.147444:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff880097fa8000 x1830881265624192/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00010000:00010000:3.0:1746065226.147448:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00100000:0.0:1746065226.147451:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa8000 with x1830881265624192 ext(1048576->2097151) 00010000:00010000:3.0:1746065226.147454:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880095f67200/0xad6b7ddc147b05d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a55f expref: 19 pid: 11461 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.147456:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 34 pid: 11461 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.147461:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880095f67200/0xad6b7ddc147b05d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a55f expref: 19 pid: 11461 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.147466:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 34 pid: 11461 timeout: 922 lvb_type: 0 00002000:00010000:0.0:1746065226.147471:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa8000 00010000:00010000:3.0:1746065226.147475:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f67200/0xad6b7ddc147b05d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a55f expref: 19 pid: 11461 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746065226.147481:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065226.147483:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265625088 00000100:00100000:0.0:1746065226.147485:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265625088 00000100:00100000:3.0:1746065226.147495:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265626240:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 53us (1908us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.147498:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8500 00002000:00100000:0.0:1746065226.147502:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1064959) req@ffff880097fa9c00 x1830881265625088/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 16872/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065226.147509:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa9c00 with x1830881265625088 ext(1048576->1064959) 00010000:00010000:0.0:1746065226.147513:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 25 pid: 11461 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746065226.147520:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 25 pid: 11461 timeout: 922 lvb_type: 0 00002000:00010000:0.0:1746065226.147529:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa9c00 00000100:00100000:0.0:1746065226.147540:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2137 00000100:00100000:3.0:1746065226.147581:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0001_UUID:3068:1830881264087936:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.147597:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065226.147613:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264088064:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.147622:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065226.147638:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2006:x1830881265625088:12345-192.168.202.27@tcp:4:multiop.0 00010000:00010000:1.0:1746065226.147919:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad7e lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a383 expref: 43 pid: 12258 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.148109:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012b4f3800/0xad6b7ddc147ad7e lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a383 expref: 43 pid: 12258 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.148118:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.148120:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.148123:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.148130:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.148212:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065226.148236:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+42:2006:x1830881265625216:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2178us (2678us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.148242:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8498 00000100:00100000:0.0:1746065226.148265:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2006:x1830881265625088:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 718us (2860us total) trans 21474841810 rc 0/0 00000100:00100000:0.0:1746065226.148282:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2137 00002000:00100000:0.0:1746065226.148287:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1064959) req@ffff880097fa9c00 x1830881265625088/t21474841810(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 16872/448 e 0 to 0 dl 1746065237 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065226.148294:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fa9c00 with x1830881265625088 ext(1048576->1064959) 00010000:00010000:0.0:1746065226.148299:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 27 pid: 11461 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.148305:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.148306:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 27 pid: 11461 timeout: 922 lvb_type: 0 00002000:00010000:0.0:1746065226.148311:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880097fa9c00 00010000:00010000:2.0:1746065226.148312:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.148325:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.148331:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.148337:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.148343:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88012c488a00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065226.148346:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.148353:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.148362:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.148368:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c488a00/0xad6b7ddc147b0c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.148417:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+17:2006:x1830881265624320:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 16621us (16774us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.148423:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18148 00000100:00100000:0.0:1746065226.152601:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.152858:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265626496 00000100:00100000:1.0:1746065226.152866:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265626496 00010000:00010000:1.0:1746065226.152895:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 21 pid: 1880 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746065226.154176:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8501 00000100:00100000:1.0:1746065226.154187:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2005:x1830881265626496:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065226.154201:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065226.154218:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 21 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.154235:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 21 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.154253:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac30c00/0xad6b7ddc147afed lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 5033984->5242879) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a519 expref: 21 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.154278:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.154280:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.154285:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.154293:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.154327:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065226.154369:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265626496:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 185us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.154376:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8501 00010000:00010000:3.0:1746065226.154492:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.154499:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.154515:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.154523:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.154530:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.154536:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009ac31000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065226.154539:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.154545:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.154555:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.154560:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009ac31000/0xad6b7ddc147b0d4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065226.154601:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:02506576-29fe-43be-8266-ebca0ccafd52+16:2006:x1830881265624832:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 22654us (22919us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.154609:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18150 00000100:00100000:1.0:1746065226.155359:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.155383:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.155403:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.155415:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.155443:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.155482:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265626752 00000100:00100000:2.0:1746065226.155486:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265626752 00010000:00010000:2.0:1746065226.155504:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc147aeb2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a471 expref: 21 pid: 13375 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746065226.155520:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265627008 00000100:00100000:2.0:1746065226.155522:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265627008 00010000:00010000:2.0:1746065226.155534:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc147ae81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a44e expref: 27 pid: 13375 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746065226.155542:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265626624 00000100:00100000:2.0:1746065226.155543:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265626624 00010000:00010000:2.0:1746065226.155551:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 20 pid: 1880 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.155562:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265626880 00000100:00100000:2.0:1746065226.155563:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265626880 00010000:00010000:2.0:1746065226.155570:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 34 pid: 13375 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.155576:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265627136 00000100:00100000:2.0:1746065226.155577:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265627136 00010000:00010000:2.0:1746065226.155583:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 28 pid: 11461 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.155590:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8502 00000100:00100000:2.0:1746065226.155594:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+21:2005:x1830881265626752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.155601:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.155612:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc147aeb2 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a471 expref: 21 pid: 13375 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.155618:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc147aeb2 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a471 expref: 21 pid: 13375 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.155629:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090685400/0xad6b7ddc147aeb2 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a471 expref: 21 pid: 13375 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.155638:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.155657:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+20:2005:x1830881265626752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 62us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.155662:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8502 00000100:00100000:2.0:1746065226.155672:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8503 00000100:00100000:2.0:1746065226.155676:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+28:2005:x1830881265627008:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.155682:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.155688:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc147ae81 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a44e expref: 28 pid: 13375 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.155694:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc147ae81 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a44e expref: 28 pid: 13375 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.155704:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009ac31800/0xad6b7ddc147ae81 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a44e expref: 28 pid: 13375 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.155711:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.155723:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265627008:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 46us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.155727:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8503 00000100:00100000:2.0:1746065226.155735:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8504 00000100:00100000:2.0:1746065226.155739:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2005:x1830881265626624:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.155744:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.155752:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 20 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.155759:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 20 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.155768:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880091a97a00/0xad6b7ddc147af8b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4e1 expref: 20 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.155798:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.155800:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.155803:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155808:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155821:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.155834:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2005:x1830881265626624:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 95us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.155839:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8504 00000100:00100000:2.0:1746065226.155866:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8505 00000100:00100000:2.0:1746065226.155871:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265626880:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.155877:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.155883:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 34 pid: 13375 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.155890:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 34 pid: 13375 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.155900:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008f7f3400/0xad6b7ddc147ae5e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a42b expref: 34 pid: 13375 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.155908:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.155910:0:9565:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.155912:0:9565:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155917:0:9565:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155930:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065226.155940:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155946:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155956:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155962:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155968:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155972:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009577b600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065226.155975:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155981:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155993:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.155999:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577b600/0xad6b7ddc147b0e9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.156031:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265624960:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 22968us (23372us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.156036:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18153 00000100:00100000:2.0:1746065226.156055:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8506 00000100:00100000:2.0:1746065226.156060:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881265627136:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.156066:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.156073:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 26 pid: 11461 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.156080:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 26 pid: 11461 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.156089:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.156090:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.156093:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.156098:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.156115:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.156127:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881265627136:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 67us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.156132:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8506 00000100:00100000:2.0:1746065226.156150:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265626880:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 278us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.156153:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8505 00010000:00010000:2.0:1746065226.156173:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.156179:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.156189:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.156195:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.156200:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.156205:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683be00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065226.156208:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.156217:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.156224:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.156229:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88013683be00/0xad6b7ddc147b0e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.156257:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:02506576-29fe-43be-8266-ebca0ccafd52+15:2006:x1830881265624704:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 23462us (24552us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.156262:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18152 00010000:00010000:0.0:1746065226.156356:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b048 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->1064959) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a543 expref: 25 pid: 11461 timeout: 922 lvb_type: 0 00000100:00100000:0.0:1746065226.156366:0:9548:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:9548:1830881264088576:192.168.202.27@tcp:106: 00010000:00010000:0.0:1746065226.156382:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc147b0fe lrc: 1/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a597 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.156395:0:9548:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012f84b200/0xad6b7ddc147b0fe lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a597 expref: 24 pid: 9548 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.156402:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b200, rc 0) 00000100:00100000:0.0:1746065226.156418:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2005:x1830881265626112:12345-192.168.202.27@tcp:101:cat.0 Request processed in 9549us (9586us total) trans 0 rc 301/301 00000100:00100000:0.0:1746065226.156422:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18156 00010000:00010000:1.0:1746065226.156535:0:13375:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.156542:0:13375:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.156555:0:13375:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.156560:0:13375:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.156565:0:13375:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.156569:0:13375:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f44400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065226.156572:0:13375:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.156577:0:13375:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.156585:0:13375:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.156590:0:13375:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f44400/0xad6b7ddc147b0cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065226.156613:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265624576:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 24809us (24944us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.156618:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18149 00000100:00100000:0.0:1746065226.158520:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.158564:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.158948:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265627264 00000100:00100000:1.0:1746065226.158955:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265627264 00000100:00100000:1.0:1746065226.158995:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18157 00000100:00100000:1.0:1746065226.159001:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2738:x1830881265627264:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065226.159015:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065226.159028:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147b105 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a59e expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065226.159044:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d74a, atime: 0x6812d749, ctime: 0x6812d74a, blocks: 0x808 00010000:00010000:1.0:1746065226.159059:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.159060:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.159066:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147b105 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a59e expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.159077:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147b105 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a59e expref: 34 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.159085:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f73800, rc 0) 00000100:00100000:1.0:1746065226.159114:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2738:x1830881265627264:12345-192.168.202.27@tcp:101:cat.0 Request processed in 114us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.159120:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18157 00000100:00100000:0.0:1746065226.161097:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.161116:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265627520 00000100:00100000:0.0:1746065226.161121:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265627520 00000100:00100000:0.0:1746065226.161152:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18158 00000100:00100000:0.0:1746065226.161158:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2743:x1830881265627520:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065226.161168:0:9548:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.161183:0:9548:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b10c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5a5 expref: -99 pid: 9548 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065226.161199:0:9548:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d748, atime: 0x6812d748, ctime: 0x6812d748, blocks: 0x800 00010000:00010000:0.0:1746065226.161332:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.161334:0:9548:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.161339:0:9548:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b10c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5a5 expref: 20 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.161350:0:9548:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b10c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5a5 expref: 20 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.161357:0:9548:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012f84b000, rc 0) 00000100:00100000:0.0:1746065226.161386:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2743:x1830881265627520:12345-192.168.202.27@tcp:101:cat.0 Request processed in 229us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.161391:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18158 00000100:00100000:3.0:1746065226.161558:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265627392 00000100:00100000:3.0:1746065226.161562:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265627392 00010000:00010000:3.0:1746065226.161577:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 34 pid: 11461 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.161592:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8507 00000100:00100000:3.0:1746065226.161596:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265627392:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065226.161603:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065226.161612:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 34 pid: 11461 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.161621:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 34 pid: 11461 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.161633:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf200/0xad6b7ddc147b04f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a54a expref: 34 pid: 11461 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.161642:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.161643:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.161646:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.161652:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.161678:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065226.161694:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265627392:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 97us (3130us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.161699:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8507 00010000:00010000:2.0:1746065226.161706:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.161713:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.161726:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.161733:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.161739:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.161755:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff8800996bfa00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065226.161758:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.161765:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.161788:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.161792:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b0db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.161831:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+17:2006:x1830881265624448:12345-192.168.202.27@tcp:1:mirror_io.0 Request processed in 29737us (30139us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.161837:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18151 00000100:00100000:0.0:1746065226.163883:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.164130:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265627776 00000100:00100000:2.0:1746065226.164136:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265627776 00002000:00100000:2.0:1746065226.164167:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012f3c0e00 x1830881265627776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.164176:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0e00 with x1830881265627776 ext(1048576->2097151) 00000100:00100000:0.0:1746065226.164179:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00002000:00010000:2.0:1746065226.164180:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3c0e00 00000100:00100000:2.0:1746065226.164250:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6506 00000100:00100000:3.0:1746065226.164255:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265628032 00000100:00100000:3.0:1746065226.164258:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265628032 00000100:00100000:2.0:1746065226.164258:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265627776:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065226.164329:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14724 00000100:00100000:3.0:1746065226.164334:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+14:2739:x1830881265628032:12345-192.168.202.27@tcp:36:mirror_io.0 00010000:00010000:3.0:1746065226.164361:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065226.164380:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f44e00/0xad6b7ddc147b0bf lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a582 expref: 14 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.164393:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065226.164396:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065226.164415:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 10 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.164425:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147afd8 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a50b expref: 19 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.164432:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147b010 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a527 expref: 37 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.164438:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a336 expref: 37 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.164443:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc147add9 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c9 expref: 19 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.164448:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc147af30 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a9 expref: 19 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.164453:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 8/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.164474:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc147af30 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a9 expref: 19 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.164483:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc147af30 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a9 expref: 19 pid: 7205 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.164498:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264088704:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.164579:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc147add9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c9 expref: 19 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.164587:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc147add9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c9 expref: 19 pid: 7231 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.164593:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264088832:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.164615:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a336 expref: 37 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.164622:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a336 expref: 37 pid: 7205 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.164628:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264088960:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.164646:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147b010 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a527 expref: 37 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.164651:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147b010 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a527 expref: 37 pid: 7204 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.164657:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264089088:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.164674:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147afd8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a50b expref: 19 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.164684:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147afd8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a50b expref: 19 pid: 7204 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.164690:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264089216:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.164703:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534900 going to sleep for 11 seconds 00000100:00100000:0.0:1746065226.167145:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.167374:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265628288 00000100:00100000:3.0:1746065226.167382:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265628288 00002000:00100000:3.0:1746065226.167418:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012f3c3100 x1830881265628288/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065226.167427:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c3100 with x1830881265628288 ext(0->1048575) 00002000:00010000:3.0:1746065226.167431:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c3100 00000100:00100000:3.0:1746065226.167460:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6507 00000100:00100000:3.0:1746065226.167467:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265628288:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065226.169575:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.169603:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.169633:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.169733:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265628416 00000100:00100000:2.0:1746065226.169739:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265628416 00010000:00010000:2.0:1746065226.169764:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc147af30 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a9 expref: 20 pid: 7205 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.169807:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265628544 00000100:00100000:2.0:1746065226.169809:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265628544 00010000:00010000:2.0:1746065226.169818:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc147add9 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c9 expref: 21 pid: 7231 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.169828:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265628672 00000100:00100000:2.0:1746065226.169830:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265628672 00010000:00010000:2.0:1746065226.169837:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a336 expref: 38 pid: 7205 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.169848:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8508 00000100:00100000:2.0:1746065226.169854:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265628416:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.169863:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.169868:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc147af30 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a9 expref: 21 pid: 7205 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.169877:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc147af30 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a9 expref: 21 pid: 7205 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.169897:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.169901:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.169909:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.169937:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265628416:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 83us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.169946:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8508 00000100:00100000:2.0:1746065226.169958:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8509 00000100:00100000:2.0:1746065226.169963:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265628544:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.169968:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.169972:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc147add9 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c9 expref: 20 pid: 7231 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.169978:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc147add9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c9 expref: 20 pid: 7231 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.169986:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.169989:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.169993:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.170006:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2007:x1830881265628544:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 43us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.170011:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8509 00000100:00100000:2.0:1746065226.170019:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8510 00000100:00100000:2.0:1746065226.170023:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881265628672:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.170028:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.170031:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 5/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a336 expref: 38 pid: 7205 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.170039:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 11 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a336 expref: 38 pid: 7205 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.170052:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.170054:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.170059:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.170070:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+38:2007:x1830881265628672:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 47us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.170075:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8510 00010000:00010000:3.0:1746065226.170154:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abadc00/0xad6b7ddc147af30 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xd/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a4a9 expref: 19 pid: 7205 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.170167:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264088704:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.170175:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009abb3400/0xad6b7ddc147add9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a3c9 expref: 18 pid: 7231 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.170181:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264088832:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.170189:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880097aa5800/0xad6b7ddc147acf9 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a336 expref: 37 pid: 7205 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.170199:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264088960:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.170206:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264089088:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.170212:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264089216:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.170233:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:2.0:1746065226.174552:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265627776:12345-192.168.202.27@tcp:3:cat.0 Request processed in 10286us (10666us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065226.174562:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6506 00002000:00100000:2.0:1746065226.174572:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff88012f3c0e00 x1830881265627776/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.174581:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c0e00 with x1830881265627776 ext(1048576->2097151) 00002000:00010000:2.0:1746065226.174586:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88012f3c0e00 00000100:00100000:0.0:1746065226.174829:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.174862:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265628928 00000100:00100000:1.0:1746065226.174869:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265628928 00010000:00010000:1.0:1746065226.174892:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147afd8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a50b expref: 18 pid: 7204 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.174927:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.174942:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265628800 00000100:00100000:2.0:1746065226.174946:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265628800 00010000:00010000:2.0:1746065226.174959:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147b010 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a527 expref: 37 pid: 7204 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746065226.174962:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8511 00000100:00100000:1.0:1746065226.174967:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4a10850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+18:2005:x1830881265628928:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1746065226.174980:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8512 00010000:00010000:1.0:1746065226.174981:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065226.174985:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265628800:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065226.174986:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147afd8 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a50b expref: 18 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.174991:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065226.174994:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147afd8 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a50b expref: 18 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.174996:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147b010 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a527 expref: 37 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.175010:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147afd8 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a50b expref: 18 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.175015:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147b010 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a527 expref: 37 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.175027:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489000/0xad6b7ddc147b010 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1a/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a527 expref: 37 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:1.0:1746065226.175124:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065226.175129:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.175136:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065226.175142:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.175148:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.175152:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065226.175164:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.175168:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265628800:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 182us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.175174:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8512 00000100:00100000:1.0:1746065226.175181:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4a10850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+17:2005:x1830881265628928:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 214us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.175186:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8511 00010000:00010000:3.0:1746065226.175254:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.175261:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000040:00080000:3.0:1746065226.175457:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1165, 88 off110368 00000004:00080000:3.0:1746065226.175463:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822193688846ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065226.175869:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1169, 88 off110720 00000004:00080000:3.0:1746065226.175875:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822194101239ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065226.175894:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1170, 88 off110808 00000004:00080000:3.0:1746065226.175896:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822194122818ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065226.175904:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1166, 88 off110456 00000004:00080000:3.0:1746065226.175906:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822194132863ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065226.175913:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1167, 88 off110544 00000004:00080000:3.0:1746065226.175916:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822194142263ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065226.175922:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1171, 88 off110896 00000004:00080000:3.0:1746065226.175924:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822194150978ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065226.175931:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1172, 88 off110984 00000004:00080000:3.0:1746065226.175933:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822194159401ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065226.175939:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1173, 88 off111072 00000004:00080000:3.0:1746065226.175942:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822194168089ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065226.176030:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1168, 88 off110632 00000004:00080000:3.0:1746065226.176034:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822194260898ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065226.176045:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1174, 88 off111160 00000004:00080000:3.0:1746065226.176047:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822194273818ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065226.176054:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1169, 88 off110720 00000004:00080000:3.0:1746065226.176056:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822194282604ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065226.176062:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1175, 88 off111248 00000004:00080000:3.0:1746065226.176065:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822194291166ns, next at 761143559853ns, rc = 0 00000040:00080000:3.0:1746065226.176071:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1170, 88 off110808 00000004:00080000:3.0:1746065226.176073:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822194299911ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065226.176080:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1171, 88 off110896 00000004:00080000:3.0:1746065226.176082:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822194308964ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065226.176089:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1172, 88 off110984 00000004:00080000:3.0:1746065226.176091:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822194317526ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065226.176097:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1173, 88 off111072 00000004:00080000:3.0:1746065226.176099:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822194325898ns, next at 761143591313ns, rc = 0 00000040:00080000:3.0:1746065226.176106:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1176, 88 off111336 00000004:00080000:3.0:1746065226.176109:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822194335441ns, next at 761143559853ns, rc = 0 00000001:00080000:0.0:1746065226.187575:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937257 is committed 00000004:00080000:0.0:1746065226.187585:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1154 committed 00000004:00080000:0.0:1746065226.187599:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1153 committed 00000004:00080000:0.0:1746065226.187605:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1152 committed 00000004:00080000:0.0:1746065226.187606:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1151 committed 00000004:00080000:0.0:1746065226.187607:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1150 committed 00000004:00080000:0.0:1746065226.187608:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1153 committed 00000004:00080000:0.0:1746065226.187609:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1149 committed 00000004:00080000:0.0:1746065226.187611:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1152 committed 00000004:00080000:0.0:1746065226.187612:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1148 committed 00000004:00080000:0.0:1746065226.187613:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1151 committed 00000004:00080000:0.0:1746065226.187615:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1150 committed 00000004:00080000:0.0:1746065226.187616:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1149 committed 00000004:00080000:0.0:1746065226.187617:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1147 committed 00000004:00080000:0.0:1746065226.187618:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1146 committed 00000004:00080000:0.0:1746065226.187620:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1148 committed 00000004:00080000:0.0:1746065226.187622:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1147 committed 00000004:00080000:0.0:1746065226.187624:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1145 committed 00000001:00080000:0.0:1746065226.187628:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937256 is committed 00000001:00080000:0.0:1746065226.187638:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937251 is committed 00000100:00100000:0.0:1746065226.187762:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264089728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.187831:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.187902:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264089472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.187925:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.187997:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264089728 00000100:00100000:1.0:1746065226.188002:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264089728 00000100:00080000:1.0:1746065226.188020:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065226.188045:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18159 00000100:00100000:1.0:1746065226.188054:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264089472 00000100:00100000:1.0:1746065226.188056:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264089472 00000100:00100000:1.0:1746065226.188069:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18160 00000100:00100000:1.0:1746065226.188073:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+78:3759:x1830881264089472:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.188193:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+79:3759:x1830881264089472:12345-0@lo:2:osp-syn-1-0.0 Request processed in 119us (266us total) trans 17179874437 rc 0/0 00000100:00100000:1.0:1746065226.188199:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18160 00000100:00100000:1.0:1746065226.188220:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+78:3761:x1830881264089728:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.188287:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+79:3761:x1830881264089728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 236us (457us total) trans 17179874438 rc 0/0 00000100:00100000:1.0:1746065226.188292:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18159 00000004:00010000:3.0:1746065226.188849:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff88012f3c3480 reply state ffff88009df67400 transno 8589937257 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.188865:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.188872:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065226.188875:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:3.0:1746065226.188878:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065226.190473:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264089344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065226.190508:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065226.190531:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264089600:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065226.190544:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065226.190555:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264090112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.190556:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264089856:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065226.190565:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065226.190576:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264090624:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065226.190579:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065226.190591:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.190593:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264090368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065226.190602:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264091136:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065226.190607:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065226.190620:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264089344 00000100:00100000:1.0:1746065226.190622:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264090880:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065226.190624:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264089344 00000100:00100000:1.0:1746065226.190633:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065226.190643:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264089600 00000100:00100000:2.0:1746065226.190645:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264089600 00000100:00100000:1.0:1746065226.190645:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1746065226.190649:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264090752:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065226.190652:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264090112 00000100:00100000:2.0:1746065226.190654:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264090112 00000100:00100000:1.0:1746065226.190660:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065226.190672:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264089856 00000100:00100000:2.0:1746065226.190674:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264089856 00000100:00100000:1.0:1746065226.190675:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264091264:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065226.190679:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264090624 00000100:00100000:2.0:1746065226.190681:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264090624 00000100:00100000:1.0:1746065226.190687:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065226.190693:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264090368 00000100:00100000:2.0:1746065226.190694:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264090368 00000100:00100000:2.0:1746065226.190699:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264090880 00000100:00100000:2.0:1746065226.190701:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264090880 00000100:00100000:1.0:1746065226.190704:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264090752 00000100:00100000:2.0:1746065226.190706:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264091264 00000100:00100000:1.0:1746065226.190706:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264090752 00000100:00100000:2.0:1746065226.190708:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264091264 00000100:00100000:2.0:1746065226.190716:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18161 00000100:00100000:2.0:1746065226.190721:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+82:3762:x1830881264089344:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.190724:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18162 00000100:00100000:1.0:1746065226.190728:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+82:3760:x1830881264089600:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1746065226.190788:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1746065226.190802:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:2.0:1746065226.190805:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065226.190806:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065226.190809:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:2.0:1746065226.190810:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746065226.190820:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+84:3760:x1830881264089600:12345-0@lo:2:osp-syn-1-0.0 Request processed in 91us (274us total) trans 17179874440 rc 0/0 00000100:00100000:1.0:1746065226.190825:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18162 00000100:00100000:2.0:1746065226.190831:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3762:x1830881264089344:12345-0@lo:2:osp-syn-1-0.0 Request processed in 110us (323us total) trans 17179874439 rc 0/0 00000100:00100000:2.0:1746065226.190836:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18161 00000100:00100000:1.0:1746065226.190839:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18163 00000100:00100000:1.0:1746065226.190843:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+82:3760:x1830881264090112:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065226.190847:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18164 00000100:00100000:2.0:1746065226.190851:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+82:3762:x1830881264089856:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065226.190876:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:1.0:1746065226.190879:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065226.190881:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065226.190882:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:2.0:1746065226.190884:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065226.190884:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00002000:00010000:2.0:1746065226.190886:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1746065226.190888:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065226.190890:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:2.0:1746065226.190891:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:1.0:1746065226.190902:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+84:3760:x1830881264090112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 58us (335us total) trans 17179874441 rc 0/0 00000100:00100000:1.0:1746065226.190907:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18163 00000100:00100000:2.0:1746065226.190908:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+84:3762:x1830881264089856:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (328us total) trans 17179874442 rc 0/0 00000100:00100000:2.0:1746065226.190913:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18164 00000100:00100000:1.0:1746065226.190917:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18165 00000100:00100000:1.0:1746065226.190921:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+81:3760:x1830881264090624:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065226.190922:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18166 00000100:00100000:2.0:1746065226.190926:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+81:3762:x1830881264090368:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065226.190975:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd5c00/2, rc 0, transno 17179874439 00000100:00100000:2.0:1746065226.190977:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+83:3762:x1830881264090368:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (369us total) trans 21474841811 rc 0/0 00000100:00100000:2.0:1746065226.190981:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18166 00000100:00100000:1.0:1746065226.190983:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264089344:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065226.190988:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18167 00000100:00100000:2.0:1746065226.190992:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+82:3762:x1830881264090880:12345-0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065226.190992:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b00e00/2, rc 0, transno 17179874442 00000100:00100000:1.0:1746065226.190995:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264089856:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065226.191001:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa9880/2, rc 0, transno 21474841811 00000100:00100000:1.0:1746065226.191004:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264090368:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065226.191022:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18168 00000100:00100000:2.0:1746065226.191026:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+83:3762:x1830881264091264:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065226.191039:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+83:3760:x1830881264090624:12345-0@lo:2:osp-syn-0-0.0 Request processed in 118us (447us total) trans 21474841812 rc 0/0 00000100:00100000:1.0:1746065226.191047:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18165 00000100:00100000:1.0:1746065226.191057:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18169 00000100:00100000:1.0:1746065226.191060:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+83:3762:x1830881264090752:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065226.191071:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+83:3762:x1830881264091264:12345-0@lo:2:osp-syn-0-0.0 Request processed in 44us (382us total) trans 21474841814 rc 0/0 00000100:00100000:2.0:1746065226.191075:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18168 00000100:00100000:2.0:1746065226.191089:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065226.191095:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065226.191097:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065226.191099:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065226.191100:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065226.191102:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000004:00080000:2.0:1746065226.191107:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd5500/2, rc 0, transno 17179874440 00000100:00100000:2.0:1746065226.191110:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264089600:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065226.191116:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b00700/2, rc 0, transno 17179874441 00000100:00100000:1.0:1746065226.191119:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+83:3762:x1830881264090752:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (457us total) trans 21474841815 rc 0/0 00000100:00100000:2.0:1746065226.191120:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b00700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264090112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.191124:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18169 00000004:00080000:2.0:1746065226.191125:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3c2680/2, rc 0, transno 21474841812 00000100:00100000:2.0:1746065226.191128:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264090624:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065226.191132:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1746065226.191135:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264091136 00000100:00100000:2.0:1746065226.191136:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264090496:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065226.191137:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264091136 00000100:00100000:1.0:1746065226.191148:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18170 00000100:00100000:2.0:1746065226.191150:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.191152:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+83:3760:x1830881264091136:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065226.191157:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264091008:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065226.191168:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065226.191180:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264090496 00000100:00100000:2.0:1746065226.191182:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264090496 00000100:00100000:2.0:1746065226.191190:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264091008 00000100:00100000:2.0:1746065226.191192:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264091008 00000100:00100000:2.0:1746065226.191198:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18171 00000100:00100000:1.0:1746065226.191201:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+86:3760:x1830881264091136:12345-0@lo:2:osp-syn-0-0.0 Request processed in 48us (110us total) trans 21474841816 rc 0/0 00000100:00100000:2.0:1746065226.191202:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+86:3760:x1830881264090496:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065226.191206:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18170 00000100:00100000:1.0:1746065226.191215:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18172 00000100:00100000:1.0:1746065226.191219:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+85:3760:x1830881264091008:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1746065226.191236:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065226.191238:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:2.0:1746065226.191240:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065225 -> 1746065225 00002000:00010000:2.0:1746065226.191242:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065226 -> 1746065226 00002000:00010000:2.0:1746065226.191244:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00002000:00010000:1.0:1746065226.191250:0:9548:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:1.0:1746065226.191252:0:9548:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065226.191254:0:9548:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065226.191255:0:9548:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:1.0:1746065226.191257:0:9548:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:2.0:1746065226.191259:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+87:3760:x1830881264090496:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (108us total) trans 21474841817 rc 0/0 00000100:00100000:2.0:1746065226.191263:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18171 00000100:00100000:1.0:1746065226.191286:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+86:3760:x1830881264091008:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (115us total) trans 21474841818 rc 0/0 00000100:00100000:1.0:1746065226.191291:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18172 00000004:00080000:2.0:1746065226.191295:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3c0a80/2, rc 0, transno 21474841817 00000100:00100000:2.0:1746065226.191299:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264090496:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065226.191305:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e5880/2, rc 0, transno 21474841818 00000100:00100000:2.0:1746065226.191308:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264091008:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065226.191312:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009834d500/2, rc 0, transno 21474841815 00000100:00100000:1.0:1746065226.191315:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009834d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264090752:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065226.191316:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e5c00/2, rc 0, transno 21474841816 00000100:00100000:2.0:1746065226.191318:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264091136:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065226.191322:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e4000/2, rc 0, transno 21474841814 00000100:00100000:1.0:1746065226.191324:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264091264:0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065226.191342:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:1.0:1746065226.191589:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065226.191591:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065226.191593:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065226.191595:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:1.0:1746065226.191617:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+85:3762:x1830881264090880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 624us (982us total) trans 21474841813 rc 0/0 00000100:00100000:1.0:1746065226.191622:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18167 00000004:00080000:1.0:1746065226.191641:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88008f3e7b80/2, rc 0, transno 21474841813 00000100:00100000:1.0:1746065226.191644:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264090880:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065226.195404:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b03100/2, rc 0, transno 17179874438 00000100:00100000:0.0:1746065226.195415:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b03100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264089728:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.195423:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264090240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.195463:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065226.195487:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264090240 00000100:00100000:0.0:1746065226.195492:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264090240 00000100:00100000:0.0:1746065226.195520:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18173 00000100:00100000:0.0:1746065226.195526:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+83:3761:x1830881264090240:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065226.195586:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265628288:12345-192.168.202.27@tcp:3:cat.0 Request processed in 28117us (28446us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065226.195594:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6507 00002000:00100000:2.0:1746065226.195601:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x75:0x0] (0->1048575) req@ffff88012f3c3100 x1830881265628288/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.195608:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012f3c3100 with x1830881265628288 ext(0->1048575) 00002000:00010000:2.0:1746065226.195612:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012f3c3100 00002000:00010000:0.0:1746065226.195627:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:0.0:1746065226.195630:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065226.195631:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065226.195633:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065226.195635:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:0.0:1746065226.195657:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+84:3761:x1830881264090240:12345-0@lo:2:osp-syn-1-0.0 Request processed in 131us (194us total) trans 17179874443 rc 0/0 00000100:00100000:0.0:1746065226.195662:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18173 00000100:00100000:0.0:1746065226.196093:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000004:00080000:0.0:1746065226.196178:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b02300/2, rc 0, transno 17179874443 00000100:00100000:0.0:1746065226.196182:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b02300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264090240:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.196192:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1746065226.196197:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264091392:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065226.196205:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099bd4700/2, rc 0, transno 17179874437 00000100:00100000:1.0:1746065226.196210:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264089472:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.196215:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880134b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264089984:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.196215:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.196233:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065226.196249:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265629056 00000100:00100000:0.0:1746065226.196252:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265629056 00000100:00100000:0.0:1746065226.196281:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264091392 00000100:00100000:0.0:1746065226.196283:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264091392 00000100:00100000:1.0:1746065226.196286:0:12258:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264089984 00000100:00100000:1.0:1746065226.196289:0:12258:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264089984 00000100:00100000:0.0:1746065226.196296:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18174 00000100:00100000:0.0:1746065226.196301:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+42:2738:x1830881265629056:12345-192.168.202.27@tcp:101:cat.0 00000100:00100000:1.0:1746065226.196305:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18175 00010000:00010000:0.0:1746065226.196309:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065226.196310:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3761:x1830881264091392:12345-0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1746065226.196322:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489400/0xad6b7ddc147b11a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5ac expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065226.196335:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d749, atime: 0x6812d748, ctime: 0x6812d749, blocks: 0x808 00010000:00010000:0.0:1746065226.196349:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.196351:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.196356:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489400/0xad6b7ddc147b11a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ac expref: 43 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065226.196369:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+86:3761:x1830881264091392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 59us (153us total) trans 17179874444 rc 0/0 00010000:00010000:0.0:1746065226.196369:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489400/0xad6b7ddc147b11a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ac expref: 43 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065226.196375:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18175 00010000:00010000:0.0:1746065226.196377:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489400, rc 0) 00000100:00100000:1.0:1746065226.196383:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18176 00000100:00100000:1.0:1746065226.196387:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+85:3759:x1830881264089984:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.196395:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+43:2738:x1830881265629056:12345-192.168.202.27@tcp:101:cat.0 Request processed in 95us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.196401:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18174 00000004:00080000:0.0:1746065226.196421:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d04a80/2, rc 0, transno 17179874444 00000100:00100000:0.0:1746065226.196425:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264091392:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.196426:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+86:3759:x1830881264089984:12345-0@lo:2:osp-syn-1-0.0 Request processed in 39us (192us total) trans 17179874445 rc 0/0 00000100:00100000:1.0:1746065226.196431:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18176 00000004:00080000:1.0:1746065226.196450:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880134b02680/2, rc 0, transno 17179874445 00000100:00100000:1.0:1746065226.196453:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880134b02680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264089984:0@lo:2:osp-syn-1-0.0 00010000:00080000:3.0:1746065226.197020:0:7204:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1746065226.197575:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2739:x1830881265628032:12345-192.168.202.27@tcp:36:mirror_io.0 Request processed in 33238us (33392us total) trans 8589937257 rc 0/0 00000100:00100000:3.0:1746065226.197582:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14724 00010000:00010000:0.0:1746065226.198103:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065226.198111:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065226.198117:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065226.198122:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683aa00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065226.198125:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065226.198131:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065226.198144:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065226.198146:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065226.198149:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065226.198154:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683aa00/0xad6b7ddc147b113 lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00000100:00100000:2.0:1746065226.214857:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.215283:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265629184 00000100:00100000:3.0:1746065226.215291:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265629184 00000100:00100000:3.0:1746065226.215331:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14725 00000100:00100000:3.0:1746065226.215339:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2739:x1830881265629184:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:3.0:1746065226.215365:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065226.215382:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147b121 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5b3 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.215427:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147b121 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5b3 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.215437:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147b121 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5b3 expref: 8 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.215451:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065226.215453:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065226.215456:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174a00, rc 0) 00000100:00100000:3.0:1746065226.215502:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2739:x1830881265629184:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 164us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.215507:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14725 00000100:00100000:3.0:1746065226.217956:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.217977:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265629696 00000100:00100000:3.0:1746065226.217982:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265629696 00000100:00100000:3.0:1746065226.218023:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14726 00000100:00100000:3.0:1746065226.218030:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2746:x1830881265629696:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065226.218047:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065226.218060:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174000/0xad6b7ddc147b128 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5c8 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.218114:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc147b12f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.218123:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc147b12f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.218131:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc147b12f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.218142:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc147b136 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.218147:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc147b136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.218152:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc147b136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.218226:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.218235:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b08e lrc: 2/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a574 expref: 7 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.218241:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.218281:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b08e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a574 expref: 7 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.218293:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b08e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a574 expref: 7 pid: 7205 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.218303:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264091520:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.219087:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800905340c0 going to sleep for 11 seconds 00000100:00100000:3.0:1746065226.222768:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.222822:0:7205:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265629312 00000100:00100000:1.0:1746065226.222829:0:7205:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265629312 00000100:00100000:3.0:1746065226.222832:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.222861:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.222861:0:7205:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14727 00000100:00100000:1.0:1746065226.222867:0:7205:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2738:x1830881265629312:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065226.222881:0:7205:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065226.222894:0:7205:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880131055800/0xad6b7ddc147b144 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5ba expref: -99 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065226.222912:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265629824 00000100:00100000:0.0:1746065226.222917:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265629824 00010000:00010000:1.0:1746065226.222933:0:7205:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880131055800/0xad6b7ddc147b144 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ba expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065226.222940:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14728 00010000:00010000:1.0:1746065226.222942:0:7205:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880131055800/0xad6b7ddc147b144 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ba expref: 29 pid: 7205 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065226.222945:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+8:2739:x1830881265629824:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065226.222953:0:7203:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065226.222955:0:7205:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065226.222957:0:7205:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065226.222960:0:7205:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131055800, rc 0) 00010000:00010000:0.0:1746065226.222960:0:7203:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147b14b lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5cf expref: -99 pid: 7203 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065226.222991:0:7205:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2738:x1830881265629312:12345-192.168.202.27@tcp:101:cat.0 Request processed in 124us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.222996:0:7205:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14727 00010000:00010000:0.0:1746065226.223016:0:7203:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065226.223024:0:7203:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x50210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065226.223031:0:7203:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00000004:00200000:0.0:1746065226.223051:0:7203:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00000004:00200000:0.0:1746065226.223062:0:7203:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1746065226.223078:0:7203:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7203 initiator: MDT0 00010000:00010000:0.0:1746065226.223097:0:7203:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c489a00/0xad6b7ddc147b14b lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 9 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5cf expref: 10 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.223108:0:7203:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5cf expref: 9 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.223113:0:7203:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065226.223115:0:7203:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1746065226.223117:0:7203:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488000, rc 0) 00000100:00100000:0.0:1746065226.223138:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:02506576-29fe-43be-8266-ebca0ccafd52+9:2739:x1830881265629824:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 193us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.223144:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14728 00000100:00100000:2.0:1746065226.223362:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265629440 00000100:00100000:2.0:1746065226.223366:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265629440 00000100:00100000:2.0:1746065226.223390:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18177 00000100:00100000:2.0:1746065226.223394:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2743:x1830881265629440:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065226.223401:0:13375:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.223412:0:13375:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009abada00/0xad6b7ddc147b159 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5c1 expref: -99 pid: 13375 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065226.223427:0:13375:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d74a, atime: 0x6812d748, ctime: 0x6812d74a, blocks: 0x800 00010000:00010000:2.0:1746065226.223437:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.223439:0:13375:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.223445:0:13375:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009abada00/0xad6b7ddc147b159 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5c1 expref: 24 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.223454:0:13375:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009abada00/0xad6b7ddc147b159 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5c1 expref: 24 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.223462:0:13375:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abada00, rc 0) 00000100:00100000:2.0:1746065226.223487:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2743:x1830881265629440:12345-192.168.202.27@tcp:101:cat.0 Request processed in 88us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.223492:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18177 00000100:00100000:0.0:1746065226.234851:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.234888:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.234916:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.234929:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.234953:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.234970:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.234992:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265629952 00000100:00100000:0.0:1746065226.234999:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265629952 00000100:00100000:0.0:1746065226.235029:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265630080 00000100:00100000:0.0:1746065226.235031:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265630080 00000100:00100000:0.0:1746065226.235042:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265630208 00000100:00100000:0.0:1746065226.235043:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265630208 00000100:00100000:0.0:1746065226.235051:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265630336 00000100:00100000:0.0:1746065226.235053:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265630336 00000100:00100000:0.0:1746065226.235060:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265630464 00000100:00100000:0.0:1746065226.235062:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265630464 00000100:00100000:0.0:1746065226.235070:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265630592 00000100:00100000:0.0:1746065226.235071:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265630592 00000100:00100000:0.0:1746065226.235081:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18178 00000100:00100000:0.0:1746065226.235092:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265629952:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065226.235107:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.235121:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc147b160 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5d6 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.235140:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235141:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235148:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc147b160 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5d6 expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235161:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc147b160 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5d6 expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235170:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f04b600, rc 0) 00000100:00100000:0.0:1746065226.235205:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265629952:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 114us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.235210:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18178 00000100:00100000:0.0:1746065226.235223:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18179 00000100:00100000:0.0:1746065226.235227:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265630080:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065226.235233:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.235241:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b167 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5dd expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.235250:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235252:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235256:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b167 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5dd expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235264:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b167 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5dd expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235281:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489e00, rc 0) 00000100:00100000:0.0:1746065226.235295:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+20:2005:x1830881265630080:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 67us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.235299:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18179 00000100:00100000:0.0:1746065226.235308:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18180 00000100:00100000:0.0:1746065226.235313:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265630208:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065226.235317:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.235322:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc147b16e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5e4 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.235334:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235335:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235338:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc147b16e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5e4 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235345:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc147b16e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5e4 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235351:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488800, rc 0) 00000100:00100000:0.0:1746065226.235363:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+20:2005:x1830881265630208:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 50us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.235368:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18180 00000100:00100000:0.0:1746065226.235376:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18181 00000100:00100000:0.0:1746065226.235380:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265630336:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065226.235385:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.235390:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc147b175 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5eb expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.235398:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235399:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235403:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc147b175 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5eb expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235410:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc147b175 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5eb expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235420:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489a00, rc 0) 00000100:00100000:0.0:1746065226.235433:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265630336:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 53us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.235437:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18181 00000100:00100000:0.0:1746065226.235445:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18182 00000100:00100000:0.0:1746065226.235449:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+17:2005:x1830881265630464:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065226.235454:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.235461:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88012c489000/0xad6b7ddc147b17c lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5f2 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065226.235476:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 5034592, mtime: 0x6812d74a, atime: 0x6812d749, ctime: 0x6812d74a, blocks: 0x1678 00010000:00010000:0.0:1746065226.235484:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235485:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235488:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489000/0xad6b7ddc147b17c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f2 expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235496:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88012c489000/0xad6b7ddc147b17c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f2 expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235501:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c489000, rc 0) 00000100:00100000:0.0:1746065226.235515:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+18:2005:x1830881265630464:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 66us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.235519:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18182 00000100:00100000:0.0:1746065226.235528:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18183 00000100:00100000:0.0:1746065226.235532:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+19:2005:x1830881265630592:12345-192.168.202.27@tcp:101:mirror_io.0 00010000:00010000:0.0:1746065226.235537:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.235544:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc147b183 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a5f9 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065226.235554:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d749, atime: 0x6812d749, ctime: 0x6812d749, blocks: 0x1008 00010000:00010000:0.0:1746065226.235561:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235562:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.235565:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc147b183 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f9 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235573:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc147b183 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f9 expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.235579:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88012c488a00, rc 0) 00000100:00100000:0.0:1746065226.235593:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+20:2005:x1830881265630592:12345-192.168.202.27@tcp:101:mirror_io.0 Request processed in 60us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.235597:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18183 00000100:00100000:0.0:1746065226.235716:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.235735:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265630848 00000100:00100000:0.0:1746065226.235738:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265630848 00002000:00100000:0.0:1746065226.235761:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800900f2680 x1830881265630848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065226.235768:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2680 with x1830881265630848 ext(1048576->2097151) 00002000:00010000:0.0:1746065226.235799:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f2680 00000100:00100000:0.0:1746065226.235813:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6508 00000100:00100000:0.0:1746065226.235818:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881265630848:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065226.236192:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.236204:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265630976 00000100:00100000:3.0:1746065226.236206:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265630976 00000100:00100000:3.0:1746065226.236225:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14729 00000100:00100000:3.0:1746065226.236229:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2743:x1830881265630976:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065226.236239:0:13395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065226.236248:0:13395:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b18a lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a600 expref: -99 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.236290:0:13395:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b18a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a600 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.236298:0:13395:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b18a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a600 expref: 8 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.236309:0:13395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065226.236311:0:13395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1746065226.236313:0:13395:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88013683bc00, rc 0) 00000100:00100000:3.0:1746065226.236331:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2743:x1830881265630976:12345-192.168.202.27@tcp:101:cat.0 Request processed in 102us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.236335:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14729 00000100:00100000:3.0:1746065226.236380:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264091520:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.236392:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:3.0:1746065226.236499:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.236512:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265631104 00000100:00100000:3.0:1746065226.236514:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265631104 00010000:00010000:3.0:1746065226.236526:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b08e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a574 expref: 9 pid: 7205 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.236539:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8513 00000100:00100000:3.0:1746065226.236543:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2005:x1830881265631104:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065226.236549:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065226.236552:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b08e lrc: 4/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a574 expref: 9 pid: 7205 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.236561:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b08e lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a574 expref: 9 pid: 7205 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.236575:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b08e lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a574 expref: 9 pid: 7205 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.236587:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065226.236590:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236599:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236604:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236615:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065226.236629:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2005:x1830881265631104:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 85us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.236634:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8513 00010000:00010000:3.0:1746065226.236664:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236669:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:3.0:1746065226.236679:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:3.0:1746065226.236745:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236751:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236756:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236760:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683b800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065226.236763:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236768:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236797:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065226.236799:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065226.236802:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 2/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236806:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683b800/0xad6b7ddc147b13d lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236819:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc147b12f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236824:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc147b12f lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236828:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc147b12f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236831:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc147b12f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236835:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880131047800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065226.236837:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc147b12f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236841:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc147b12f lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236847:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065226.236849:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065226.236851:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc147b12f lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236855:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131047800/0xad6b7ddc147b12f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236862:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc147b136 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236866:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc147b136 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236870:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc147b136 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236873:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88013683ac00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065226.236875:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc147b136 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236878:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc147b136 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236883:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098c34c00) 00010000:00010000:3.0:1746065226.236885:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065226.236887:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc147b136 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236891:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683ac00/0xad6b7ddc147b136 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.236920:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174000/0xad6b7ddc147b128 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5c8 expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.236926:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174000/0xad6b7ddc147b128 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5c8 expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.236932:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009a174000, rc 0) 00000100:00100000:3.0:1746065226.236948:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2746:x1830881265629696:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 18919us (18997us total) trans 8589937258 rc 301/301 00000100:00100000:3.0:1746065226.236954:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14726 00000100:00100000:0.0:1746065226.248113:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.250031:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265631360 00000100:00100000:2.0:1746065226.250042:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265631360 00002000:00100000:2.0:1746065226.250076:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800900f0700 x1830881265631360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.250083:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0700 with x1830881265631360 ext(1048576->2097151) 00002000:00010000:2.0:1746065226.250087:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f0700 00000100:00100000:2.0:1746065226.250105:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6509 00000100:00100000:2.0:1746065226.250111:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881265631360:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065226.250118:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+43:2007:x1830881265630848:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14299us (14401us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065226.250124:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6508 00002000:00100000:0.0:1746065226.250128:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff8800900f2680 x1830881265630848/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065226.250134:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f2680 with x1830881265630848 ext(1048576->2097151) 00002000:00010000:0.0:1746065226.250137:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800900f2680 00000100:00100000:0.0:1746065226.253117:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.253288:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265631616 00000100:00100000:3.0:1746065226.253294:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265631616 00000100:00100000:3.0:1746065226.253329:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14730 00000100:00100000:3.0:1746065226.253336:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2746:x1830881265631616:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065226.253360:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065226.253363:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1746065226.253390:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131055800/0xad6b7ddc147b144 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ba expref: 28 pid: 7205 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.253413:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065226.253417:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1746065226.253427:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b000/0xad6b7ddc147b198 lrc: 2/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a607 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.253462:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.253472:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5cf expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.253479:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147b121 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5b3 expref: 7 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.253485:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b18a lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a600 expref: 7 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.253490:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 6/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.253511:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b18a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a600 expref: 7 pid: 13395 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.254038:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b18a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a600 expref: 7 pid: 13395 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.254048:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264091648:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.254133:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147b121 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5b3 expref: 7 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.254140:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147b121 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5b3 expref: 7 pid: 7204 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.254147:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264091776:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.254170:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5cf expref: 7 pid: 7203 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.254176:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5cf expref: 7 pid: 7203 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.254182:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264091904:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.254196:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065226.255904:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2004:x1830881265631360:12345-192.168.202.27@tcp:3:cat.0 Request processed in 5788us (7794us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065226.255914:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6509 00002000:00100000:2.0:1746065226.255923:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x94:0x0] (1048576->2097151) req@ffff8800900f0700 x1830881265631360/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.255931:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800900f0700 with x1830881265631360 ext(1048576->2097151) 00002000:00010000:2.0:1746065226.255936:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff8800900f0700 00000100:00100000:0.0:1746065226.259008:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.259034:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.259036:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264091648:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.259047:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264091776:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.259054:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264091904:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.259074:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265631872 00010000:00010000:3.0:1746065226.259076:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:2.0:1746065226.259080:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265631872 00000100:00100000:0.0:1746065226.259095:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.259101:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265631744 00000100:00100000:3.0:1746065226.259104:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265631744 00010000:00010000:2.0:1746065226.259108:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147b121 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5b3 expref: 8 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.259116:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b18a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a600 expref: 8 pid: 13395 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.259128:0:9565:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265632000 00000100:00100000:2.0:1746065226.259130:0:9565:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265632000 00000100:00100000:3.0:1746065226.259135:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8514 00010000:00010000:2.0:1746065226.259138:0:9565:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5cf expref: 9 pid: 7203 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.259141:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265631872:12345-192.168.202.27@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1746065226.259142:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8515 00000100:00100000:0.0:1746065226.259149:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265631744:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065226.259151:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1746065226.259152:0:9565:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8516 00010000:00010000:3.0:1746065226.259156:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147b121 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5b3 expref: 9 pid: 7204 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.259157:0:9565:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+9:2007:x1830881265632000:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065226.259157:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065226.259162:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b18a lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a600 expref: 8 pid: 13395 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.259163:0:9565:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065226.259164:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147b121 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5b3 expref: 9 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.259167:0:9565:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 13 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5cf expref: 9 pid: 7203 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746065226.259171:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b18a lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 12 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a600 expref: 8 pid: 13395 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.259188:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009a174a00/0xad6b7ddc147b121 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 11 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5b3 expref: 9 pid: 7204 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.259190:0:9565:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 12 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5cf expref: 9 pid: 7203 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746065226.259202:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88013683bc00/0xad6b7ddc147b18a lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 10 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a600 expref: 8 pid: 13395 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.259207:0:9565:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88012c488000/0xad6b7ddc147b152 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 11 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5cf expref: 8 pid: 7203 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.259214:0:8352:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065226.259218:0:8352:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.259226:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.260154:0:8352:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 8 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065226.260870:0:7192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065226.260875:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065226.260877:0:9565:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.260882:0:9565:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.260929:0:9565:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:02506576-29fe-43be-8266-ebca0ccafd52+7:2007:x1830881265632000:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1768us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.260929:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2007:x1830881265631744:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1778us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.260936:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8515 00000100:00100000:2.0:1746065226.260940:0:9565:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8516 00010000:00010000:3.0:1746065226.261213:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065226.261222:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065226.261229:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:3.0:1746065226.261242:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:02506576-29fe-43be-8266-ebca0ccafd52+6:2007:x1830881265631872:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2100us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.261248:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8514 00000040:00080000:0.0:1746065226.261425:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1174, 88 off111160 00000004:00080000:0.0:1746065226.261430:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822279655972ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065226.261464:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1177, 88 off111424 00000004:00080000:0.0:1746065226.261468:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822279693930ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065226.261478:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1178, 88 off111512 00000004:00080000:0.0:1746065226.261480:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822279706842ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065226.261506:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1175, 88 off111248 00000004:00080000:0.0:1746065226.261509:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822279735334ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065226.261653:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1176, 88 off111336 00000004:00080000:2.0:1746065226.261657:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822279883774ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065226.261671:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1179, 88 off111600 00000004:00080000:2.0:1746065226.261674:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822279900350ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065226.262917:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1180, 88 off111688 00000004:00080000:2.0:1746065226.262923:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822281149255ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065226.262931:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1181, 88 off111776 00000004:00080000:2.0:1746065226.262934:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822281160008ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065226.262944:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1177, 88 off111424 00000004:00080000:2.0:1746065226.262947:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822281173198ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065226.262965:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1182, 88 off111864 00000004:00080000:2.0:1746065226.262969:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822281195220ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065226.262975:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1178, 88 off111512 00000004:00080000:2.0:1746065226.262978:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822281204613ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065226.262985:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1183, 88 off111952 00000004:00080000:2.0:1746065226.262988:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822281214510ns, next at 761143559853ns, rc = 0 00000040:00080000:2.0:1746065226.262995:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1179, 88 off111600 00000004:00080000:2.0:1746065226.262997:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822281223685ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065226.263039:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1180, 88 off111688 00000004:00080000:2.0:1746065226.263043:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822281269173ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065226.263051:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1181, 88 off111776 00000004:00080000:2.0:1746065226.263053:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822281279853ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065226.263060:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1182, 88 off111864 00000004:00080000:2.0:1746065226.263062:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 822281288740ns, next at 761143591313ns, rc = 0 00000040:00080000:2.0:1746065226.263071:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1184, 88 off112040 00000004:00080000:2.0:1746065226.263073:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 822281299850ns, next at 761143559853ns, rc = 0 00000100:00100000:0.0:1746065226.263516:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.263564:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265632128 00000100:00100000:3.0:1746065226.263570:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265632128 00000100:00100000:3.0:1746065226.263608:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18184 00000100:00100000:3.0:1746065226.263614:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+24:2743:x1830881265632128:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065226.263632:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065226.263645:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc147b1a6 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a60e expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.263665:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.263667:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.263674:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc147b1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a60e expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.263685:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc147b1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a60e expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.263697:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577ae00, rc 0) 00000100:00100000:3.0:1746065226.263738:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2743:x1830881265632128:12345-192.168.202.27@tcp:101:cat.0 Request processed in 124us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.263743:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18184 00000100:00100000:1.0:1746065226.265164:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.265592:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265632256 00000100:00100000:0.0:1746065226.265597:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265632256 00000100:00100000:0.0:1746065226.265632:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14731 00000100:00100000:0.0:1746065226.265638:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2738:x1830881265632256:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065226.265649:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.265660:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147b1ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a615 expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.265694:0:7231:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 2/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065226.265700:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147b1ad lrc: 4/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a615 expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.265713:0:7231:0:(ldlm_request.c:361:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065226.265721:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147b1ad lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a615 expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.265731:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065226.265733:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065226.265736:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147b1ad lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a615 expref: 31 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.265742:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b600, rc 0) 00000100:00100000:0.0:1746065226.265807:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+31:2738:x1830881265632256:12345-192.168.202.27@tcp:101:cat.0 Request processed in 169us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.265812:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14731 00000100:00100000:2.0:1746065226.267129:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.267264:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265632384 00000100:00100000:0.0:1746065226.267275:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265632384 00000001:00080000:2.0:1746065226.267297:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937259 is committed 00000004:00080000:2.0:1746065226.267303:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1162 committed 00000004:00080000:2.0:1746065226.267320:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1162 committed 00000100:00100000:0.0:1746065226.267423:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14732 00000100:00100000:0.0:1746065226.267429:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2743:x1830881265632384:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:0.0:1746065226.267438:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:1.0:1746065226.267447:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264092032:0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1746065226.267448:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc147b1b4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a61c expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.267475:0:7231:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc147b1b4 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a61c expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065226.267482:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1746065226.267616:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc147b1b4 lrc: 3/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a61c expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.267627:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065226.267629:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065226.267632:0:7231:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147b1ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a615 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.267638:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ba00, rc 0) 00000100:00100000:0.0:1746065226.267660:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2743:x1830881265632384:12345-192.168.202.27@tcp:101:cat.0 Request processed in 231us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.267665:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14732 00000100:00100000:0.0:1746065226.267679:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264092288:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065226.267680:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1161 committed 00000004:00080000:2.0:1746065226.267682:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1160 committed 00000004:00080000:2.0:1746065226.267683:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1159 committed 00000004:00080000:2.0:1746065226.267685:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1161 committed 00000004:00080000:2.0:1746065226.267686:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1158 committed 00000004:00080000:2.0:1746065226.267688:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1160 committed 00000004:00080000:2.0:1746065226.267689:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1157 committed 00000004:00080000:2.0:1746065226.267692:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1159 committed 00000004:00080000:2.0:1746065226.267693:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1158 committed 00000004:00080000:2.0:1746065226.267695:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1157 committed 00000004:00080000:2.0:1746065226.267696:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1156 committed 00000004:00080000:2.0:1746065226.267698:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1155 committed 00000004:00080000:2.0:1746065226.267700:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1156 committed 00000004:00080000:2.0:1746065226.267702:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1155 committed 00000004:00080000:2.0:1746065226.267706:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1154 committed 00000100:00100000:2.0:1746065226.267720:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264092160:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065226.267802:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a607 expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.267811:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.267813:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint a 00010000:00010000:2.0:1746065226.267816:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147b1ad lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a615 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.267823:0:7204:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147b1ad lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a615 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.267829:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147b1ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a615 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.267835:0:7204:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc147b1b4 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a61c expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.267840:0:7204:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc147b1b4 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a61c expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.267846:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc147b1b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a61c expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.267862:0:7204:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc147b1b4 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a61c expref: 7 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.267870:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009577c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264094080:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065226.267949:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.267951:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264092544:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065226.267967:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264092800:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065226.267969:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065226.267984:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.267986:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264093056:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.268000:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264093312:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.268002:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.268014:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264093568:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.268016:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.268028:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065226.268029:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264093824:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.268041:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1746065226.268044:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.268046:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264093184:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.268055:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1746065226.268059:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264092416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065226.268060:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065226.268072:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.268073:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264093696:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.268083:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009acedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264092928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065226.268087:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065226.268096:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065226.268103:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264093440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.268111:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264092032 00000100:00100000:1.0:1746065226.268113:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264092032 00000100:00100000:0.0:1746065226.268115:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065226.268122:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264093952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.268131:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264092288 00000100:00100000:1.0:1746065226.268132:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264092288 00000100:00100000:0.0:1746065226.268133:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065226.268138:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264092544 00000100:00100000:1.0:1746065226.268140:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264092544 00000100:00100000:1.0:1746065226.268145:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264092800 00000100:00100000:1.0:1746065226.268147:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264092800 00000100:00100000:0.0:1746065226.268149:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264093056 00000100:00100000:0.0:1746065226.268151:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264093056 00000100:00100000:1.0:1746065226.268152:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264093312 00000100:00100000:1.0:1746065226.268153:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264093312 00000100:00100000:1.0:1746065226.268160:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264093568 00000100:00100000:1.0:1746065226.268161:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264093568 00000100:00100000:0.0:1746065226.268165:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264093824 00000100:00100000:0.0:1746065226.268166:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264093824 00000100:00100000:1.0:1746065226.268167:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264093184 00000100:00100000:1.0:1746065226.268168:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264093184 00000100:00100000:0.0:1746065226.268173:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264092416 00000100:00100000:1.0:1746065226.268175:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264093696 00000100:00100000:0.0:1746065226.268175:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264092416 00000100:00100000:1.0:1746065226.268177:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264093696 00000100:00100000:0.0:1746065226.268181:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264092928 00000100:00100000:0.0:1746065226.268183:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264092928 00000100:00100000:1.0:1746065226.268184:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264093440 00000100:00100000:1.0:1746065226.268186:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264093440 00000100:00100000:0.0:1746065226.268189:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264093952 00000100:00100000:0.0:1746065226.268190:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264093952 00000100:00100000:1.0:1746065226.268195:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18185 00000100:00100000:1.0:1746065226.268200:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+90:3759:x1830881264092032:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065226.268201:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18186 00000100:00100000:0.0:1746065226.268206:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+90:3761:x1830881264092288:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065226.268280:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18187 00000100:00100000:0.0:1746065226.268285:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+92:3759:x1830881264092544:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065226.268296:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065226.268299:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:1.0:1746065226.268301:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:1.0:1746065226.268303:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065226 -> 1746065226 00002000:00010000:1.0:1746065226.268305:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:1.0:1746065226.268326:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3759:x1830881264092032:12345-0@lo:2:osp-syn-0-0.0 Request processed in 126us (843us total) trans 21474841819 rc 0/0 00002000:00010000:0.0:1746065226.268327:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb size from disk: 3145728 -> 3145728 00002000:00010000:0.0:1746065226.268330:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00000100:00100000:1.0:1746065226.268331:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18185 00002000:00010000:0.0:1746065226.268331:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065226.268333:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065226.268334:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x97:0x0] updating lvb blocks from disk: 3816 -> 3816 00000100:00100000:1.0:1746065226.268341:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18188 00000100:00100000:1.0:1746065226.268346:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+92:3761:x1830881264092800:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065226.268354:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+92:3759:x1830881264092544:12345-0@lo:2:osp-syn-0-0.0 Request processed in 69us (384us total) trans 21474841821 rc 0/0 00000100:00100000:3.0:1746065226.268360:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18189 00000100:00100000:0.0:1746065226.268364:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18187 00000100:00100000:3.0:1746065226.268367:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+93:3761:x1830881264093312:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.268374:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18190 00000100:00100000:0.0:1746065226.268378:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+93:3759:x1830881264093056:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.268396:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+92:3761:x1830881264092800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (410us total) trans 21474841822 rc 0/0 00000100:00100000:1.0:1746065226.268401:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18188 00000100:00100000:1.0:1746065226.268411:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18191 00000100:00100000:1.0:1746065226.268415:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+95:3759:x1830881264093568:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065226.268416:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18192 00000100:00100000:3.0:1746065226.268420:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+95:3761:x1830881264093824:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065226.268422:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:0.0:1746065226.268424:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065224 -> 1746065224 00002000:00010000:0.0:1746065226.268426:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00002000:00010000:0.0:1746065226.268428:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065224 -> 1746065224 00002000:00010000:0.0:1746065226.268430:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:0.0:1746065226.268444:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+97:3759:x1830881264093056:12345-0@lo:2:osp-syn-1-0.0 Request processed in 66us (441us total) trans 17179874446 rc 0/0 00000100:00100000:0.0:1746065226.268449:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18190 00002000:00010000:1.0:1746065226.268452:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1746065226.268455:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1746065226.268457:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb atime from disk: 0 -> 0 00000100:00100000:0.0:1746065226.268457:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18193 00002000:00010000:1.0:1746065226.268458:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb ctime from disk: 0 -> 0 00002000:00010000:3.0:1746065226.268459:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00002000:00010000:1.0:1746065226.268460:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7a:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1746065226.268460:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+96:3759:x1830881264093184:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065226.268461:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065226.268463:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065225 -> 1746065225 00002000:00010000:3.0:1746065226.268465:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065226.268466:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00000100:00100000:1.0:1746065226.268477:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+96:3759:x1830881264093568:12345-0@lo:2:osp-syn-1-0.0 Request processed in 61us (447us total) trans 17179874448 rc 0/0 00000100:00100000:1.0:1746065226.268482:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18191 00000100:00100000:3.0:1746065226.268486:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b02a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+97:3761:x1830881264093312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 121us (469us total) trans 17179874447 rc 0/0 00002000:00010000:0.0:1746065226.268488:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:3.0:1746065226.268490:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18189 00002000:00010000:0.0:1746065226.268490:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065225 -> 1746065225 00002000:00010000:0.0:1746065226.268492:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065224 -> 1746065224 00000100:00100000:1.0:1746065226.268493:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18194 00002000:00010000:0.0:1746065226.268493:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065225 -> 1746065225 00002000:00010000:0.0:1746065226.268495:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065226.268497:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+91:3761:x1830881264092416:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065226.268500:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18195 00000100:00100000:3.0:1746065226.268504:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+95:3759:x1830881264093696:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065226.268508:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+95:3759:x1830881264093184:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (447us total) trans 17179874450 rc 0/0 00000100:00100000:0.0:1746065226.268512:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18193 00000100:00100000:0.0:1746065226.268520:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18196 00000100:00100000:0.0:1746065226.268524:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+92:3761:x1830881264092928:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1746065226.268531:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065226.268533:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065226.268535:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065226.268537:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065226.268538:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:3.0:1746065226.268554:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+95:3759:x1830881264093696:12345-0@lo:2:osp-syn-1-0.0 Request processed in 49us (466us total) trans 17179874451 rc 0/0 00000100:00100000:1.0:1746065226.268556:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+93:3761:x1830881264092416:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (482us total) trans 21474841823 rc 0/0 00000100:00100000:3.0:1746065226.268559:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18195 00000100:00100000:1.0:1746065226.268562:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18194 00000100:00100000:0.0:1746065226.268562:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+93:3761:x1830881264092928:12345-0@lo:2:osp-syn-0-0.0 Request processed in 38us (465us total) trans 21474841824 rc 0/0 00000100:00100000:0.0:1746065226.268567:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18196 00000100:00100000:3.0:1746065226.268570:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18197 00000100:00100000:1.0:1746065226.268572:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18198 00000100:00100000:3.0:1746065226.268574:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+94:3761:x1830881264093440:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.268576:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+94:3761:x1830881264093952:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065226.268589:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065226.268591:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065225 -> 1746065225 00002000:00010000:0.0:1746065226.268592:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065225 -> 1746065225 00002000:00010000:0.0:1746065226.268594:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065225 -> 1746065225 00002000:00010000:0.0:1746065226.268596:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746065226.268608:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+91:3761:x1830881264092288:12345-0@lo:2:osp-syn-0-0.0 Request processed in 402us (659us total) trans 21474841820 rc 0/0 00000100:00100000:0.0:1746065226.268612:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18186 00000100:00100000:3.0:1746065226.268625:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+96:3761:x1830881264093440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 50us (508us total) trans 17179874452 rc 0/0 00000004:00080000:1.0:1746065226.268628:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098ddb800/2, rc 0, transno 17179874450 00000100:00100000:3.0:1746065226.268629:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18197 00000004:00080000:0.0:1746065226.268630:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090ddbb80/2, rc 0, transno 21474841823 00000100:00100000:0.0:1746065226.268634:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264092416:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065226.268635:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264093184:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065226.268640:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009acedf80/2, rc 0, transno 21474841824 00000004:00080000:1.0:1746065226.268642:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092747100/2, rc 0, transno 17179874451 00000100:00100000:0.0:1746065226.268642:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009acedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264092928:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065226.268645:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264093696:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065226.268649:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd8000/2, rc 0, transno 17179874452 00000100:00100000:0.0:1746065226.268651:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264093440:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1746065226.268652:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd8a80/2, rc 0, transno 17179874446 00000100:00100000:1.0:1746065226.268654:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264093056:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065226.268658:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd9880/2, rc 0, transno 17179874447 00000004:00080000:1.0:1746065226.268660:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880099e12680/2, rc 0, transno 17179874448 00002000:00010000:3.0:1746065226.268661:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00000100:00100000:0.0:1746065226.268661:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264093312:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065226.268663:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00000100:00100000:1.0:1746065226.268663:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099e12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264093568:0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065226.268665:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065226.268666:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00000004:00080000:0.0:1746065226.268666:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d07100/2, rc 0, transno 21474841820 00002000:00010000:3.0:1746065226.268668:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:0.0:1746065226.268668:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d07100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264092288:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065226.268670:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d05180/2, rc 0, transno 21474841819 00000100:00100000:1.0:1746065226.268673:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264092032:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065226.268674:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090dd9880/2, rc 0, transno 21474841822 00000100:00100000:0.0:1746065226.268676:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264092800:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1746065226.268679:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090dd9c00/2, rc 0, transno 21474841821 00000100:00100000:1.0:1746065226.268681:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090dd9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264092544:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065226.268684:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092746d80/2, rc 0, transno 17179874449 00000100:00100000:3.0:1746065226.268687:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880134b01880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+95:3761:x1830881264093824:12345-0@lo:2:osp-syn-1-0.0 Request processed in 265us (641us total) trans 17179874449 rc 0/0 00000100:00100000:0.0:1746065226.268687:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264093824:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065226.268697:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18192 00000100:00100000:0.0:1746065226.268711:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264094208:0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1746065226.268719:0:1880:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb size from disk: 7258112 -> 7258112 00002000:00010000:1.0:1746065226.268721:0:1880:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:1.0:1746065226.268723:0:1880:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1746065226.268724:0:1880:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00000100:00100000:0.0:1746065226.268725:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1746065226.268726:0:1880:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x7c:0x0] updating lvb blocks from disk: 5432 -> 5432 00000100:00100000:3.0:1746065226.268746:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264094208 00000100:00100000:1.0:1746065226.268749:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aba7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+94:3761:x1830881264093952:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (614us total) trans 17179874453 rc 0/0 00000100:00100000:3.0:1746065226.268750:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264094208 00000004:00080000:0.0:1746065226.268750:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092745500/2, rc 0, transno 17179874453 00000100:00100000:0.0:1746065226.268753:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264093952:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065226.268754:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18198 00000100:00100000:3.0:1746065226.268764:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18199 00000100:00100000:3.0:1746065226.268768:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+94:3759:x1830881264094208:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065226.268834:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+95:3759:x1830881264094208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 65us (108us total) trans 17179874454 rc 0/0 00000100:00100000:3.0:1746065226.268839:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18199 00000004:00080000:0.0:1746065226.268841:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097fa8a80/2, rc 0, transno 17179874454 00000100:00100000:0.0:1746065226.268843:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264094208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065226.268908:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065226.268934:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264092160 00000100:00100000:0.0:1746065226.268936:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264092160 00000100:00100000:2.0:1746065226.268941:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880090ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264092672:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065226.268949:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18200 00000100:00100000:0.0:1746065226.268952:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+91:3760:x1830881264092160:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065226.268964:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065226.268983:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264092672 00002000:00010000:0.0:1746065226.268983:0:9550:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00000100:00100000:2.0:1746065226.268985:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264092672 00002000:00010000:0.0:1746065226.268986:0:9550:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:0.0:1746065226.268987:0:9550:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065225 -> 1746065225 00002000:00010000:0.0:1746065226.268989:0:9550:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065226 -> 1746065226 00002000:00010000:0.0:1746065226.268991:0:9550:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065226.269007:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18201 00000100:00100000:0.0:1746065226.269008:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+93:3760:x1830881264092160:12345-0@lo:2:osp-syn-0-0.0 Request processed in 55us (100us total) trans 21474841825 rc 0/0 00000100:00100000:2.0:1746065226.269012:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:3760:x1830881264092672:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065226.269012:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18200 00002000:00010000:2.0:1746065226.269053:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb size from disk: 4112384 -> 4112384 00002000:00010000:2.0:1746065226.269055:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb mtime from disk: 1746065171 -> 1746065171 00002000:00010000:2.0:1746065226.269057:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1746065226.269058:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb ctime from disk: 1746065171 -> 1746065171 00002000:00010000:2.0:1746065226.269060:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x98:0x0] updating lvb blocks from disk: 1624 -> 1624 00000100:00100000:2.0:1746065226.269078:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+93:3760:x1830881264092672:12345-0@lo:2:osp-syn-0-0.0 Request processed in 66us (113us total) trans 21474841826 rc 0/0 00000100:00100000:2.0:1746065226.269082:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18201 00000004:00080000:2.0:1746065226.269100:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880097d05f80/2, rc 0, transno 21474841825 00000100:00100000:2.0:1746065226.269103:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264092160:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1746065226.269109:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880090ddaa00/2, rc 0, transno 21474841826 00000100:00100000:2.0:1746065226.269111:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880090ddaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264092672:0@lo:2:osp-syn-0-0.0 00010000:00010000:2.0:1746065226.269125:0:7204:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147b1ad lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a615 expref: 29 pid: 7231 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.269133:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264094336:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065226.269177:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065226.272531:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264094336:192.168.202.27@tcp:105: 00000100:00100000:0.0:1746065226.272766:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.272818:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009577c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264094080:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065226.272852:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b000/0xad6b7ddc147b198 lrc: 0/0,0 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a607 expref: 29 pid: 7204 timeout: 0 lvb_type: 3 00010000:00010000:2.0:1746065226.272868:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a607 expref: 28 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.272892:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009577b800, rc 0) 00000100:00100000:2.0:1746065226.272938:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800900f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2746:x1830881265631616:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 19602us (19828us total) trans 8589937259 rc 0/0 00000100:00100000:2.0:1746065226.272945:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14730 00000100:00100000:1.0:1746065226.273430:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.273449:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265632512 00000100:00100000:2.0:1746065226.273455:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265632512 00000100:00100000:2.0:1746065226.273484:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5553 00000100:00100000:2.0:1746065226.273489:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2738:x1830881265632512:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:2.0:1746065226.273551:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2738:x1830881265632512:12345-192.168.202.27@tcp:49:cat.0 Request processed in 62us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.273556:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5553 00000100:00100000:2.0:1746065226.274359:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265632640 00000100:00100000:2.0:1746065226.274363:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265632640 00000100:00100000:2.0:1746065226.274380:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5554 00000100:00100000:2.0:1746065226.274384:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2743:x1830881265632640:12345-192.168.202.27@tcp:49:cat.0 00000100:00100000:2.0:1746065226.274419:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2743:x1830881265632640:12345-192.168.202.27@tcp:49:cat.0 Request processed in 35us (991us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.274424:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5554 00000100:00100000:3.0:1746065226.274791:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.274841:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265632768 00000100:00100000:0.0:1746065226.274844:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265632768 00000100:00100000:0.0:1746065226.274860:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5555 00000100:00100000:0.0:1746065226.274865:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2746:x1830881265632768:12345-192.168.202.27@tcp:49:multiop.0 00000100:00100000:0.0:1746065226.274901:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092746a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2746:x1830881265632768:12345-192.168.202.27@tcp:49:multiop.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.274906:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5555 00000100:00100000:0.0:1746065226.279194:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.279223:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.279240:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265632896 00000100:00100000:1.0:1746065226.279247:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265632896 00000100:00100000:2.0:1746065226.279353:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265633024 00000100:00100000:2.0:1746065226.279357:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265633024 00000100:00100000:2.0:1746065226.279398:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18202 00000100:00100000:2.0:1746065226.279405:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+43:2738:x1830881265633024:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065226.279420:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.279433:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc147b1bb lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a62a expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.279452:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.279453:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.279459:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc147b1bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a62a expref: 45 pid: 1880 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065226.279459:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18203 00000100:00100000:1.0:1746065226.279465:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2746:x1830881265632896:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065226.279470:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc147b1bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a62a expref: 45 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.279479:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009abad200, rc 0) 00000100:00100000:2.0:1746065226.279509:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+45:2738:x1830881265633024:12345-192.168.202.27@tcp:101:cat.0 Request processed in 105us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.279514:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18202 00010000:00010000:1.0:1746065226.279804:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065226.279814:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a623 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.279830:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b10c lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5a5 expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.279838:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc147b160 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5d6 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.279844:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.279846:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.279849:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 5/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [86016->380927] (req 86016->380927) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 45 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.279870:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc147b160 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5d6 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.279880:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc147b160 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5d6 expref: 17 pid: 3067 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746065226.279890:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097faaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264094464:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.279956:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b10c lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5a5 expref: 19 pid: 9548 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.279965:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b10c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5a5 expref: 19 pid: 9548 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746065226.279972:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264094592:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065226.279987:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065226.283223:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.283289:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.283324:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.283419:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265633536 00000100:00100000:2.0:1746065226.283426:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265633536 00010000:00010000:2.0:1746065226.283453:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b10c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5a5 expref: 20 pid: 9548 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.283473:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265633408 00000100:00100000:2.0:1746065226.283475:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265633408 00010000:00010000:2.0:1746065226.283482:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc147b160 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5d6 expref: 18 pid: 3067 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746065226.283498:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8517 00000100:00100000:2.0:1746065226.283503:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265633536:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.283511:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.283526:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b10c lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5a5 expref: 20 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.283534:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b10c lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5a5 expref: 20 pid: 9548 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.283552:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.283577:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2006:x1830881265633536:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 75us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.283582:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8517 00000100:00100000:2.0:1746065226.283592:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8518 00000100:00100000:2.0:1746065226.283596:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a850e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265633408:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.283601:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.283606:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc147b160 lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5d6 expref: 18 pid: 3067 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.283614:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc147b160 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5d6 expref: 18 pid: 3067 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.283622:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.283624:0:7190:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.283629:0:7190:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 45 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.283637:0:7190:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x50080000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 45 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.283657:0:7190:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 45 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.283667:0:7190:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264094720:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065226.283705:0:7190:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b000 going to sleep for 11 seconds 00000100:00100000:2.0:1746065226.283724:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265633280 00000100:00100000:2.0:1746065226.283726:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265633280 00002000:00100000:2.0:1746065226.283746:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880091bc3480 x1830881265633280/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.283754:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc3480 with x1830881265633280 ext(1048576->2097151) 00002000:00010000:2.0:1746065226.283757:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc3480 00000100:00100000:2.0:1746065226.283768:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6510 00010000:00010000:1.0:1746065226.284057:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f04b600/0xad6b7ddc147b160 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5d6 expref: 18 pid: 3067 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746065226.284071:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097faaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264094464:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.284080:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012f84b000/0xad6b7ddc147b10c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5a5 expref: 19 pid: 9548 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746065226.284088:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264094592:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.284106:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 45 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.284113:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1a200, rc 0) 00000100:00100000:1.0:1746065226.284186:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2746:x1830881265632896:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4670us (4949us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.284193:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18203 00000100:00100000:2.0:1746065226.284419:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265633280:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065226.288029:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.288059:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.288078:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265633792 00000100:00100000:0.0:1746065226.288084:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265633792 00002000:00100000:0.0:1746065226.288114:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800a4e52300 x1830881265633792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065226.288122:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52300 with x1830881265633792 ext(2097152->3145727) 00002000:00010000:0.0:1746065226.288127:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e52300 00000100:00100000:0.0:1746065226.288139:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265634048 00000100:00100000:0.0:1746065226.288140:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265634048 00002000:00100000:0.0:1746065226.288148:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x75:0x0] (86016->90111) req@ffff88012edac000 x1830881265634048/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:0.0:1746065226.288154:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac000 with x1830881265634048 ext(86016->90111) 00002000:00010000:0.0:1746065226.288156:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac000 00000100:00100000:0.0:1746065226.288165:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6511 00000100:00100000:0.0:1746065226.288170:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+46:2004:x1830881265633792:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065226.288319:0:7190:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:7190:1830881264094720:192.168.202.27@tcp:105: 00010000:00010000:2.0:1746065226.288339:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.288367:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a850e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+17:2006:x1830881265633408:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4769us (5041us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.288375:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8518 00000100:00100000:2.0:1746065226.288459:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6512 00000100:00100000:2.0:1746065226.288465:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265634048:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065226.288524:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+47:2006:x1830881265634048:12345-192.168.202.27@tcp:3:cat.0 Request processed in 59us (464us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065226.288530:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6512 00002000:00100000:2.0:1746065226.288535:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_006: refresh rw locks for [0x2c0000401:0x75:0x0] (86016->90111) req@ffff88012edac000 x1830881265634048/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/4536 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.288543:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edac000 with x1830881265634048 ext(86016->90111) 00002000:00010000:2.0:1746065226.288546:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edac000 00000100:00100000:3.0:1746065226.299565:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091bc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265633280:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15784us (16340us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065226.299576:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6510 00002000:00100000:3.0:1746065226.299586:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->2097151) req@ffff880091bc3480 x1830881265633280/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065226.299594:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091bc3480 with x1830881265633280 ext(1048576->2097151) 00002000:00010000:3.0:1746065226.299599:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880091bc3480 00000100:00100000:0.0:1746065226.301237:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.301406:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a4e52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+45:2004:x1830881265633792:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13234us (13382us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065226.301415:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6511 00002000:00100000:1.0:1746065226.301423:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->3145727) req@ffff8800a4e52300 x1830881265633792/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.301430:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff8800a4e52300 with x1830881265633792 ext(2097152->3145727) 00002000:00010000:1.0:1746065226.301434:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8800a4e52300 00000100:00100000:3.0:1746065226.301552:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265634304 00000100:00100000:3.0:1746065226.301559:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265634304 00002000:00100000:3.0:1746065226.301585:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (376832->380927) req@ffff88012edaea00 x1830881265634304/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065226.301591:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaea00 with x1830881265634304 ext(376832->380927) 00002000:00010000:3.0:1746065226.301594:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaea00 00000100:00100000:3.0:1746065226.301605:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6513 00000100:00100000:3.0:1746065226.301610:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881265634304:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065226.301693:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881265634304:12345-192.168.202.27@tcp:3:cat.0 Request processed in 82us (460us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065226.301698:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6513 00002000:00100000:3.0:1746065226.301702:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (376832->380927) req@ffff88012edaea00 x1830881265634304/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/4536 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065226.301708:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88012edaea00 with x1830881265634304 ext(376832->380927) 00002000:00010000:3.0:1746065226.301710:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88012edaea00 00000100:00100000:0.0:1746065226.303510:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.303594:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265634432 00000100:00100000:1.0:1746065226.303599:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265634432 00000100:00100000:1.0:1746065226.303641:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18204 00000100:00100000:1.0:1746065226.303648:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+19:2743:x1830881265634432:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065226.303658:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065226.303671:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147b1c9 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a631 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.303689:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.303692:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.303698:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147b1c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a631 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.303710:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147b1c9 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a631 expref: 20 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.303718:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1ae00, rc 0) 00000100:00100000:1.0:1746065226.303743:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2743:x1830881265634432:12345-192.168.202.27@tcp:101:cat.0 Request processed in 96us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.303748:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18204 00000100:00100000:0.0:1746065226.304448:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.304519:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265634688 00000100:00100000:3.0:1746065226.304523:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265634688 00000100:00100000:3.0:1746065226.304548:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5556 00000100:00100000:3.0:1746065226.304554:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4298850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+28:2746:x1830881265634688:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065226.304987:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4298850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2746:x1830881265634688:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 434us (540us total) trans 8589937260 rc 0/0 00000100:00100000:3.0:1746065226.304993:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5556 00000100:00100000:0.0:1746065226.307402:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.307491:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265634816 00000100:00100000:2.0:1746065226.307497:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265634816 00000100:00100000:2.0:1746065226.307537:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18205 00000100:00100000:2.0:1746065226.307542:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+33:2738:x1830881265634816:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065226.307555:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.307570:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc147b1d0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a638 expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.307588:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.307589:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.307595:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc147b1d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a638 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.307606:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc147b1d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a638 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.307614:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f60400, rc 0) 00000100:00100000:2.0:1746065226.307856:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2738:x1830881265634816:12345-192.168.202.27@tcp:101:cat.0 Request processed in 313us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.307864:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18205 00000100:00100000:0.0:1746065226.308875:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.308937:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265635072 00000100:00100000:1.0:1746065226.308941:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265635072 00002000:00100000:1.0:1746065226.308968:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009252a680 x1830881265635072/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.308977:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252a680 with x1830881265635072 ext(1048576->2097151) 00002000:00010000:1.0:1746065226.308981:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252a680 00000100:00100000:1.0:1746065226.309005:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6514 00000100:00100000:1.0:1746065226.309011:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265635072:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065226.320254:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.320417:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265635072:12345-192.168.202.27@tcp:3:cat.0 Request processed in 11405us (11543us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065226.320426:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6514 00002000:00100000:1.0:1746065226.320436:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x77:0x0] (1048576->2097151) req@ffff88009252a680 x1830881265635072/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.320444:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009252a680 with x1830881265635072 ext(1048576->2097151) 00002000:00010000:1.0:1746065226.320450:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009252a680 00000100:00100000:2.0:1746065226.321087:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.321132:0:9554:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265635584 00000100:00100000:1.0:1746065226.321139:0:9554:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265635584 00002000:00100000:1.0:1746065226.321166:0:9554:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009077fb80 x1830881265635584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.321173:0:9554:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077fb80 with x1830881265635584 ext(3145728->4194303) 00002000:00010000:1.0:1746065226.321177:0:9554:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077fb80 00000100:00100000:0.0:1746065226.321181:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265635456 00000100:00100000:0.0:1746065226.321184:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265635456 00002000:00100000:0.0:1746065226.321198:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88008f7fce00 x1830881265635456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00000100:00100000:1.0:1746065226.321199:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6515 00000100:00100000:1.0:1746065226.321205:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009077fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881265635584:12345-192.168.202.27@tcp:3:cat.0 00002000:00100000:0.0:1746065226.321205:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fce00 with x1830881265635456 ext(2097152->4194303) 00002000:00010000:0.0:1746065226.321208:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fce00 00000100:00100000:0.0:1746065226.321536:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6516 00000100:00100000:0.0:1746065226.321543:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265635456:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:1.0:1746065226.329207:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009077fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+45:2005:x1830881265635584:12345-192.168.202.27@tcp:3:cat.0 Request processed in 7992us (8952us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065226.329219:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6515 00002000:00100000:1.0:1746065226.329228:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (3145728->4194303) req@ffff88009077fb80 x1830881265635584/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 1048576/1048576 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.329237:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88009077fb80 with x1830881265635584 ext(3145728->4194303) 00002000:00010000:1.0:1746065226.329244:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff88009077fb80 00000100:00100000:1.0:1746065226.329994:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.330073:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265635840 00000100:00100000:2.0:1746065226.330080:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265635840 00000100:00100000:2.0:1746065226.330124:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14733 00000100:00100000:2.0:1746065226.330130:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2749:x1830881265635840:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:2.0:1746065226.330146:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.330161:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc147b1d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a63f expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.330229:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147b1de lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330241:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147b1de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330250:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147b1de lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330261:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147b1e5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330274:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330279:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330367:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147b1ec lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330374:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147b1ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330380:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147b1ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065226.330386:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:2.0:1746065226.330438:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147b1ec lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330443:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147b1ec lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330447:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147b1ec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330452:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f61c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065226.330456:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147b1ec lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330461:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147b1ec lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330469:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065226.330472:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1746065226.330475:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147b1ec lrc: 2/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330479:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61c00/0xad6b7ddc147b1ec lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330511:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147b1de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330515:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147b1de lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330521:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147b1de lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330526:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147b1de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330530:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60800 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065226.330531:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147b1de lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330536:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147b1de lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330542:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065226.330544:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065226.330546:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147b1de lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330549:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60800/0xad6b7ddc147b1de lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330556:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147b1e5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330560:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147b1e5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330563:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147b1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330566:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f60200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:2.0:1746065226.330568:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147b1e5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330574:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147b1e5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330579:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff8800924c5600) 00010000:00010000:2.0:1746065226.330580:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1746065226.330582:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147b1e5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330586:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f60200/0xad6b7ddc147b1e5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065226.330614:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc147b1d7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a63f expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.330620:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f61000/0xad6b7ddc147b1d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a63f expref: 10 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.330626:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61000, rc 0) 00000100:00100000:2.0:1746065226.330654:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2749:x1830881265635840:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 524us (662us total) trans 8589937261 rc 301/301 00000100:00100000:2.0:1746065226.330659:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14733 00000100:00100000:0.0:1746065226.332489:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.333210:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265635968 00000100:00100000:1.0:1746065226.333217:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265635968 00000100:00100000:1.0:1746065226.333428:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18206 00000100:00100000:1.0:1746065226.333440:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+20:2004:x1830881265635968:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065226.333454:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065226.333467:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880098c1b000/0xad6b7ddc147b1fa lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a646 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065226.333513:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097faaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264094848:192.168.202.27@tcp:106: 00000100:00100000:0.0:1746065226.333576:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.333646:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265636096 00000100:00100000:2.0:1746065226.333649:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265636096 00000100:00100000:2.0:1746065226.333671:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18207 00000100:00100000:2.0:1746065226.333675:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+22:2004:x1830881265636096:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065226.333681:0:1880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.333687:0:1880:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147b201 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a64d expref: -99 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.333701:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.333703:0:1880:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.333710:0:1880:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147b201 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a64d expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.333720:0:1880:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147b201 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a64d expref: 23 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.333728:0:1880:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61a00, rc 0) 00000100:00100000:2.0:1746065226.333745:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098118000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+23:2004:x1830881265636096:12345-192.168.202.27@tcp:101:cat.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.333750:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18207 00000100:00100000:1.0:1746065226.334375:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1746065226.334589:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.334688:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265636224 00000100:00100000:2.0:1746065226.334692:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265636224 00000100:00100000:2.0:1746065226.334717:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18208 00000100:00100000:2.0:1746065226.334722:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2004:x1830881265636224:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:2.0:1746065226.334730:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065226.334738:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147b208 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a654 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.334750:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.334751:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.334756:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147b208 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a654 expref: 26 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.334764:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147b208 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a654 expref: 26 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065226.334789:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f61600, rc 0) 00000100:00100000:2.0:1746065226.334805:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098118380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265636224:12345-192.168.202.27@tcp:101:cat.0 Request processed in 83us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.334810:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18208 00000100:00100000:1.0:1746065226.334958:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265635456:12345-192.168.202.27@tcp:3:cat.0 Request processed in 13415us (13871us total) trans 0 rc 2097152/2097152 00000100:00100000:1.0:1746065226.334965:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6516 00002000:00100000:1.0:1746065226.334972:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff88008f7fce00 x1830881265635456/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.334979:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f7fce00 with x1830881265635456 ext(2097152->4194303) 00002000:00010000:1.0:1746065226.334983:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff88008f7fce00 00002000:00010000:1.0:1746065226.336767:0:11461:0:(ofd_lvb.c:264:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime: 1746065224 -> 1746065226 00002000:00010000:1.0:1746065226.336792:0:11461:0:(ofd_lvb.c:270:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime: 1746065224 -> 1746065226 00002000:00010000:1.0:1746065226.336794:0:11461:0:(ofd_lvb.c:276:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime: 1746065224 -> 1746065226 00000100:00100000:1.0:1746065226.336810:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097faaa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11461:1830881264094848:192.168.202.27@tcp:106: 00010000:00010000:1.0:1746065226.336833:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880098c1b000/0xad6b7ddc147b1fa lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a646 expref: 22 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.336843:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1b000/0xad6b7ddc147b1fa lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a646 expref: 22 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.336869:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880098c1b000, rc 0) 00000100:00100000:1.0:1746065226.336900:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2004:x1830881265635968:12345-192.168.202.27@tcp:101:cat.0 Request processed in 3465us (4416us total) trans 0 rc 301/301 00000100:00100000:1.0:1746065226.336906:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18206 00000100:00100000:0.0:1746065226.343398:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.343692:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265636352 00000100:00100000:1.0:1746065226.343700:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265636352 00000100:00100000:1.0:1746065226.343747:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18209 00000100:00100000:1.0:1746065226.343754:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265636352:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:1.0:1746065226.343769:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065226.343893:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147b20f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a65b expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.343911:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.343913:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.343920:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147b20f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a65b expref: 35 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.343933:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147b20f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a65b expref: 35 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.343942:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880095f6d200, rc 0) 00000100:00100000:1.0:1746065226.343988:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098118700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265636352:12345-192.168.202.27@tcp:101:cat.0 Request processed in 235us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.343995:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18209 00000100:00100000:0.0:1746065226.346924:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.347048:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.347693:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265636608 00000100:00100000:2.0:1746065226.347701:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265636608 00002000:00100000:2.0:1746065226.347738:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880098118a80 x1830881265636608/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.347746:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098118a80 with x1830881265636608 ext(2097152->4194303) 00002000:00010000:2.0:1746065226.347751:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098118a80 00000100:00100000:2.0:1746065226.347807:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265636864 00000100:00100000:2.0:1746065226.347810:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265636864 00002000:00100000:2.0:1746065226.347821:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880098118e00 x1830881265636864/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.347827:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098118e00 with x1830881265636864 ext(2097152->4194303) 00002000:00010000:2.0:1746065226.347830:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098118e00 00000100:00100000:2.0:1746065226.347840:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6517 00000100:00100000:2.0:1746065226.347846:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265636608:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065226.348602:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6518 00000100:00100000:3.0:1746065226.348610:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881265636864:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:0.0:1746065226.350347:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.351242:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265637120 00000100:00100000:1.0:1746065226.351250:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265637120 00002000:00100000:1.0:1746065226.351294:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880098119180 x1830881265637120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.351303:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098119180 with x1830881265637120 ext(4194304->5038079) 00002000:00010000:1.0:1746065226.351307:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098119180 00000100:00100000:1.0:1746065226.351329:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6519 00000100:00100000:1.0:1746065226.351336:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881265637120:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:3.0:1746065226.363483:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098118e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881265636864:12345-192.168.202.27@tcp:3:cat.0 Request processed in 14866us (16426us total) trans 0 rc 2097152/2097152 00000100:00100000:3.0:1746065226.363493:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6518 00002000:00100000:3.0:1746065226.363503:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2097152->4194303) req@ffff880098118e00 x1830881265636864/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:3.0:1746065226.363511:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098118e00 with x1830881265636864 ext(2097152->4194303) 00002000:00010000:3.0:1746065226.363516:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880098118e00 00000100:00100000:1.0:1746065226.368450:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098119180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+45:2006:x1830881265637120:12345-192.168.202.27@tcp:3:cat.0 Request processed in 17105us (18097us total) trans 0 rc 843776/843776 00000100:00100000:1.0:1746065226.368464:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6519 00002000:00100000:1.0:1746065226.368473:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_010: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880098119180 x1830881265637120/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.368482:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098119180 with x1830881265637120 ext(4194304->5038079) 00002000:00010000:1.0:1746065226.368487:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098119180 00000100:00100000:2.0:1746065226.379761:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098118a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265636608:12345-192.168.202.27@tcp:3:cat.0 Request processed in 31905us (32833us total) trans 0 rc 2097152/2097152 00000100:00100000:2.0:1746065226.379792:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6517 00002000:00100000:2.0:1746065226.379802:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (2097152->4194303) req@ffff880098118a80 x1830881265636608/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 2097152/2097152 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.379817:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098118a80 with x1830881265636608 ext(2097152->4194303) 00002000:00010000:2.0:1746065226.379822:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098118a80 00000100:00100000:0.0:1746065226.379953:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.380588:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265637376 00000100:00100000:3.0:1746065226.380596:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265637376 00000100:00100000:3.0:1746065226.380640:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5557 00000100:00100000:3.0:1746065226.380646:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2738:x1830881265637376:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065226.384684:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098119500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2738:x1830881265637376:12345-192.168.202.27@tcp:35:cat.0 Request processed in 4028us (4722us total) trans 8589937262 rc 0/0 00000100:00100000:3.0:1746065226.384696:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5557 00000100:00100000:0.0:1746065226.396556:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.396609:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265637504 00000100:00100000:3.0:1746065226.396617:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265637504 00000100:00100000:3.0:1746065226.396663:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18210 00000100:00100000:3.0:1746065226.396670:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265637504:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065226.396686:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065226.396699:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc147b216 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a662 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065226.396745:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264094976:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065226.396860:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065226.408156:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264094976:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065226.408182:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc147b216 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a662 expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.408194:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc147b216 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a662 expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.408217:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538800, rc 0) 00000100:00100000:3.0:1746065226.408250:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098119880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265637504:12345-192.168.202.27@tcp:101:cat.0 Request processed in 11580us (11700us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065226.408257:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18210 00000100:00100000:0.0:1746065226.423673:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.423903:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265637760 00000100:00100000:2.0:1746065226.423914:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265637760 00002000:00100000:2.0:1746065226.423957:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880098119c00 x1830881265637760/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.423967:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098119c00 with x1830881265637760 ext(4194304->5038079) 00002000:00010000:2.0:1746065226.423972:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098119c00 00000100:00100000:2.0:1746065226.424122:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6520 00000100:00100000:2.0:1746065226.424130:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265637760:12345-192.168.202.27@tcp:3:cat.0 00000100:00100000:2.0:1746065226.439733:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098119c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2006:x1830881265637760:12345-192.168.202.27@tcp:3:cat.0 Request processed in 15595us (16059us total) trans 0 rc 843776/843776 00000100:00100000:2.0:1746065226.439743:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6520 00002000:00100000:2.0:1746065226.439752:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_004: refresh rw locks for [0x2c0000401:0x78:0x0] (4194304->5038079) req@ffff880098119c00 x1830881265637760/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/440 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 843776/843776 job:'cat.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.439760:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880098119c00 with x1830881265637760 ext(4194304->5038079) 00002000:00010000:2.0:1746065226.439765:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff880098119c00 00000100:00100000:0.0:1746065226.453728:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.453897:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.453922:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.454004:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265637888 00000100:00100000:3.0:1746065226.454011:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265637888 00000100:00100000:3.0:1746065226.454044:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18211 00000100:00100000:3.0:1746065226.454050:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265637888:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065226.454064:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065226.454078:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147b21d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a669 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065226.454123:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264095104:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065226.454187:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065226.454405:0:8144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265638016 00000100:00100000:2.0:1746065226.454409:0:8144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265638016 00000100:00100000:2.0:1746065226.454545:0:8144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 243 00000100:00100000:2.0:1746065226.454552:0:8144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124d38bc-0f92-4827-84b7-a543154654fd+15:2007:x1830881265638016:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065226.454671:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265638272 00000100:00100000:3.0:1746065226.454674:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265638272 00000100:00100000:2.0:1746065226.454955:0:8144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:124d38bc-0f92-4827-84b7-a543154654fd+15:2007:x1830881265638016:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 403us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.454965:0:8144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 243 00000100:00100000:0.0:1746065226.455214:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.455242:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.455254:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265638144 00000100:00100000:0.0:1746065226.455257:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265638144 00000100:00100000:3.0:1746065226.455320:0:13395:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265638400 00000100:00100000:3.0:1746065226.455322:0:13395:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265638400 00000100:00100000:0.0:1746065226.455379:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1153 00000100:00100000:0.0:1746065226.455385:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009811a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2007:x1830881265638272:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065226.455413:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009811a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2007:x1830881265638272:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 28us (1490us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.455418:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1153 00000100:00100000:0.0:1746065226.455428:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1154 00000100:00100000:0.0:1746065226.455432:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009811a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:2007:x1830881265638144:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:0.0:1746065226.455448:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009811a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+294:2007:x1830881265638144:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 15us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065226.455452:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1154 00000100:00100000:3.0:1746065226.455651:0:13395:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 1155 00000100:00100000:3.0:1746065226.455657:0:13395:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009811aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+5:2007:x1830881265638400:12345-192.168.202.27@tcp:400:kworker.0 00000100:00100000:3.0:1746065226.455678:0:13395:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009811aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:02506576-29fe-43be-8266-ebca0ccafd52+5:2007:x1830881265638400:12345-192.168.202.27@tcp:400:kworker.0 Request processed in 21us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.455770:0:13395:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 1155 00000100:00080000:1.0:1746065226.455849:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746065226.460896:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264095104:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065226.460919:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147b21d lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a669 expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.460931:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538a00/0xad6b7ddc147b21d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a669 expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.460943:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538a00, rc 0) 00000100:00100000:3.0:1746065226.460975:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098119f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265637888:12345-192.168.202.27@tcp:101:cat.0 Request processed in 6924us (7253us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065226.460982:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18211 00000100:00100000:1.0:1746065226.467245:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.467349:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265638528 00000100:00100000:3.0:1746065226.467357:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265638528 00000100:00100000:3.0:1746065226.467400:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18212 00000100:00100000:3.0:1746065226.467407:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265638528:12345-192.168.202.27@tcp:101:cat.0 00010000:00010000:3.0:1746065226.467421:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065226.467434:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc147b224 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a670 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065226.467479:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264095232:192.168.202.27@tcp:106: 00000100:00100000:3.0:1746065226.467553:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065226.469180:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264095232:192.168.202.27@tcp:106: 00010000:00010000:3.0:1746065226.469202:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc147b224 lrc: 1/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a670 expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.469213:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c538800/0xad6b7ddc147b224 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a670 expref: 22 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.469225:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008c538800, rc 0) 00000100:00100000:3.0:1746065226.469262:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+21:2007:x1830881265638528:12345-192.168.202.27@tcp:101:cat.0 Request processed in 1856us (2024us total) trans 0 rc 301/301 00000100:00100000:3.0:1746065226.469280:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18212 00000100:00100000:0.0:1746065226.472841:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.472895:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265638784 00000100:00100000:3.0:1746065226.472905:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265638784 00000100:00100000:3.0:1746065226.472951:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5558 00000100:00100000:3.0:1746065226.472958:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009811ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2743:x1830881265638784:12345-192.168.202.27@tcp:35:cat.0 00000100:00100000:3.0:1746065226.473134:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009811ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2743:x1830881265638784:12345-192.168.202.27@tcp:35:cat.0 Request processed in 175us (299us total) trans 8589937263 rc 0/0 00000100:00100000:3.0:1746065226.473140:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5558 00000100:00100000:0.0:1746065226.510881:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.510974:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265638912 00000100:00100000:3.0:1746065226.510981:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265638912 00000100:00100000:1.0:1746065226.511059:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18213 00000100:00100000:1.0:1746065226.511068:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009811b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2749:x1830881265638912:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:1.0:1746065226.511082:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065226.511099:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b22b lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a677 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.511122:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009abada00/0xad6b7ddc147b159 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5c1 expref: 27 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.511133:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147b20f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a65b expref: 34 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.511139:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b167 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5dd expref: 19 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.511144:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.511146:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065226.511149:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b22b lrc: 6/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1855488->2097151] (req 1855488->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a677 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.511174:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b167 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5dd expref: 19 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.511184:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b167 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5dd expref: 19 pid: 3067 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746065226.511195:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264095360:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.511319:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147b20f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a65b expref: 34 pid: 11461 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065226.511327:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147b20f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a65b expref: 34 pid: 11461 timeout: 922 lvb_type: 1 00000100:00100000:1.0:1746065226.511335:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097faa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264095488:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.511356:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009abada00/0xad6b7ddc147b159 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5c1 expref: 27 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.511363:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009abada00/0xad6b7ddc147b159 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5c1 expref: 27 pid: 13375 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746065226.511370:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264095616:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065226.511382:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff88012e2de9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1746065226.513842:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fab100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264095360:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065226.513853:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097faa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264095488:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065226.515194:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.515280:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fa8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264095616:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065226.515303:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b22b lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [1855488->2097151] (req 1855488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a677 expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065226.515317:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090684e00, rc 0) 00000100:00100000:1.0:1746065226.515365:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009811b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2749:x1830881265638912:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 4298us (4490us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.515373:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18213 00000100:00100000:2.0:1746065226.515517:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265639168 00000100:00100000:2.0:1746065226.515522:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265639168 00010000:00010000:2.0:1746065226.515545:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147b20f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a65b expref: 35 pid: 11461 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746065226.515684:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8519 00000100:00100000:2.0:1746065226.515690:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009811b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+35:2007:x1830881265639168:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.515700:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.515715:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147b20f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a65b expref: 35 pid: 11461 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.515724:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147b20f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a65b expref: 35 pid: 11461 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.515740:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d200/0xad6b7ddc147b20f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a65b expref: 35 pid: 11461 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.515763:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.515812:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009811b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265639168:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 122us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.515818:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8519 00000100:00100000:0.0:1746065226.516044:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.516659:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.516702:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265639040 00000100:00100000:2.0:1746065226.516706:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265639040 00010000:00010000:2.0:1746065226.516719:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b167 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5dd expref: 20 pid: 3067 timeout: 922 lvb_type: 1 00000100:00100000:2.0:1746065226.516738:0:7190:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265639296 00000100:00100000:2.0:1746065226.516740:0:7190:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265639296 00010000:00010000:2.0:1746065226.516748:0:7190:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009abada00/0xad6b7ddc147b159 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5c1 expref: 27 pid: 13375 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.516761:0:7190:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8520 00000100:00100000:2.0:1746065226.516766:0:7190:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009811b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+20:2007:x1830881265639040:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.516789:0:7190:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.516797:0:7190:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b167 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5dd expref: 20 pid: 3067 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746065226.516803:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8521 00010000:00010000:2.0:1746065226.516805:0:7190:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b167 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5dd expref: 20 pid: 3067 timeout: 922 lvb_type: 1 00000100:00100000:0.0:1746065226.516810:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009811bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265639296:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065226.516816:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.516817:0:7190:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c489e00/0xad6b7ddc147b167 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5dd expref: 20 pid: 3067 timeout: 922 lvb_type: 1 00010000:00010000:0.0:1746065226.516825:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009abada00/0xad6b7ddc147b159 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5c1 expref: 27 pid: 13375 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.516826:0:7190:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065226.516834:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009abada00/0xad6b7ddc147b159 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5c1 expref: 27 pid: 13375 timeout: 922 lvb_type: 0 00010000:00010000:0.0:1746065226.516844:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009abada00/0xad6b7ddc147b159 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5c1 expref: 27 pid: 13375 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.516855:0:7190:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009811b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:02506576-29fe-43be-8266-ebca0ccafd52+19:2007:x1830881265639040:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 88us (811us total) trans 0 rc 0/0 00010000:00010000:0.0:1746065226.516856:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.516858:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.516862:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b22b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a677 expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.516864:0:7190:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8520 00010000:00010000:0.0:1746065226.516873:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b22b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a677 expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.517203:0:10893:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b22b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a677 expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.517215:0:10893:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881264095744:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065226.517286:0:10893:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:0.0:1746065226.521981:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.522041:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265639552 00000100:00100000:3.0:1746065226.522049:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265639552 00002000:00100000:3.0:1746065226.522084:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1855488->1859583) req@ffff880097c0c380 x1830881265639552/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065226.522094:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c0c380 with x1830881265639552 ext(1855488->1859583) 00002000:00010000:3.0:1746065226.522099:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c0c380 00000100:00100000:2.0:1746065226.522124:0:10893:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c0c000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_005:lustre-OST0000_UUID:10893:1830881264095744:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065226.522131:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6521 00000100:00100000:3.0:1746065226.522137:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2004:x1830881265639552:12345-192.168.202.27@tcp:3:multiop.0 00010000:00010000:2.0:1746065226.522141:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.522641:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009811bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2005:x1830881265639296:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5830us (5980us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.522650:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8521 00000100:00100000:3.0:1746065226.522706:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265639552:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 567us (731us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1746065226.522713:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6521 00002000:00100000:3.0:1746065226.522719:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1855488->1859583) req@ffff880097c0c380 x1830881265639552/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/4536 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065226.522727:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c0c380 with x1830881265639552 ext(1855488->1859583) 00002000:00010000:3.0:1746065226.522730:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c0c380 00000100:00100000:1.0:1746065226.527198:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.527227:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265639808 00000100:00100000:1.0:1746065226.527232:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.527235:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265639808 00000100:00100000:0.0:1746065226.528539:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18214 00000100:00100000:0.0:1746065226.528550:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2749:x1830881265639808:12345-192.168.202.27@tcp:101:multiop.0 00000100:00100000:3.0:1746065226.528553:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265639936 00000100:00100000:3.0:1746065226.528557:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265639936 00010000:00010000:0.0:1746065226.528567:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.528581:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46400/0xad6b7ddc147b232 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a67e expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065226.528584:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14734 00000100:00100000:3.0:1746065226.528587:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2754:x1830881265639936:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065226.528597:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065226.528605:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147b105 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a59e expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.528607:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b239 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a685 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.528612:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc147b1a6 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a60e expref: 27 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.528620:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc147b16e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5e4 expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065226.528624:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.528626:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065226.528628:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46400/0xad6b7ddc147b232 lrc: 6/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [1048576->1794047] (req 1048576->1794047) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a67e expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065226.528658:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc147b16e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5e4 expref: 18 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.528665:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b240 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:0.0:1746065226.528669:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc147b16e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5e4 expref: 18 pid: 3067 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746065226.528673:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00000100:00100000:0.0:1746065226.528678:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264095872:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.528680:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b240 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528687:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b247 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528690:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528693:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528754:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147b24e lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528759:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147b24e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528762:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147b24e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:3.0:1746065226.528768:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:3.0:1746065226.528824:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147b24e lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528828:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147b24e lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528831:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147b24e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528834:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5be00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065226.528836:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147b24e lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528840:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147b24e lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528845:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065226.528847:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1746065226.528849:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147b24e lrc: 2/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528851:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5be00/0xad6b7ddc147b24e lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528866:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b240 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528869:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b240 lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528871:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b240 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528876:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b240 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528879:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5a200 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065226.528880:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b240 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528882:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b240 lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528885:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065226.528886:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065226.528887:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b240 lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528890:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a200/0xad6b7ddc147b240 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528893:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b247 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528895:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b247 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528897:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528899:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008ec5a400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065226.528900:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b247 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528903:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b247 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528911:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098c34c00) 00010000:00010000:3.0:1746065226.528912:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065226.528914:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b247 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528916:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b247 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065226.528936:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b239 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a685 expref: 32 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.528940:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bfa00/0xad6b7ddc147b239 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a685 expref: 32 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.528944:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bfa00, rc 0) 00000100:00100000:3.0:1746065226.528974:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2754:x1830881265639936:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 386us (1741us total) trans 8589937264 rc 301/301 00000100:00100000:3.0:1746065226.528978:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14734 00010000:00010000:3.0:1746065226.530697:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc147b1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a60e expref: 27 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.530709:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc147b1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a60e expref: 27 pid: 9550 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.530720:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264096000:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.530756:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147b105 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a59e expref: 33 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.530768:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147b105 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a59e expref: 33 pid: 13375 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.530792:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264096128:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065226.530996:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.531016:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265640064 00000100:00100000:2.0:1746065226.531021:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265640064 00010000:00010000:2.0:1746065226.531044:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc147b16e lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5e4 expref: 19 pid: 3067 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746065226.532547:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:3.0:1746065226.532578:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c0c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264095872:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065226.532865:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8522 00000100:00100000:2.0:1746065226.532874:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+19:2006:x1830881265640064:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.532885:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.532901:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc147b16e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5e4 expref: 19 pid: 3067 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.532910:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc147b16e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5e4 expref: 19 pid: 3067 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.532925:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488800/0xad6b7ddc147b16e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5e4 expref: 19 pid: 3067 timeout: 922 lvb_type: 1 00010000:00010000:2.0:1746065226.532941:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.532971:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+18:2006:x1830881265640064:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 101us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.532979:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8522 00000100:00100000:0.0:1746065226.535542:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.535753:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264096000:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.535763:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264096128:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.535817:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f46400/0xad6b7ddc147b232 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [1048576->1794047] (req 1048576->1794047) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a67e expref: 27 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.535831:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46400, rc 0) 00000100:00100000:3.0:1746065226.536875:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2749:x1830881265639808:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 8322us (9678us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.536884:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18214 00000100:00100000:2.0:1746065226.537312:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265640320 00000100:00100000:2.0:1746065226.537319:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265640320 00010000:00010000:2.0:1746065226.537344:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147b105 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a59e expref: 34 pid: 13375 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.537366:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8523 00000100:00100000:2.0:1746065226.537371:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+34:2006:x1830881265640320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.537487:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.537506:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147b105 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a59e expref: 34 pid: 13375 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.537516:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147b105 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a59e expref: 34 pid: 13375 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.537533:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f73800/0xad6b7ddc147b105 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a59e expref: 34 pid: 13375 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.537544:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065226.537577:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265640320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 206us (2042us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065226.537583:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8523 00000100:00100000:0.0:1746065226.538260:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.538309:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.538439:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265640192 00000100:00100000:2.0:1746065226.538444:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265640192 00010000:00010000:2.0:1746065226.538458:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc147b1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a60e expref: 27 pid: 9550 timeout: 922 lvb_type: 0 00000100:00100000:2.0:1746065226.538480:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8524 00000100:00100000:2.0:1746065226.538485:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+27:2007:x1830881265640192:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065226.538492:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065226.538501:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc147b1a6 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a60e expref: 27 pid: 9550 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.538509:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc147b1a6 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a60e expref: 27 pid: 9550 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.538522:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88009577ae00/0xad6b7ddc147b1a6 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a60e expref: 27 pid: 9550 timeout: 922 lvb_type: 0 00010000:00010000:2.0:1746065226.538530:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.538532:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065226.538538:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46400/0xad6b7ddc147b232 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a67e expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.538544:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46400/0xad6b7ddc147b232 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a67e expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065226.538568:0:8352:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46400/0xad6b7ddc147b232 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a67e expref: 26 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065226.538578:0:8352:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264096256:192.168.202.27@tcp:105: 00000100:00100000:2.0:1746065226.538634:0:8352:0:(client.c:2553:ptlrpc_set_wait()) set ffff88009a48b300 going to sleep for 11 seconds 00000100:00100000:3.0:1746065226.538730:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265640448 00000100:00100000:3.0:1746065226.538734:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265640448 00000100:00100000:3.0:1746065226.538755:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18215 00000100:00100000:3.0:1746065226.538760:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2754:x1830881265640448:12345-192.168.202.27@tcp:101:multiop.0 00010000:00010000:3.0:1746065226.538769:0:11461:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065226.538795:0:11461:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a68c expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.538815:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc147b183 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f9 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.538822:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147b208 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a654 expref: 26 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.538827:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc147b1d0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a638 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.538833:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.538834:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.538837:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 6/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2330624->2555903] (req 2330624->2555903) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 34 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.539137:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc147b1d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a638 expref: 34 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.539147:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc147b1d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a638 expref: 34 pid: 1880 timeout: 922 lvb_type: 0 00000100:00100000:3.0:1746065226.539155:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264096384:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.539193:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147b208 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a654 expref: 26 pid: 9550 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.539201:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147b208 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a654 expref: 26 pid: 9550 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746065226.539213:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264096512:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.539239:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc147b183 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f9 expref: 17 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:3.0:1746065226.539246:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc147b183 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f9 expref: 17 pid: 3067 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746065226.539252:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264096640:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.539276:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534600 going to sleep for 11 seconds 00000100:00100000:3.0:1746065226.544214:0:8352:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f7fdf80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8352:1830881264096256:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065226.544237:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065226.544300:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2007:x1830881265640192:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5813us (6039us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.544309:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8524 00000100:00100000:0.0:1746065226.549646:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065226.549690:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.549938:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aec8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264096384:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.549948:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aeca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264096512:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065226.549956:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264096640:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065226.549983:0:11461:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [2330624->2555903] (req 2330624->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 34 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.549998:0:11461:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf600, rc 0) 00000100:00100000:1.0:1746065226.550030:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265640576 00000100:00100000:3.0:1746065226.550034:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+34:2754:x1830881265640448:12345-192.168.202.27@tcp:101:multiop.0 Request processed in 11273us (11725us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.550036:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265640576 00000100:00100000:3.0:1746065226.550042:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18215 00010000:00010000:1.0:1746065226.550060:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc147b1d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a638 expref: 34 pid: 1880 timeout: 922 lvb_type: 0 00000100:00100000:1.0:1746065226.550078:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265640704 00000100:00100000:1.0:1746065226.550080:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265640704 00010000:00010000:1.0:1746065226.550242:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc147b183 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f9 expref: 18 pid: 3067 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746065226.550467:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8525 00000100:00100000:3.0:1746065226.550475:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2007:x1830881265640576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065226.550485:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065226.550501:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc147b1d0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a638 expref: 34 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.550511:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc147b1d0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a638 expref: 34 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.550529:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f60400/0xad6b7ddc147b1d0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 6 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a638 expref: 34 pid: 1880 timeout: 922 lvb_type: 0 00010000:00010000:3.0:1746065226.550543:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065226.550560:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2007:x1830881265640576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 87us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.550611:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8526 00000100:00100000:1.0:1746065226.550617:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+18:2007:x1830881265640704:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065226.550624:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065226.550632:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc147b183 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f9 expref: 18 pid: 3067 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.550640:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc147b183 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f9 expref: 18 pid: 3067 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.550656:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88012c488a00/0xad6b7ddc147b183 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f9 expref: 18 pid: 3067 timeout: 922 lvb_type: 1 00010000:00010000:1.0:1746065226.551044:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065226.551064:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:02506576-29fe-43be-8266-ebca0ccafd52+17:2007:x1830881265640704:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 446us (1373us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065226.551070:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8526 00000100:00100000:0.0:1746065226.551983:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.552538:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265640960 00000100:00100000:2.0:1746065226.552544:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265640960 00002000:00100000:2.0:1746065226.552573:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1789952->1794047) req@ffff880097c0d880 x1830881265640960/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.552581:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c0d880 with x1830881265640960 ext(1789952->1794047) 00002000:00010000:2.0:1746065226.552584:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c0d880 00000100:00100000:2.0:1746065226.552599:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6522 00000100:00100000:2.0:1746065226.552605:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265640960:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:3.0:1746065226.552825:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8525 00000100:00100000:2.0:1746065226.553495:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2004:x1830881265640960:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 888us (1512us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1746065226.553502:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6522 00002000:00100000:2.0:1746065226.553507:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1789952->1794047) req@ffff880097c0d880 x1830881265640960/t0(0) o3->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:142/0 lens 488/4536 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065226.553515:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c0d880 with x1830881265640960 ext(1789952->1794047) 00002000:00010000:2.0:1746065226.553518:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c0d880 00000100:00100000:0.0:1746065226.558995:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.559296:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265641088 00000100:00100000:3.0:1746065226.559304:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265641088 00010000:00010000:3.0:1746065226.559335:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147b208 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a654 expref: 26 pid: 9550 timeout: 922 lvb_type: 1 00000100:00100000:3.0:1746065226.559374:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8527 00000100:00100000:3.0:1746065226.559381:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+26:2006:x1830881265641088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065226.559392:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065226.559408:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147b208 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a654 expref: 26 pid: 9550 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746065226.559418:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147b208 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a654 expref: 26 pid: 9550 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746065226.559436:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f61600/0xad6b7ddc147b208 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a654 expref: 26 pid: 9550 timeout: 922 lvb_type: 1 00010000:00010000:3.0:1746065226.559454:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.559456:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065226.559462:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 32 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.559468:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 32 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065226.559493:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 32 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065226.559504:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264096768:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065226.559579:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065226.562103:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.562320:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265641344 00000100:00100000:3.0:1746065226.562327:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265641344 00000100:00100000:3.0:1746065226.562366:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5559 00000100:00100000:3.0:1746065226.562373:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+10:2749:x1830881265641344:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065226.562544:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2749:x1830881265641344:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 170us (447us total) trans 8589937265 rc 0/0 00000100:00100000:3.0:1746065226.562551:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5559 00000100:00100000:1.0:1746065226.564404:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065226.564424:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264096768:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065226.564439:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065226.564564:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+25:2006:x1830881265641088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 5182us (5575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065226.564573:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8527 00000100:00100000:0.0:1746065226.566587:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265641600 00000100:00100000:0.0:1746065226.566599:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265641600 00002000:00100000:0.0:1746065226.566633:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2330624->2334719) req@ffff880097fab100 x1830881265641600/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065226.566641:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab100 with x1830881265641600 ext(2330624->2334719) 00002000:00010000:0.0:1746065226.566645:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fab100 00000100:00100000:0.0:1746065226.566661:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6523 00000100:00100000:0.0:1746065226.566666:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265641600:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:0.0:1746065226.566882:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:251e5313-64c6-436c-a0af-246328b144ca+33:2004:x1830881265641600:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 214us (2482us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1746065226.566888:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6523 00002000:00100000:0.0:1746065226.566893:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x96:0x0] (2330624->2334719) req@ffff880097fab100 x1830881265641600/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/4536 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065226.566899:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097fab100 with x1830881265641600 ext(2330624->2334719) 00002000:00010000:0.0:1746065226.566902:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097fab100 00000100:00100000:0.0:1746065226.576975:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065226.577360:0:13377:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265641856 00000100:00100000:1.0:1746065226.577368:0:13377:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265641856 00002000:00100000:1.0:1746065226.577403:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2551808->2555903) req@ffff880097c0e300 x1830881265641856/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/0 e 0 to 0 dl 1746065237 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.577413:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c0e300 with x1830881265641856 ext(2551808->2555903) 00002000:00010000:1.0:1746065226.577418:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c0e300 00000100:00100000:1.0:1746065226.577446:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6524 00000100:00100000:1.0:1746065226.577454:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265641856:12345-192.168.202.27@tcp:3:multiop.0 00000100:00100000:1.0:1746065226.577581:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+33:2006:x1830881265641856:12345-192.168.202.27@tcp:3:multiop.0 Request processed in 127us (614us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1746065226.577588:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6524 00002000:00100000:1.0:1746065226.577593:0:13377:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_010: refresh rw locks for [0x280000401:0x96:0x0] (2551808->2555903) req@ffff880097c0e300 x1830881265641856/t0(0) o3->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:142/0 lens 488/4536 e 0 to 0 dl 1746065237 ref 1 fl Complete:/200/0 rc 4096/4096 job:'multiop.0' uid:0 gid:0 00002000:00100000:1.0:1746065226.577604:0:13377:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c0e300 with x1830881265641856 ext(2551808->2555903) 00002000:00010000:1.0:1746065226.577606:0:13377:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c0e300 00000100:00100000:0.0:1746065226.585547:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065226.588935:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265642112 00000100:00100000:2.0:1746065226.588946:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265642112 00000100:00100000:3.0:1746065226.590855:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5560 00000100:00100000:3.0:1746065226.590866:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2754:x1830881265642112:12345-192.168.202.27@tcp:35:multiop.0 00000100:00100000:3.0:1746065226.592321:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2754:x1830881265642112:12345-192.168.202.27@tcp:35:multiop.0 Request processed in 1453us (6778us total) trans 8589937266 rc 0/0 00000100:00100000:3.0:1746065226.592330:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5560 00000001:00080000:0.0:1746065226.706054:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841826 is committed 00000001:00080000:0.0:1746065226.706086:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841810 is committed 00000001:00080000:0.0:1746065226.706095:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841808 is committed 00000001:00080000:0.0:1746065226.706143:0:30400:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0000: transno 21474841772 is committed 00010000:00010000:2.0:1746065227.135381:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065227.244520:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065227.246316:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265642368 00000100:00100000:3.0:1746065227.246326:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265642368 00000100:00080000:1.0:1746065227.246683:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065227.246757:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5561 00000100:00100000:3.0:1746065227.246766:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+6:2739:x1830881265642368:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:3.0:1746065227.246964:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2739:x1830881265642368:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 199us (2451us total) trans 8589937267 rc 0/0 00000100:00100000:3.0:1746065227.246970:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5561 00000100:00100000:0.0:1746065227.250746:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065227.251902:0:16721:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265642624 00000100:00100000:2.0:1746065227.251912:0:16721:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265642624 00000100:00100000:2.0:1746065227.251958:0:16721:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5562 00000100:00100000:2.0:1746065227.251966:0:16721:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800b4298450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+7:2739:x1830881265642624:12345-192.168.202.27@tcp:35:mirror_io.0 00000100:00100000:2.0:1746065227.252138:0:16721:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800b4298450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:02506576-29fe-43be-8266-ebca0ccafd52+8:2739:x1830881265642624:12345-192.168.202.27@tcp:35:mirror_io.0 Request processed in 172us (1398us total) trans 8589937268 rc 0/0 00000100:00100000:2.0:1746065227.252145:0:16721:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5562 00000001:00080000:0.0:1746065227.694983:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874454 is committed 00000001:00080000:0.0:1746065227.695013:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874436 is committed 00000001:00080000:0.0:1746065227.695022:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874435 is committed 00000001:00080000:0.0:1746065227.695080:0:32022:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-OST0001: transno 17179874393 is committed 00000100:00100000:0.0:1746065227.806191:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1746065227.806814:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881264096896:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1746065227.806864:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065227.807222:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264096896 00000100:00100000:2.0:1746065227.807229:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264096896 00000100:00100000:2.0:1746065227.807277:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1746065227.807284:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881264096896:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1746065227.807305:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 319488 granted 1068370240 pending 0 free 3906572288 avail 3675049984 00000100:00100000:2.0:1746065227.807333:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3759:x1830881264096896:12345-0@lo:13:osp-pre-1-1.0 Request processed in 51us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065227.807337:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00080000:1.0:1746065227.807391:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1746065227.807442:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881264096896:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1746065227.950021:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1746065227.950041:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264097024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1746065227.950097:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065227.951154:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264097024 00000100:00100000:2.0:1746065227.951162:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264097024 00000100:00100000:2.0:1746065227.951205:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:2.0:1746065227.951211:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881264097024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1746065227.951234:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 266240 granted 1065846208 pending 0 free 3910598656 avail 3679076352 00000100:00100000:2.0:1746065227.951297:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881264097024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (1200us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065227.951302:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00000100:00080000:1.0:1746065227.951410:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065227.951463:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264097024:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1746065228.137743:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065228.501216:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065228.501287:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065228.501324:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065228.501354:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065228.501373:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065228.501392:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065228.501414:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065228.501430:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265643392 00000100:00100000:3.0:1746065228.501442:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265643392 00000100:00100000:3.0:1746065228.501458:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265643648 00000100:00100000:0.0:1746065228.501458:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065228.501460:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265643648 00000100:00100000:0.0:1746065228.501483:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265642752 00000100:00100000:0.0:1746065228.501489:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265642752 00000100:00100000:3.0:1746065228.501507:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265643008 00000100:00100000:3.0:1746065228.501510:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265643008 00000100:00100000:0.0:1746065228.501525:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265643264 00000100:00100000:0.0:1746065228.501527:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265643264 00000100:00100000:3.0:1746065228.501528:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265643520 00000100:00100000:3.0:1746065228.501530:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265643520 00000100:00100000:0.0:1746065228.501546:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18216 00000100:00100000:0.0:1746065228.501554:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265643648:12345-192.168.202.27@tcp:16:kworker.0 00000100:00100000:3.0:1746065228.501556:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18217 00000100:00100000:3.0:1746065228.501563:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265642752:12345-192.168.202.27@tcp:16:kworker.0 00000100:00100000:0.0:1746065228.501662:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265643648:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 107us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065228.501667:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265642752:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 104us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065228.501669:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18216 00000100:00100000:3.0:1746065228.501674:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18217 00000100:00100000:0.0:1746065228.501688:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18218 00000100:00100000:3.0:1746065228.501693:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18219 00000100:00100000:0.0:1746065228.501694:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265643008:12345-192.168.202.27@tcp:16:kworker.0 00000100:00100000:3.0:1746065228.501699:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265643264:12345-192.168.202.27@tcp:16:kworker.0 00000100:00100000:0.0:1746065228.501725:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265643008:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 31us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065228.501731:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18218 00000100:00100000:3.0:1746065228.501734:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265643264:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 36us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065228.501739:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18219 00000100:00100000:0.0:1746065228.501743:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18220 00000100:00100000:0.0:1746065228.501747:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265643520:12345-192.168.202.27@tcp:16:kworker.0 00000100:00100000:0.0:1746065228.501819:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265643520:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 70us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065228.501822:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18221 00000100:00100000:0.0:1746065228.501825:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18220 00000100:00100000:3.0:1746065228.501828:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265643392:12345-192.168.202.27@tcp:16:kworker.0 00000100:00100000:3.0:1746065228.501861:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2007:x1830881265643392:12345-192.168.202.27@tcp:16:kworker.0 Request processed in 33us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065228.501866:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18221 00000100:00080000:3.0:1746065228.501902:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1746065228.501905:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1746065228.502015:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265642880 00000100:00100000:2.0:1746065228.502020:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265642880 00002000:00100000:2.0:1746065228.502044:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1855488->2097151) req@ffff880097c0f100 x1830881265642880/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:144/0 lens 488/0 e 0 to 0 dl 1746065239 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065228.502052:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c0f100 with x1830881265642880 ext(1855488->2097151) 00002000:00010000:2.0:1746065228.502057:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c0f100 00000100:00100000:2.0:1746065228.502077:0:29488:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265643136 00000100:00100000:2.0:1746065228.502079:0:29488:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265643136 00002000:00100000:2.0:1746065228.502088:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1794047) req@ffff880097c0f480 x1830881265643136/t0(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:144/0 lens 488/0 e 0 to 0 dl 1746065239 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065228.502093:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c0f480 with x1830881265643136 ext(1048576->1794047) 00002000:00010000:2.0:1746065228.502097:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c0f480 00000100:00100000:2.0:1746065228.502105:0:29488:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6525 00000100:00100000:2.0:1746065228.502109:0:29488:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2007:x1830881265642880:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065228.502207:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6526 00000100:00100000:2.0:1746065228.502212:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+9:2007:x1830881265643136:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:2.0:1746065228.515619:0:29488:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265642880:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 13496us (14404us total) trans 21474841827 rc 0/0 00000100:00100000:2.0:1746065228.515634:0:29488:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6525 00002000:00100000:2.0:1746065228.515649:0:29488:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x280000401:0x94:0x0] (1855488->2097151) req@ffff880097c0f100 x1830881265642880/t21474841827(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:144/0 lens 488/448 e 0 to 0 dl 1746065239 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:2.0:1746065228.515659:0:29488:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c0f100 with x1830881265642880 ext(1855488->2097151) 00002000:00010000:2.0:1746065228.515666:0:29488:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c0f100 00000100:00100000:0.0:1746065228.528966:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2007:x1830881265643136:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 26743us (27669us total) trans 21474841828 rc 0/0 00000100:00100000:0.0:1746065228.528978:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6526 00002000:00100000:0.0:1746065228.528988:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x95:0x0] (1048576->1794047) req@ffff880097c0f480 x1830881265643136/t21474841828(0) o4->1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3@192.168.202.27@tcp:144/0 lens 488/448 e 0 to 0 dl 1746065239 ref 1 fl Complete:/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065228.528997:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880097c0f480 with x1830881265643136 ext(1048576->1794047) 00002000:00010000:0.0:1746065228.529002:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff880097c0f480 00000100:00100000:0.0:1746065228.542147:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065228.542208:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265643776 00000100:00100000:3.0:1746065228.542216:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265643776 00000100:00100000:3.0:1746065228.542621:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 882 00000100:00100000:3.0:1746065228.542628:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:124d38bc-0f92-4827-84b7-a543154654fd+15:2005:x1830881265643776:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065228.542642:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065228.542656:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880136166000/0xad6b7ddc1470d7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934573 expref: 15 pid: 8144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065228.542681:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065228.542721:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:124d38bc-0f92-4827-84b7-a543154654fd+14:2005:x1830881265643776:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 94us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065228.542726:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 882 00000100:00100000:2.0:1746065228.548064:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065228.548099:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065228.548185:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065228.548207:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265644416 00000100:00100000:2.0:1746065228.548214:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265644416 00000100:00100000:2.0:1746065228.548254:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18222 00000100:00100000:2.0:1746065228.548261:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+7:2003:x1830881265644416:12345-192.168.202.27@tcp:9:umount.0 00000020:00000080:2.0:1746065228.548286:0:3067:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1470da4 00000020:00010000:2.0:1746065228.548293:0:3067:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012dfb0800: total 0 00000100:00080000:2.0:1746065228.548297:0:3067:0:(import.c:66:import_set_state_nolock()) ffff88012dfb0000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065228.548329:0:3067:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874454 00000100:00100000:2.0:1746065228.548439:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2003:x1830881265644416:12345-192.168.202.27@tcp:9:umount.0 Request processed in 177us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065228.548448:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18222 00000100:00100000:2.0:1746065228.548475:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265644160 00000100:00100000:2.0:1746065228.548478:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265644160 00000100:00100000:3.0:1746065228.548487:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265644032 00000100:00100000:3.0:1746065228.548491:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265644032 00000020:00010000:0.0:1746065228.548569:0:7194:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012dfb0800: total 0 00010000:00010000:0.0:1746065228.548599:0:7194:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012dfb0800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1746065228.548640:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1ae00/0xad6b7ddc147b1c9 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a631 expref: 4 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065228.548665:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f61a00/0xad6b7ddc147b201 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a64d expref: 3 pid: 1880 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065228.548674:0:7194:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012dfb0800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1746065228.548684:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065228.548686:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065228.548687:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1746065228.548947:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 883 00000100:00100000:3.0:1746065228.549004:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 884 00000100:00100000:3.0:1746065228.549011:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124d38bc-0f92-4827-84b7-a543154654fd+15:2004:x1830881265644032:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065228.549019:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065228.549030:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880136166c00/0xad6b7ddc1470d81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9345a4 expref: 15 pid: 8144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065228.549038:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065228.549040:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:124d38bc-0f92-4827-84b7-a543154654fd+15:2004:x1830881265644160:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065228.549049:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065228.549058:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880095f6ca00/0xad6b7ddc1470d88 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9345ab expref: 14 pid: 8144 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065228.549069:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124d38bc-0f92-4827-84b7-a543154654fd+14:2004:x1830881265644032:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 59us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065228.549075:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 884 00010000:00010000:2.0:1746065228.549540:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1746065228.549568:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f7fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:124d38bc-0f92-4827-84b7-a543154654fd+12:2004:x1830881265644160:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 614us (1512us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065228.549574:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 883 00000100:00100000:0.0:1746065228.563914:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065228.563997:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265644800 00000100:00100000:2.0:1746065228.564006:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265644800 00000100:00100000:2.0:1746065228.564044:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18223 00000100:00100000:2.0:1746065228.564051:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2003:x1830881265644800:12345-192.168.202.27@tcp:9:umount.0 00000020:00000080:2.0:1746065228.564079:0:10219:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1470d9d 00000020:00010000:2.0:1746065228.564086:0:10219:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012dfb2800: total 0 00000100:00080000:2.0:1746065228.564089:0:10219:0:(import.c:66:import_set_state_nolock()) ffff88012dfb4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1746065228.564132:0:10219:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841828 00000020:00010000:3.0:1746065228.564147:0:8351:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012dfb2800: total 0 00010000:00010000:3.0:1746065228.564152:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065228.564190:0:8351:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012dfb2800, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1746065228.564233:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b22b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1855488->2097151) gid 0 flags: 0x44801000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a677 expref: 9 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065228.564255:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+8:2003:x1830881265644800:12345-192.168.202.27@tcp:9:umount.0 Request processed in 196us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065228.564262:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18223 00010000:00010000:3.0:1746065228.564283:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46400/0xad6b7ddc147b232 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->1794047) gid 0 flags: 0x44801000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a67e expref: 7 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065228.564294:0:8351:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012dfb2800, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1746065228.564304:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065228.564306:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1746065228.564307:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065228.576074:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065228.576171:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265645184 00000100:00100000:3.0:1746065228.576179:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265645184 00000100:00100000:3.0:1746065228.576237:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14735 00000100:00100000:3.0:1746065228.576244:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+11:2003:x1830881265645184:12345-192.168.202.27@tcp:39:umount.0 00000020:00000080:3.0:1746065228.576281:0:7204:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1470d8f 00000020:00010000:3.0:1746065228.576287:0:7204:0:(genops.c:1938:obd_stale_export_put()) Put export ffff8800ac558800: total 0 00000100:00080000:3.0:1746065228.576290:0:7204:0:(import.c:66:import_set_state_nolock()) ffff8800ac55a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746065228.576315:0:7204:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589937268 00000100:00080000:0.0:1746065228.576471:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:2.0:1746065228.576694:0:7193:0:(genops.c:1924:obd_stale_export_get()) Get export ffff8800ac558800: total 0 00010000:00010000:2.0:1746065228.576732:0:7193:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff8800ac558800, canceled 0 locks, left on hash table 3. 00010000:00010000:2.0:1746065228.576757:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:2.0:1746065228.576760:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1746065228.576767:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45400/0xad6b7ddc1470e29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93465a expref: 10 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065228.576824:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065228.576826:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1746065228.576830:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880131bee200/0xad6b7ddc14730ea lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd935a1f expref: 9 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065228.576841:0:7193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065228.576843:0:7193:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065228.576845:0:7193:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1ba00/0xad6b7ddc147b1b4 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a61c expref: 8 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065228.576854:0:7193:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff8800ac558800, canceled 3 locks, left on hash table 0. 00010000:00010000:2.0:1746065228.576865:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065228.576866:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1746065228.576868:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065228.578128:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+6:2003:x1830881265645184:12345-192.168.202.27@tcp:39:umount.0 Request processed in 1876us (2053us total) trans 8589937269 rc 0/0 00000100:00100000:3.0:1746065228.578138:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14735 00000100:00100000:0.0:1746065228.587142:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065228.587238:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265645312 00000100:00100000:3.0:1746065228.587254:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265645312 00000100:00080000:0.0:1746065228.588094:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1746065228.588190:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14736 00000100:00100000:3.0:1746065228.588200:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+5:2003:x1830881265645312:12345-192.168.202.27@tcp:39:umount.0 00000020:00000080:3.0:1746065228.588227:0:7204:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1470d96 00000100:00080000:3.0:1746065228.588234:0:7204:0:(import.c:66:import_set_state_nolock()) ffff8800ac55f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746065228.588259:0:7204:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294975982 00000100:00100000:3.0:1746065228.588413:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3+3:2003:x1830881265645312:12345-192.168.202.27@tcp:39:umount.0 Request processed in 214us (1277us total) trans 4294975983 rc 0/0 00000100:00100000:3.0:1746065228.588419:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14736 00010000:00010000:0.0:1746065228.588949:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065229.134692:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.134727:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.134754:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.134851:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.134875:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265646464 00000100:00100000:0.0:1746065229.134882:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265646464 00000100:00100000:0.0:1746065229.134921:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18224 00000100:00100000:0.0:1746065229.134928:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+10:2003:x1830881265646464:12345-192.168.202.27@tcp:9:umount.0 00000020:00000080:0.0:1746065229.134951:0:3067:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1470dd5 00000020:00010000:0.0:1746065229.134955:0:3067:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009a41d800: total 0 00000100:00080000:0.0:1746065229.134958:0:3067:0:(import.c:66:import_set_state_nolock()) ffff88009a41b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1746065229.134986:0:3067:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 4, last_transno is 17179874454 00000100:00100000:0.0:1746065229.135077:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:02506576-29fe-43be-8266-ebca0ccafd52+8:2003:x1830881265646464:12345-192.168.202.27@tcp:9:umount.0 Request processed in 149us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.135083:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18224 00000100:00080000:0.0:1746065229.135097:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:0.0:1746065229.135147:0:8351:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009a41d800: total 0 00010000:00010000:0.0:1746065229.135163:0:8351:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009a41d800, canceled 0 locks, left on hash table 5. 00010000:00010000:0.0:1746065229.135200:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff8800996bea00/0xad6b7ddc14715d1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 3145728->3211263) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934a19 expref: 7 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.135226:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008c539000/0xad6b7ddc147300a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 5074944->5160959) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9359c4 expref: 6 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.135273:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489000/0xad6b7ddc147b17c lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5f2 expref: 5 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.135287:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012ef3c400/0xad6b7ddc14732b8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->450559) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd935b5a expref: 4 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.135307:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489a00/0xad6b7ddc147b175 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5eb expref: 3 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.135315:0:8351:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009a41d800, canceled 5 locks, left on hash table 0. 00010000:00010000:0.0:1746065229.135325:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065229.135326:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065229.135327:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1746065229.135376:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265645440 00000100:00100000:3.0:1746065229.135379:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265645440 00000100:00100000:3.0:1746065229.135401:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265645824 00000100:00100000:3.0:1746065229.135403:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265645824 00000100:00100000:3.0:1746065229.135413:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265645568 00000100:00100000:3.0:1746065229.135414:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265645568 00000100:00100000:3.0:1746065229.136268:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 885 00000100:00100000:3.0:1746065229.136277:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124d38bc-0f92-4827-84b7-a543154654fd+14:2006:x1830881265645440:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065229.136287:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065229.136298:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008f2b9400/0xad6b7ddc1470dab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9345dc expref: 14 pid: 8144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.136310:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065229.136336:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124d38bc-0f92-4827-84b7-a543154654fd+13:2006:x1830881265645440:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 62us (1652us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.136342:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 885 00000100:00100000:3.0:1746065229.136353:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 886 00000100:00100000:3.0:1746065229.136357:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a850ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124d38bc-0f92-4827-84b7-a543154654fd+12:2006:x1830881265645824:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065229.136363:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065229.136369:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008f2b8400/0xad6b7ddc1470db9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934614 expref: 12 pid: 8144 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.136376:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065229.136388:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a850ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:124d38bc-0f92-4827-84b7-a543154654fd+11:2006:x1830881265645824:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 30us (1660us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.136393:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 886 00000100:00100000:0.0:1746065229.136420:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 887 00000100:00100000:0.0:1746065229.136426:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124d38bc-0f92-4827-84b7-a543154654fd+10:2006:x1830881265645568:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065229.136433:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065229.136440:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880136167600/0xad6b7ddc1470db2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93460d expref: 10 pid: 8142 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.136448:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065229.136461:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:124d38bc-0f92-4827-84b7-a543154654fd+9:2006:x1830881265645568:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 35us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.136466:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 887 00010000:00010000:1.0:1746065229.141230:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065229.142233:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.142275:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265646976 00000100:00100000:1.0:1746065229.142283:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265646976 00000100:00100000:1.0:1746065229.142329:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18225 00000100:00100000:1.0:1746065229.142337:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+8:2003:x1830881265646976:12345-192.168.202.27@tcp:9:umount.0 00000020:00000080:1.0:1746065229.142362:0:10219:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1470dce 00000020:00010000:1.0:1746065229.142368:0:10219:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88009a41a800: total 0 00000100:00080000:1.0:1746065229.142372:0:10219:0:(import.c:66:import_set_state_nolock()) ffff88009a41b800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746065229.142404:0:10219:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 5, last_transno is 21474841828 00000100:00100000:1.0:1746065229.142507:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:02506576-29fe-43be-8266-ebca0ccafd52+6:2003:x1830881265646976:12345-192.168.202.27@tcp:9:umount.0 Request processed in 171us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.142514:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18225 00000020:00010000:1.0:1746065229.142527:0:7194:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88009a41a800: total 0 00010000:00010000:1.0:1746065229.142529:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065229.142541:0:7194:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88009a41a800, canceled 0 locks, left on hash table 3. 00010000:00010000:1.0:1746065229.142575:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800929fa000/0xad6b7ddc14732b1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->450559) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd935b53 expref: 5 pid: 13375 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.142618:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996be000/0xad6b7ddc14715ca lrc: 0/0,0 mode: --/PW res: [0x280000401:0x98:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 4112384->4194303) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934a12 expref: 4 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.142638:0:7194:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c539600/0xad6b7ddc1473003 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x97:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2977792->3063807) gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd9359bd expref: 3 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.142650:0:7194:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88009a41a800, canceled 3 locks, left on hash table 0. 00010000:00010000:1.0:1746065229.142658:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065229.142660:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1746065229.142661:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1746065229.143397:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065229.150591:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.150865:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265647232 00000100:00100000:3.0:1746065229.150882:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265647232 00000100:00080000:0.0:1746065229.151026:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065229.151343:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14737 00000100:00100000:3.0:1746065229.151351:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+8:2003:x1830881265647232:12345-192.168.202.27@tcp:39:umount.0 00000020:00000080:3.0:1746065229.151378:0:7204:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1470dc0 00000020:00010000:3.0:1746065229.151383:0:7204:0:(genops.c:1938:obd_stale_export_put()) Put export ffff88012dfb6000: total 0 00000100:00080000:3.0:1746065229.151386:0:7204:0:(import.c:66:import_set_state_nolock()) ffff88012dfb6800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1746065229.151399:0:7204:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589937269 00000100:00100000:3.0:1746065229.151498:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:02506576-29fe-43be-8266-ebca0ccafd52+7:2003:x1830881265647232:12345-192.168.202.27@tcp:39:umount.0 Request processed in 148us (914us total) trans 8589937270 rc 0/0 00000100:00100000:3.0:1746065229.151504:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14737 00000020:00010000:0.0:1746065229.151818:0:8351:0:(genops.c:1924:obd_stale_export_get()) Get export ffff88012dfb6000: total 0 00010000:00010000:0.0:1746065229.151855:0:8351:0:(ldlm_lock.c:2647:ldlm_export_cancel_blocked_locks()) Export ffff88012dfb6000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1746065229.151883:0:8351:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:0.0:1746065229.151886:0:8351:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1746065229.151892:0:8351:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880129f45800/0xad6b7ddc1470de3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd934645 expref: 6 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.151906:0:8351:0:(ldlm_lock.c:2675:ldlm_export_cancel_locks()) Export ffff88012dfb6000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1746065229.151915:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065229.151916:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1746065229.151918:0:8351:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1746065229.157729:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.158145:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265647360 00000100:00100000:1.0:1746065229.158152:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265647360 00000100:00100000:1.0:1746065229.158207:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14738 00000100:00100000:1.0:1746065229.158213:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+5:2003:x1830881265647360:12345-192.168.202.27@tcp:39:umount.0 00000020:00000080:1.0:1746065229.158238:0:7231:0:(genops.c:1485:class_disconnect()) disconnect: cookie 0xad6b7ddc1470dc7 00000100:00080000:1.0:1746065229.158254:0:7231:0:(import.c:66:import_set_state_nolock()) ffff8800ac55f800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1746065229.158270:0:7231:0:(tgt_lastrcvd.c:696:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294975983 00000100:00100000:1.0:1746065229.158373:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:02506576-29fe-43be-8266-ebca0ccafd52+3:2003:x1830881265647360:12345-192.168.202.27@tcp:39:umount.0 Request processed in 159us (651us total) trans 4294975984 rc 0/0 00000100:00100000:1.0:1746065229.158379:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14738 00010000:00010000:1.0:1746065229.158397:0:7193:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1746065229.158537:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1746065229.192417:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.192557:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265647488 00000100:00100000:3.0:1746065229.192564:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265647488 00000100:00100000:3.0:1746065229.192617:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14739 00000100:00100000:3.0:1746065229.192623:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012c1bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2799:x1830881265647488:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065229.192642:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065229.192656:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc147b263 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a693 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.192700:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc147b26a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192710:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc147b26a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192717:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc147b26a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192726:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc147b271 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192730:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc147b271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192735:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc147b271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192813:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192821:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192826:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:3.0:1746065229.192855:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00000004:00200000:3.0:1746065229.192858:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1746065229.192869:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192876:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192882:0:7204:0:(ldlm_lock.c:949:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc147b26a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192887:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc147b26a lrc: 4/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192891:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc147b26a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192895:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc147b26a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192900:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b8400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065229.192903:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc147b26a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192908:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc147b26a lrc: 5/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192917:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8800b4838000) 00010000:00010000:3.0:1746065229.192920:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065229.192923:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc147b26a lrc: 3/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192927:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b8400/0xad6b7ddc147b26a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192953:0:7204:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc147b271 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192957:0:7204:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc147b271 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192961:0:7204:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc147b271 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192964:0:7204:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008f2b9400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:3.0:1746065229.192966:0:7204:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc147b271 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192970:0:7204:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc147b271 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192976:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x5f98ebce (ffff880098c34300) 00010000:00010000:3.0:1746065229.192977:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1746065229.192979:0:7204:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc147b271 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.192982:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008f2b9400/0xad6b7ddc147b271 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x5f98ebce bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.193002:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f67200/0xad6b7ddc147b263 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a693 expref: 34 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.193011:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a693 expref: 33 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.193016:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065229.193017:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1746065229.193019:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996be000, rc 0) 00000100:00100000:3.0:1746065229.193055:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012c1bd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2799:x1830881265647488:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 432us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.193060:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14739 00000100:00080000:0.0:1746065229.193555:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065229.196283:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.197009:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265647616 00000100:00100000:1.0:1746065229.197017:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265647616 00000100:00100000:1.0:1746065229.197060:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18226 00000100:00100000:1.0:1746065229.197067:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+19:2005:x1830881265647616:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065229.197080:0:3067:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065229.197097:0:3067:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090684a00/0xad6b7ddc147b27f lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a69a expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065229.197118:0:3067:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d74a, atime: 0x6812d748, ctime: 0x6812d74a, blocks: 0x800 00010000:00010000:1.0:1746065229.197131:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.197133:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.197140:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090684a00/0xad6b7ddc147b27f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a69a expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065229.197152:0:3067:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090684a00/0xad6b7ddc147b27f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a69a expref: 20 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065229.197160:0:3067:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090684a00, rc 0) 00000100:00100000:1.0:1746065229.197199:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881265647616:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 132us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.197204:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18226 00000100:00080000:1.0:1746065229.197252:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065229.197666:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.197717:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265647744 00000100:00100000:1.0:1746065229.197720:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265647744 00000100:00100000:1.0:1746065229.197737:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18227 00000100:00100000:1.0:1746065229.197741:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+20:2005:x1830881265647744:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065229.197748:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065229.197756:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b286 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6a1 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:1.0:1746065229.197766:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d74a, atime: 0x6812d749, ctime: 0x6812d74a, blocks: 0x808 00010000:00010000:1.0:1746065229.197793:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.197794:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.197799:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b286 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a1 expref: 21 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065229.197809:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b286 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a1 expref: 21 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:1.0:1746065229.197815:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090684e00, rc 0) 00000100:00100000:1.0:1746065229.197831:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+21:2005:x1830881265647744:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 89us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.197835:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18227 00000100:00100000:0.0:1746065229.201475:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.201686:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265648000 00000100:00100000:3.0:1746065229.201694:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265648000 00000100:00100000:3.0:1746065229.201745:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14740 00000100:00100000:3.0:1746065229.201753:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+33:2799:x1830881265648000:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:3.0:1746065229.201769:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1746065229.201805:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc147b28d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6a8 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.201883:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.201895:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 2/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a693 expref: 34 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.201901:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 4/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:3.0:1746065229.201926:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a693 expref: 34 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.201939:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a693 expref: 34 pid: 7204 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746065229.201949:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264097152:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065229.202034:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065229.205455:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264097152:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065229.205477:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:0.0:1746065229.205892:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.205962:0:10893:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265648128 00000100:00100000:1.0:1746065229.205967:0:10893:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265648128 00010000:00010000:1.0:1746065229.205991:0:10893:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a693 expref: 35 pid: 7204 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746065229.206058:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8528 00000100:00100000:1.0:1746065229.206065:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265648128:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065229.206076:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065229.206081:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 4/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a693 expref: 35 pid: 7204 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.206090:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a693 expref: 35 pid: 7204 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.206106:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b278 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a693 expref: 35 pid: 7204 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.206130:0:10893:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065229.206134:0:10893:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 3/0,1 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.206141:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.206147:0:10893:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 4/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.206162:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065229.206201:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+34:2004:x1830881265648128:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 136us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.206207:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8528 00010000:00010000:1.0:1746065229.206235:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.206250:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 3/0,1 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065229.206264:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:1.0:1746065229.206372:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be600/0xad6b7ddc147b28d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a8 expref: 35 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.206383:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a8 expref: 34 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.206388:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065229.206391:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1746065229.206393:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800996bf800, rc 0) 00000100:00100000:1.0:1746065229.206415:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2799:x1830881265648000:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4664us (4947us total) trans 8589937271 rc 0/0 00000100:00100000:1.0:1746065229.206421:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14740 00000100:00100000:0.0:1746065229.209408:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.209724:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265648256 00000100:00100000:1.0:1746065229.209733:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265648256 00000100:00100000:1.0:1746065229.209804:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14741 00000100:00100000:1.0:1746065229.209812:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2799:x1830881265648256:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065229.209832:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065229.209846:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b2a2 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6af expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.209921:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc147b2a9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.209933:0:7204:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 2/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a8 expref: 35 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.209938:0:7204:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc147b2a9 lrc: 4/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.209962:0:7204:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a8 expref: 35 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.209972:0:7204:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a8 expref: 35 pid: 7204 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746065229.209982:0:7204:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264097280:192.168.202.27@tcp:104: 00000100:00100000:1.0:1746065229.210057:0:7204:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd480 going to sleep for 11 seconds 00000100:00100000:1.0:1746065229.211582:0:7204:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:7204:1830881264097280:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065229.211600:0:7204:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc147b2a9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:0.0:1746065229.214824:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.214915:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265648384 00000100:00100000:2.0:1746065229.214922:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265648384 00010000:00010000:2.0:1746065229.215962:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a8 expref: 36 pid: 7204 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746065229.216005:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8529 00000100:00100000:2.0:1746065229.216014:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2004:x1830881265648384:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1746065229.216026:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065229.216031:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 4/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a8 expref: 36 pid: 7204 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746065229.216045:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 3/0,0 mode: CW/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a8 expref: 36 pid: 7204 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746065229.216063:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996bf800/0xad6b7ddc147b294 lrc: 0/0,0 mode: --/CW res: [0x200000404:0x31:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a8 expref: 36 pid: 7204 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746065229.216088:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065229.216093:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc147b2a9 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065229.216100:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc147b2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065229.216106:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc147b2a9 lrc: 4/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065229.216125:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065229.216132:0:7204:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc147b2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.216141:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc147b2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000100:00100000:2.0:1746065229.216161:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2004:x1830881265648384:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 150us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.216167:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8529 00000004:00200000:1.0:1746065229.216180:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00000004:00200000:1.0:1746065229.216185:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1746065229.216198:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc147b2a9 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.216755:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800996be000/0xad6b7ddc147b2a2 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6af expref: 35 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.217069:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc147b2a9 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6af expref: 34 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.217075:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065229.217077:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1746065229.217079:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5aa00, rc 0) 00000100:00100000:1.0:1746065229.217423:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2799:x1830881265648256:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 7611us (8020us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.217429:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14741 00000100:00100000:0.0:1746065229.219949:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.220161:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265648640 00000100:00100000:1.0:1746065229.220169:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265648640 00000100:00100000:1.0:1746065229.220207:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14742 00000100:00100000:1.0:1746065229.220214:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+34:2799:x1830881265648640:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:1.0:1746065229.220230:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1746065229.220258:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b400/0xad6b7ddc147b2b0 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6b6 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.220338:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b2b7 lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.220349:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.220357:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b2b7 lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:1.0:1746065229.220367:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00010000:00010000:1.0:1746065229.220707:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5b400/0xad6b7ddc147b2b0 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6b6 expref: 37 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.220720:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b2b7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6b6 expref: 36 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.220727:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065229.220730:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1746065229.220732:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008ec5a400, rc 0) 00000100:00100000:1.0:1746065229.221333:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097c0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2799:x1830881265648640:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 1118us (1399us total) trans 8589937272 rc 0/0 00000100:00100000:1.0:1746065229.221339:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14742 00000100:00100000:1.0:1746065229.225291:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.225324:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.225337:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.225369:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.225381:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.225403:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.225425:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265648768 00000100:00100000:1.0:1746065229.225432:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265648768 00000100:00100000:1.0:1746065229.225469:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265648896 00000100:00100000:1.0:1746065229.225471:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265648896 00000100:00100000:1.0:1746065229.225481:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265649152 00000100:00100000:1.0:1746065229.225482:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265649152 00000100:00100000:1.0:1746065229.225490:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265649408 00000100:00100000:1.0:1746065229.225491:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265649408 00000100:00100000:1.0:1746065229.225498:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265649024 00000100:00100000:1.0:1746065229.225500:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265649024 00000100:00100000:1.0:1746065229.225506:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265649280 00000100:00100000:1.0:1746065229.225508:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265649280 00000100:00100000:1.0:1746065229.225517:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18228 00000100:00100000:1.0:1746065229.225523:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265648768:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:1.0:1746065229.225559:0:10219:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.225573:0:10219:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.225579:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065229.225581:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:1.0:1746065229.225583:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.225607:0:10219:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 29 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.225616:0:10219:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 29 pid: 11461 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746065229.225632:0:10219:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264097408:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065229.226056:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18229 00000100:00100000:2.0:1746065229.226064:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265648896:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065229.226082:0:11461:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.226091:0:11461:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090684a00/0xad6b7ddc147b27f lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a69a expref: 23 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.226101:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.226102:0:11461:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.226104:0:11461:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 4/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.226118:0:11461:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090684a00/0xad6b7ddc147b27f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a69a expref: 23 pid: 3067 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.226125:0:11461:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090684a00/0xad6b7ddc147b27f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a69a expref: 23 pid: 3067 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746065229.226133:0:11461:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264097536:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065229.226208:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18230 00000100:00100000:0.0:1746065229.226214:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265649152:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065229.226230:0:3067:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.226249:0:3067:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88012c489400/0xad6b7ddc147b11a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ac expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.226256:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.226257:0:3067:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.226259:0:3067:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.226278:0:3067:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88012c489400/0xad6b7ddc147b11a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ac expref: 29 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.226286:0:3067:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88012c489400/0xad6b7ddc147b11a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ac expref: 29 pid: 3067 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746065229.226293:0:3067:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264097664:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065229.226321:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18231 00000100:00100000:0.0:1746065229.226326:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265649408:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065229.226340:0:3068:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.226349:0:3068:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 23 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.226354:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065229.226355:0:3068:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 1 00010000:00010000:0.0:1746065229.226357:0:3068:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 4/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.226370:0:3068:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x50000000020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 23 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.226377:0:3068:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x70000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 23 pid: 11461 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746065229.226389:0:3068:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097c0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264097792:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065229.226416:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18232 00000100:00100000:0.0:1746065229.226421:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265649024:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:0.0:1746065229.226437:0:9549:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.226446:0:9549:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b286 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a1 expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.226451:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.226452:0:9549:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.226454:0:9549:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.226469:0:9549:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b286 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a1 expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.226476:0:9549:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b286 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a1 expref: 23 pid: 10219 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746065229.226483:0:9549:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264097920:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065229.226637:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18233 00000100:00100000:2.0:1746065229.226643:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265649280:12345-192.168.202.27@tcp:1:lfs.0 00010000:00010000:2.0:1746065229.226659:0:12260:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.226667:0:12260:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc147b1bb lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a62a expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.226672:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.226673:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.226674:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.226688:0:12260:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc147b1bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a62a expref: 29 pid: 1880 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.226695:0:12260:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc147b1bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a62a expref: 29 pid: 1880 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746065229.226703:0:12260:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264098048:192.168.202.27@tcp:104: 00000100:00080000:1.0:1746065229.226843:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1746065229.227214:0:10219:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b48cd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1746065229.227279:0:11461:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800b1b2b840 going to sleep for 11 seconds 00000100:00100000:0.0:1746065229.227566:0:3067:0:(client.c:2553:ptlrpc_set_wait()) set ffff880099a20e40 going to sleep for 11 seconds 00000100:00100000:2.0:1746065229.227605:0:3068:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090794600 going to sleep for 11 seconds 00000100:00100000:0.0:1746065229.227664:0:9549:0:(client.c:2553:ptlrpc_set_wait()) set ffff8800929c4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1746065229.227723:0:12260:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435540 going to sleep for 11 seconds 00000100:00100000:1.0:1746065229.230364:0:10219:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fd1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10219:1830881264097408:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065229.230384:0:10219:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065229.230731:0:3067:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c0ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_006:lustre-OST0001_UUID:3067:1830881264097664:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065229.230742:0:3067:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065229.230821:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.230837:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.231019:0:3068:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097c0d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_007:lustre-OST0000_UUID:3068:1830881264097792:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065229.231033:0:3068:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 3/0,1 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065229.231082:0:9549:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88008f3e6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:9549:1830881264097920:192.168.202.27@tcp:104: 00010000:00010000:1.0:1746065229.231092:0:9549:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.231161:0:11461:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11461:1830881264097536:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065229.231172:0:11461:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065229.231221:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.231235:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.231330:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.231348:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265649664 00000100:00100000:0.0:1746065229.231353:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265649664 00010000:00010000:0.0:1746065229.231381:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090684a00/0xad6b7ddc147b27f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a69a expref: 24 pid: 3067 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746065229.231407:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265649920 00000100:00100000:0.0:1746065229.231409:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265649920 00010000:00010000:0.0:1746065229.231417:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b286 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a1 expref: 25 pid: 10219 timeout: 925 lvb_type: 1 00000100:00100000:0.0:1746065229.231429:0:7192:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265649792 00000100:00100000:0.0:1746065229.231431:0:7192:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265649792 00010000:00010000:0.0:1746065229.231439:0:7192:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88012c489400/0xad6b7ddc147b11a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ac expref: 30 pid: 3067 timeout: 925 lvb_type: 0 00000100:00100000:0.0:1746065229.231452:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8530 00000100:00100000:0.0:1746065229.231458:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265649664:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065229.231467:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065229.231482:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090684a00/0xad6b7ddc147b27f lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a69a expref: 25 pid: 3067 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746065229.231491:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090684a00/0xad6b7ddc147b27f lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a69a expref: 25 pid: 3067 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746065229.231510:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090684a00/0xad6b7ddc147b27f lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a69a expref: 25 pid: 3067 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746065229.231526:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.231527:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.231531:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.231537:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.231551:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065229.231583:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265649664:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 125us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.231589:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8530 00000100:00100000:0.0:1746065229.231601:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8531 00000100:00100000:0.0:1746065229.231605:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265649920:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1746065229.231612:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1746065229.231619:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b286 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a1 expref: 23 pid: 10219 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746065229.231626:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b286 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a1 expref: 23 pid: 10219 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746065229.231636:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880090684e00/0xad6b7ddc147b286 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6a1 expref: 23 pid: 10219 timeout: 925 lvb_type: 1 00010000:00010000:0.0:1746065229.231643:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.231645:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.231647:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.231652:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065229.232355:0:10893:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8532 00000100:00100000:1.0:1746065229.232362:0:10893:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265649792:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065229.232370:0:10893:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065229.232382:0:10893:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88012c489400/0xad6b7ddc147b11a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ac expref: 30 pid: 3067 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.232391:0:10893:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88012c489400/0xad6b7ddc147b11a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ac expref: 30 pid: 3067 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.232409:0:10893:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88012c489400/0xad6b7ddc147b11a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a5ac expref: 30 pid: 3067 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.232418:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.232420:0:10893:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.232422:0:10893:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.232429:0:10893:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.232443:0:10893:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1746065229.232460:0:10893:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265649792:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 99us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.232464:0:10893:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8532 00010000:00010000:1.0:1746065229.232479:0:3067:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.232485:0:3067:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.232498:0:3067:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.232504:0:3067:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.232513:0:3067:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.232519:0:3067:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46400 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065229.232521:0:3067:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.232527:0:3067:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.232534:0:3067:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.232539:0:3067:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880129f46400/0xad6b7ddc147b2d3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3067 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065229.232569:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265649152:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 6356us (7231us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.232575:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18230 00000100:00100000:3.0:1746065229.232642:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265649536 00000100:00100000:3.0:1746065229.232646:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265649536 00002000:00100000:3.0:1746065229.232678:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (86016->380927) req@ffff88008f3e7480 x1830881265649536/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:145/0 lens 488/0 e 0 to 0 dl 1746065240 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065229.232685:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7480 with x1830881265649536 ext(86016->380927) 00010000:00010000:3.0:1746065229.232690:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 28 pid: 11461 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746065229.232699:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 28 pid: 11461 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746065229.232704:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3e7480 00000100:00100000:3.0:1746065229.232714:0:29491:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265650048 00000100:00100000:3.0:1746065229.232716:0:29491:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265650048 00002000:00100000:3.0:1746065229.232724:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_007: refresh rw locks for [0x280000401:0x96:0x0] (2330624->2555903) req@ffff880091aa5c00 x1830881265650048/t0(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:145/0 lens 488/0 e 0 to 0 dl 1746065240 ref 1 fl New:/200/ffffffff rc 0/-1 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065229.232730:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa5c00 with x1830881265650048 ext(2330624->2555903) 00010000:00010000:3.0:1746065229.232733:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 23 pid: 11461 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746065229.232739:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 23 pid: 11461 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746065229.232743:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091aa5c00 00000100:00100000:3.0:1746065229.232751:0:29491:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2138 00000100:00100000:3.0:1746065229.232755:0:29491:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265649536:12345-192.168.202.27@tcp:4:multiop.0 00000100:00100000:3.0:1746065229.232850:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 2139 00000100:00100000:3.0:1746065229.232854:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265650048:12345-192.168.202.27@tcp:4:multiop.0 00010000:00010000:2.0:1746065229.233179:0:11461:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.233187:0:11461:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.233198:0:11461:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.233204:0:11461:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.233208:0:11461:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.233217:0:11461:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065229.233219:0:11461:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.233225:0:11461:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.233235:0:11461:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.233255:0:11461:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b2cc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11461 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.233294:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265648896:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 7232us (7970us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.233300:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18229 00010000:00010000:0.0:1746065229.234129:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065229.234179:0:9549:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.234185:0:9549:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.234198:0:9549:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.234204:0:9549:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.234209:0:9549:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.234213:0:9549:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065229.234216:0:9549:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.234222:0:9549:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.234230:0:9549:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.234236:0:9549:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46600/0xad6b7ddc147b2e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9549 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065229.234441:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265649920:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2832us (3202us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.234449:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8531 00000100:00100000:1.0:1746065229.236134:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265649024:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 9704us (10742us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.236144:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18232 00000100:00100000:0.0:1746065229.236501:0:12260:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880099cf1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_009:lustre-OST0001_UUID:12260:1830881264098048:192.168.202.27@tcp:104: 00010000:00010000:0.0:1746065229.236523:0:12260:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.243440:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.243515:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265650176 00000100:00100000:1.0:1746065229.243523:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265650176 00010000:00010000:1.0:1746065229.243549:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc147b1bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a62a expref: 30 pid: 1880 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746065229.243584:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8533 00000100:00100000:1.0:1746065229.243591:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265650176:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065229.243605:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065229.243621:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc147b1bb lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a62a expref: 30 pid: 1880 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.243632:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc147b1bb lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a62a expref: 30 pid: 1880 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.243652:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88009abad200/0xad6b7ddc147b1bb lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->3145727) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a62a expref: 30 pid: 1880 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.243669:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.243671:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.243674:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.243681:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.243698:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1746065229.243721:0:12260:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.243729:0:12260:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065229.243732:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265650176:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 142us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.243738:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8533 00010000:00010000:0.0:1746065229.243743:0:12260:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.243749:0:12260:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.243755:0:12260:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.243760:0:12260:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065229.243763:0:12260:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.243769:0:12260:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.243796:0:12260:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.243802:0:12260:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b2e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1746065229.243844:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265649280:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 17201us (18440us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.243851:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18233 00000100:00100000:0.0:1746065229.246016:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+22:2007:x1830881265650048:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 13154us (15172us total) trans 21474841829 rc 0/0 00000100:00100000:0.0:1746065229.246027:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2139 00002000:00100000:0.0:1746065229.246036:0:29490:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_006: refresh rw locks for [0x280000401:0x96:0x0] (2330624->2555903) req@ffff880091aa5c00 x1830881265650048/t21474841829(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:145/0 lens 488/448 e 0 to 0 dl 1746065240 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:0.0:1746065229.246044:0:29490:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff880091aa5c00 with x1830881265650048 ext(2330624->2555903) 00010000:00010000:0.0:1746065229.246057:0:29490:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 22 pid: 11461 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746065229.246219:0:29491:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88008f3e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_007:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265649536:12345-192.168.202.27@tcp:4:multiop.0 Request processed in 13462us (15397us total) trans 17179874455 rc 0/0 00000100:00100000:3.0:1746065229.246225:0:29491:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 2138 00002000:00100000:3.0:1746065229.246230:0:29491:0:(ofd_dev.c:2591:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_007: refresh rw locks for [0x2c0000401:0x75:0x0] (86016->380927) req@ffff88008f3e7480 x1830881265649536/t17179874455(0) o4->251e5313-64c6-436c-a0af-246328b144ca@192.168.202.27@tcp:145/0 lens 488/448 e 0 to 0 dl 1746065240 ref 1 fl Complete:H/200/0 rc 0/0 job:'multiop.0' uid:0 gid:0 00002000:00100000:3.0:1746065229.246236:0:29491:0:(ofd_dev.c:2450:ofd_prolong_extent_locks()) Prolong locks for req ffff88008f3e7480 with x1830881265649536 ext(86016->380927) 00010000:00010000:3.0:1746065229.246252:0:29491:0:(ldlm_extent.c:774:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 28 pid: 11461 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746065229.246268:0:29491:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 28 pid: 11461 timeout: 925 lvb_type: 0 00002000:00010000:3.0:1746065229.246274:0:29491:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff88008f3e7480 00010000:00010000:0.0:1746065229.246288:0:29490:0:(ldlm_lockd.c:608:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 22 pid: 11461 timeout: 925 lvb_type: 0 00002000:00010000:0.0:1746065229.246293:0:29490:0:(ofd_dev.c:2596:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff880091aa5c00 00000100:00100000:0.0:1746065229.253529:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.253592:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265650304 00000100:00100000:1.0:1746065229.253599:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265650304 00000100:00100000:0.0:1746065229.253602:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:1.0:1746065229.253628:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 28 pid: 11461 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746065229.253660:0:8352:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265650432 00000100:00100000:1.0:1746065229.253663:0:8352:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265650432 00010000:00010000:1.0:1746065229.253673:0:8352:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 22 pid: 11461 timeout: 925 lvb_type: 0 00000100:00100000:1.0:1746065229.253687:0:8352:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8534 00000100:00100000:1.0:1746065229.253693:0:8352:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265650304:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065229.253702:0:8352:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065229.253717:0:8352:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 28 pid: 11461 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.253726:0:8352:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 28 pid: 11461 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.253743:0:8352:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880098c1a200/0xad6b7ddc147b1c2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 86016->380927) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a623 expref: 28 pid: 11461 timeout: 925 lvb_type: 0 00000100:00100000:2.0:1746065229.253748:0:7192:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8535 00000100:00100000:2.0:1746065229.253756:0:7192:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+22:2006:x1830881265650432:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1746065229.253757:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.253759:0:8352:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.253762:0:8352:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.253763:0:7192:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1746065229.253769:0:8352:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065229.253786:0:7192:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065225 -> 1746065226 00002000:00010000:2.0:1746065229.253789:0:7192:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065225 -> 1746065226 00010000:00010000:2.0:1746065229.253793:0:7192:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x60000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 22 pid: 11461 timeout: 925 lvb_type: 0 00010000:00010000:2.0:1746065229.253806:0:7192:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x50000400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 22 pid: 11461 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.253809:0:8352:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065229.253818:0:7192:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800996bf600/0xad6b7ddc147b25c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2330624->2555903) gid 0 flags: 0x44801400020020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a68c expref: 22 pid: 11461 timeout: 925 lvb_type: 0 00010000:00010000:1.0:1746065229.253823:0:10219:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.253829:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.253829:0:10219:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.253830:0:7192:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.253833:0:7192:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.253838:0:7192:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.253843:0:10219:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.253849:0:10219:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.253851:0:7192:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065229.253856:0:10219:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.253860:0:10219:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6ca00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065229.253863:0:10219:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.253870:0:10219:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.253878:0:10219:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.253879:0:7192:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:251e5313-64c6-436c-a0af-246328b144ca+21:2006:x1830881265650432:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 125us (276us total) trans 0 rc 0/0 00010000:00010000:1.0:1746065229.253883:0:10219:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6ca00/0xad6b7ddc147b2c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.253885:0:7192:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8535 00000100:00100000:1.0:1746065229.253920:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2004:x1830881265648768:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 28396us (28636us total) trans 0 rc 0/0 00010000:00010000:2.0:1746065229.253972:0:3068:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.253979:0:3068:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.253989:0:3068:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.254000:0:3068:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.254005:0:3068:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.254010:0:3068:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880129f46000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065229.254012:0:3068:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.254018:0:3068:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.254026:0:3068:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.254032:0:3068:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b2da lrc: 0/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 3068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.254061:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+20:2004:x1830881265649408:12345-192.168.202.27@tcp:1:lfs.0 Request processed in 27735us (28692us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.254068:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18231 00000100:00100000:1.0:1746065229.254139:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18228 00000100:00100000:1.0:1746065229.254166:0:8352:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265650304:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 474us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.254171:0:8352:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8534 00000100:00100000:0.0:1746065229.258063:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.258297:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265650688 00000100:00100000:1.0:1746065229.258305:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265650688 00000100:00100000:1.0:1746065229.258351:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14743 00000100:00100000:1.0:1746065229.258358:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+36:2799:x1830881265650688:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:1.0:1746065229.258398:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1746065229.258419:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009577b800/0xad6b7ddc147b19f lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0xa/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a607 expref: 36 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.258434:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880098c1b600/0xad6b7ddc147b1ad lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a615 expref: 35 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.258445:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5aa00/0xad6b7ddc147b2a9 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6af expref: 34 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.258453:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065229.258456:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1746065229.258474:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.258483:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.258490:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000040:00080000:1.0:1746065229.258676:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1183, 88 off111952 00000004:00080000:1.0:1746065229.258683:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825276908862ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065229.258709:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1185, 88 off112128 00000004:00080000:1.0:1746065229.258713:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825276939228ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065229.258739:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1186, 88 off112216 00000004:00080000:1.0:1746065229.258741:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825276967705ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065229.258749:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1184, 88 off112040 00000004:00080000:1.0:1746065229.258751:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825276977922ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065229.258757:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1185, 88 off112128 00000004:00080000:1.0:1746065229.258759:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825276985625ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065229.258766:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1187, 88 off112304 00000004:00080000:1.0:1746065229.258768:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825276994505ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065229.258797:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1188, 88 off112392 00000004:00080000:1.0:1746065229.258800:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825277026578ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065229.258807:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1189, 88 off112480 00000004:00080000:1.0:1746065229.258809:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825277035918ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065229.258816:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1186, 88 off112216 00000004:00080000:1.0:1746065229.258819:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825277045345ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065229.258825:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1190, 88 off112568 00000004:00080000:1.0:1746065229.258828:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825277054115ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065229.258834:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1187, 88 off112304 00000004:00080000:1.0:1746065229.258836:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825277061948ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065229.258842:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1191, 88 off112656 00000004:00080000:1.0:1746065229.258844:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825277070573ns, next at 761143559853ns, rc = 0 00000040:00080000:1.0:1746065229.258856:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1188, 88 off112392 00000004:00080000:1.0:1746065229.258858:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825277084810ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065229.258865:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1189, 88 off112480 00000004:00080000:1.0:1746065229.258867:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825277093972ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065229.258875:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1190, 88 off112568 00000004:00080000:1.0:1746065229.258877:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825277103295ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065229.258883:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1191, 88 off112656 00000004:00080000:1.0:1746065229.258885:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825277111485ns, next at 761143591313ns, rc = 0 00000040:00080000:1.0:1746065229.258892:0:7204:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1192, 88 off112744 00000004:00080000:1.0:1746065229.258894:0:7204:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825277120833ns, next at 761143559853ns, rc = 0 00000001:00080000:2.0:1746065229.269770:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937273 is committed 00000004:00080000:2.0:1746065229.269795:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1170 committed 00000004:00080000:2.0:1746065229.269815:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1171 committed 00000004:00080000:2.0:1746065229.269827:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1170 committed 00000004:00080000:2.0:1746065229.269829:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1169 committed 00000004:00080000:2.0:1746065229.269831:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1168 committed 00000004:00080000:2.0:1746065229.269832:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1169 committed 00000004:00080000:2.0:1746065229.269833:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1167 committed 00000004:00080000:2.0:1746065229.269835:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1168 committed 00000004:00080000:2.0:1746065229.269836:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1166 committed 00000004:00080000:2.0:1746065229.269838:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1167 committed 00000004:00080000:2.0:1746065229.269839:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1166 committed 00000004:00080000:2.0:1746065229.269840:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1165 committed 00000004:00080000:2.0:1746065229.269842:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1165 committed 00000004:00080000:2.0:1746065229.269843:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1164 committed 00000004:00080000:2.0:1746065229.269845:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1164 committed 00000004:00080000:2.0:1746065229.269846:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1163 committed 00000004:00080000:2.0:1746065229.269848:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1163 committed 00000001:00100000:2.0:1746065229.269855:0:8138:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 02506576-29fe-43be-8266-ebca0ccafd52 00000001:00080000:2.0:1746065229.269861:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937270 is committed 00000001:00100000:2.0:1746065229.269863:0:8138:0:(tgt_lastrcvd.c:532:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3 00000001:00080000:2.0:1746065229.269866:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937269 is committed 00000020:00000080:2.0:1746065229.269872:0:8138:0:(genops.c:904:class_export_put()) final put ffff88012dfb6000/02506576-29fe-43be-8266-ebca0ccafd52 00000020:00000080:2.0:1746065229.269887:0:8138:0:(genops.c:904:class_export_put()) final put ffff8800ac558800/1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3 00000020:00000080:2.0:1746065229.269910:0:65:0:(genops.c:863:class_export_destroy()) destroying export ffff88012dfb6000/02506576-29fe-43be-8266-ebca0ccafd52 for lustre-MDT0000 00000020:00000080:2.0:1746065229.269952:0:65:0:(genops.c:863:class_export_destroy()) destroying export ffff8800ac558800/1e6a9ff3-e5c1-4ee4-b4fb-30a75d06e2c3 for lustre-MDT0000 00000020:00000080:2.0:1746065229.269970:0:65:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff88012dfb6800 for lustre-MDT0000 00000020:00000080:2.0:1746065229.269974:0:65:0:(genops.c:1202:obd_zombie_import_free()) destroying import ffff8800ac55a000 for lustre-MDT0000 00000100:00100000:0.0:1746065229.270180:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264098304:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.270232:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.270279:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264098816:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.270291:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264098560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.270294:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.270311:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1746065229.270315:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.270316:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264098688:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.270332:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264099072:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.270344:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065229.270357:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746065229.270361:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264098432:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.270373:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065229.270383:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264098944:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.270396:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065229.270414:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264098304 00000100:00100000:2.0:1746065229.270420:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264098304 00000100:00100000:2.0:1746065229.270453:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264098816 00000100:00100000:2.0:1746065229.270455:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264098816 00000100:00100000:2.0:1746065229.270464:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264098560 00000100:00100000:2.0:1746065229.270465:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264098560 00000100:00100000:2.0:1746065229.270473:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264099072 00000100:00100000:2.0:1746065229.270474:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264099072 00000100:00100000:2.0:1746065229.270481:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264098432 00000100:00100000:2.0:1746065229.270483:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264098432 00000100:00100000:2.0:1746065229.270489:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264098944 00000100:00100000:2.0:1746065229.270490:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264098944 00000100:00100000:2.0:1746065229.270499:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18234 00000100:00100000:2.0:1746065229.270504:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881264098304:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.270626:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3762:x1830881264098304:12345-0@lo:2:osp-syn-1-0.0 Request processed in 122us (394us total) trans 17179874456 rc 0/0 00000100:00100000:2.0:1746065229.270632:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18234 00000100:00100000:2.0:1746065229.270644:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18235 00000100:00100000:2.0:1746065229.270647:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881264098816:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.270703:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3762:x1830881264098816:12345-0@lo:2:osp-syn-1-0.0 Request processed in 55us (408us total) trans 17179874457 rc 0/0 00000100:00100000:2.0:1746065229.270708:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18235 00000100:00100000:2.0:1746065229.270717:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18236 00000100:00100000:2.0:1746065229.270721:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881264098560:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.270793:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3760:x1830881264098560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 71us (476us total) trans 17179874458 rc 0/0 00000100:00100000:2.0:1746065229.270797:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18236 00000100:00100000:2.0:1746065229.270806:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18237 00000100:00100000:2.0:1746065229.270810:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881264099072:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.270853:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3760:x1830881264099072:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (508us total) trans 17179874459 rc 0/0 00000100:00100000:2.0:1746065229.270858:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18237 00000100:00100000:2.0:1746065229.270866:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18238 00000100:00100000:2.0:1746065229.270869:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881264098432:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.270914:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3760:x1830881264098432:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (540us total) trans 17179874460 rc 0/0 00000100:00100000:2.0:1746065229.270918:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18238 00000100:00100000:2.0:1746065229.270924:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18239 00000100:00100000:2.0:1746065229.270928:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+10:3760:x1830881264098944:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.270969:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+11:3760:x1830881264098944:12345-0@lo:2:osp-syn-1-0.0 Request processed in 41us (572us total) trans 17179874461 rc 0/0 00000100:00100000:2.0:1746065229.270974:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18239 00000100:00080000:2.0:1746065229.270986:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065229.271014:0:3760:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 17179874454 gen 2 00000004:00080000:2.0:1746065229.271017:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834d880, transno 17179874342 00000004:00080000:2.0:1746065229.271023:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615ed80, transno 17179874343 00000004:00080000:2.0:1746065229.271025:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834e680, transno 17179874344 00000004:00080000:2.0:1746065229.271027:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834c700, transno 17179874345 00000004:00080000:2.0:1746065229.271029:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834c380, transno 17179874346 00000004:00080000:2.0:1746065229.271032:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834d180, transno 17179874347 00000004:00080000:2.0:1746065229.271034:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834ca80, transno 17179874348 00000004:00080000:2.0:1746065229.271035:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834dc00, transno 17179874349 00000004:00080000:2.0:1746065229.271038:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091bc0700, transno 17179874350 00000004:00080000:2.0:1746065229.271040:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52b480, transno 17179874353 00000004:00080000:2.0:1746065229.271042:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077c700, transno 17179874354 00000004:00080000:2.0:1746065229.271044:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077c000, transno 17179874355 00000004:00080000:2.0:1746065229.271046:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077df80, transno 17179874356 00000004:00080000:2.0:1746065229.271048:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c529c00, transno 17179874357 00000004:00080000:2.0:1746065229.271050:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528380, transno 17179874358 00000004:00080000:2.0:1746065229.271051:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52a300, transno 17179874359 00000004:00080000:2.0:1746065229.271053:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009077f800, transno 17179874360 00000004:00080000:2.0:1746065229.271055:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528e00, transno 17179874361 00000004:00080000:2.0:1746065229.271057:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c45a680, transno 17179874362 00000004:00080000:2.0:1746065229.271059:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c459500, transno 17179874363 00000004:00080000:2.0:1746065229.271061:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856d500, transno 17179874364 00000004:00080000:2.0:1746065229.271063:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c458a80, transno 17179874365 00000004:00080000:2.0:1746065229.271064:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c459880, transno 17179874366 00000004:00080000:2.0:1746065229.271066:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c45bb80, transno 17179874367 00000004:00080000:2.0:1746065229.271068:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856c700, transno 17179874368 00000004:00080000:2.0:1746065229.271070:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c45b480, transno 17179874369 00000004:00080000:2.0:1746065229.271072:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a6d180, transno 17179874370 00000004:00080000:2.0:1746065229.271074:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135138a80, transno 17179874381 00000004:00080000:2.0:1746065229.271076:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984db100, transno 17179874382 00000004:00080000:2.0:1746065229.271078:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135139880, transno 17179874383 00000004:00080000:2.0:1746065229.271080:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135138e00, transno 17179874384 00000004:00080000:2.0:1746065229.271081:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135138000, transno 17179874385 00000004:00080000:2.0:1746065229.271083:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513a300, transno 17179874386 00000004:00080000:2.0:1746065229.271085:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013513bb80, transno 17179874387 00000004:00080000:2.0:1746065229.271087:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135139180, transno 17179874388 00000004:00080000:2.0:1746065229.271089:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac65f80, transno 17179874389 00000004:00080000:2.0:1746065229.271091:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac64e00, transno 17179874394 00000004:00080000:2.0:1746065229.271093:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac67100, transno 17179874395 00000004:00080000:2.0:1746065229.271095:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac66a00, transno 17179874396 00000004:00080000:2.0:1746065229.271097:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac65c00, transno 17179874397 00000004:00080000:2.0:1746065229.271099:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac66300, transno 17179874398 00000004:00080000:2.0:1746065229.271101:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac67480, transno 17179874399 00000004:00080000:2.0:1746065229.271103:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3d180, transno 17179874400 00000004:00080000:2.0:1746065229.271105:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac64a80, transno 17179874401 00000004:00080000:2.0:1746065229.271107:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac66d80, transno 17179874402 00000004:00080000:2.0:1746065229.271109:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d8700, transno 17179874403 00000004:00080000:2.0:1746065229.271110:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e50e00, transno 17179874404 00000004:00080000:2.0:1746065229.271112:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d8a80, transno 17179874405 00000004:00080000:2.0:1746065229.271114:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984da680, transno 17179874406 00000004:00080000:2.0:1746065229.271116:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984d8380, transno 17179874407 00000004:00080000:2.0:1746065229.271117:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a7800, transno 17179874408 00000004:00080000:2.0:1746065229.271119:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800984dbb80, transno 17179874409 00000004:00080000:2.0:1746065229.271121:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f1a4380, transno 17179874410 00000004:00080000:2.0:1746065229.271123:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f1180, transno 17179874411 00000004:00080000:2.0:1746065229.271125:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1500, transno 17179874413 00000004:00080000:2.0:1746065229.271127:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f2a00, transno 17179874414 00000004:00080000:2.0:1746065229.271129:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1c00, transno 17179874415 00000004:00080000:2.0:1746065229.271130:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d29500, transno 17179874416 00000004:00080000:2.0:1746065229.271132:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f0a80, transno 17179874417 00000004:00080000:2.0:1746065229.271133:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1180, transno 17179874418 00000004:00080000:2.0:1746065229.271135:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f1f80, transno 17179874419 00000004:00080000:2.0:1746065229.271137:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009c5f3b80, transno 17179874420 00000004:00080000:2.0:1746065229.271139:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098ddb100, transno 17179874421 00000004:00080000:2.0:1746065229.271140:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856ed80, transno 17179874422 00000004:00080000:2.0:1746065229.271142:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856f100, transno 17179874423 00000004:00080000:2.0:1746065229.271144:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856d880, transno 17179874424 00000004:00080000:2.0:1746065229.271146:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856ca80, transno 17179874425 00000004:00080000:2.0:1746065229.271148:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009856f800, transno 17179874426 00000004:00080000:2.0:1746065229.271149:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6de680, transno 17179874427 00000004:00080000:2.0:1746065229.271151:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012dc3f800, transno 17179874428 00000004:00080000:2.0:1746065229.271153:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6dd880, transno 17179874429 00000004:00080000:2.0:1746065229.271155:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009a6ddf80, transno 17179874430 00000004:00080000:2.0:1746065229.271156:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd4700, transno 17179874437 00000004:00080000:2.0:1746065229.271158:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b03100, transno 17179874438 00000004:00080000:2.0:1746065229.271160:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd5c00, transno 17179874439 00000004:00080000:2.0:1746065229.271162:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099bd5500, transno 17179874440 00000004:00080000:2.0:1746065229.271164:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b00700, transno 17179874441 00000004:00080000:2.0:1746065229.271166:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b00e00, transno 17179874442 00000004:00080000:2.0:1746065229.271167:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b02300, transno 17179874443 00000004:00080000:2.0:1746065229.271169:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d04a80, transno 17179874444 00000004:00080000:2.0:1746065229.271171:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880134b02680, transno 17179874445 00000004:00080000:2.0:1746065229.271173:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd8a80, transno 17179874446 00000004:00080000:2.0:1746065229.271175:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd9880, transno 17179874447 00000004:00080000:2.0:1746065229.271176:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099e12680, transno 17179874448 00000004:00080000:2.0:1746065229.271178:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092746d80, transno 17179874449 00000004:00080000:2.0:1746065229.271180:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098ddb800, transno 17179874450 00000004:00080000:2.0:1746065229.271182:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092747100, transno 17179874451 00000004:00080000:2.0:1746065229.271183:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880098dd8000, transno 17179874452 00000004:00080000:2.0:1746065229.271185:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880092745500, transno 17179874453 00000004:00080000:2.0:1746065229.271187:0:3760:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa8a80, transno 17179874454 00000100:00100000:2.0:1746065229.271192:0:3760:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880091aa6680 x1830881264098432/t17179874460(17179874460) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065245 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 00000004:00080000:2.0:1746065229.271200:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa6680/2, rc 0, transno 17179874460 00000100:00100000:2.0:1746065229.271203:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264098432:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065229.271213:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa7b80/2, rc 0, transno 17179874461 00000100:00100000:2.0:1746065229.271216:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264098944:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065229.271221:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa5500/2, rc 0, transno 17179874458 00000100:00100000:2.0:1746065229.271224:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264098560:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065229.271229:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa4a80/2, rc 0, transno 17179874459 00000100:00100000:2.0:1746065229.271231:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264099072:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.271458:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.271481:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264099200:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.271495:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1746065229.271510:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa7480/2, rc 0, transno 17179874456 00000100:00100000:0.0:1746065229.271513:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264098304:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065229.271520:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa4380/2, rc 0, transno 17179874457 00000100:00100000:0.0:1746065229.271522:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264098816:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065229.271840:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264099328:0@lo:2:osp-syn-0-0.0 00000004:00080000:0.0:1746065229.271858:0:8154:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0001-osc-MDT0000: 1 changes, 8 in progress, 2 in flight, 90 done 00000100:00100000:3.0:1746065229.271862:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.271876:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264099840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065229.271877:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264099584:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.271889:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065229.271996:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264098688 00000100:00100000:1.0:1746065229.272001:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264098688 00000100:00100000:1.0:1746065229.272019:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264099200 00000100:00100000:1.0:1746065229.272021:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264099200 00000100:00100000:1.0:1746065229.272027:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264099328 00000100:00100000:1.0:1746065229.272029:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264099328 00000100:00100000:1.0:1746065229.272043:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264099840 00000100:00100000:1.0:1746065229.272044:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264099840 00000100:00100000:1.0:1746065229.272052:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18240 00000100:00100000:1.0:1746065229.272057:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881264098688:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065229.272121:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881264098688:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (662us total) trans 17179874462 rc 0/0 00000100:00100000:1.0:1746065229.272126:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18240 00000100:00100000:1.0:1746065229.272137:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18241 00000100:00100000:1.0:1746065229.272141:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+12:3762:x1830881264099200:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1746065229.272186:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881264099200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 45us (690us total) trans 17179874463 rc 0/0 00000100:00100000:1.0:1746065229.272194:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18241 00000100:00100000:1.0:1746065229.272201:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18242 00000100:00100000:1.0:1746065229.272205:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3759:x1830881264099328:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065229.272276:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3759:x1830881264099328:12345-0@lo:2:osp-syn-0-0.0 Request processed in 70us (412us total) trans 21474841830 rc 0/0 00000100:00100000:1.0:1746065229.272281:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18242 00000100:00100000:1.0:1746065229.272289:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18243 00000100:00100000:1.0:1746065229.272292:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3759:x1830881264099840:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065229.272329:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3759:x1830881264099840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 37us (439us total) trans 21474841831 rc 0/0 00000100:00100000:1.0:1746065229.272333:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18243 00000100:00080000:1.0:1746065229.272347:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00010000:1.0:1746065229.272373:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880091aa4700 reply state ffff8800984bb000 transno 8589937273 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.272387:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.272394:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065229.272397:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:1.0:1746065229.272400:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00080000:1.0:1746065229.272450:0:7204:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1746065229.272459:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2799:x1830881265650688:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 14100us (14402us total) trans 8589937273 rc 0/0 00000100:00100000:1.0:1746065229.272464:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14743 00010000:00010000:1.0:1746065229.272478:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.272488:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.272493:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.272497:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6da00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065229.272500:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.272506:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.272513:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065229.272515:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1746065229.272517:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.272521:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f6da00/0xad6b7ddc147b2ef lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00000100:00100000:3.0:1746065229.272619:0:3759:0:(client.c:2927:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 21474841826 gen 2 00000004:00080000:3.0:1746065229.272622:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615c700, transno 21474841714 00000004:00080000:3.0:1746065229.272627:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615ca80, transno 21474841715 00000004:00080000:3.0:1746065229.272629:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615dc00, transno 21474841716 00000004:00080000:3.0:1746065229.272631:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615d880, transno 21474841717 00000004:00080000:3.0:1746065229.272633:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615c380, transno 21474841718 00000004:00080000:3.0:1746065229.272635:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615e300, transno 21474841719 00000004:00080000:3.0:1746065229.272636:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615e680, transno 21474841720 00000004:00080000:3.0:1746065229.272638:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88013615d180, transno 21474841721 00000004:00080000:3.0:1746065229.272640:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf4000, transno 21474841723 00000004:00080000:3.0:1746065229.272642:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf6d80, transno 21474841724 00000004:00080000:3.0:1746065229.272644:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf5880, transno 21474841725 00000004:00080000:3.0:1746065229.272646:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4ead80, transno 21474841726 00000004:00080000:3.0:1746065229.272648:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf5f80, transno 21474841727 00000004:00080000:3.0:1746065229.272762:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4eaa00, transno 21474841728 00000004:00080000:3.0:1746065229.272764:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4e8700, transno 21474841729 00000004:00080000:3.0:1746065229.272766:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009adf4700, transno 21474841730 00000004:00080000:3.0:1746065229.272768:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fdc00, transno 21474841732 00000004:00080000:3.0:1746065229.272770:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fc380, transno 21474841733 00000004:00080000:3.0:1746065229.272786:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fea00, transno 21474841734 00000004:00080000:3.0:1746065229.272788:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd880, transno 21474841735 00000004:00080000:3.0:1746065229.272790:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e4380, transno 21474841736 00000004:00080000:3.0:1746065229.272792:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e5500, transno 21474841737 00000004:00080000:3.0:1746065229.272794:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f7fd500, transno 21474841738 00000004:00080000:3.0:1746065229.272796:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e6a00, transno 21474841739 00000004:00080000:3.0:1746065229.272798:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c529880, transno 21474841741 00000004:00080000:3.0:1746065229.272799:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528700, transno 21474841742 00000004:00080000:3.0:1746065229.272801:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c529180, transno 21474841743 00000004:00080000:3.0:1746065229.272803:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4e8a80, transno 21474841744 00000004:00080000:3.0:1746065229.272805:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4e8000, transno 21474841745 00000004:00080000:3.0:1746065229.272807:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c528000, transno 21474841746 00000004:00080000:3.0:1746065229.272809:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008c52b100, transno 21474841747 00000004:00080000:3.0:1746065229.272810:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012b4eb800, transno 21474841748 00000004:00080000:3.0:1746065229.272812:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e50700, transno 21474841761 00000004:00080000:3.0:1746065229.272814:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e50a80, transno 21474841762 00000004:00080000:3.0:1746065229.272816:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e53800, transno 21474841763 00000004:00080000:3.0:1746065229.272818:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e52a00, transno 21474841764 00000004:00080000:3.0:1746065229.272820:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e50000, transno 21474841765 00000004:00080000:3.0:1746065229.272821:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e51c00, transno 21474841766 00000004:00080000:3.0:1746065229.272823:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e51880, transno 21474841767 00000004:00080000:3.0:1746065229.272825:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800a4e53480, transno 21474841768 00000004:00080000:3.0:1746065229.272827:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf2300, transno 21474841773 00000004:00080000:3.0:1746065229.272829:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad7800, transno 21474841774 00000004:00080000:3.0:1746065229.272830:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad4700, transno 21474841775 00000004:00080000:3.0:1746065229.272832:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88011dad6300, transno 21474841776 00000004:00080000:3.0:1746065229.272834:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135221f80, transno 21474841777 00000004:00080000:3.0:1746065229.272836:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135220000, transno 21474841778 00000004:00080000:3.0:1746065229.272838:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880099cf0700, transno 21474841779 00000004:00080000:3.0:1746065229.272840:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880135220700, transno 21474841780 00000004:00080000:3.0:1746065229.272842:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a91180, transno 21474841781 00000004:00080000:3.0:1746065229.272844:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a90380, transno 21474841782 00000004:00080000:3.0:1746065229.272846:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a7a680, transno 21474841783 00000004:00080000:3.0:1746065229.272848:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a79c00, transno 21474841784 00000004:00080000:3.0:1746065229.272850:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880136a78a80, transno 21474841785 00000004:00080000:3.0:1746065229.272851:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880091a90000, transno 21474841786 00000004:00080000:3.0:1746065229.272853:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9500, transno 21474841787 00000004:00080000:3.0:1746065229.272855:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800957d9180, transno 21474841788 00000004:00080000:3.0:1746065229.272857:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d28a80, transno 21474841791 00000004:00080000:3.0:1746065229.272859:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0e00, transno 21474841792 00000004:00080000:3.0:1746065229.272861:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f3b80, transno 21474841793 00000004:00080000:3.0:1746065229.272863:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bf800, transno 21474841794 00000004:00080000:3.0:1746065229.272865:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d2b800, transno 21474841795 00000004:00080000:3.0:1746065229.272866:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bfb80, transno 21474841796 00000004:00080000:3.0:1746065229.272868:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800900f0000, transno 21474841797 00000004:00080000:3.0:1746065229.272870:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff8800907bf480, transno 21474841798 00000004:00080000:3.0:1746065229.272871:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a6d880, transno 21474841799 00000004:00080000:3.0:1746065229.272873:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a6df80, transno 21474841800 00000004:00080000:3.0:1746065229.272875:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a6e680, transno 21474841801 00000004:00080000:3.0:1746065229.272877:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a6f100, transno 21474841802 00000004:00080000:3.0:1746065229.272879:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a6c700, transno 21474841803 00000004:00080000:3.0:1746065229.272880:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac65180, transno 21474841804 00000004:00080000:3.0:1746065229.272882:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097a6c380, transno 21474841805 00000004:00080000:3.0:1746065229.272884:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009ac66680, transno 21474841806 00000004:00080000:3.0:1746065229.272886:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097fa9880, transno 21474841811 00000004:00080000:3.0:1746065229.272888:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3c2680, transno 21474841812 00000004:00080000:3.0:1746065229.272890:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e7b80, transno 21474841813 00000004:00080000:3.0:1746065229.272891:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e4000, transno 21474841814 00000004:00080000:3.0:1746065229.272893:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009834d500, transno 21474841815 00000004:00080000:3.0:1746065229.272896:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e5c00, transno 21474841816 00000004:00080000:3.0:1746065229.272898:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88012f3c0a80, transno 21474841817 00000004:00080000:3.0:1746065229.272900:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88008f3e5880, transno 21474841818 00000004:00080000:3.0:1746065229.272902:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d05180, transno 21474841819 00000004:00080000:3.0:1746065229.272904:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d07100, transno 21474841820 00000004:00080000:3.0:1746065229.272906:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090dd9c00, transno 21474841821 00000004:00080000:3.0:1746065229.272908:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090dd9880, transno 21474841822 00000004:00080000:3.0:1746065229.272910:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090ddbb80, transno 21474841823 00000004:00080000:3.0:1746065229.272912:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff88009acedf80, transno 21474841824 00000004:00080000:3.0:1746065229.272913:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880097d05f80, transno 21474841825 00000004:00080000:3.0:1746065229.272915:0:3759:0:(osp_sync.c:507:osp_sync_request_commit_cb()) commit req ffff880090ddaa00, transno 21474841826 00000100:00100000:3.0:1746065229.272920:0:3759:0:(client.c:2971:ptlrpc_free_committed()) @@@ stopping search req@ffff880092747100 x1830881264099840/t21474841831(21474841831) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1746065245 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 00000004:00080000:3.0:1746065229.272928:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092747100/2, rc 0, transno 21474841831 00000100:00100000:3.0:1746065229.272931:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264099840:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.272943:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092744e00/2, rc 0, transno 21474841830 00000100:00100000:3.0:1746065229.272946:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092744e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264099328:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.272949:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065229.272953:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264099456:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.272970:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.272992:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264099968:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.273002:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.273017:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264099456 00000100:00100000:3.0:1746065229.273019:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264099456 00000100:00100000:3.0:1746065229.273033:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264099968 00000100:00100000:3.0:1746065229.273034:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264099968 00000100:00100000:3.0:1746065229.273042:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18244 00000100:00100000:3.0:1746065229.273046:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881264099456:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.273103:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881264099456:12345-0@lo:2:osp-syn-0-0.0 Request processed in 56us (132us total) trans 21474841832 rc 0/0 00000100:00100000:3.0:1746065229.273108:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18244 00000100:00100000:3.0:1746065229.273116:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18245 00000100:00100000:3.0:1746065229.273120:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3759:x1830881264099968:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.273162:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3759:x1830881264099968:12345-0@lo:2:osp-syn-0-0.0 Request processed in 41us (158us total) trans 21474841833 rc 0/0 00000100:00100000:3.0:1746065229.273167:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18245 00000004:00080000:3.0:1746065229.273185:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092746680/2, rc 0, transno 21474841832 00000100:00100000:3.0:1746065229.273187:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264099456:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.273192:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092745500/2, rc 0, transno 21474841833 00000100:00100000:3.0:1746065229.273194:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264099968:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.273465:0:8152:0:(osp_sync.c:1188:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 8 in progress, 4 in flight, 88 done 00000100:00100000:3.0:1746065229.273477:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264098176:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.273495:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.273508:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264099712:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.273519:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.273529:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264100224:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065229.273540:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1746065229.273552:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa5880/2, rc 0, transno 17179874462 00000100:00100000:3.0:1746065229.273555:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264098688:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065229.273561:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880091aa4000/2, rc 0, transno 17179874463 00000100:00100000:3.0:1746065229.273563:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091aa4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264099200:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065229.273578:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264098176 00000100:00100000:3.0:1746065229.273581:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264098176 00000100:00100000:3.0:1746065229.273589:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264099712 00000100:00100000:3.0:1746065229.273591:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264099712 00000100:00100000:3.0:1746065229.273596:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264100224 00000100:00100000:3.0:1746065229.273597:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264100224 00000100:00100000:3.0:1746065229.273604:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18246 00000100:00100000:3.0:1746065229.273607:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881264098176:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.273660:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3762:x1830881264098176:12345-0@lo:2:osp-syn-0-0.0 Request processed in 52us (164us total) trans 21474841834 rc 0/0 00000100:00100000:3.0:1746065229.273665:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18246 00000100:00100000:3.0:1746065229.273673:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18247 00000100:00100000:3.0:1746065229.273677:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+10:3762:x1830881264099712:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.273720:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+11:3762:x1830881264099712:12345-0@lo:2:osp-syn-0-0.0 Request processed in 42us (200us total) trans 21474841835 rc 0/0 00000100:00100000:3.0:1746065229.273725:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18247 00000100:00100000:3.0:1746065229.273733:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18248 00000100:00100000:3.0:1746065229.273736:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+13:3762:x1830881264100224:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065229.273804:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881264100224:12345-0@lo:2:osp-syn-1-0.0 Request processed in 67us (262us total) trans 17179874464 rc 0/0 00000100:00100000:3.0:1746065229.273808:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18248 00000004:00080000:3.0:1746065229.273827:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092747480/2, rc 0, transno 21474841834 00000100:00100000:3.0:1746065229.273830:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092747480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264098176:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.273835:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092746d80/2, rc 0, transno 21474841835 00000100:00100000:3.0:1746065229.273837:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264099712:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.273843:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88011dad5c00/2, rc 0, transno 17179874464 00000100:00100000:3.0:1746065229.273846:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264100224:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.274576:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1746065229.274880:0:3067:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264099584 00000100:00100000:1.0:1746065229.274884:0:3067:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264099584 00000100:00100000:1.0:1746065229.274905:0:3067:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18249 00000100:00100000:1.0:1746065229.274910:0:3067:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+11:3761:x1830881264099584:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1746065229.274984:0:3067:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881264099584:12345-0@lo:2:osp-syn-0-0.0 Request processed in 74us (409us total) trans 21474841836 rc 0/0 00000100:00100000:1.0:1746065229.274989:0:3067:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18249 00000004:00080000:0.0:1746065229.275215:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092745880/2, rc 0, transno 21474841836 00000100:00100000:0.0:1746065229.275220:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092745880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264099584:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065229.275227:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264100096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065229.275256:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065229.275285:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264100096 00000100:00100000:2.0:1746065229.275289:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264100096 00000100:00100000:2.0:1746065229.275310:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18250 00000100:00100000:2.0:1746065229.275314:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+12:3761:x1830881264100096:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1746065229.275385:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+13:3761:x1830881264100096:12345-0@lo:2:osp-syn-0-0.0 Request processed in 71us (129us total) trans 21474841837 rc 0/0 00000100:00100000:2.0:1746065229.275389:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18250 00000004:00080000:0.0:1746065229.275395:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880092746a00/2, rc 0, transno 21474841837 00000100:00100000:0.0:1746065229.275399:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880092746a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264100096:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065229.275645:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.275677:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265650816 00000100:00100000:2.0:1746065229.275684:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265650816 00000100:00100000:2.0:1746065229.275705:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14744 00000100:00100000:2.0:1746065229.275709:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2799:x1830881265650816:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065229.275721:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065229.275733:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc147b2f6 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6bd expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.275796:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc147b2f6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6bd expref: 28 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.275807:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc147b2f6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6bd expref: 28 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.275827:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065229.275829:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065229.275832:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5c00, rc 0) 00000100:00100000:2.0:1746065229.275868:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2799:x1830881265650816:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 158us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.275873:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14744 00000100:00100000:1.0:1746065229.279320:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.279400:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265650944 00000100:00100000:2.0:1746065229.279406:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265650944 00000100:00100000:2.0:1746065229.279469:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14745 00000100:00100000:2.0:1746065229.279476:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2799:x1830881265650944:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065229.279491:0:7204:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065229.279505:0:7204:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc147b2fd lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6c4 expref: -99 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.279569:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc147b304 lrc: 3/1,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065229.279579:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc147b304 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065229.279588:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc147b304 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00200000:2.0:1746065229.279613:0:7204:0:(mdt_handler.c:907:mdt_pack_attr2body()) [0x200000404:0x31:0x0]: returning size 9228896 00000004:00200000:2.0:1746065229.280000:0:7204:0:(mdt_handler.c:1572:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1746065229.280015:0:7204:0:(mdt_handler.c:2489:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc147b304 lrc: 3/1,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065229.280035:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de4200/0xad6b7ddc147b2fd lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6c4 expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.280050:0:7204:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc147b304 lrc: 3/0,0 mode: PR/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6c4 expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.280057:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065229.280059:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1746065229.280062:0:7204:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5200, rc 0) 00000100:00100000:2.0:1746065229.280102:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2799:x1830881265650944:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 626us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.280107:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14745 00000100:00100000:0.0:1746065229.283304:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.283334:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.283358:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.283381:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.283394:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.283412:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265651072 00000100:00100000:0.0:1746065229.283418:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265651072 00000100:00100000:0.0:1746065229.283448:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265651200 00000100:00100000:0.0:1746065229.283449:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265651200 00000100:00100000:0.0:1746065229.283458:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265651328 00000100:00100000:0.0:1746065229.283460:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265651328 00000100:00100000:0.0:1746065229.283468:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265651456 00000100:00100000:0.0:1746065229.283469:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265651456 00000100:00100000:0.0:1746065229.283479:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265651584 00000100:00100000:0.0:1746065229.283481:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265651584 00000100:00100000:0.0:1746065229.283493:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18251 00000100:00100000:0.0:1746065229.283499:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265651072:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065229.283512:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065229.283527:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc147b30b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6cb expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065229.283548:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x75:0x0] initial LVB size: 1048576, mtime: 0x6812d74a, atime: 0x6812d748, ctime: 0x6812d74a, blocks: 0x800 00010000:00010000:0.0:1746065229.283564:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.283565:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.283572:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc147b30b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6cb expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.283583:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc147b30b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6cb expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.283592:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b8400, rc 0) 00000100:00100000:0.0:1746065229.283623:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265651072:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 124us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.283629:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18251 00000100:00100000:0.0:1746065229.283644:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18252 00000100:00100000:0.0:1746065229.283648:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881265651200:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065229.283660:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065229.283668:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b312 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6d2 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065229.283679:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x94:0x0] initial LVB size: 2097152, mtime: 0x6812d74a, atime: 0x6812d748, ctime: 0x6812d74a, blocks: 0x800 00010000:00010000:0.0:1746065229.283687:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.283688:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.283692:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b312 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d2 expref: 22 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.283701:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b312 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d2 expref: 22 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.283708:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880129f46000, rc 0) 00000100:00100000:0.0:1746065229.283727:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265651200:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 79us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.283732:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18252 00000100:00100000:0.0:1746065229.283743:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18253 00000100:00100000:0.0:1746065229.283746:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+21:2004:x1830881265651328:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065229.283752:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065229.283758:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147b319 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6d9 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065229.283766:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x95:0x0] initial LVB size: 2097152, mtime: 0x6812d74a, atime: 0x6812d749, ctime: 0x6812d74a, blocks: 0x808 00010000:00010000:0.0:1746065229.283791:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.283793:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.283796:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147b319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d9 expref: 22 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.283805:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147b319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d9 expref: 22 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.283811:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8800b53d1000, rc 0) 00000100:00100000:0.0:1746065229.283824:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092528380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265651328:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 77us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.283829:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18253 00000100:00100000:0.0:1746065229.283843:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18254 00000100:00100000:0.0:1746065229.283848:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265651456:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065229.283854:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065229.283860:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc147b320 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6e0 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065229.283869:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x77:0x0] initial LVB size: 2097152, mtime: 0x6812d749, atime: 0x6812d748, ctime: 0x6812d749, blocks: 0x808 00010000:00010000:0.0:1746065229.283875:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.283876:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.283879:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc147b320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e0 expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.283887:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc147b320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e0 expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.283892:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880131019c00, rc 0) 00000100:00100000:0.0:1746065229.283905:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009252b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265651456:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 58us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.283910:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18254 00000100:00100000:0.0:1746065229.283919:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18255 00000100:00100000:0.0:1746065229.283923:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+28:2004:x1830881265651584:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065229.283928:0:12260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065229.283934:0:12260:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc147b327 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6e7 expref: -99 pid: 12260 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065229.283943:0:12260:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x78:0x0] initial LVB size: 5034592, mtime: 0x6812d74a, atime: 0x6812d749, ctime: 0x6812d74a, blocks: 0x1678 00010000:00010000:0.0:1746065229.283949:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.283950:0:12260:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.283954:0:12260:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc147b327 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e7 expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.283961:0:12260:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc147b327 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e7 expref: 29 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.283967:0:12260:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88008f2b8600, rc 0) 00000100:00100000:0.0:1746065229.283981:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:251e5313-64c6-436c-a0af-246328b144ca+29:2004:x1830881265651584:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 58us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.283985:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18255 00000100:00100000:0.0:1746065229.284024:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.284038:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265651712 00000100:00100000:0.0:1746065229.284041:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265651712 00000100:00100000:0.0:1746065229.284056:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18256 00000100:00100000:0.0:1746065229.284060:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+22:2004:x1830881265651712:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:0.0:1746065229.284065:0:10219:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1746065229.284072:0:10219:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880136166600/0xad6b7ddc147b32e lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6ee expref: -99 pid: 10219 timeout: 0 lvb_type: 0 00002000:00010000:0.0:1746065229.284081:0:10219:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x96:0x0] initial LVB size: 4194304, mtime: 0x6812d74a, atime: 0x6812d749, ctime: 0x6812d74a, blocks: 0x1008 00010000:00010000:0.0:1746065229.284087:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.284088:0:10219:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.284092:0:10219:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880136166600/0xad6b7ddc147b32e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6ee expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.284100:0:10219:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880136166600/0xad6b7ddc147b32e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6ee expref: 23 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:0.0:1746065229.284110:0:10219:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880136166600, rc 0) 00000100:00100000:0.0:1746065229.284124:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+23:2004:x1830881265651712:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 64us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.284129:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18256 00000100:00100000:0.0:1746065229.289089:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.289268:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.290158:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.292055:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.292191:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265651968 00000100:00100000:3.0:1746065229.292192:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265652224 00000100:00100000:3.0:1746065229.292199:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265652224 00000100:00100000:1.0:1746065229.292199:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265651968 00000100:00100000:3.0:1746065229.292234:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265652480 00000100:00100000:3.0:1746065229.292236:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265652480 00000100:00100000:2.0:1746065229.292257:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18257 00000100:00100000:2.0:1746065229.292267:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265652224:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065229.292359:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2006:x1830881265652224:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 95us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.292366:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18257 00000100:00100000:1.0:1746065229.292513:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265651840 00000100:00100000:1.0:1746065229.292517:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265651840 00000100:00100000:3.0:1746065229.292520:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18258 00000100:00100000:3.0:1746065229.292527:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265651968:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065229.292536:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18259 00000100:00100000:1.0:1746065229.292541:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265652480:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065229.292566:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265651968:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 39us (3485us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.292574:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2006:x1830881265652480:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 33us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.292705:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18258 00000100:00100000:1.0:1746065229.292765:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18259 00000100:00100000:1.0:1746065229.292793:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18260 00000100:00100000:1.0:1746065229.292799:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265651840:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065229.292829:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265651840:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 30us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.292833:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18260 00000100:00100000:0.0:1746065229.292909:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.292946:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:1.0:1746065229.293012:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265652096 00000100:00100000:1.0:1746065229.293015:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265652096 00000100:00100000:1.0:1746065229.293027:0:1880:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265652352 00000100:00100000:1.0:1746065229.293029:0:1880:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265652352 00000100:00100000:1.0:1746065229.293038:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18261 00000100:00100000:1.0:1746065229.293041:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881265652096:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065229.293069:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+23:2006:x1830881265652096:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 27us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.293073:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18261 00000100:00100000:1.0:1746065229.293081:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18262 00000100:00100000:1.0:1746065229.293084:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265652352:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065229.293101:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2006:x1830881265652352:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 17us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.293106:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18262 00000100:00100000:0.0:1746065229.299841:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.299873:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.299890:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.299911:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.299924:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.299942:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265652608 00000100:00100000:0.0:1746065229.299948:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265652608 00000100:00100000:0.0:1746065229.299975:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265652864 00000100:00100000:0.0:1746065229.299977:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265652864 00000100:00100000:0.0:1746065229.299985:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265653120 00000100:00100000:0.0:1746065229.299987:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265653120 00000100:00100000:0.0:1746065229.299994:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265652736 00000100:00100000:0.0:1746065229.299995:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265652736 00000100:00100000:0.0:1746065229.300002:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265652992 00000100:00100000:0.0:1746065229.300003:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265652992 00000100:00100000:0.0:1746065229.300014:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18263 00000100:00100000:0.0:1746065229.300020:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265652608:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065229.300022:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18264 00000100:00100000:3.0:1746065229.300029:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881265652864:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:1.0:1746065229.300107:0:1880:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18265 00000100:00100000:3.0:1746065229.300108:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881265652864:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 80us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.300114:0:1880:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265653120:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:3.0:1746065229.300115:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18264 00000100:00100000:3.0:1746065229.300130:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18266 00000100:00100000:3.0:1746065229.300134:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265652736:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:2.0:1746065229.300175:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18267 00000100:00100000:2.0:1746065229.300182:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265652992:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065229.300224:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2007:x1830881265652608:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 205us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.300230:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18263 00000100:00100000:0.0:1746065229.300275:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.300341:0:9548:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265653248 00000100:00100000:0.0:1746065229.300343:0:9548:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265653248 00000100:00100000:0.0:1746065229.300357:0:9548:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18268 00000100:00100000:0.0:1746065229.300361:0:9548:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881265653248:12345-192.168.202.27@tcp:23:lfs.0 00000100:00100000:0.0:1746065229.300390:0:9548:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:251e5313-64c6-436c-a0af-246328b144ca+24:2007:x1830881265653248:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 29us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.300395:0:9548:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18268 00000100:00100000:1.0:1746065229.300463:0:1880:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:251e5313-64c6-436c-a0af-246328b144ca+30:2007:x1830881265653120:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 349us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1746065229.300468:0:1880:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18265 00000100:00100000:3.0:1746065229.300732:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+23:2007:x1830881265652736:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 596us (818us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.300738:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18266 00000100:00100000:2.0:1746065229.300788:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2007:x1830881265652992:12345-192.168.202.27@tcp:23:lfs.0 Request processed in 590us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.300794:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18267 00000100:00100000:0.0:1746065229.306424:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.307944:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265653376 00000100:00100000:2.0:1746065229.307954:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265653376 00000100:00100000:2.0:1746065229.308004:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18269 00000100:00100000:2.0:1746065229.308010:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+23:2799:x1830881265653376:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065229.308025:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065229.308040:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880090de5400/0xad6b7ddc147b335 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6f5 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065229.308059:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x280000401:0x93:0x0] initial LVB size: 2097152, mtime: 0x6812d71b, atime: 0x0, ctime: 0x6812d71b, blocks: 0xc90 00010000:00010000:2.0:1746065229.308075:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.308077:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.308084:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880090de5400/0xad6b7ddc147b335 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6f5 expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.308097:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff880090de5400/0xad6b7ddc147b335 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x93:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6f5 expref: 24 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.308106:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5400, rc 0) 00000100:00100000:2.0:1746065229.308161:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+24:2799:x1830881265653376:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 150us (1744us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.308168:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18269 00000100:00100000:0.0:1746065229.310295:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.310752:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265653504 00000100:00100000:3.0:1746065229.310759:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265653504 00000100:00100000:3.0:1746065229.310826:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18270 00000100:00100000:3.0:1746065229.310833:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+24:2004:x1830881265653504:12345-192.168.202.27@tcp:22:lfs.0 00002000:00010000:3.0:1746065229.310976:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065229.310979:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065229.310981:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065229.310983:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065229.310985:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:3.0:1746065229.311029:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097d28380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265653504:12345-192.168.202.27@tcp:22:lfs.0 Request processed in 196us (740us total) trans 21474841838 rc 0/0 00000100:00100000:3.0:1746065229.311035:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18270 00000100:00100000:0.0:1746065229.315191:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.315814:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265653632 00000100:00100000:2.0:1746065229.315821:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265653632 00000100:00100000:2.0:1746065229.316034:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18271 00000100:00100000:2.0:1746065229.316041:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2799:x1830881265653632:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065229.316055:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065229.316071:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147b33c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a6fc expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00002000:00010000:2.0:1746065229.316089:0:9550:0:(ofd_lvb.c:150:ofd_lvbo_init()) res: [0x2c0000401:0x76:0x0] initial LVB size: 4194304, mtime: 0x6812d71b, atime: 0x0, ctime: 0x6812d71b, blocks: 0x1c98 00010000:00010000:2.0:1746065229.316105:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.316106:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.316113:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147b33c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6fc expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.316125:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff880090de5800/0xad6b7ddc147b33c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x76:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6fc expref: 30 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.316133:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff880090de5800, rc 0) 00000100:00100000:2.0:1746065229.316169:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+30:2799:x1830881265653632:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 128us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.316174:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18271 00000100:00100000:0.0:1746065229.320659:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.320759:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265653760 00000100:00100000:3.0:1746065229.320767:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265653760 00000100:00100000:3.0:1746065229.320832:0:11461:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18272 00000100:00100000:3.0:1746065229.320839:0:11461:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+30:2005:x1830881265653760:12345-192.168.202.27@tcp:22:lfs.0 00002000:00010000:3.0:1746065229.320996:0:11461:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065229.320998:0:11461:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065229.321000:0:11461:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065229.321002:0:11461:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065229.321004:0:11461:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:3.0:1746065229.321052:0:11461:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265653760:12345-192.168.202.27@tcp:22:lfs.0 Request processed in 213us (401us total) trans 17179874465 rc 0/0 00000100:00100000:3.0:1746065229.321058:0:11461:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18272 00000100:00100000:0.0:1746065229.328993:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.329031:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.329059:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.329087:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.329100:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.329114:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.329134:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265654144 00000100:00100000:0.0:1746065229.329142:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265654144 00000100:00100000:0.0:1746065229.329181:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265654272 00000100:00100000:0.0:1746065229.329183:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265654272 00000100:00100000:2.0:1746065229.329188:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265654656 00000100:00100000:2.0:1746065229.329193:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265654656 00000100:00100000:0.0:1746065229.329195:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265654528 00000100:00100000:0.0:1746065229.329197:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265654528 00000100:00100000:0.0:1746065229.329208:0:29492:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265655040 00000100:00100000:0.0:1746065229.329209:0:29492:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265655040 00000100:00100000:2.0:1746065229.329216:0:29490:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265655296 00000100:00100000:2.0:1746065229.329218:0:29490:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265655296 00000100:00100000:0.0:1746065229.329224:0:29492:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6527 00000100:00100000:0.0:1746065229.329229:0:29492:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265654144:12345-192.168.202.27@tcp:3:lfs.0 00000100:00100000:2.0:1746065229.329234:0:29490:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6528 00000100:00100000:2.0:1746065229.329247:0:29490:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265654272:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065229.329266:0:29490:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b34a lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.329266:0:29492:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147b343 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.329277:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.329277:0:29492:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.329279:0:29490:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.329279:0:29492:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.329282:0:29492:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147b343 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.329293:0:29492:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147b343 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.329725:0:29490:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b34a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.329737:0:29490:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b34a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065229.329987:0:13377:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6529 00000100:00100000:1.0:1746065229.329994:0:13377:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265654528:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065229.330012:0:13377:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc147b351 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.330019:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.330021:0:13377:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.330024:0:13377:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc147b351 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.330032:0:13377:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc147b351 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.330259:0:9553:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6530 00000100:00100000:2.0:1746065229.330266:0:9553:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265654656:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065229.330282:0:9553:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc147b358 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.330288:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.330289:0:9553:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.330293:0:9553:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc147b358 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.330300:0:9553:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc147b358 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065229.330530:0:9554:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6531 00000100:00100000:1.0:1746065229.330535:0:9554:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265655040:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:1.0:1746065229.330550:0:9554:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f6da00/0xad6b7ddc147b35f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.330557:0:9554:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.330559:0:9554:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:1.0:1746065229.330561:0:9554:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6da00/0xad6b7ddc147b35f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.330568:0:9554:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880095f6da00/0xad6b7ddc147b35f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.330850:0:9555:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6532 00000100:00100000:2.0:1746065229.330856:0:9555:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265655296:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:2.0:1746065229.330871:0:9555:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc147b366 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.330878:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.330879:0:9555:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.330881:0:9555:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc147b366 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.330889:0:9555:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc147b366 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.331441:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.331461:0:29489:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265655552 00000100:00100000:0.0:1746065229.331467:0:29489:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265655552 00000100:00100000:0.0:1746065229.331496:0:29489:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6533 00000100:00100000:0.0:1746065229.331502:0:29489:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265655552:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:0.0:1746065229.331514:0:29489:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147b36d lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.331521:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.331522:0:29489:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:0.0:1746065229.331525:0:29489:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147b36d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.331531:0:29489:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147b36d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.332096:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.332119:0:29493:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265655808 00000100:00100000:3.0:1746065229.332123:0:29493:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265655808 00000100:00100000:3.0:1746065229.332146:0:29493:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 6534 00000100:00100000:3.0:1746065229.332151:0:29493:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265655808:12345-192.168.202.27@tcp:3:lfs.0 00010000:00010000:3.0:1746065229.332165:0:29493:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147b374 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.332176:0:29493:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.332178:0:29493:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.332181:0:29493:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147b374 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.332187:0:29493:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147b374 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.343270:0:29490:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b34a lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.343289:0:29490:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b34a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.343296:0:29490:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b34a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.343302:0:29490:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065229.343305:0:29490:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b34a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.343311:0:29490:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b34a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.343326:0:29490:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b34a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.343331:0:29490:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f00000/0xad6b7ddc147b34a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29490 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.343407:0:29490:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_006:251e5313-64c6-436c-a0af-246328b144ca+37:2005:x1830881265654272:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 14164us (14371us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065229.343422:0:29490:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6528 00010000:00010000:1.0:1746065229.350304:0:13377:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc147b351 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.350318:0:13377:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc147b351 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.350325:0:13377:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc147b351 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.350331:0:13377:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6d000 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065229.350334:0:13377:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc147b351 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.350341:0:13377:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc147b351 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.350355:0:13377:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc147b351 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.350360:0:13377:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f6d000/0xad6b7ddc147b351 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 13377 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065229.350436:0:13377:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_010:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265654528:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 20438us (21343us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065229.350445:0:13377:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6529 00010000:00010000:2.0:1746065229.353977:0:9553:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc147b358 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.353992:0:9553:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc147b358 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.354005:0:9553:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc147b358 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.354011:0:9553:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f00c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065229.354014:0:9553:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc147b358 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.354021:0:9553:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc147b358 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.354034:0:9553:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc147b358 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.354039:0:9553:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f00c00/0xad6b7ddc147b358 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9553 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.354123:0:9553:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265654656:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 23849us (25054us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065229.354132:0:9553:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6530 00010000:00010000:1.0:1746065229.363119:0:9554:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880095f6da00/0xad6b7ddc147b35f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.363135:0:9554:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880095f6da00/0xad6b7ddc147b35f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.363143:0:9554:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880095f6da00/0xad6b7ddc147b35f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.363149:0:9554:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f6da00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:1.0:1746065229.363152:0:9554:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6da00/0xad6b7ddc147b35f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.363159:0:9554:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880095f6da00/0xad6b7ddc147b35f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.363174:0:9554:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880095f6da00/0xad6b7ddc147b35f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1746065229.363180:0:9554:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880095f6da00/0xad6b7ddc147b35f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9554 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1746065229.363280:0:9554:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265655040:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 32739us (34173us total) trans 0 rc 1048576/1048576 00000100:00100000:1.0:1746065229.363289:0:9554:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6531 00010000:00010000:2.0:1746065229.369920:0:9555:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc147b366 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.369932:0:9555:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc147b366 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.369937:0:9555:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc147b366 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.369945:0:9555:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065229.369948:0:9555:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc147b366 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.369952:0:9555:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc147b366 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.369966:0:9555:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc147b366 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.369971:0:9555:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880095f01600/0xad6b7ddc147b366 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9555 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.370059:0:9555:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265655296:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 39196us (40937us total) trans 0 rc 1048576/1048576 00000100:00100000:2.0:1746065229.370067:0:9555:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6532 00010000:00010000:2.0:1746065229.377911:0:29492:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147b343 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.377925:0:29492:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147b343 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.377931:0:29492:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147b343 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.377937:0:29492:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166e00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:2.0:1746065229.377940:0:29492:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147b343 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.377947:0:29492:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147b343 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.377961:0:29492:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147b343 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.377966:0:29492:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166e00/0xad6b7ddc147b343 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [4096->1048575] (req 4096->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29492 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1746065229.379162:0:29492:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_008:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265654144:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 49925us (50168us total) trans 0 rc 1044480/1044480 00000100:00100000:2.0:1746065229.379172:0:29492:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6527 00010000:00010000:0.0:1746065229.380384:0:29489:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147b36d lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.380396:0:29489:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147b36d lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.380402:0:29489:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147b36d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.380407:0:29489:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880136166c00 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:0.0:1746065229.380411:0:29489:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147b36d lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.380417:0:29489:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147b36d lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.380430:0:29489:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147b36d lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1746065229.380441:0:29489:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880136166c00/0xad6b7ddc147b36d lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29489 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.383297:0:29493:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147b374 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.383310:0:29493:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147b374 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.383317:0:29493:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147b374 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.383322:0:29493:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88008c5c4600 already unused, calling callback (ffffffffa086fd70) 00010000:00010000:3.0:1746065229.383325:0:29493:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147b374 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.383331:0:29493:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147b374 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.383344:0:29493:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147b374 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.383350:0:29493:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff88008c5c4600/0xad6b7ddc147b374 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 29493 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065229.383407:0:29493:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_009:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265655808:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 51251us (51307us total) trans 0 rc 1048576/1048576 00000100:00100000:3.0:1746065229.383416:0:29493:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6534 00000100:00100000:0.0:1746065229.383658:0:29489:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:251e5313-64c6-436c-a0af-246328b144ca+31:2005:x1830881265655552:12345-192.168.202.27@tcp:3:lfs.0 Request processed in 52154us (52216us total) trans 0 rc 1048576/1048576 00000100:00100000:0.0:1746065229.383666:0:29489:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 6533 00000100:00100000:0.0:1746065229.387881:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.390559:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265656064 00000100:00100000:2.0:1746065229.390569:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265656064 00000100:00100000:2.0:1746065229.390618:0:7204:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14746 00000100:00100000:2.0:1746065229.390625:0:7204:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+29:2799:x1830881265656064:12345-192.168.202.27@tcp:36:lfs.0 00010000:00010000:2.0:1746065229.390664:0:7204:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1746065229.390686:0:7204:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5200/0xad6b7ddc147b304 lrc: 0/0,0 mode: --/PR res: [0x200000404:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6c4 expref: 29 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.390704:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065229.390707:0:7204:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1746065229.390742:0:7204:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 3/0,1 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065229.390757:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065229.390767:0:7204:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00000004:00010000:2.0:1746065229.390850:0:7204:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880097faad80 reply state ffff880087e25000 transno 8589937274 ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 3/0,1 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065229.390860:0:7204:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:2.0:1746065229.390865:0:7204:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065229.390867:0:7204:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1746065229.390869:0:7204:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1746065229.390926:0:7204:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2799:x1830881265656064:12345-192.168.202.27@tcp:36:lfs.0 Request processed in 301us (3052us total) trans 8589937274 rc 0/0 00000100:00100000:2.0:1746065229.390931:0:7204:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14746 00000100:00100000:0.0:1746065229.392925:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.393121:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265656192 00000100:00100000:2.0:1746065229.393127:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265656192 00000100:00100000:2.0:1746065229.393155:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18273 00000100:00100000:2.0:1746065229.393160:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2799:x1830881265656192:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065229.393172:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065229.393185:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc147b382 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a703 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.393205:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc147b30b lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6cb expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.393211:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.393213:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.393216:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc147b382 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a703 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.393250:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc147b30b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6cb expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.393259:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc147b30b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6cb expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746065229.393269:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264100352:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065229.393335:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065229.397611:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.397908:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264100352:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065229.397932:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc147b382 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a703 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.397946:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b000, rc 0) 00000100:00100000:2.0:1746065229.397993:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097faaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2799:x1830881265656192:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 4831us (5073us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.398001:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18273 00000100:00100000:3.0:1746065229.398365:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265656320 00000100:00100000:3.0:1746065229.398371:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265656320 00010000:00010000:3.0:1746065229.398393:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc147b30b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6cb expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00000100:00100000:3.0:1746065229.398421:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8536 00000100:00100000:3.0:1746065229.398427:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265656320:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065229.398437:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065229.398451:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc147b30b lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6cb expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.398460:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc147b30b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6cb expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.398477:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8400/0xad6b7ddc147b30b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x75:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6cb expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.398498:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.398500:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.398505:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc147b382 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a703 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.398512:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc147b382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a703 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.398535:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71b000/0xad6b7ddc147b382 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x75:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a703 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065229.398545:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264100480:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065229.398596:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534780 going to sleep for 11 seconds 00000100:00100000:1.0:1746065229.403166:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.403260:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264100480:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065229.403279:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065229.403324:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265656320:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4896us (5718us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.403333:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8536 00000100:00100000:2.0:1746065229.404948:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265656448 00000100:00100000:2.0:1746065229.404956:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265656448 00000100:00100000:2.0:1746065229.405002:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18274 00000100:00100000:2.0:1746065229.405008:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2799:x1830881265656448:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065229.405022:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065229.405034:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147b389 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a70a expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.405057:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b312 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d2 expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.405065:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.405067:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.405070:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147b389 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a70a expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.405098:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b312 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d2 expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.405108:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b312 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d2 expref: 26 pid: 12260 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746065229.405119:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264100608:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065229.405259:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435180 going to sleep for 11 seconds 00000100:00100000:0.0:1746065229.413283:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.413396:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264100608:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065229.413420:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147b389 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a70a expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.413434:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71ba00, rc 0) 00000100:00100000:2.0:1746065229.413470:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2799:x1830881265656448:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 8461us (10311us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.413478:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18274 00000100:00100000:3.0:1746065229.414165:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265656576 00000100:00100000:3.0:1746065229.414171:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265656576 00010000:00010000:3.0:1746065229.414193:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b312 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d2 expref: 26 pid: 12260 timeout: 925 lvb_type: 1 00000100:00100000:3.0:1746065229.414225:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8537 00000100:00100000:3.0:1746065229.414231:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265656576:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065229.414249:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065229.414263:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b312 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d2 expref: 26 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.414275:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b312 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d2 expref: 26 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.414297:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880129f46000/0xad6b7ddc147b312 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x94:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d2 expref: 26 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.414317:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.414319:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.414324:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147b389 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a70a expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.414330:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147b389 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a70a expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.414352:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71ba00/0xad6b7ddc147b389 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x94:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a70a expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065229.414362:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264100736:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065229.414420:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534780 going to sleep for 11 seconds 00000100:00100000:0.0:1746065229.416892:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.417213:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264100736:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065229.417231:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065229.417284:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265656576:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3052us (4007us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.417293:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8537 00000100:00100000:2.0:1746065229.417362:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265656704 00000100:00100000:2.0:1746065229.417367:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265656704 00000100:00100000:2.0:1746065229.417400:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18275 00000100:00100000:2.0:1746065229.417415:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2799:x1830881265656704:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065229.417428:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065229.417440:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71a200/0xad6b7ddc147b390 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a711 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.417463:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147b319 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d9 expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.417469:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.417470:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.417473:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a200/0xad6b7ddc147b390 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a711 expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.417498:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147b319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d9 expref: 26 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.417508:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147b319 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d9 expref: 26 pid: 12260 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746065229.417518:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264100864:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065229.417577:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435180 going to sleep for 11 seconds 00000100:00100000:3.0:1746065229.419650:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264100864:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065229.419673:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71a200/0xad6b7ddc147b390 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a711 expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.419691:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71a200, rc 0) 00000100:00100000:3.0:1746065229.419735:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2799:x1830881265656704:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2329us (2849us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.419742:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18275 00000100:00100000:0.0:1746065229.420009:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.420045:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265656832 00000100:00100000:3.0:1746065229.420051:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265656832 00010000:00010000:3.0:1746065229.420070:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147b319 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d9 expref: 26 pid: 12260 timeout: 925 lvb_type: 1 00000100:00100000:3.0:1746065229.420101:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8538 00000100:00100000:3.0:1746065229.420107:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2004:x1830881265656832:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065229.420116:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065229.420130:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147b319 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d9 expref: 26 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.420139:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147b319 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d9 expref: 26 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.420156:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff8800b53d1000/0xad6b7ddc147b319 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x95:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6d9 expref: 26 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.420166:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.420168:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.420172:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71a200/0xad6b7ddc147b390 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a711 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.420183:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71a200/0xad6b7ddc147b390 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a711 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.420202:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71a200/0xad6b7ddc147b390 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x95:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a711 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065229.420211:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264100992:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065229.420863:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065229.421723:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264100992:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065229.421736:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1746065229.421758:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.421907:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2004:x1830881265656832:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 1798us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.421914:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8538 00000100:00100000:2.0:1746065229.421946:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265656960 00000100:00100000:2.0:1746065229.421952:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265656960 00000100:00100000:2.0:1746065229.421981:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18276 00000100:00100000:2.0:1746065229.421986:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2799:x1830881265656960:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065229.421998:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065229.422009:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147b397 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a718 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.422031:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc147b320 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e0 expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.422037:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.422038:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.422041:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147b397 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a718 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.422057:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc147b320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e0 expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.422066:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc147b320 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e0 expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746065229.422074:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264101120:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065229.422441:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435300 going to sleep for 11 seconds 00000100:00100000:2.0:1746065229.424788:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264101120:192.168.202.27@tcp:104: 00000100:00100000:0.0:1746065229.424807:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00010000:00010000:2.0:1746065229.424810:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147b397 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a718 expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.424824:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71aa00, rc 0) 00000100:00100000:3.0:1746065229.424855:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265657088 00000100:00100000:2.0:1746065229.424855:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+32:2799:x1830881265656960:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 2868us (3096us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.424860:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265657088 00000100:00100000:2.0:1746065229.424862:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18276 00010000:00010000:3.0:1746065229.424877:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc147b320 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e0 expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00000100:00100000:3.0:1746065229.425083:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8539 00000100:00100000:3.0:1746065229.425088:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265657088:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065229.425097:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065229.425110:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc147b320 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e0 expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.425123:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc147b320 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e0 expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.425139:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff880131019c00/0xad6b7ddc147b320 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x77:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e0 expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.425150:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.425152:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.425156:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147b397 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a718 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.425163:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147b397 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a718 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.425184:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71aa00/0xad6b7ddc147b397 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x77:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 1048576->2097151) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a718 expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065229.425193:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264101248:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065229.425317:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065229.429049:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264101248:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065229.429069:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065229.429106:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265657088:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 4017us (4300us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.429115:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8539 00000100:00100000:0.0:1746065229.429246:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.429369:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265657216 00000100:00100000:2.0:1746065229.429376:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265657216 00000100:00100000:2.0:1746065229.429404:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18277 00000100:00100000:2.0:1746065229.429409:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+31:2799:x1830881265657216:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065229.429421:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065229.429435:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc147b39e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a71f expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.429585:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc147b327 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e7 expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.429593:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.429594:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.429598:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc147b39e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a71f expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.429620:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc147b327 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e7 expref: 32 pid: 12260 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.429630:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc147b327 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e7 expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746065229.429645:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264101376:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065229.430310:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065229.432077:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.432114:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:9550:1830881264101376:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065229.432133:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc147b39e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a71f expref: 32 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.432151:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71bc00, rc 0) 00000100:00100000:3.0:1746065229.432491:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265657344 00000100:00100000:3.0:1746065229.432496:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265657344 00010000:00010000:3.0:1746065229.432515:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc147b327 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e7 expref: 33 pid: 12260 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746065229.432549:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+33:2799:x1830881265657216:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3140us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.432556:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18277 00000100:00100000:3.0:1746065229.432709:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8540 00000100:00100000:3.0:1746065229.432716:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+32:2004:x1830881265657344:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065229.432725:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065229.432738:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc147b327 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e7 expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.432748:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc147b327 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e7 expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.432764:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: ffff88008f2b8600/0xad6b7ddc147b327 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x78:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6e7 expref: 32 pid: 12260 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.432792:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.432793:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.432799:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc147b39e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a71f expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.432806:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc147b39e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a71f expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.432828:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: ffff88009c71bc00/0xad6b7ddc147b39e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x78:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a71f expref: 31 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065229.432838:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264101504:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065229.432882:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534780 going to sleep for 11 seconds 00000100:00100000:3.0:1746065229.434915:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:7191:1830881264101504:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065229.434931:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065229.435379:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009df64450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265657344:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 2660us (3304us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.435388:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8540 00000100:00100000:0.0:1746065229.435573:0:3752:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.436084:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265657472 00000100:00100000:2.0:1746065229.436090:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265657472 00000100:00100000:2.0:1746065229.436119:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18278 00000100:00100000:2.0:1746065229.436124:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+25:2799:x1830881265657472:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065229.436137:0:9550:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065229.436148:0:9550:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc147b3a5 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a726 expref: -99 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.436168:0:9550:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: ffff880136166600/0xad6b7ddc147b32e lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6ee expref: 26 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.436174:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.436175:0:9550:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:2.0:1746065229.436178:0:9550:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc147b3a5 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a726 expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.436199:0:9550:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: ffff880136166600/0xad6b7ddc147b32e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6ee expref: 26 pid: 10219 timeout: 0 lvb_type: 1 00010000:00010000:2.0:1746065229.436208:0:9550:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: ffff880136166600/0xad6b7ddc147b32e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6ee expref: 26 pid: 10219 timeout: 925 lvb_type: 1 00000100:00100000:2.0:1746065229.436222:0:9550:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264101632:192.168.202.27@tcp:104: 00000100:00100000:2.0:1746065229.436294:0:9550:0:(client.c:2553:ptlrpc_set_wait()) set ffff88008c435300 going to sleep for 11 seconds 00000100:00100000:0.0:1746065229.439030:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.439325:0:9550:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009aceca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:9550:1830881264101632:192.168.202.27@tcp:104: 00010000:00010000:2.0:1746065229.439346:0:9550:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc147b3a5 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [2097152->8388607] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a726 expref: 26 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.439359:0:9550:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71be00, rc 0) 00000100:00100000:2.0:1746065229.439397:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:251e5313-64c6-436c-a0af-246328b144ca+26:2799:x1830881265657472:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 3272us (3824us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.439404:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18278 00000100:00100000:3.0:1746065229.439801:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265657600 00000100:00100000:3.0:1746065229.439806:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265657600 00010000:00010000:3.0:1746065229.439831:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: ffff880136166600/0xad6b7ddc147b32e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6ee expref: 26 pid: 10219 timeout: 925 lvb_type: 1 00000100:00100000:3.0:1746065229.439851:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8541 00000100:00100000:3.0:1746065229.439857:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+26:2005:x1830881265657600:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065229.439866:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065229.439880:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: ffff880136166600/0xad6b7ddc147b32e lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6ee expref: 26 pid: 10219 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.439888:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: ffff880136166600/0xad6b7ddc147b32e lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6ee expref: 26 pid: 10219 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.439906:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: ffff880136166600/0xad6b7ddc147b32e lrc: 0/0,0 mode: --/PR res: [0x280000401:0x96:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6ee expref: 26 pid: 10219 timeout: 925 lvb_type: 1 00010000:00010000:3.0:1746065229.439918:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.439920:0:7191:0:(ldlm_extent.c:417:ldlm_check_contention()) contended locks = 0 00010000:00010000:3.0:1746065229.439925:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc147b3a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a726 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.439935:0:7191:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc147b3a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40080000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a726 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.439958:0:7191:0:(ldlm_lockd.c:1083:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: ffff88009c71be00/0xad6b7ddc147b3a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x96:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 2097152->8388607) gid 0 flags: 0x40000000020000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a726 expref: 25 pid: 9550 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1746065229.439967:0:7191:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264101760:192.168.202.27@tcp:105: 00000100:00100000:3.0:1746065229.440006:0:7191:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065229.443155:0:7191:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:7191:1830881264101760:192.168.202.27@tcp:105: 00010000:00010000:3.0:1746065229.443174:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065229.443600:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098ddaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+25:2005:x1830881265657600:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 3740us (4572us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.443608:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8541 00000100:00100000:2.0:1746065229.443754:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.443862:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.443875:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.443885:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.443896:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.443913:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.444360:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265657728 00000100:00100000:3.0:1746065229.444365:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265657728 00000100:00100000:0.0:1746065229.444375:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265657856 00000100:00100000:0.0:1746065229.444378:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265657856 00000100:00100000:3.0:1746065229.444391:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265657984 00000100:00100000:3.0:1746065229.444393:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265657984 00000100:00100000:0.0:1746065229.444393:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265658112 00000100:00100000:0.0:1746065229.444395:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265658112 00000100:00100000:3.0:1746065229.444401:0:9549:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265658240 00000100:00100000:3.0:1746065229.444403:0:9549:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265658240 00000100:00100000:0.0:1746065229.444403:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265658368 00000100:00100000:0.0:1746065229.444405:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265658368 00000100:00100000:0.0:1746065229.444414:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18279 00000100:00100000:3.0:1746065229.444419:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18280 00000100:00100000:0.0:1746065229.444419:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+33:2005:x1830881265657728:12345-192.168.202.27@tcp:2:lfs.0 00000100:00100000:3.0:1746065229.444423:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265657856:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065229.444514:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:0.0:1746065229.444514:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065229.444517:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:0.0:1746065229.444517:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065229.444519:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065224 -> 1746065226 00002000:00010000:0.0:1746065229.444519:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065224 -> 1746065226 00002000:00010000:3.0:1746065229.444521:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065226 -> 1746065229 00002000:00010000:0.0:1746065229.444521:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065226 -> 1746065229 00002000:00010000:0.0:1746065229.444522:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 2048 -> 2048 00002000:00010000:3.0:1746065229.444523:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746065229.444545:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009acedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265657856:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 121us (683us total) trans 21474841839 rc 0/0 00000100:00100000:3.0:1746065229.444551:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18280 00000100:00100000:3.0:1746065229.444565:0:9549:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18281 00000100:00100000:3.0:1746065229.444568:0:9549:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2005:x1830881265657984:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:3.0:1746065229.444603:0:9549:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065229.444605:0:9549:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065229.444607:0:9549:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065225 -> 1746065226 00002000:00010000:3.0:1746065229.444608:0:9549:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065226 -> 1746065229 00002000:00010000:3.0:1746065229.444610:0:9549:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:1.0:1746065229.444740:0:12258:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18282 00000100:00100000:1.0:1746065229.444747:0:12258:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265658112:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:1.0:1746065229.444814:0:12258:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:1.0:1746065229.444817:0:12258:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065225 -> 1746065226 00002000:00010000:1.0:1746065229.444819:0:12258:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065224 -> 1746065226 00002000:00010000:1.0:1746065229.444820:0:12258:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065225 -> 1746065229 00002000:00010000:1.0:1746065229.444822:0:12258:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065229.444828:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18283 00000100:00100000:2.0:1746065229.444834:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265658240:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:2.0:1746065229.444878:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00002000:00010000:2.0:1746065229.444881:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:2.0:1746065229.444882:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065225 -> 1746065226 00002000:00010000:2.0:1746065229.444884:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065226 -> 1746065229 00002000:00010000:2.0:1746065229.444885:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00000100:00100000:0.0:1746065229.445141:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009aceca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+36:2005:x1830881265657728:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 721us (1386us total) trans 17179874466 rc 0/0 00000100:00100000:0.0:1746065229.445147:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18279 00000100:00100000:0.0:1746065229.445161:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 18284 00000100:00100000:0.0:1746065229.445166:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265658368:12345-192.168.202.27@tcp:2:lfs.0 00002000:00010000:0.0:1746065229.445201:0:10219:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065229.445203:0:10219:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:0.0:1746065229.445205:0:10219:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065225 -> 1746065226 00002000:00010000:0.0:1746065229.445206:0:10219:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065226 -> 1746065229 00002000:00010000:0.0:1746065229.445208:0:10219:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:0.0:1746065229.445221:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:251e5313-64c6-436c-a0af-246328b144ca+29:2005:x1830881265658368:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 55us (1307us total) trans 21474841841 rc 0/0 00000100:00100000:0.0:1746065229.445225:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18284 00000100:00100000:3.0:1746065229.445435:0:9549:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2005:x1830881265657984:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 864us (1558us total) trans 21474841840 rc 0/0 00000100:00100000:1.0:1746065229.445435:0:12258:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012edaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:251e5313-64c6-436c-a0af-246328b144ca+35:2005:x1830881265658112:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 690us (1549us total) trans 17179874467 rc 0/0 00000100:00100000:3.0:1746065229.445441:0:9549:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18281 00000100:00100000:1.0:1746065229.445443:0:12258:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18282 00000100:00100000:2.0:1746065229.445565:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:251e5313-64c6-436c-a0af-246328b144ca+34:2005:x1830881265658240:12345-192.168.202.27@tcp:2:lfs.0 Request processed in 730us (1667us total) trans 17179874468 rc 0/0 00000100:00100000:2.0:1746065229.445570:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 18283 00000100:00100000:0.0:1746065229.447745:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.447795:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265658624 00000100:00100000:3.0:1746065229.447802:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265658624 00000100:00100000:3.0:1746065229.447927:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5563 00000100:00100000:3.0:1746065229.447936:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2799:x1830881265658624:12345-192.168.202.27@tcp:35:lfs.0 00000004:00010000:3.0:1746065229.447984:0:7207:0:(mdt_open.c:2471:mdt_close_resync_done()) ### [0x200000404:0x31:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b2b7 lrc: 3/0,0 mode: PW/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6b6 expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.448025:0:7207:0:(ldlm_lock.c:770:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065229.448036:0:7207:0:(ldlm_lock.c:683:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc147b2f6 lrc: 2/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6bd expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.448047:0:7207:0:(ldlm_resource.c:1526:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 4/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065229.448072:0:7207:0:(ldlm_lockd.c:964:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc147b2f6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6bd expref: 30 pid: 7204 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1746065229.448083:0:7207:0:(ldlm_lockd.c:496:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc147b2f6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6bd expref: 30 pid: 7204 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746065229.448094:0:7207:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7207:1830881264101888:192.168.202.27@tcp:104: 00000100:00100000:3.0:1746065229.448170:0:7207:0:(client.c:2553:ptlrpc_set_wait()) set ffff880090534480 going to sleep for 11 seconds 00000100:00100000:3.0:1746065229.449562:0:7207:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:7207:1830881264101888:192.168.202.27@tcp:104: 00010000:00010000:3.0:1746065229.449588:0:7207:0:(ldlm_request.c:273:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT0 00000100:00100000:0.0:1746065229.451100:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:3.0:1746065229.451158:0:7191:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265658752 00000100:00100000:3.0:1746065229.451163:0:7191:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265658752 00010000:00010000:3.0:1746065229.451188:0:7191:0:(ldlm_lockd.c:2661:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc147b2f6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6bd expref: 31 pid: 7204 timeout: 925 lvb_type: 0 00000100:00100000:3.0:1746065229.451301:0:7191:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 8542 00000100:00100000:3.0:1746065229.451307:0:7191:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+31:2004:x1830881265658752:12345-192.168.202.27@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1746065229.451318:0:7191:0:(ldlm_lockd.c:1740:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1746065229.451322:0:7191:0:(ldlm_lockd.c:1789:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc147b2f6 lrc: 4/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6bd expref: 31 pid: 7204 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746065229.451330:0:7191:0:(ldlm_lockd.c:569:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc147b2f6 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6bd expref: 31 pid: 7204 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746065229.451345:0:7191:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880090de5c00/0xad6b7ddc147b2f6 lrc: 0/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6bd expref: 31 pid: 7204 timeout: 925 lvb_type: 0 00010000:00010000:3.0:1746065229.451496:0:7191:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:3.0:1746065229.451501:0:7191:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 3/0,1 mode: --/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065229.451508:0:7191:0:(ldlm_lock.c:711:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065229.451513:0:7191:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 4/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 7207 initiator: MDT0 00010000:00010000:3.0:1746065229.451638:0:7191:0:(ldlm_lockd.c:1801:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1746065229.451672:0:7191:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:251e5313-64c6-436c-a0af-246328b144ca+30:2004:x1830881265658752:12345-192.168.202.27@tcp:103:ldlm_bl.0 Request processed in 364us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.451678:0:7191:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 8542 00010000:00010000:0.0:1746065229.451819:0:7207:0:(ldlm_request.c:185:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065229.451826:0:7207:0:(ldlm_request.c:513:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT0 00000040:00080000:0.0:1746065229.452024:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1192, 88 off112744 00000004:00080000:0.0:1746065229.452029:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825470255253ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065229.452052:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1193, 88 off112832 00000004:00080000:0.0:1746065229.452055:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825470281496ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065229.452066:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1194, 88 off112920 00000004:00080000:0.0:1746065229.452069:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825470295413ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065229.452077:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1193, 88 off112832 00000004:00080000:0.0:1746065229.452080:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825470306638ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065229.452087:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1194, 88 off112920 00000004:00080000:0.0:1746065229.452089:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825470315543ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065229.452096:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1195, 88 off113008 00000004:00080000:0.0:1746065229.452098:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825470324873ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065229.452106:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1196, 88 off113096 00000004:00080000:0.0:1746065229.452108:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825470334095ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065229.452114:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1197, 88 off113184 00000004:00080000:0.0:1746065229.452117:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825470342751ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065229.452123:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1195, 88 off113008 00000004:00080000:0.0:1746065229.452125:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825470352068ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065229.452132:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1198, 88 off113272 00000004:00080000:0.0:1746065229.452134:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825470360573ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065229.452140:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1196, 88 off113096 00000004:00080000:0.0:1746065229.452142:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825470368991ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065229.452149:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1199, 88 off113360 00000004:00080000:0.0:1746065229.452151:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825470377526ns, next at 761143559853ns, rc = 0 00000040:00080000:0.0:1746065229.452158:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1197, 88 off113184 00000004:00080000:0.0:1746065229.452160:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825470386343ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065229.452166:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1198, 88 off113272 00000004:00080000:0.0:1746065229.452168:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825470394773ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065229.452174:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1199, 88 off113360 00000004:00080000:0.0:1746065229.452176:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825470402918ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065229.452182:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0xa:0x0].1200, 88 off113448 00000004:00080000:0.0:1746065229.452185:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 825470411063ns, next at 761143591313ns, rc = 0 00000040:00080000:0.0:1746065229.452191:0:7207:0:(llog_osd.c:734:llog_osd_write_rec()) added record [0x1:0x8:0x0].1200, 88 off113448 00000004:00080000:0.0:1746065229.452193:0:7207:0:(osp_sync.c:1787:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 825470419701ns, next at 761143559853ns, rc = 0 00000001:00080000:2.0:1746065229.454511:0:8138:0:(tgt_lastrcvd.c:950:tgt_cb_last_committed()) lustre-MDT0000: transno 8589937275 is committed 00000004:00080000:2.0:1746065229.454522:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1178 committed 00000004:00080000:2.0:1746065229.454588:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1180 committed 00000004:00080000:2.0:1746065229.454695:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1179 committed 00000004:00080000:2.0:1746065229.454698:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1178 committed 00000004:00080000:2.0:1746065229.454699:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1177 committed 00000004:00080000:2.0:1746065229.454700:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1177 committed 00000004:00080000:2.0:1746065229.454702:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1176 committed 00000004:00080000:2.0:1746065229.454703:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1176 committed 00000004:00080000:2.0:1746065229.454704:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1175 committed 00000004:00080000:2.0:1746065229.454705:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1175 committed 00000004:00080000:2.0:1746065229.454707:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1174 committed 00000004:00080000:2.0:1746065229.454708:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1173 committed 00000004:00080000:2.0:1746065229.454709:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1174 committed 00000004:00080000:2.0:1746065229.454710:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1173 committed 00000004:00080000:2.0:1746065229.454712:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1172 committed 00000004:00080000:2.0:1746065229.454713:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1171 committed 00000004:00080000:2.0:1746065229.454714:0:8138:0:(osp_sync.c:1752:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1172 committed 00010000:00010000:1.0:1746065229.454793:0:3746:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.454802:0:3746:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.454808:0:3746:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.454812:0:3746:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff88009c71a400 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:1.0:1746065229.454815:0:3746:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.454820:0:3746:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.454833:0:3746:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:1.0:1746065229.454835:0:3746:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1746065229.454838:0:3746:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00010000:00010000:1.0:1746065229.454845:0:3746:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71a400/0xad6b7ddc147b37b lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7204 initiator: MDT0 00000100:00100000:3.0:1746065229.454983:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264102016:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.455029:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.455052:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264102528:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.455067:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.455079:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264103040:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.455091:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.455105:0:3759:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1746065229.455109:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264102144:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.455123:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.455134:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264102656:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.455148:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.455165:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264102400:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1746065229.455181:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.455193:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264102912:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.455205:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.455218:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1746065229.455222:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264102272:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.455235:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.455257:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88009c5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264102784:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.455271:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.455292:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264102016 00000100:00100000:3.0:1746065229.455297:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264102016 00000100:00100000:3.0:1746065229.455323:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264102528 00000100:00100000:3.0:1746065229.455325:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264102528 00000100:00100000:3.0:1746065229.455334:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264103040 00000100:00100000:3.0:1746065229.455335:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264103040 00000100:00100000:3.0:1746065229.455341:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264102144 00000100:00100000:3.0:1746065229.455342:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264102144 00000100:00100000:3.0:1746065229.455347:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264102656 00000100:00100000:3.0:1746065229.455348:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264102656 00000100:00100000:3.0:1746065229.455354:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264102400 00000100:00100000:3.0:1746065229.455355:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264102400 00000100:00100000:3.0:1746065229.455361:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264102912 00000100:00100000:3.0:1746065229.455363:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264102912 00000100:00100000:3.0:1746065229.455368:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264102272 00000100:00100000:3.0:1746065229.455369:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264102272 00000100:00100000:3.0:1746065229.455374:0:3068:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264102784 00000100:00100000:3.0:1746065229.455375:0:3068:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264102784 00000100:00100000:3.0:1746065229.455383:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18285 00000100:00100000:3.0:1746065229.455389:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881264102016:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065229.455486:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065229.455489:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065229.455491:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb atime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065229.455493:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb ctime from disk: 1746065229 -> 1746065229 00002000:00010000:3.0:1746065229.455495:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x94:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746065229.455520:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881264102016:12345-0@lo:2:osp-syn-0-0.0 Request processed in 131us (491us total) trans 21474841842 rc 0/0 00000100:00100000:3.0:1746065229.455526:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18285 00000100:00100000:3.0:1746065229.455537:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18286 00000100:00100000:3.0:1746065229.455541:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881264102528:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065229.455576:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065229.455578:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065229.455580:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1746065229.455581:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:3.0:1746065229.455583:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x93:0x0] updating lvb blocks from disk: 3216 -> 3216 00000100:00100000:3.0:1746065229.455597:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881264102528:12345-0@lo:2:osp-syn-0-0.0 Request processed in 57us (529us total) trans 21474841843 rc 0/0 00000100:00100000:3.0:1746065229.455602:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18286 00000100:00100000:3.0:1746065229.455611:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18287 00000100:00100000:3.0:1746065229.455614:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881264103040:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.455665:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091aa7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881264103040:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (572us total) trans 21474841844 rc 0/0 00000100:00100000:3.0:1746065229.455670:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18287 00000100:00100000:3.0:1746065229.455678:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18288 00000100:00100000:3.0:1746065229.455682:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881264102144:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065229.455717:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:3.0:1746065229.455719:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065229.455721:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb atime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065229.455722:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb ctime from disk: 1746065229 -> 1746065229 00002000:00010000:3.0:1746065229.455724:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x95:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:3.0:1746065229.455740:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880097fa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881264102144:12345-0@lo:2:osp-syn-0-0.0 Request processed in 58us (616us total) trans 21474841845 rc 0/0 00000100:00100000:3.0:1746065229.455744:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18288 00000100:00100000:3.0:1746065229.455753:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18289 00000100:00100000:3.0:1746065229.455756:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3759:x1830881264102656:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.455823:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3759:x1830881264102656:12345-0@lo:2:osp-syn-0-0.0 Request processed in 65us (674us total) trans 21474841846 rc 0/0 00000100:00100000:3.0:1746065229.455827:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18289 00000100:00100000:3.0:1746065229.455835:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18290 00000100:00100000:3.0:1746065229.455838:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+14:3762:x1830881264102400:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1746065229.455884:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb size from disk: 1048576 -> 1048576 00002000:00010000:3.0:1746065229.455886:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065229.455888:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb atime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065229.455889:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb ctime from disk: 1746065229 -> 1746065229 00002000:00010000:3.0:1746065229.455890:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x75:0x0] updating lvb blocks from disk: 2048 -> 2048 00000100:00100000:3.0:1746065229.455911:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+15:3762:x1830881264102400:12345-0@lo:2:osp-syn-1-0.0 Request processed in 72us (729us total) trans 17179874469 rc 0/0 00000100:00100000:3.0:1746065229.455915:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18290 00000100:00100000:3.0:1746065229.455923:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18291 00000100:00100000:3.0:1746065229.455927:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881264102912:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.455977:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881264102912:12345-0@lo:2:osp-syn-0-0.0 Request processed in 50us (770us total) trans 21474841847 rc 0/0 00000100:00100000:3.0:1746065229.455982:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18291 00000100:00100000:3.0:1746065229.455989:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18292 00000100:00100000:3.0:1746065229.455992:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881264102272:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1746065229.456025:0:3068:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:3.0:1746065229.456027:0:3068:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065229.456029:0:3068:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb atime from disk: 1746065226 -> 1746065226 00002000:00010000:3.0:1746065229.456030:0:3068:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb ctime from disk: 1746065229 -> 1746065229 00002000:00010000:3.0:1746065229.456032:0:3068:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x280000401:0x96:0x0] updating lvb blocks from disk: 4104 -> 4104 00000100:00100000:3.0:1746065229.456047:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881264102272:12345-0@lo:2:osp-syn-0-0.0 Request processed in 54us (812us total) trans 21474841848 rc 0/0 00000100:00100000:3.0:1746065229.456052:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18292 00000100:00100000:3.0:1746065229.456059:0:3068:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18293 00000100:00100000:3.0:1746065229.456062:0:3068:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+20:3762:x1830881264102784:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1746065229.456108:0:3068:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+21:3762:x1830881264102784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 45us (836us total) trans 21474841849 rc 0/0 00000100:00100000:3.0:1746065229.456113:0:3068:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18293 00000004:00080000:3.0:1746065229.456140:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f2300/2, rc 0, transno 21474841848 00000100:00100000:3.0:1746065229.456144:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264102272:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.456149:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f2a00/2, rc 0, transno 21474841849 00000100:00100000:3.0:1746065229.456151:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264102784:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.456158:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd8380/2, rc 0, transno 17179874469 00000100:00100000:3.0:1746065229.456160:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264102400:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1746065229.456166:0:3762:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1c00/2, rc 0, transno 21474841847 00000100:00100000:3.0:1746065229.456168:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264102912:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.456178:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f3b80/2, rc 0, transno 21474841845 00000100:00100000:3.0:1746065229.456180:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264102144:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.456184:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1500/2, rc 0, transno 21474841846 00000100:00100000:3.0:1746065229.456186:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264102656:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.456191:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f1f80/2, rc 0, transno 21474841842 00000100:00100000:3.0:1746065229.456193:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264102016:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.456197:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f2680/2, rc 0, transno 21474841843 00000100:00100000:3.0:1746065229.456198:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264102528:0@lo:2:osp-syn-0-0.0 00000004:00080000:3.0:1746065229.456202:0:3759:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88009c5f0a80/2, rc 0, transno 21474841844 00000100:00100000:3.0:1746065229.456204:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88009c5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3759:1830881264103040:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1746065229.456376:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264103296:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.456396:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.456406:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264103808:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.456417:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.456424:0:3761:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1746065229.456427:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264103424:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.456437:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.456443:0:3761:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264103936:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.456452:0:3761:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.456465:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264103296 00000100:00100000:0.0:1746065229.456467:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264103296 00000100:00100000:0.0:1746065229.456479:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264103808 00000100:00100000:0.0:1746065229.456480:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264103808 00000100:00100000:0.0:1746065229.456486:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264103424 00000100:00100000:0.0:1746065229.456487:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264103424 00000100:00100000:0.0:1746065229.456492:0:13375:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264103936 00000100:00100000:0.0:1746065229.456493:0:13375:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264103936 00000100:00100000:0.0:1746065229.456498:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18294 00000100:00100000:0.0:1746065229.456501:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881264103296:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065229.456540:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb size from disk: 5034592 -> 5034592 00002000:00010000:0.0:1746065229.456543:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:0.0:1746065229.456544:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb atime from disk: 1746065226 -> 1746065226 00002000:00010000:0.0:1746065229.456546:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb ctime from disk: 1746065229 -> 1746065229 00002000:00010000:0.0:1746065229.456548:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x78:0x0] updating lvb blocks from disk: 5752 -> 5752 00000100:00100000:0.0:1746065229.456566:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881264103296:12345-0@lo:2:osp-syn-1-0.0 Request processed in 64us (170us total) trans 17179874470 rc 0/0 00000100:00100000:0.0:1746065229.456571:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18294 00000100:00100000:0.0:1746065229.456581:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18295 00000100:00100000:0.0:1746065229.456585:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881264103808:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1746065229.456618:0:13375:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb size from disk: 4194304 -> 4194304 00002000:00010000:0.0:1746065229.456621:0:13375:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb mtime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065229.456622:0:13375:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1746065229.456624:0:13375:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb ctime from disk: 1746065179 -> 1746065179 00002000:00010000:0.0:1746065229.456625:0:13375:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x76:0x0] updating lvb blocks from disk: 7320 -> 7320 00000100:00100000:0.0:1746065229.456641:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881264103808:12345-0@lo:2:osp-syn-1-0.0 Request processed in 56us (223us total) trans 17179874471 rc 0/0 00000100:00100000:0.0:1746065229.456646:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18295 00000100:00100000:0.0:1746065229.456654:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18296 00000100:00100000:0.0:1746065229.456657:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881264103424:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.456701:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881264103424:12345-0@lo:2:osp-syn-1-0.0 Request processed in 43us (263us total) trans 17179874472 rc 0/0 00000100:00100000:0.0:1746065229.456705:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18296 00000100:00100000:0.0:1746065229.456714:0:13375:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18297 00000100:00100000:0.0:1746065229.456718:0:13375:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+18:3761:x1830881264103936:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.456763:0:13375:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+19:3761:x1830881264103936:12345-0@lo:2:osp-syn-1-0.0 Request processed in 44us (310us total) trans 17179874473 rc 0/0 00000100:00100000:0.0:1746065229.456768:0:13375:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18297 00000004:00080000:0.0:1746065229.456808:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098ddbb80/2, rc 0, transno 17179874472 00000100:00100000:0.0:1746065229.456812:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264103424:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065229.456818:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3c2680/2, rc 0, transno 17179874473 00000100:00100000:0.0:1746065229.456820:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264103936:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065229.456825:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098ddad80/2, rc 0, transno 17179874470 00000100:00100000:0.0:1746065229.456828:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264103296:0@lo:2:osp-syn-1-0.0 00000004:00080000:0.0:1746065229.456833:0:3761:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd8000/2, rc 0, transno 17179874471 00000100:00100000:0.0:1746065229.456835:0:3761:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3761:1830881264103808:0@lo:2:osp-syn-1-0.0 00000004:00010000:0.0:1746065229.456880:0:7207:0:(mdt_handler.c:4446:mdt_save_lock()) ### save lock request ffff880098dda300 reply state ffff88012eb0a400 transno 8589937275 ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 3/0,1 mode: EX/EX res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065229.456893:0:7207:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065229.456899:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065229.456901:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00000100:00100000:0.0:1746065229.456904:0:7207:0:(service.c:173:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1746065229.456908:0:7207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065229.456910:0:7207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1746065229.456915:0:7207:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008ec5a400/0xad6b7ddc147b2b7 lrc: 0/0,0 mode: --/PW res: [0x200000404:0x31:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a6b6 expref: 27 pid: 7204 timeout: 0 lvb_type: 0 00010000:00080000:0.0:1746065229.456974:0:7207:0:(ldlm_lib.c:3369:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1746065229.456982:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880098dda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2799:x1830881265658624:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 9048us (9242us total) trans 8589937275 rc 0/0 00000100:00100000:0.0:1746065229.456989:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5563 00010000:00010000:0.0:1746065229.457008:0:3745:0:(ldlm_lock.c:824:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065229.457014:0:3745:0:(ldlm_lock.c:882:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065229.457018:0:3745:0:(ldlm_lockd.c:1900:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065229.457022:0:3745:0:(ldlm_lockd.c:1914:ldlm_handle_bl_callback()) Lock ffff880095f01c00 already unused, calling callback (ffffffffa0f21690) 00010000:00010000:0.0:1746065229.457025:0:3745:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065229.457030:0:3745:0:(ldlm_request.c:1309:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065229.457038:0:3745:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:0.0:1746065229.457039:0:3745:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1746065229.457041:0:3745:0:(ldlm_lockd.c:1926:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 2/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT0 00010000:00010000:0.0:1746065229.457045:0:3745:0:(ldlm_lock.c:195:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880095f01c00/0xad6b7ddc147b3ac lrc: 0/0,0 mode: --/TXN res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7207 initiator: MDT0 00000100:00100000:2.0:1746065229.457640:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264103168:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.457667:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065229.457682:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264103680:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.457694:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065229.457706:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1746065229.457711:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880098ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264103552:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.457725:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065229.457735:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264104064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.457746:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1746065229.457762:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264103168 00000100:00100000:2.0:1746065229.457765:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264103168 00000100:00100000:2.0:1746065229.457803:0:11461:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264103680 00000100:00100000:2.0:1746065229.457806:0:11461:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264103680 00000100:00100000:2.0:1746065229.457819:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264103552 00000100:00100000:2.0:1746065229.457820:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264103552 00000100:00100000:2.0:1746065229.457829:0:12260:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264104064 00000100:00100000:2.0:1746065229.457830:0:12260:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264104064 00000100:00100000:2.0:1746065229.457839:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18298 00000100:00100000:2.0:1746065229.457844:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881264103168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1746065229.457900:0:12260:0:(ofd_lvb.c:304:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb size from disk: 2097152 -> 2097152 00002000:00010000:2.0:1746065229.457903:0:12260:0:(ofd_lvb.c:311:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb mtime from disk: 1746065226 -> 1746065226 00002000:00010000:2.0:1746065229.457904:0:12260:0:(ofd_lvb.c:317:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb atime from disk: 1746065226 -> 1746065226 00002000:00010000:2.0:1746065229.457906:0:12260:0:(ofd_lvb.c:323:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb ctime from disk: 1746065229 -> 1746065229 00002000:00010000:2.0:1746065229.457907:0:12260:0:(ofd_lvb.c:329:ofd_lvbo_update()) res: [0x2c0000401:0x77:0x0] updating lvb blocks from disk: 2056 -> 2056 00000100:00100000:2.0:1746065229.457930:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3760:x1830881264103168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 86us (262us total) trans 17179874474 rc 0/0 00000100:00100000:2.0:1746065229.457935:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18298 00000100:00100000:2.0:1746065229.457945:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18299 00000100:00100000:2.0:1746065229.457949:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881264103680:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.457996:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3760:x1830881264103680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (300us total) trans 17179874475 rc 0/0 00000100:00100000:2.0:1746065229.458001:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18299 00000100:00100000:2.0:1746065229.458009:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18300 00000100:00100000:2.0:1746065229.458013:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881264103552:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.458060:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880092b30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3760:x1830881264103552:12345-0@lo:2:osp-syn-1-0.0 Request processed in 46us (333us total) trans 17179874476 rc 0/0 00000100:00100000:2.0:1746065229.458065:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18300 00000100:00100000:2.0:1746065229.458150:0:12260:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18301 00000100:00100000:2.0:1746065229.458155:0:12260:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+22:3760:x1830881264104064:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1746065229.458202:0:12260:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+23:3760:x1830881264104064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 47us (455us total) trans 17179874477 rc 0/0 00000100:00100000:2.0:1746065229.458206:0:12260:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18301 00000004:00080000:2.0:1746065229.458227:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098ddb100/2, rc 0, transno 17179874476 00000100:00100000:2.0:1746065229.458231:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098ddb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264103552:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065229.458236:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff88012f3c0a80/2, rc 0, transno 17179874477 00000100:00100000:2.0:1746065229.458250:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264104064:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065229.458257:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd9f80/2, rc 0, transno 17179874474 00000100:00100000:2.0:1746065229.458259:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264103168:0@lo:2:osp-syn-1-0.0 00000004:00080000:2.0:1746065229.458264:0:3760:0:(osp_sync.c:560:osp_sync_interpret()) reply req ffff880098dd9880/2, rc 0, transno 17179874475 00000100:00100000:2.0:1746065229.458266:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880098dd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264103680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1746065229.461280:0:3754:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:2.0:1746065229.461343:0:7231:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265658880 00000100:00100000:2.0:1746065229.461349:0:7231:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265658880 00000100:00100000:2.0:1746065229.461386:0:7231:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 14747 00000100:00100000:2.0:1746065229.461392:0:7231:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+26:2799:x1830881265658880:12345-192.168.202.27@tcp:101:lfs.0 00010000:00010000:2.0:1746065229.461409:0:7231:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1746065229.461423:0:7231:0:(ldlm_lockd.c:1337:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147b3b3 lrc: 2/0,0 mode: --/CR res: [0x200000404:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb2dae6dedd93a72d expref: -99 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.461469:0:7231:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147b3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a72d expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.461485:0:7231:0:(ldlm_lockd.c:1507:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88009c71b800/0xad6b7ddc147b3b3 lrc: 3/0,0 mode: CR/CR res: [0x200000404:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.27@tcp remote: 0xb2dae6dedd93a72d expref: 27 pid: 7231 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1746065229.461499:0:7231:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000404:0x31:0x0].0x0 (ffff880097e34700) 00010000:00010000:2.0:1746065229.461501:0:7231:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1746065229.461503:0:7231:0:(ldlm_lockd.c:1585:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff88009c71b800, rc 0) 00000100:00100000:2.0:1746065229.461539:0:7231:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88012f3c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:251e5313-64c6-436c-a0af-246328b144ca+27:2799:x1830881265658880:12345-192.168.202.27@tcp:101:lfs.0 Request processed in 147us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1746065229.461544:0:7231:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 14747 00000100:00100000:2.0:1746065229.464184:0:3753:0:(events.c:341:request_in_callback()) peer: 12345-192.168.202.27@tcp (source: 12345-192.168.202.27@tcp) 00000100:00100000:0.0:1746065229.464444:0:7207:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881265659136 00000100:00100000:0.0:1746065229.464451:0:7207:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881265659136 00000100:00100000:0.0:1746065229.464484:0:7207:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.27@tcp, seq: 5564 00000100:00100000:0.0:1746065229.464490:0:7207:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+27:2799:x1830881265659136:12345-192.168.202.27@tcp:35:lfs.0 00000100:00100000:0.0:1746065229.464655:0:7207:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:251e5313-64c6-436c-a0af-246328b144ca+28:2799:x1830881265659136:12345-192.168.202.27@tcp:35:lfs.0 Request processed in 164us (476us total) trans 8589937276 rc 0/0 00000100:00100000:0.0:1746065229.464661:0:7207:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.27@tcp, seq: 5564 00000100:00100000:2.0:1746065229.821071:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264104192:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1746065229.821121:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.822658:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264104192 00000100:00100000:0.0:1746065229.822666:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264104192 00000100:00100000:0.0:1746065229.822697:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1746065229.822703:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3760:x1830881264104192:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1746065229.822731:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1445683200 avail 1316220928 00000100:00100000:0.0:1746065229.822803:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3760:x1830881264104192:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.822809:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1746065229.837895:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88011dad6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264104192:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1746065229.849151:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881264104704:0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.849201:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.849246:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3760:1830881264105216:0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.849264:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.849281:0:3760:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1746065229.849285:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3760:1830881264104576:0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.849298:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.849307:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3760:1830881264105088:0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.849320:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.849341:0:7204:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264105216 00000100:00100000:0.0:1746065229.849346:0:7204:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264105216 00000100:00100000:0.0:1746065229.849390:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264104576 00000100:00100000:0.0:1746065229.849391:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264104576 00000100:00100000:0.0:1746065229.849402:0:7203:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264105088 00000100:00100000:0.0:1746065229.849404:0:7203:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264105088 00000100:00100000:0.0:1746065229.849415:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1746065229.849420:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3760:x1830881264105216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.849452:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3760:x1830881264105216:12345-0@lo:400:kworker.0 Request processed in 32us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.849457:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:0.0:1746065229.849468:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1746065229.849472:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3760:x1830881264104576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.849485:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3760:x1830881264104576:12345-0@lo:400:kworker.0 Request processed in 14us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.849489:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:0.0:1746065229.849495:0:7203:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1746065229.849499:0:7203:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3760:x1830881264105088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.849514:0:7203:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3760:x1830881264105088:12345-0@lo:400:kworker.0 Request processed in 15us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.849518:0:7203:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00100000:0.0:1746065229.849538:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3760:1830881264104576:0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.849545:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3760:1830881264105088:0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.849552:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3760:1830881264105216:0@lo:400:kworker.0 00000100:00080000:0.0:1746065229.849574:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1746065229.849576:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1746065229.849589:0:9550:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264104704 00000100:00100000:0.0:1746065229.849591:0:9550:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264104704 00000100:00100000:0.0:1746065229.849610:0:9550:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1746065229.849614:0:9550:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881264104704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.849633:0:9550:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880091a92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3760:x1830881264104704:12345-0@lo:400:kworker.0 Request processed in 19us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.849637:0:9550:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00080000:0.0:1746065229.849649:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1746065229.849658:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3760:1830881264104704:0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.849731:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264104448:0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.849754:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.849766:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3762:1830881264104960:0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.849792:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.849800:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881264105472:0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.849812:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.849822:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1746065229.849826:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ceddf226-8ddf-479f-9953-8a74c62285a9:3762:1830881264104320:0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.849840:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.849857:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88012f3c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264104832:0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.849870:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.849878:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880091a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3762:1830881264105344:0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.849889:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.849903:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264104960 00000100:00100000:3.0:1746065229.849905:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264104960 00000100:00100000:3.0:1746065229.849920:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264105472 00000100:00100000:3.0:1746065229.849922:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264105472 00000100:00100000:3.0:1746065229.849929:0:9571:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264105344 00000100:00100000:3.0:1746065229.849930:0:9571:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264105344 00000100:00100000:3.0:1746065229.849939:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1746065229.849943:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3762:x1830881264104960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.849963:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3762:x1830881264104960:12345-0@lo:400:kworker.0 Request processed in 20us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.849967:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:3.0:1746065229.849975:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1746065229.849978:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881264105472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.849991:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3762:x1830881264105472:12345-0@lo:400:kworker.0 Request processed in 13us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.849996:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1746065229.850001:0:9571:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:3.0:1746065229.850004:0:9571:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3762:x1830881264105344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.850017:0:9571:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3762:x1830881264105344:12345-0@lo:400:kworker.0 Request processed in 13us (128us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.850021:0:9571:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00080000:3.0:1746065229.850029:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1746065229.850031:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1746065229.850041:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3762:1830881264105344:0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.850047:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3762:1830881264104960:0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.850053:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880091a93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3762:1830881264105472:0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.850071:0:8144:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264104320 00000100:00100000:3.0:1746065229.850073:0:8144:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264104320 00000100:00100000:3.0:1746065229.850090:0:8144:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1746065229.850094:0:8144:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3762:x1830881264104320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.850117:0:8144:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ceddf226-8ddf-479f-9953-8a74c62285a9+23:3762:x1830881264104320:12345-0@lo:400:kworker.0 Request processed in 22us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.850121:0:8144:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1746065229.850142:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ceddf226-8ddf-479f-9953-8a74c62285a9:3762:1830881264104320:0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.850157:0:8357:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264104448 00000100:00100000:3.0:1746065229.850159:0:8357:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264104448 00000100:00100000:3.0:1746065229.850172:0:8357:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1746065229.850176:0:8357:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881264104448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1746065229.850195:0:8357:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+7:3762:x1830881264104448:12345-0@lo:400:kworker.0 Request processed in 19us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.850199:0:8357:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1746065229.850213:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264104448:0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.850351:0:10219:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264104832 00000100:00100000:0.0:1746065229.850354:0:10219:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264104832 00000100:00100000:0.0:1746065229.850381:0:10219:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1746065229.850385:0:10219:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881264104832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1746065229.850416:0:10219:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff880099cf2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3762:x1830881264104832:12345-0@lo:400:kworker.0 Request processed in 31us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.850421:0:10219:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:2.0:1746065229.850470:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88012f3c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3762:1830881264104832:0@lo:400:kworker.0 00000100:00080000:3.0:1746065229.850505:0:7201:0:(pinger.c:498:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1746065229.888641:0:3759:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881264105600:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1746065229.888696:0:3759:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.891423:0:7209:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264105600 00000100:00100000:3.0:1746065229.891435:0:7209:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264105600 00000100:00100000:3.0:1746065229.891475:0:7209:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1746065229.891481:0:7209:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881264105600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1746065229.891509:0:7209:0:(mdt_handler.c:538:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 1445543936 avail 1316081664 00000100:00100000:3.0:1746065229.891572:0:7209:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+7:3759:x1830881264105600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (2875us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.891580:0:7209:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:3.0:1746065229.891631:0:3759:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3759:1830881264105600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1746065229.916967:0:3760:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff88013615c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264105728:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1746065229.917020:0:3760:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1746065229.917150:0:12120:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264105728 00000100:00100000:3.0:1746065229.917157:0:12120:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264105728 00000100:00100000:3.0:1746065229.917192:0:12120:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:3.0:1746065229.917198:0:12120:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881264105728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1746065229.917217:0:12120:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 491419072 pending 1286144 free 3910598656 avail 3679076352 00000100:00100000:3.0:1746065229.917260:0:12120:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88009577ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+21:3760:x1830881264105728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1746065229.917267:0:12120:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:1.0:1746065229.917452:0:3760:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff88013615c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3760:1830881264105728:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1746065229.948887:0:3762:0:(ptlrpcd.c:342:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1746065229.948904:0:3762:0:(client.c:1778:ptlrpc_send_new_req()) Sending RPC req@ffff880097fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264105856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1746065229.948954:0:3762:0:(events.c:341:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1746065229.949310:0:9552:0:(service.c:2226:ptlrpc_server_handle_req_in()) unwrap req x1830881264105856 00000100:00100000:0.0:1746065229.949317:0:9552:0:(service.c:2291:ptlrpc_server_handle_req_in()) got req x1830881264105856 00000100:00100000:0.0:1746065229.949346:0:9552:0:(nrs_fifo.c:155:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:0.0:1746065229.949351:0:9552:0:(service.c:2470:ptlrpc_server_handle_request()) Handling RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3762:x1830881264105856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1746065229.949367:0:9552:0:(ofd_obd.c:714:ofd_statfs()) blocks cached 0 granted 490453312 pending 319488 free 3906572288 avail 3675049984 00000100:00100000:0.0:1746065229.949397:0:9552:0:(service.c:2522:ptlrpc_server_handle_request()) Handled RPC req@ffff88011dad4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+23:3762:x1830881264105856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 46us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1746065229.949402:0:9552:0:(nrs_fifo.c:217:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1746065229.949477:0:3762:0:(client.c:2263:ptlrpc_check_set()) Completed RPC req@ffff880097fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3762:1830881264105856:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1746065230.142926:0:7194:0:(ldlm_lockd.c:2815:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1746065230.279437:0:13830:0:(debug.c:792:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-flr test_200b: @@@@@@ FAIL: final resync failed Debug log: 69930 lines, 69930 kept, 0 dropped, 0 bad.